JP2010130553A - In-vehicle device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To perform associative control normally over a mobile terminal device and an in-vehicle device whatever information is transmitted from the mobile terminal device. <P>SOLUTION: The in-vehicle device 10 of an in-vehicle system 1 acquires the display area information of a display operation unit 44 of a mobile terminal 40 when radio communication with the mobile terminal 40 is established. When data from the mobile terminal 40 is received, after the radio communication with the mobile terminal 40 is established, the in-vehicle device 10 converts the received data to a format that the display operation unit 12 can display, based on the display area information of the display operation unit 44, and displays the data. Furthermore, the in-vehicle device 10, when transmitting information displayed by the display operation unit 12 to the mobile terminal 40, after the radio communication with the mobile terminal 40 is established, converts the data to a format that the mobile terminal 40 can display, based on the acquired display area information of the display operation unit 44 of the mobile terminal 40 and transmits the data. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to an in-vehicle device that includes a display unit and performs wireless communication with a mobile terminal device.

  With the spread of car navigation systems using GPS (Global Positioning System), in-vehicle devices having a navigation function are often mounted on vehicles. In addition, in order to respond to user needs for multifunctional in-vehicle devices, multifunctional in-vehicle devices have become prominent.

  For example, in-vehicle devices often include many functions such as a television reception function, a CD (Compact Disc) playback function, and a DVD (Digital Versatile Disk) playback function in addition to the navigation function. However, the increase in the number of functions of the in-vehicle device causes an increase in the price of the in-vehicle device, which is not preferable for the user.

  On the other hand, portable terminal devices such as mobile phones have been popularized at low prices but with navigation functions and music playback functions. In addition, since mobile terminal devices equipped with a short-range wireless communication function such as Bluetooth (registered trademark) have also become widespread, the mobile terminal device and the vehicle-mounted device are linked with such a short-range wireless communication function, and the mobile terminal device side Efforts are also being made to use functions on the in-vehicle device side. This makes it possible to reduce the price of the in-vehicle device.

  For example, Patent Literature 1 discloses a technique for transmitting a display screen displayed on a screen of a mobile terminal device to an in-vehicle device and displaying a display screen generated by the mobile terminal device on a display of the in-vehicle device. Yes.

JP 2003-244343 A

  However, the above-described conventional technology may not be able to execute various controls by correctly displaying information transmitted from the mobile terminal device on the in-vehicle device side, and performs processing in conjunction with the mobile terminal device and the in-vehicle device. There was a problem that it was not possible.

  Specifically, the information that the mobile terminal device sends to the in-vehicle device is information that uses different applications such as car navigation information, downloaded music, movies, etc. Also, depending on the model and manufacturer of the mobile terminal device, etc. Is different. On the in-vehicle device side, the display resolution and the type of application to be executed differ depending on the model and manufacturer. For these reasons, the in-vehicle device cannot correctly execute the application transmitted by the mobile terminal device, and an event occurs in which the mobile terminal device and the in-vehicle device cannot cooperate.

  Therefore, the present invention has been made to solve the above-described problems of the prior art, and the mobile terminal device and the in-vehicle device normally control the cooperation regardless of what information is transmitted from the mobile terminal device. It is an object of the present invention to provide an in-vehicle device that can be used.

  In order to solve the above-described problems and achieve the object, the present invention is an in-vehicle device that includes a display unit and performs wireless communication with a mobile terminal device, and displays display area information on the display unit of the mobile terminal device. When receiving area information acquisition means acquired from the mobile terminal apparatus and data from the mobile terminal apparatus, the display unit receives the received data based on the display area information acquired by the area information acquisition means. Display control means for converting to a displayable format for display, and when transmitting the information displayed on the display unit to the portable terminal device, based on the display area information acquired by the area information acquisition means Transmission control means for converting the data into a format that can be displayed on the mobile terminal device and transmitting the data.

  According to the present invention, the mobile terminal device and the in-vehicle device can normally perform cooperative control regardless of what information is transmitted from the mobile terminal device.

  Embodiments of an in-vehicle device according to the present invention will be described below in detail with reference to the accompanying drawings. In the following, the outline of the in-vehicle system including the in-vehicle apparatus according to the present embodiment, the configuration of the in-vehicle system, and the flow of processing will be described in order, and finally various modifications to the present embodiment will be described.

  First, main terms used in this embodiment will be described. The “in-vehicle system” used in this embodiment is a short-range wireless communication between an in-vehicle device called “Display Audio” (hereinafter referred to as DA) mounted on a car and a mobile terminal that receives applications and data from a server device. A system that links functions.

  Here, DA refers to an in-vehicle device that is mounted with only basic functions such as a display function, an audio playback function, and a communication function with a mobile terminal device, and becomes multi-functional by cooperating with the mobile terminal device. Therefore, the in-vehicle device used in the present embodiment is a device that is inexpensive compared to a highly accurate in-vehicle device mounted on a vehicle in recent years, and can be expected to spread.

  The mobile terminal has a short-range wireless communication function such as Bluetooth (registered trademark) and infrared communication, and various functions such as a mail function, an Internet connection function (Web connection function), a music player function, and a moving image playback function. For example, a personal computer, a PDA, or a mobile communication terminal such as a mobile phone or PHS.

[Outline of in-vehicle system]
Next, the outline of the in-vehicle system according to the first embodiment will be described with reference to FIG. FIG. 1 is a diagram for explaining the outline of the in-vehicle system according to the first embodiment.

  As shown in FIG. 1, the in-vehicle system includes an in-vehicle device called DA mounted in an automobile and a mobile terminal that receives applications and data from a server device, and what information is received from the mobile terminal. Even if it is transmitted, the portable terminal and the in-vehicle device can normally perform cooperative control. Here, the term “cooperation” means that information updated on the mobile terminal is reflected on the in-vehicle device, and information updated on the in-vehicle device is reflected on the mobile terminal, and is executed on the mobile terminal. When an in-vehicle device that displays an application image or the like receives an operation by a user, the operation content is executed on the mobile terminal side, and the in-vehicle device outputs an operation result.

  Specifically, the in-vehicle device of this in-vehicle system acquires display area information of the display unit (display or touch panel) of the mobile terminal from the mobile terminal when wireless communication is established with the mobile terminal (see FIG. 1 (1) and (2)). For example, when a pairing process is performed between the in-vehicle device and the mobile terminal and wireless communication is established, the in-vehicle device displays the display area information (screen size = width (W pixels) × high in the display unit of the mobile terminal. (H pixel), resolution, etc.) are acquired from the portable terminal.

  Subsequently, when the in-vehicle device receives data from the mobile terminal after wireless communication is established with the mobile terminal, the in-vehicle device displays the received data based on the previously acquired display area information. Are converted into a displayable format (see (3) and (4) in FIG. 1).

  For example, in the case where the in-vehicle device receives data from the mobile terminal after wireless communication is established with the mobile terminal, the display (touch panel) width (W pixel) × height (H pixel) of the display unit ) To convert the area size to match. That is, since the area size of the acquired data is “x × y” and the area size of the display of the own device is “a × b”, the size of the acquired data is converted into a ratio of “a: b”. And display.

  After that, when the in-vehicle device transmits information displayed on the display unit such as a display or a touch panel to the mobile terminal, the data is converted into a format that can be displayed on the mobile terminal based on the acquired display area information. It converts and transmits (refer (5) and (6) of Drawing 1).

  For example, when the coordinates (a2, b2) displayed on the display unit are selected by the user, the in-vehicle device uses the horizontal axis (a: a2 = p) based on the region size (a × b) of the display unit. And the vertical axis (b: b2 = q) are calculated, and the position where the selected coordinates are present is calculated. Then, the in-vehicle device uses the previously received area size (x × y) of the mobile terminal and the calculated ratio (p) of the horizontal axis and the ratio (q) of the vertical axis (x: x2 = “x2, y2” where p) and the vertical axis (y: y2 = q) hold is calculated, and this is transmitted to the portable terminal as operated coordinates.

  Thus, the in-vehicle device in the in-vehicle system according to the first embodiment can obtain the screen size of the mobile terminal immediately after wireless connection and calculate the difference from the screen size of the own device, Regardless of what information is transmitted from the mobile terminal, the information displayed on the mobile terminal can be displayed in the same manner on the in-vehicle device, and the information displayed on the in-vehicle device can be displayed in the same manner on the mobile terminal. Therefore, the portable terminal and the in-vehicle device can be normally linked and controlled.

[Configuration of in-vehicle system]
Next, the configuration of the in-vehicle system shown in FIG. 1 will be described with reference to FIG. FIG. 2 is a block diagram illustrating the configuration of the in-vehicle system according to the first embodiment. As shown in FIG. 2, the in-vehicle system 1 includes an in-vehicle device 10 and a mobile terminal 40, and therefore each device will be described here.

(Configuration of in-vehicle device 10)
First, the configuration of the in-vehicle device 10 in the in-vehicle system according to the first embodiment will be described. As shown in FIG. 2, the in-vehicle device 10 includes a short-range communication unit 11, a display operation unit 12, a storage unit 13, and a control unit 15, and is connected to the vehicle control system unit 20 and the speaker 30. .

  The vehicle control system unit 20 is connected to the in-vehicle device 10 and includes various sensors that detect the state of the vehicle, such as a vehicle speed sensor, an acceleration sensor, a steering sensor, a brake sensor, and a winker sensor. Vehicle speed), vehicle acceleration, vehicle tire position, turn signal operation, and brake state are detected. The speaker 30 outputs the audio signal input from the in-vehicle device 10 into the vehicle, and is installed on the side of the driver's seat, the front of the passenger seat, the left side of the rear seat, the right side of the rear seat, and the like.

  Returning to the configuration of the in-vehicle device 10, the short-range communication unit 11 establishes a communication link with the mobile terminal 40 using short-range wireless communication such as Bluetooth (registered trademark) and uses the established communication link to install the in-vehicle device. 10 / Communication processing between the portable terminals 40 is performed. Here, Bluetooth (registered trademark) is a short-range wireless communication standard for performing wireless communication with a radius of about 10 m using a 2.4 GHz frequency band. In recent years, electronic devices such as mobile phones and personal computers are used. Widely applied to equipment.

  In this embodiment, a case where communication between the in-vehicle device 10 and the portable terminal 40 is performed using Bluetooth (registered trademark) will be described. Wi-Fi (Wi-Fi: registered trademark), ZigBee (ZigBee: registered trademark) Other wireless communication standards such as the above may be used. Moreover, it is good also as performing communication between the vehicle equipment 10 / the portable terminal 40 by wired communication.

  The display operation unit 12 is connected to the control unit 15 and displays and outputs an image output from the control unit 15. Specifically, the display operation unit 12 includes an input / output device such as a touch panel display, and displays a display screen that is received from the mobile terminal 40 and converted into a format that can be output by the control unit 15. Get touch information for the screen. Here, the touch information is information including coordinates on the touched display, a time interval from the touch to the next touch, and the like. The display operation unit 12 notifies the control unit 15 of the acquired touch information.

  The storage unit 13 stores data and programs necessary for various processes by the control unit 15, and stores region information of the mobile terminal 40 acquired from the mobile terminal 40. To give a specific example, the storage unit 13 stores region information (screen size = width (W pixels) × height (H pixels), resolution, etc.) of the mobile terminal stored by the region information acquisition unit 15b described later. Remember.

  The control unit 15 includes an internal memory for storing a control program such as an OS (Operating System), a program that defines various processing procedures, and necessary data, and a wireless establishment unit 15a, an area information acquisition unit 15b, The area information transmission unit 15c, the display control unit 15d, and the transmission control unit 15e have various processes.

  The wireless establishment unit 15a establishes wireless communication with respect to the mobile terminal located at a predetermined distance where wireless communication with the in-vehicle device 10 is possible. Specifically, when the power of the device is turned on, the wireless establishing unit 15a activates the short-range communication unit 11 and searches for a terminal in an area where wireless communication is possible. Then, when the mobile terminal 40 enters an area where wireless communication is possible, the wireless establishment unit 15a detects the mobile terminal 40 that has entered, and performs pairing processing using the short-range communication unit 11 for the detected mobile terminal 40 To establish wireless communication with the mobile terminal 40.

  The wireless establishment unit 15a can also establish wireless communication with the mobile terminal in accordance with a user operation. For example, a cooperation start button with the portable terminal is displayed on the display operation unit 12 to be described later, and when this button is pressed by the user, the wireless establishment unit 15a activates the short-range communication unit 11 to perform wireless communication. Search for a terminal in a possible area. And if the wireless establishment part 15a detects the portable terminal 40, it will perform the pairing process using the near field communication part 11 with respect to the detected portable terminal 40, and establish wireless communication between the portable terminals 40 To do.

  The area information acquisition unit 15 b acquires display area information of the display unit of the mobile terminal 40 from the mobile terminal 40 when wireless communication is established with the mobile terminal 40. Specifically, the area information acquisition unit 15b performs display area information (screen) on the display unit of the portable terminal 40 when the pairing process is performed between the in-vehicle device 10 and the portable terminal 40 to establish wireless communication. Size (x × y) = width (W pixels) × height (H pixels), resolution, etc.) are acquired from the portable terminal 40. Then, the area information acquisition unit 15 b stores the acquired display area information of the mobile terminal 40 in the storage unit 13.

  The area information transmission unit 15 c transmits the display area information of the in-vehicle device 10 to the portable terminal 40 when wireless communication is established with the portable terminal 40. Specifically, when the pairing process is performed between the in-vehicle device 10 and the mobile terminal 40 and the wireless communication is established, the region information transmission unit 15c displays the display region information ( The screen size (a × b) = width (W pixels) × height (H pixels), resolution, displayable format list, and the like are transmitted to the mobile phone 40.

  When the wireless communication is established with the mobile terminal 40 and the data is received from the mobile terminal 40, the display control unit 15d receives the data based on the acquired display area information of the mobile terminal 40. Data is converted into a format that can be displayed by the in-vehicle device 10 and displayed. Specifically, when the area size of the acquired mobile terminal is “x × y” and the area size of the own device is “a × b”, the display control unit 15d acquires the acquired data size “x, “y” is converted into a ratio of “a: b” and displayed. At this time, the display control unit 15d may convert the data into a data format that can be displayed by the own device, or display the data in accordance with the resolution and the number of pixels of the own device.

  For example, when the area size of the acquired mobile terminal is “10 × 20” and the area size of the own device is “40 × 50”, the display control unit 15d uses the acquired “10 × 20” data as “ 4: 4 "ratio is displayed. In addition, when the resolution of the mobile terminal 40 is “800 × 600” and the area size of the own device is “1024 × 768”, the display control unit 15d receives the data with the acquired resolution “800 × 600”. , Converted to a resolution of “1024 × 768” and displayed.

  In addition, the display control unit 15d performs data conversion when the data acquired from the portable terminal 40 is data that can be displayed by the own device or data that has already been converted into a format that can be displayed by the own device. Display without doing.

  The transmission control unit 15e is acquired by the area information acquisition unit 15b when the information displayed on the display operation unit 12 is transmitted to the mobile terminal 40 after wireless communication is established with the mobile terminal 40. Based on the display area information of the mobile terminal 40, the data is converted into a format that can be displayed on the mobile terminal 40 and transmitted.

  Specifically, the transmission control unit 15e is based on the area size (a × b) of the display operation unit 12 when the coordinates (a2, b2) of the image displayed on the display operation unit 12 are selected by the user. Then, the horizontal axis (a: a2 = p) and the vertical axis (b: b2 = q) are calculated, and the position on the display operation unit 12 where the selected coordinates exist is calculated. Then, the transmission control unit 15e acquires the area size (x × y) of the mobile terminal 40 acquired by the area information acquisition unit 15b and stored in the storage unit 13, and the calculated ratio (p) of the horizontal axis and the ratio of the vertical axis. (Q) is used to calculate “x2, y2” in which the horizontal axis (x: x2 = p) and the vertical axis (y: y2 = q) hold, and these are transmitted to the portable terminal 40 as operated coordinates. To do. At this time, the transmission control unit 15e may convert the data into a data format that can be displayed on the mobile terminal 40, or display the data in accordance with the resolution and the number of pixels of the mobile terminal 40.

(Configuration of mobile terminal 40)
Next, the configuration of the mobile terminal 40 in the in-vehicle system according to the first embodiment will be described. As illustrated in FIG. 2, the mobile terminal 40 includes a communication unit 41, a short-range communication unit 42, a speaker 43, a display operation unit 44, a storage unit 45, and a control unit 46.

  The communication unit 41 is a device that communicates with a server device or a GPS (Global Positioning System) communication device provided on a network such as the Internet via a base station of a communication carrier, for example. Specifically, when a navigation application is executed on the mobile terminal 40, the communication unit 41 communicates with the GPS or the like according to an instruction from the navigation application, and acquires the current position of the mobile terminal 40, etc. To do.

  The short-range communication unit 42 establishes a communication link with the vehicle-mounted device 10 using short-range wireless communication such as Bluetooth (registered trademark), as well as the short-range communication unit 11 of the vehicle-mounted device 10, and the established communication link Is used to perform communication processing between the mobile terminal 40 and the in-vehicle device 10.

  When the speaker 43 receives an audio signal from the control unit 46, which will be described later, the speaker 43 outputs the audio signal to the outside, and outputs the audio at the time of normal telephone connection to the outside. The display operation unit 44 includes an input / output device such as a touch panel display, and displays and outputs an image output from the control unit 46 and the like which will be described later.

  The storage unit 45 stores data and programs necessary for various processes by the control unit 46, and stores, for example, an application 45a that is read and executed by an application execution control unit 49 described later. The application 45a is, for example, a navigation application, a music download application, a moving image distribution application, or the like.

  The control unit 46 includes an internal memory for storing a control program such as an OS (Operating System), a program that defines various processing procedures, and necessary data, and performs processing such as voice calls and wireless communication. It has the establishment part 47, the area | region information transmission part 48, and the application execution control part 49, and performs various processes by these.

  The wireless establishment unit 47 is a processing unit that establishes wireless communication with the in-vehicle device 10, and specifically, when a pairing process or the like is received from the in-vehicle device 10 via the short-range communication unit 42. Then, a response to the processing is transmitted to the in-vehicle device 10 to establish wireless communication.

  The area information transmission unit 48 transmits display area information to the in-vehicle device 10 when wireless communication is established with the in-vehicle device 10. Specifically, when the pairing process is performed between the in-vehicle device 10 and the mobile terminal 40 and the wireless communication is established, the region information transmission unit 48 displays the display region information ( The screen size (a × b) = width (W pixels) × height (H pixels), resolution, displayable format list, and the like are transmitted to the in-vehicle device 10.

  The application execution control unit 49 receives an instruction operation of the user of the mobile terminal 40, reads an application corresponding to the received operation from the storage unit 45, and executes it. For example, when the application execution control unit 49 receives a navigation application activation instruction from the user of the mobile terminal 40, the application execution control unit 49 reads the navigation application from the storage unit 45 and executes the navigation application.

  Further, the application execution control unit 49 transmits the image output to the display operation unit 44 and the sound output from the speaker 43 to the in-vehicle device 10 via the short-range communication unit 42. For example, when the navigation application is executed, the application execution control unit 49 transmits an image indicating the destination set and executed on the navigation application and the route to the destination to the in-vehicle device 10, and along the guidance route. The guidance voice output is transmitted to the in-vehicle device 10.

  In addition, when touch information is notified from the in-vehicle device 10, the application execution control unit 49 converts the touch information into an input operation on the display screen, operates the application based on the input operation, and updates the display screen. Perform the process. And the application execution control part 49 transmits the audio | voice signal which generate | occur | produces with the updated display screen and the updated display screen to the vehicle-mounted apparatus 10. FIG.

[Processing by in-vehicle system]
Next, processing by the in-vehicle system will be described with reference to FIGS. 3 and 4. FIG. 3 is a flowchart illustrating a flow of cooperative connection and data reception display processing in the in-vehicle device according to the first embodiment, and FIG. 4 is a flowchart illustrating a flow of data transmission processing in the in-vehicle device according to the first embodiment.

  First, the flow of cooperative connection and data reception display processing in the in-vehicle device will be described with reference to FIG. As illustrated in FIG. 3, the in-vehicle device 10 of the in-vehicle system 1 acquires area information of the portable terminal 40 from the portable terminal 40 when wireless communication is established with the portable terminal 40 (Yes in Step S101) (Step S102). ), The area information of the own apparatus is transmitted (step S103).

  Thereafter, when the in-vehicle device 10 receives data (image and / or sound) from the portable terminal 40 (Yes at Step S104), it determines whether the received data is already displayable or converted (Step S105). If the received data is not already displayable or converted (No at step S105), the received data is converted into a displayable format and output (step S106 and step S107).

  Then, the in-vehicle device 10 repeats the processes of Steps S104 to S108 described above while wireless communication is established (No at Step S108), and ends the process when the wireless communication is disconnected (Yes at Step S108). .

  On the other hand, when the received data can be displayed or converted (Yes at Step S105), the in-vehicle device 10 displays and outputs the received data as it is (Step S107), and executes the process of Step S108.

  Next, the flow of data transmission processing in the in-vehicle device will be described with reference to FIG. As shown in FIG. 4, the in-vehicle device 10 of the in-vehicle system 1 is in a state in which the wireless communication with the mobile terminal 40 is established, the area information of the mobile terminal 40 is acquired, and then the screen arbitration with the screen of the mobile terminal is completed. (Step S201) When the screen operation is accepted by the user in the display operation unit 12 (Yes in Step S202), the received operation position (coordinates) is converted according to the screen (size, resolution, etc.) of the portable terminal 40 and carried. It transmits to the terminal 40 (step S203).

  Then, the in-vehicle device 10 repeats the processes of Steps S202 to S204 described above while wireless communication is established (No at Step S204), and ends the process when the wireless communication is disconnected (Yes at Step S204). .

[Effects of Example 1]
As described above, according to the first embodiment, immediately after wireless connection, the area information of the mobile terminal 40 can be acquired and compared with the area information of the own device. Even if such information is transmitted, the information displayed on the mobile terminal 40 can be displayed on the in-vehicle device 10 in the same manner, and the information displayed on the in-vehicle device 10 can be displayed on the mobile terminal 40 in the same manner. Therefore, the portable terminal 40 and the in-vehicle device 10 can normally perform cooperative control.

  Moreover, according to Example 1, since the area | region information of the vehicle-mounted apparatus 10 can also be transmitted to the portable terminal 40, it can also convert into the data according to the vehicle-mounted apparatus 10 on the portable terminal 40 side, and can also transmit. As a result, the processing load on the in-vehicle device 10 can be reduced, and furthermore, the addition of functions can be suppressed, so that the cost can be further suppressed.

  In the first embodiment, the example in which the data acquired from the portable terminal 40 is converted into a format that can be displayed by the in-vehicle device 10 (screen arbitration) has been described, but the present invention is limited to this. It is not a thing.

  Therefore, in the second embodiment, an example in which the operation screen of the in-vehicle device itself and the image received from the mobile terminal are combined and output to the display (display operation unit 12) of the in-vehicle device will be described with reference to FIGS. To do.

(When securing the operation screen area of the in-vehicle device)
First, the example which outputs the image received from the portable terminal to the display operation part 12 of a vehicle-mounted apparatus is demonstrated using FIG. 5-1, FIG. 5-2, ensuring the area | region of the operation screen of a vehicle-mounted apparatus. FIG. 5A is a diagram illustrating a display example when the horizontal size of the image received from the mobile terminal is used as a reference, and FIG. 5B is a diagram when the vertical size of the image received from the mobile terminal is used as a reference. It is a figure which shows the example of a display.

  When the image acquired from the portable terminal 40 is vertically long, the in-vehicle device 10 displays the vacant area (a) on the display operation unit 12 based on the horizontal size of the acquired image as illustrated in FIG. Display the operation screen. And by providing an up-and-down scroll, the vertical part overflowing from the display operation part 12 of the vehicle-mounted apparatus 10 can be displayed. Further, as illustrated in FIG. 5B, the in-vehicle device 10 displays the image obtained from the mobile terminal 40 by reducing the vertical size based on the vertical size of the display operation unit 12, and a free area (b). Display the operation screen.

(When superimposing the operation screen of the in-vehicle device)
Next, an example in which the operation screen of the in-vehicle device is superimposed on the image received from the mobile terminal and output to the display operation unit 12 will be described with reference to FIGS. 6A and 6B. FIG. 6A is a diagram illustrating an example of superposition when the image received from the mobile terminal is horizontally long, and FIG. 6B is a diagram illustrating an example of superposition when the image received from the mobile terminal is vertically long.

  When the image received from the mobile terminal is horizontally long, the in-vehicle device 10 displays the image acquired from the mobile terminal 40 on the entire surface and provides a scroll for moving the operation screen left and right as shown in FIG. Superimpose a semi-transparent operation screen. By operating this scroll, the operation screen can be moved to the left and right, so that the entire image received from the mobile terminal 40 can be viewed.

  Further, when the image received from the mobile terminal is vertically long, the in-vehicle device 10 displays the image acquired from the mobile terminal 40 on the entire surface and scrolls to move the operation screen up and down as shown in FIG. Superimpose a semi-transparent operation screen. By operating this scroll, the operation screen can be moved up and down, the moved area can be displayed, and the entire image received from the mobile terminal 40 can be viewed.

(When the aspect ratio of the screen is different)
When the aspect ratio of the image received from the mobile terminal is different from the aspect ratio of the display operation unit 12 of the in-vehicle apparatus 10, the in-vehicle device 10 performs an operation for displaying the aspect ratio of the image received from the mobile terminal as shown in FIG. The image is converted into the aspect ratio of the unit 12 and displayed, and the operation screen is superimposed on the vacant area. FIG. 7 is a diagram illustrating a display example when the aspect ratios of the display areas are different.

  As described above, according to the second embodiment, even when the in-vehicle device 10 and the mobile terminal 40 have different screen sizes, for example, the operation screen of the in-vehicle device 10 such as an air conditioner operation can be displayed in a superimposed manner. As a result, the portable terminal 40 and the vehicle-mounted device 10 can be controlled in a coordinated manner without impairing user convenience.

  Although the embodiments of the present invention have been described so far, the present invention may be implemented in various different forms other than the embodiments described above. Therefore, different embodiments will be described below.

(1) Transmission Information For example, in the first embodiment, the in-vehicle device 10 has been described with respect to the example in which the coordinates indicating the position of the operation are transmitted to the portable terminal 40 when the display operation unit 12 is operated. However, the present invention is not limited to this. For example, an operation command for specifying the operation determined from the operated coordinates may be transmitted. By doing in this way, the erroneous operation by the misprocessing of the coordinate transformation by the vehicle-mounted apparatus 10 side can be prevented.

(2) Periodic Transmission / Reception Further, after the wireless communication is established with the mobile terminal 40, the in-vehicle device 10 periodically acquires at least one of time, radio wave state, and battery state from the mobile terminal 40. May be. By doing so, the in-vehicle device 10 side can grasp whether or not the portable terminal 40 can transmit information, that is, whether or not the service can be continued. As a result, when the service is approaching to end, it is possible to avoid the service stop by receiving data in advance or displaying and outputting a notification that the service cannot be continued.

  The in-vehicle device 10 can also periodically transmit the traveling state of the vehicle in which the in-vehicle device 10 is mounted to the mobile terminal 40. For example, the in-vehicle device 10 periodically acquires the vehicle speed, acceleration, stop information, and the like from the vehicle control system unit 20 and periodically transmits them, so that an application corresponding to the traveling state is provided on the mobile terminal 40 side. Can be provided or deterred. Specifically, in the mobile terminal 40, if the vehicle is running, it is possible to perform a control that suppresses activation of the TV application.

(3) System configuration etc. In addition, among the processes described in the present embodiment, all or part of the processes described as being automatically performed can be manually performed or manually performed. All or a part of the processing described as a thing can also be automatically performed by a known method. In addition, the processing procedure, control procedure, specific name, and information including various data and parameters shown in the above-mentioned document and drawings can be arbitrarily changed unless otherwise specified.

  Each component of each illustrated device is functionally conceptual and does not necessarily need to be physically configured as illustrated. In other words, the specific form of distribution / integration of each device is not limited to that shown in the figure, and all or a part thereof may be functionally or physically distributed or arbitrarily distributed in arbitrary units according to various loads or usage conditions. It can be configured by integrating (for example, integrating the display control unit 15d and the transmission control unit 15e). Further, all or any part of each processing function performed in each device may be realized by a CPU and a program analyzed and executed by the CPU, or may be realized as hardware by wired logic.

(4) Program The linkage control method described in the present embodiment can be realized by executing a program prepared in advance on a computer such as a personal computer or a workstation. This program can be distributed via a network such as the Internet. The program can also be executed by being recorded on a computer-readable recording medium such as a hard disk, a flexible disk (FD), a CD-ROM, an MO, and a DVD and being read from the recording medium by the computer.

  As described above, the in-vehicle device according to the present invention is useful for performing wireless communication with the mobile terminal device, and in particular, no matter what information is transmitted from the mobile terminal device, the mobile terminal device and the in-vehicle device Is suitable for the normal cooperative control.

It is a figure for demonstrating the outline | summary of the vehicle-mounted system which concerns on Example 1. FIG. 1 is a block diagram illustrating a configuration of an in-vehicle system according to a first embodiment. 3 is a flowchart illustrating a flow of cooperative connection and data reception display processing in the in-vehicle device according to the first embodiment. 4 is a flowchart illustrating a flow of data transmission processing in the in-vehicle device according to the first embodiment. It is a figure which shows the example of a display at the time of making into the reference | standard the horizontal size of the image received from the portable terminal. It is a figure which shows the example of a display at the time of making the reference | standard the vertical size of the image received from the portable terminal. It is a figure which shows the example of superimposition when the image received from the portable terminal is horizontally long. It is a figure which shows the example of a superimposition in case the image received from the portable terminal is vertically long. It is a figure which shows the example of a display when the aspect ratios of a display area differ.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 In-vehicle system 10 In-vehicle apparatus 11 Near field communication part 12 Display operation part 13 Storage part 15 Control part 15a Wireless establishment part 15b Area information acquisition part 15c Area information transmission part 15d Display control part 15e Transmission control part 20 Vehicle control system unit 30 Speaker 40 mobile terminal 41 communication unit 42 near field communication unit 43 speaker 44 display operation unit 45 storage unit 45a application 46 control unit 47 wireless establishment unit 48 area information transmission unit 49 application execution control unit

Claims (5)

An in-vehicle device having a display unit and performing wireless communication with a mobile terminal device,
Area information acquisition means for acquiring display area information of the display unit of the mobile terminal apparatus from the mobile terminal apparatus;
Display control that, when receiving data from the portable terminal device, converts the received data into a format that can be displayed on the display unit based on the display area information acquired by the area information acquisition means Means,
When transmitting the information displayed on the display unit to the mobile terminal device, the data is converted into a format that can be displayed on the mobile terminal device based on the display region information acquired by the region information acquisition means. Transmission control means for transmitting
A vehicle-mounted device comprising: Further comprising region information transmitting means for transmitting the display region information of the display unit to the mobile terminal device;
The display control means, when the data received from the portable terminal device is data converted into a format that can be displayed on the display unit based on the display area information transmitted by the area information transmission means, The in-vehicle device according to claim 1, wherein data is displayed on the display unit without being converted.   When the information displayed on the display unit is operated by a user, the transmission control unit is arranged on the operated display unit based on the display area information acquired by the area information acquisition unit. 2. The vehicle-mounted device according to claim 1, wherein the coordinates are converted into coordinates on the portable terminal device and transmitted, or an operation command specifying the operation determined from the operated coordinates is transmitted. apparatus.   The display control means displays an operation screen of the in-vehicle device superimposed on an image acquired from the mobile terminal device after wireless communication is established with the mobile terminal device. The vehicle-mounted apparatus as described in any one of 1-3.   The display control means converts and displays the image acquired from the mobile terminal device based on the display area information acquired by the area information acquisition means, and displays the operation screen of the in-vehicle device in an area where the image is not displayed. 5 is displayed. The in-vehicle device according to claim 1.

Images