JP6047948B2 - Vehicle equipment - Google Patents

Description

  The present invention relates to an apparatus for a vehicle that can display a screen of a smartphone on a display in the vehicle, for example.

  A configuration is known in which a screen of a portable information terminal brought into a vehicle, such as a smartphone, is displayed on a display (display unit) of an in-vehicle device (vehicle device). In the case of this configuration, when displaying a map or the like displayed on the smartphone screen on the display of the vehicle-mounted device, the size of the display area of each screen of the smartphone and the vehicle-mounted device is taken into consideration and displayed on the smartphone screen The image information is converted into a format that can be displayed on the display of the in-vehicle device (see, for example, Patent Document 1). And the screen of a smart phone is displayed on a display of a vehicle equipment as it is, and if the user operates the touch panel of the said display, the operation information of a touch panel will be transmitted to a smart phone from a vehicle equipment. Such a function is referred to as a so-called “virtual network computing (hereinafter, VNC (registered trademark)) function” or “terminal mode (registered trademark)”.

JP 2010-130553 A

  In the above conventional configuration, the information displayed on the display screen of the in-vehicle device is only information on the screen of the smartphone, and the in-vehicle device functions only as a display device (display) and an input device (touch panel). is there. In the above configuration, for example, when making a call, the number input for the call is performed on the display screen of the in-vehicle device, but since the displayed screen is the screen of the smartphone, the history of the phone number that was sent (outgoing) (History) will be stored only on the smartphone.

  Here, in the in-vehicle device, when the use of the VNC function is stopped and the use of the known hands-free function is switched, the in-vehicle device does not store the telephone number transmitted during the execution of the VNC function in the in-vehicle device. (Because the transmission history is not stored), there is a problem in that it is impossible to re-call to the telephone number based on the transmission history in the in-vehicle device and the usability is not good.

  SUMMARY OF THE INVENTION Accordingly, an object of the present invention is to provide a vehicular apparatus capable of storing at least a part of information displayed on the screen of the vehicular apparatus during execution of the VNC function and improving usability. .

The invention of claim 1 is a communication means (5) connected to the portable information terminal (2) for inputting information displayed on the screen of the portable information terminal (2), and a display means (6) having a touch panel function. And a control means (3) for displaying the screen of the portable information terminal (2) on the display means (6) based on the information, and an operation signal when the touch panel of the display means (6) is operated. The communication means (5) transmits the operation signal to the portable information terminal (2), and the control means (3) is executing a specific function. The display means is configured to store the characteristics of the display content displayed on the screen of the display means (6), and the control means (3) further includes the screen of the display means (6) as the feature of the display contents. At least text in the display content displayed in Is a device configured for vehicle to store broadcast.

The electrical block diagram of the information display system which shows 1st Embodiment of this invention. Flow chart showing control of in-vehicle device

  Hereinafter, a first embodiment of the present invention will be described with reference to FIGS. 1 and 2. FIG. 1 shows an electrical configuration of the information display system of the present embodiment. The information display system includes an in-vehicle device (vehicle device) 1 mounted on a vehicle and a mobile phone (portable information terminal) 2 brought into the vehicle.

  The in-vehicle device 1 includes a control unit (control unit) 3 that controls the entire system, a storage unit (storage unit) 4 including a ROM, a RAM, a flash memory, or a hard disk, a USB communication unit 5a, and a Bluetooth communication unit 5b. A communication unit (communication unit) 5, a display unit (display unit) 6 including a display having a touch panel function, and a plurality of operation switches provided on the touch panel of the display unit 6 and the display unit 6. An operation unit 7, a vehicle information acquisition unit 8 connected to an in-vehicle LAN such as a CAN (Controller Area Network), and a voice input / output unit 9 that includes a microphone and a speaker and can input and output voice and various sounds. ing.

  The USB communication unit 5a has a function of performing wired communication with the mobile phone 2 using, for example, a USB communication protocol. Note that the USB communication unit 5a may be configured to have a function of performing wired communication with the mobile phone 2 using another communication protocol. The Bluetooth communication unit 5b has a function of performing wireless communication with the mobile phone 2 using, for example, a Bluetooth (registered trademark) communication protocol. Note that the Bluetooth communication unit 5b may be configured to have a function of performing wireless communication with the mobile phone 2 using another communication protocol.

  The display unit 6 has a touch panel function, and can display information necessary for the user to perform an operation input, an operator image for a touch operation, information on an execution state of the function, and the like. The operation input method by the user for the content (screen) displayed on the display unit 6 is not limited to the operation input by the touch panel described above, and for example, an operation input method by a remote operation switch such as a joystick is also possible.

  The operation unit 7 has a function of outputting an operation signal corresponding to a user operation to the control unit 3 when the touch panel or the plurality of operation switches are operated by the user. The vehicle information acquisition unit 8 has a function of acquiring various vehicle information (such as vehicle travel information) from various electronic devices mounted on the vehicle via the in-vehicle LAN, and outputting the acquired vehicle information to the control unit 3. Have.

  On the other hand, the mobile phone 2 is configured by a smartphone, for example. The mobile phone 2 includes a control unit 10 that performs overall control, a storage unit 11 that includes a ROM, a RAM, a flash memory, and the like, a communication unit 12 that includes a USB communication unit 12a and a Bluetooth communication unit 12b, and a mobile phone, for example. A wireless communication unit 13 that performs wireless communication with a network and, for example, a wireless LAN (Wi-Fi, etc.), a display unit 14 that includes a display having a touch panel function (so-called smartphone-type touch panel function), a microphone, a speaker, and the like A voice input / output unit 15 capable of inputting and outputting voice and various sounds is provided.

  The USB communication unit 12a performs wired communication with the in-vehicle device 1 using a USB communication protocol by being connected via a communication cable (not shown). Note that the USB communication unit 12a may be configured to have a function of performing wired communication with the in-vehicle device 1 using another communication protocol. The Bluetooth communication unit 12b performs short-distance wireless communication by being connected to the vehicle-mounted device 1 by a radio wave signal using a Bluetooth communication protocol. In addition, you may comprise the Bluetooth communication part 12b so that it may have a function which performs radio | wireless communication with the vehicle equipment 1 by another communication protocol. Necessary for displaying a control signal (for example, an image on the screen of the display unit 14 of the mobile phone 2) from the communication unit 12 of the mobile phone 2 to the communication unit 5 on the in-vehicle device 1 side by the wired communication or the short-range wireless communication. Various control information signals) and image signals (for example, image information signals displayed on the screen of the display unit 14 of the mobile phone 2) are transmitted, and the communication unit 5 of the mobile phone 2 is transmitted from the communication unit 5 on the vehicle-mounted device 1 side. An operation signal (for example, an operation signal obtained by operating the touch panel of the display unit 6 of the in-vehicle device 1) is transmitted to. The control signal includes the ID of an application that is displaying an image on the screen of the mobile phone 2 (smartphone screen), the aspect ratio of the screen of the display unit 14 of the mobile phone 2, and an incoming state notification signal (hands-free call). In addition, information such as a call state notification signal (hands-free call), a sound reproduction signal (AVRCP (Audio / Video Remote Control Profile) or A2DP (Advanced Audio Distribution Profile) standard), and the like are included.

  In this embodiment, the display content of the screen of the display unit 14 of the mobile phone 2 is displayed as it is on the display unit 6 of the in-vehicle device 1 by wire communication using the USB communication protocol, and the display unit 6 of the in-vehicle device 1 is displayed. When the user operates the touch panel, operation information on the touch panel is transmitted from the in-vehicle device 1 to the mobile phone 2. In other words, the in-vehicle device 1 is configured to be able to execute a so-called VNC function by wired communication of a USB communication protocol.

  The vehicle-mounted device 1 and the mobile phone 2 are so-called hands-free connected by short-range wireless communication using the Bluetooth communication protocol, and a hands-free call can be made via the mobile phone 2 by the vehicle-mounted device 1. It has a possible configuration. In this configuration, the mobile phone 2 transmits an incoming state notification signal, a transmission state notification signal, a voice signal, a music signal, or the like from the mobile phone 2 to the in-vehicle device 1 by short-range wireless communication using a Bluetooth communication protocol. Information signals necessary for incoming calls, information signals necessary for outgoing calls, audio signals, and the like are transmitted from 1 to the mobile phone 2.

  The wireless communication unit 13 has a function capable of connecting to the Internet or making a mobile phone call by being connected to a mobile phone network or a wireless LAN by radio signals. When a map application (hereinafter referred to as a map application) is executed in the mobile phone 2, the map data used in the map application may be stored in the storage unit 11 of the mobile phone 2, It is good also as a structure acquired from the outside through the communication part 12 or the radio | wireless communication part 13. FIG.

  Next, the operation of the present embodiment will be described with reference to FIG. FIG. 2 is a flowchart showing the contents of the control of the in-vehicle device 1. In the control of FIG. 2, connection by wired communication (USB) and short-range wireless communication (Bluetooth) is completed between the in-vehicle device 1 and the mobile phone 2, and the display content (image information) and control of the screen of the mobile phone 2 are controlled. This is performed when information is transmitted to the vehicle-mounted device 1 and displayed on the screen of the vehicle-mounted device 1. That is, the process of FIG. 2 is executed in a state where the in-vehicle device 1 uses the VNC function.

  The connection by wired communication is completed when the in-vehicle device 1 and the mobile phone 2 are connected by a communication cable. In addition, the connection by the short-range wireless communication exchanges authentication information such as a BD (Bluetooth Device) address and a passkey necessary for wireless communication between the in-vehicle device 1 and the mobile phone 2, and the in-vehicle device 1. Is completed by performing authentication based on the authentication request from the mobile phone 2.

  First, in step S <b> 10 of FIG. 2, the in-vehicle device 1 determines whether or not an incoming state notification or an outgoing state notification is received from the mobile phone 2. If neither the incoming state notification nor the outgoing state notification is received, the process proceeds to “NO”, returns to step S10, and repeats the determination in step S10. In step S10, when either the incoming state notification or the outgoing state notification is received, the process proceeds to “YES”, and the process proceeds to step S20.

  In step S20, the display content displayed on the screen of the display unit 6 of the in-vehicle device 1 is image-recognized (analyzed). Then, the process proceeds to step S30, and whether or not the display content includes a telephone number (text information, telephone function) based on the image recognition result (that is, whether or not the telephone number can be extracted from the display content). to decide. Here, if it is determined that the display content includes a telephone number, the process proceeds to “YES”, and the process proceeds to step S40 where the telephone number is stored in the storage area in the storage unit 4 of the in-vehicle device 1, such as a telephone directory. Register as an incoming call history or outgoing call history. Thereafter, the process returns to step S10, and the determination in step S10 is repeated.

  If it is determined in step S30 that the display content on the screen of the display unit 6 does not include a telephone number, the process proceeds to “NO”, returns to step S10, and repeats the determination in step S10.

  In step S30, when it is determined whether the display content on the screen of the display unit 6 includes a telephone number based on the image recognition result, the telephone number is included in the display content of the entire screen of the display unit 6. If the user has previously set an area (phone number display area) where the telephone number is displayed on the screen of the display unit 6 instead of determining whether or not it is included, the set area is given priority. Then, it is preferable that the image recognition (analysis) is performed.

  According to the present embodiment having the above-described configuration, the VNC function is used in the in-vehicle device 1 and the screen of the mobile phone 2 is displayed on the display unit 6 of the in-vehicle device 1. When the telephone function) is being executed, the feature of the display content displayed on the screen of the display unit 6, such as a telephone number, is stored in the telephone directory in the storage unit 4, so the use of the VNC function is stopped. Thus, when the in-vehicle device 1 is used with the hands-free function, it is possible to make a call using the telephone number stored when the VNC function is used. In this embodiment, since only the feature of the display content, for example, the telephone number (that is, text information) is stored, the storage capacity can be minimized. Further, in the present embodiment, the reception of the incoming state notification or the outgoing state notification is used as a trigger to extract the telephone number included in the display contents, and the extracted telephone number is stored in the phone book of the storage unit 4 of the in-vehicle device 1. Since it is configured to be registered as an incoming call history or outgoing call history, an incoming call history or outgoing call history update (registration) process of the in-vehicle device 1 can be executed in real time.

In addition to the embodiment described above, the following configuration may be adopted.
In the above embodiment, when image recognition (analysis) is performed on the display content displayed on the screen of the display unit 6 of the in-vehicle device 1, it is determined whether or not a telephone number is included. By recognizing (analyzing) a character string that is within the set distance from the display position of the telephone number that is determined to contain the phone number, this recognized character string is extracted as information on the destination or destination. It is preferable to register it in the telephone directory in association with the telephone number.

  In addition, when registering a telephone number in the phone book in the storage unit 4 of the in-vehicle device 1 and determining that the phone number has already been registered, the phone book information in the storage unit 4 of the in-vehicle device 1 It is also possible to configure such that it is linked to and stored in the history.

  Further, in the above embodiment, it is configured to determine whether or not a display number includes a telephone number, and to perform subsequent processing, triggered by reception of an incoming state notification or outgoing state notification However, the in-vehicle device 1 is not limited to this, and the in-vehicle device 1 is based on the information of the application ID (hereinafter referred to as application ID) included in the control signal transmitted from the mobile phone 2 to the in-vehicle device 1. When the application executing the display operation on the screen of the display unit 6 of the device 1 is an application of the phone book function, the process for determining whether or not the display number includes a telephone number and the subsequent processes are executed. You may comprise so that it may do.

  Furthermore, when the application ID is an application corresponding to the map function, by performing image analysis of the display content displayed on the screen of the display unit 6 of the vehicle-mounted device 1, for example, a screen title (usually in the upper left part) Is displayed), the display content of the screen is further subjected to image analysis to extract at least the coordinate information of the location where the location is registered, and the coordinate information is stored in the storage unit 4 of the in-vehicle device 1. It is preferable that the information is stored as point information. If comprised in this way, when performing the application of a map function by vehicle equipment 1 independent, the point information registered with the mobile telephone 2 can be used effectively by the vehicle equipment 1 side.

  Further, when the application ID is an application corresponding to the music function, for example, the screen title (usually displayed in the upper left part) is analyzed by image analysis of the display content displayed on the screen of the display unit 6 of the in-vehicle device 1. ) Is “favorite registration”, the image of the display content may be further analyzed to extract at least the song name of the favorite registered song, and the extracted song title may be stored. According to this configuration, when the music function application can be executed by the vehicle-mounted device 1 alone, the music information registered in the favorites by the mobile phone 2 can also be used effectively in the vehicle-mounted device 1.

  In addition, when the image of the display content displayed on the screen of the display unit 6 of the in-vehicle device 1 is analyzed, and at least a part of the extracted text information (for example, a telephone number or name) has been registered (stored), You may comprise so that a user may be inquired whether it overwrites. In the case of this configuration, the user is preferably configured to be able to answer “registration processing cancellation”, “overwrite registration”, or “additional registration” in response to the inquiry. Further, when executing the above inquiry, the registered content and the extracted content may be written together, or the changed portion (a portion where both are different) may be highlighted.

  For example, when the user determines that the telephone number has been changed for the same person, the user can select “overwrite registration”. Also, when the user determines that the name has changed due to marriage or the like with the same telephone number, the user can select “overwrite registration”. If the user determines that the name is the same but another person, the user can select “additional registration”. In this case, it is preferable that the user later appropriately correct the additionally registered name. Also, a registration function of “add phone number” may be provided in response to a case where the user determines that the same person is another phone number such as home or mobile phone.

  In addition, in the said embodiment and each said modification, although it comprised so that a part of display content (telephone number, point information, etc.) currently displayed on the screen of the display part 6 of the vehicle equipment 1 might be memorize | stored, Instead, the entire display content (the entire screen) may be stored. In this case, text information subjected to image recognition (analysis) may be stored, image information may be stored, or text information and image information may be mixed and stored.

  Moreover, in the said embodiment and each said deformation | transformation form, it comprised so that the vehicle equipment 1 and the mobile telephone 2 might be connected by wire connection and short-distance wireless connection, but it is not restricted to this, You may connect only by wire. However, it is only necessary to make a short distance wireless connection. In the case of a configuration in which only wired connection is made, necessary image information and control information are transmitted from the mobile phone 2 to the vehicle-mounted device 1 via the wired connection, and operation information is transmitted from the vehicle-mounted device 1 to the mobile phone 2 via the wired connection. It may be configured to transmit to. Further, in the case of a configuration in which only short-distance wireless connection is made, necessary image information and control information are transmitted from the mobile phone 2 to the vehicle-mounted device 1 through the short-distance wireless connection, and operation information is transmitted through the short-distance wireless connection. Thus, it may be configured to transmit from the in-vehicle device 1 to the mobile phone 2.

  In the drawings, 1 is an in-vehicle device (vehicle device), 2 is a mobile phone (portable information terminal), 3 is a control unit (control means), 4 is a storage unit, 5 is a communication unit (communication unit), and 6 is a display unit. (Display means), 7 is an operation unit, 9 is a voice input / output unit, 10 is a control unit, 12 is a communication unit, and 14 is a display unit.

Claims (7)

A communication means (5) connected to the portable information terminal (2) and inputting information displayed on the screen of the portable information terminal (2);
Display means (6) having a touch panel function;
Control means (3) for displaying the screen of the portable information terminal (2) on the display means (6) based on the information;
Operation means (7) for generating an operation signal when the touch panel of the display means (6) is operated,
The communication means (5) transmits the operation signal to the portable information terminal (2),
The control means (3) is configured to store characteristics of display contents displayed on the screen of the display means (6) when a specific function is executed , and further, the control means (3) Is configured to store at least text information in the display content displayed on the screen of the display means (6) as a feature of the display content . The control means (3) receives various control information signals necessary for displaying an image on the screen of the display means (6) from the portable information terminal (2), and based on the received signals. The vehicle apparatus according to claim 1, wherein the specific function is determined. 3. The vehicle apparatus according to claim 1, wherein the specific function is a telephone function, and a telephone number is stored as a characteristic of the display content . Wherein said control means (3) for a vehicle according to claim 3, wherein the storing the telephone number in the phonebook. 3. The vehicle apparatus according to claim 1, wherein the specific function is a map function, and stores coordinate information of at least a location registered as a feature of the display content . The specific function is a music function, the display content at least to store the Song information of registered music to favorites and said claim 1 or 2 vehicular apparatus described as features. The apparatus for a vehicle according to claim 1 or 2, wherein the control means (3) inquires of the user whether or not to overwrite when at least a part of the text information has been stored .

Images