JP5230380B2 - In-vehicle device and in-vehicle display system - Google Patents

Description

  The present invention relates to an in-vehicle device and an in-vehicle display system, and in particular, an in-vehicle device that displays an image displayed on a display unit of a mobile terminal device having a dictionary function and a character conversion function, and an in-vehicle display having the same device. It is about the system.

  With the spread of car navigation systems using GPS (Global Positioning System), in-vehicle devices having a navigation function are often mounted on vehicles. In addition, in order to respond to user needs for multifunctional in-vehicle devices, multifunctional in-vehicle devices have become prominent.

  For example, in-vehicle devices often include many functions such as a television reception function, a CD (Compact Disc) playback function, and a DVD (Digital Versatile Disk) playback function in addition to the navigation function. However, the increase in the number of functions of the in-vehicle device causes an increase in the price of the in-vehicle device, which is not preferable for the user.

  On the other hand, portable terminal devices such as mobile phones have been popularized at low prices but with navigation functions and music playback functions. In addition, since mobile terminal devices equipped with a short-range wireless communication function such as Bluetooth (registered trademark) have also become widespread, the mobile terminal device and the vehicle-mounted device are linked with such a short-range wireless communication function, and the mobile terminal device side Efforts are also being made to use functions on the in-vehicle device side. This makes it possible to reduce the price of the in-vehicle device.

  For example, in Patent Document 1, a display screen displayed on the screen of the mobile terminal device is transmitted to the in-vehicle device, and is generated by the mobile terminal device with respect to the display of the in-vehicle device larger in size than the screen of the mobile terminal device. A technique for displaying a display screen is disclosed.

  According to this technology, the user can see the same screen as the display screen displayed on the screen of the mobile terminal device on the display of the in-vehicle device that is larger than the screen of the mobile terminal device. Even when shaking occurs, the information displayed on the screen of the mobile terminal device can be easily visually recognized by the display of the in-vehicle device.

  Patent Document 1 discloses a technique for displaying a touch switch such as an alphanumeric key of a mobile terminal device on a display of the in-vehicle device so that the mobile terminal device can be operated from the in-vehicle device side.

  According to this technology, by operating the touch switch displayed on the display of the in-vehicle device, the function of the mobile terminal device can be used on the in-vehicle device side without operating the alphanumeric key of the mobile terminal device.

JP 2003-244343 A

  However, in the technique of Patent Document 1, since the touch switch of the mobile terminal device is displayed on the display of the in-vehicle device, the user of the in-vehicle device operates when the model of the mobile terminal device to be linked with the in-vehicle device is changed. There was a risk of difficult situations.

  In other words, the in-vehicle device is basically operated by a passenger in the driver's seat or the passenger seat, but the portable terminal device linked with the in-vehicle device may use a device owned by another person. .

  In this case, the touch key switch of the mobile terminal device that the operator is not familiar with will be displayed on the display of the in-vehicle device, and if you do not know the key layout of the touch key switch and the function of each key, you can operate as you think The problem that it is difficult to occur occurs. In particular, when manually inputting a destination while using the navigation function, there is a problem that it is difficult to input characters as expected.

  In the technique of Patent Document 1, since the display screen of the mobile terminal device is displayed as it is on the display of the in-vehicle device, the display position of the input character varies depending on the model of the mobile terminal device linked to the in-vehicle device. For this reason, there may be a problem that it is difficult to confirm the result of character input.

  Therefore, in the present invention, in a vehicle-mounted device that displays an image displayed on a display unit of a portable terminal device having a dictionary function and a character conversion function, and a portable terminal device that cooperates with the vehicle-mounted device in a vehicle-mounted display system having the device. Even if it changes, it aims at providing the vehicle-mounted apparatus and vehicle-mounted display system which were excellent in the operativity at the time of performing character input and the visibility of a display screen for the user of a vehicle-mounted apparatus.

  In this invention, it is a vehicle-mounted display system which has a portable terminal device provided with the dictionary function and the character conversion function, and a vehicle-mounted device which displays the image displayed on the display part of the said portable terminal device, Comprising: Display operation means having a touch panel function capable of displaying a predetermined character conversion screen in which a kana input area and a character display area are defined, and operation information corresponding to the operation position of the kana input area to the portable terminal device Operation information transmitting means for transmitting, image information receiving means for receiving image information corresponding to the operation information from the portable terminal device, and display control for displaying the image information received by the image information receiving means in the character display area And the portable terminal device includes: an operation information receiving unit that receives the operation information from the in-vehicle device; and the operation information received by the operation information receiving unit. A discriminating unit for discriminating a character corresponding to the image, an image information extracting unit for extracting image information of the character discriminated by the discriminating unit from image information displayed on the display unit, and an image information extracted by the image information extracting unit It is decided to provide an in-vehicle display system having image information transmitting means for transmitting the information to the in-vehicle device.

  The present invention is also an in-vehicle device that displays an image displayed on a display unit of a mobile terminal device having a dictionary function and a character conversion function, and the in-vehicle device includes a kana input area and a character display area. Display operation means having a touch panel function capable of displaying a prescribed prescribed character conversion screen, operation information transmission means for transmitting operation information corresponding to the operation position of the kana input area to the portable terminal device, and the portable To provide an in-vehicle device having image information receiving means for receiving image information corresponding to the operation information from a terminal device, and display control means for displaying the image information received by the image information receiving means in the character display area. It was.

  According to the present invention, even when the mobile terminal device linked with the in-vehicle device is changed, when inputting characters from the in-vehicle device, the user can input characters by operating a predetermined kana input area. Since the input characters are displayed in a predetermined character display area, even when the mobile terminal device linked with the in-vehicle device is changed, the operability when inputting characters for the user of the in-vehicle device and An in-vehicle device and an in-vehicle display system with excellent display screen visibility can be provided.

  Hereinafter, an embodiment of the present invention will be specifically described with reference to the drawings. In the present embodiment, an in-vehicle device called DA (display Audio) mounted on a car, a dictionary function, a character conversion function, a GPS (Global Positioning System) navigation (hereinafter referred to as “navigation”) function, and an Internet connection function. An example in which the present invention is applied to an in-vehicle display system in which a mobile phone as a mobile terminal device having various functions such as a music data playback function cooperates with a short-range wireless communication function will be described. To do.

  Here, DA refers to an in-vehicle device that is mounted with only basic functions such as a display function, a music data playback function, and a communication function with a mobile phone, and becomes multifunctional by linking with the mobile phone.

  FIG. 1 is an explanatory diagram showing an overview of the in-vehicle display system S according to the present embodiment. As shown in FIG. 1, the in-vehicle display system S according to the present embodiment includes an in-vehicle device 1 and a mobile phone 2.

  In the in-vehicle display system S, the in-vehicle device 1 and the mobile phone 2 store a cooperation application (application program) that enables various information communication between the two, and the in-vehicle device 1 and the mobile phone 2 are connected to each other. By executing the application, the function of the mobile phone 2 can be used on the in-vehicle device 1 side.

  For example, when using the navigation function of the mobile phone 2 on the in-vehicle device 1 side, the image information on the map screen M displayed on the display unit 201 of the mobile phone 2 is transferred from the mobile phone 2 to the in-vehicle device 1 as shown in FIG. The same map screen M as what is displayed on the mobile phone 2 by the display operation unit 101 of the in-vehicle device 1 is displayed.

  In addition, the display operation unit 101 of the in-vehicle device 1 has a touch panel function, and the user can switch the display of the mobile phone 2 to the menu screen by touching the “menu” in the screen, and the image is in-vehicle. After being displayed on the display operation unit 101 of the device 1, the mobile phone 2 can be operated from the in-vehicle device 1 side by touching a desired item in the menu screen.

  As described above, in the in-vehicle display system S of the present embodiment, the same screen as the display unit 201 of the mobile phone 2 is displayed on the display operation unit 101 of the in-vehicle device 1, and the user touches the display operation unit 101 of the in-vehicle device 1. By doing so, the function of the mobile phone 2 can be used on the vehicle-mounted device 1 side.

  In particular, in the in-vehicle display system S, when it is necessary to input a kana character, such as when inputting a destination while using the navigation function, the in-vehicle device regardless of the model of the mobile phone 2 linked to the in-vehicle device 1. A predetermined character conversion screen 102 (see FIG. 2) is displayed on one display operation unit 101.

  Here, with reference to FIG. 2, a predetermined character conversion screen 102 displayed on the display operation unit 101 of the in-vehicle device 1 when it is necessary to perform kana character input will be described. FIG. 2 is an explanatory diagram showing a predetermined character conversion screen 102 in the present embodiment.

  The character conversion screen 102 shown in FIG. 2 displays character information by manual input, such as when inputting a kana name while using the navigation function of the mobile phone 2 or when inputting text while using the Internet connection function. It is a screen displayed when inputting.

  This character conversion screen 102 is stored as character conversion screen information 113 in a storage unit 112 (see FIG. 5) described later included in the in-vehicle device 1. In this embodiment, the character conversion screen information 113 is stored in advance on the in-vehicle device 1 side. However, it is not necessarily stored in the in-vehicle device 1 side, but is stored in the mobile phone 2 side. Also good.

  In the case where the character conversion screen information 113 is stored on the mobile phone 2 side, the character conversion screen information 113 is stored in the cooperation application for cooperation with the in-vehicle device 1 of the present embodiment, and the cooperation application is stored in the mobile phone. When installing to the mobile phone 2, the character conversion screen information 113 is stored in the mobile phone 2.

  When the mobile phone 2 needs to manually input character information while executing each application, the character conversion screen information 113 is transmitted to the in-vehicle device 1 to display the display operation unit 101 of the in-vehicle device 1. To display.

  As shown in FIG. 2, in the character conversion screen 102, a character display area 104 that displays an input character is defined in the upper area, and a kana input area 103 is defined in a lower area of the character display area 104. Yes.

  In the kana input area 103, touch key images such as a “search” key, a “conversion” key, a “delete” key, a “character switch” key, an “input” key including 50 sounds, and left and right “direction” keys are displayed. Is done.

  The “search” key is a touch key for causing the mobile phone 2 to perform destination search in the navigation function, keyword search in the Internet function, and the like using the input characters as keywords.

  The “conversion” key is a touch key for causing the mobile phone 2 to convert the input kana characters into kanji, katakana, etc., and the “delete” key is a touch key for deleting the input characters one by one. The “character switching” key is a touch key for switching a character to be input from kana to alphabetic characters or numbers.

  The left and right “direction” keys are touch keys for moving the cursor when inputting characters. Of these left and right direction keys, the right-facing “direction” key is also used to determine (determine) the input character.

  The “input” key is composed of a kana key of 50 sounds, a dakuten key, a semi-dakuten key, a small letter switching key, and the like, and is a touch key for inputting character information. In this embodiment, when the user touches the “input” key, a character image corresponding to the touched “input” key is displayed in the character display area 104.

  In particular, in this embodiment, the character image information displayed in the character display area 104 is not stored on the vehicle-mounted device 1 side, but the character image information stored in advance in the mobile phone 2 is used. 1 is displayed on the display operation unit 101.

  Here, with reference to FIG. 3 and FIG. 4, the cooperation operation | movement of the vehicle-mounted apparatus 1 and the mobile telephone 2 at the time of inputting a character using the character conversion screen 102 is demonstrated. 3 and 4 are sequence diagrams showing the cooperative operation between the in-vehicle device 1 and the mobile phone 2.

  Here, a case where the user performs a destination search using the word “Hyogo” as a keyword while using the navigation function will be described as an example.

  As shown in FIG. 3, when the user operates the in-vehicle device 1 or the mobile phone 2 and a character input screen is displayed on the display unit 201 of the mobile phone 2 (1), the mobile phone 2 moves to the in-vehicle device 1. A character conversion screen display request is transmitted (2). Upon receiving this character conversion screen display request, the in-vehicle device 1 displays the character conversion screen 102 on the display operation unit 101 (3).

  As described above, in the present embodiment, when the character input screen is displayed on the display unit 201 of the mobile phone 2, the predetermined character conversion screen 102 is displayed regardless of the model of the mobile phone 2 that cooperates with the in-vehicle device 1. Therefore, even if the user is not familiar with the operation of the mobile phone 2 that cooperates with the in-vehicle device 1, the user can easily input characters using the character conversion screen 102.

  Thereafter, in order to input “Hyogo”, the “Hi” portion in the kana input area 103 is touched to perform the kana input area operation (4). When this kana input area operation is detected, the in-vehicle device 1 transmits coordinate information corresponding to the “hi” part in the kana input area 103 to the mobile phone 2 as operation information (5).

  Based on the received coordinate information, the mobile phone 2 determines that the kana character corresponding to the coordinate is “hi”, displays the character “hi” on the display unit 201 (6), Only the image information of the portion where the character “HI” is displayed is selectively extracted from the image currently displayed in 201 (7). Thereafter, the mobile phone 2 transmits the image information corresponding to the extracted character “HI” to the in-vehicle device 1 (8).

  Then, the in-vehicle device 1 displays an image of “HI” as an input character display in the character display area 104 based on image information corresponding to the character of “HI” received from the mobile phone 2 (9).

  Thus, in this embodiment, the mobile phone 2 determines the character corresponding to the coordinate information received from the in-vehicle device 1, and transmits the image information of the character to the in-vehicle device 1. Characters are displayed based on the image information received from.

  Therefore, although the in-vehicle device 1 side does not store image information corresponding to characters, the user feels as if the in-vehicle device 1 has a dictionary function and a character conversion function. Moreover, since it is not necessary to store character image information in the in-vehicle device 1 and it is not necessary to provide a dictionary function, a character conversion function, or the like, the in-vehicle device 1 can be reduced in price.

  Further, the mobile phone 2 does not transmit the image information of all the images displayed on the display unit 201 to the in-vehicle device 1 but selectively transmits the image information corresponding to the partial image of the character desired by the user. Therefore, the amount of information transmitted to the in-vehicle device 1 can be kept small. Thereby, compared with the case where image information of all images is transmitted, the battery usage of the mobile phone 2 can be suppressed, so that the continuous use time of the mobile phone 2 can be lengthened.

  Thereafter, the user sequentially operates the “input” key in the same manner as the above steps (4) to (9), and inputs the characters “yo”, “u”, “ko”, “” ”. The word input for the word “hyogo” is completed (10). Thereafter, when the in-vehicle device 1 detects that the “search” key has been operated (conversion operation) (11), it transmits a character conversion request to the mobile phone 2 (12).

  When the mobile phone 2 receives the character conversion request from the in-vehicle device 1, the mobile phone 2 performs character conversion of the word “hyogo” (13) and displays the conversion result on the display unit 201. Here, it is assumed that three candidates “slogan”, “Hyogo”, and “leopard” are searched.

  Then, the mobile phone 2 selectively extracts only the image information of the portion where the character “slogan” as the first candidate is displayed among the three candidates displayed on the display unit 201 (14). The image information is transmitted to the in-vehicle device 1 (15).

  The in-vehicle device 1 displays the character “slogan” as the converted character in the character display area 104 based on the image information received from the mobile phone 2 (16).

  In the present embodiment, as described above, every time a kana character is input, coordinate information as operation information is transmitted from the in-vehicle device 1 to the mobile phone 2, and each operation information is supported from the mobile phone 2 to the in-vehicle device 1. The image information of the characters to be sent is sequentially returned, but when the user continuously operates the kana input area 103 to input a character string and then performs a conversion operation using the “conversion” key, An operation information sequence (coordinate information sequence) corresponding to the operated position of the operated kana input area 103 may be transmitted to the mobile phone 2.

  In such a configuration, the mobile phone 2 determines a word corresponding to the coordinate information sequence based on the coordinate information sequence received from the in-vehicle device 1. Then, the cellular phone 2 extracts the image information of the determined word from the image information displayed on the display unit 201 and transmits it to the in-vehicle device 1.

  With this configuration, it is possible to reduce the number of communications transmitted and received between the in-vehicle device 1 and the mobile phone 2 from the input of the kana to the display of the converted word, and thus the battery usage of the mobile phone 2 is further reduced. It can be kept low. Thereby, the continuous use time of the mobile phone 2 can be further prolonged.

  When the character “Hyogo” is displayed in the character display area 104, the user does the conversion operation of the “conversion” key again because the displayed character is not the desired “Hyogo” (17).

  When the in-vehicle device 1 detects that the “conversion” key has been converted again, it transmits a character conversion request to the mobile phone 2 again (18). Upon receiving this character conversion request, the mobile phone 2 selectively selects only the image information of the portion where the character “slogan”, which is the second candidate, is displayed among the three candidates displayed on the display unit 201. The image information is extracted (19), and the image information is transmitted to the in-vehicle device 1 (20).

  The in-vehicle device 1 displays the characters “Hyogo” in the character display area 104 based on the received image information. Here, since the desired “Hyogo” character is displayed in the character display area 104, the user performs a determination operation using the “direction” key pointing to the right (21). When this determination operation (21) is detected, the in-vehicle device 1 transmits a determination request to the mobile phone 2 (22).

  When the mobile phone 2 receives the determination request from the in-vehicle device 1, the mobile phone 2 determines and displays the characters “Hyogo” on the display unit 201 and displays only the image information of the portion where the characters “Hyogo” are displayed from the screen. It selectively extracts (23) and transmits the image information to the in-vehicle device 1 (24).

  The in-vehicle device 1 displays the characters “Hyogo” in the character display area 104 based on the image information received from the mobile phone 2 (25). Thereafter, when detecting the operation of the “search” key by the user, the in-vehicle device 1 transmits a search request to the mobile phone 2 (26). When the mobile phone 2 receives the search request from the in-vehicle device 1, the mobile phone 2 performs a destination search using the characters “Hyogo” as a keyword (27).

  As described above, in the in-vehicle display system S of the present embodiment, when character input is required, the display operation unit 101 of the in-vehicle device 1 has a predetermined function regardless of the model of the mobile phone 2 that cooperates with the in-vehicle device 1. Since the character conversion screen 102 is displayed, the user can always easily input characters using the same character conversion screen 102 regardless of the model of the mobile phone 2 that cooperates with the in-vehicle device 1. In addition, since the input characters are always displayed in the upper area of the character conversion screen 102, the visibility of the characters is improved for the user.

  In addition, the vehicle-mounted device 1 according to the present embodiment does not have a dictionary function, a character conversion function, and the like, but the characters input by the user using the dictionary function and the character conversion function of the mobile phone 2 that cooperates. Therefore, it is possible to satisfactorily meet the user's needs for higher functionality while keeping the price low without increasing the functionality of the in-vehicle device 1 itself.

  Furthermore, in this in-vehicle display system S, when transmitting image information from the mobile phone 2 to the in-vehicle device 1, the image information of the entire display screen of the mobile phone 2 is not simply transmitted, but the character input by the user is not transmitted. Since only the image information of the corresponding partial image is extracted and transmitted, the amount of information transmitted from the mobile phone 2 to the in-vehicle device 1 can be kept low. Thereby, the battery usage amount by the image information transmission of the mobile phone 2 can be reduced.

  Next, configurations of the in-vehicle device 1 and the mobile phone 2 according to the present embodiment will be described with reference to FIG. FIG. 5 is a functional block diagram showing configurations of the in-vehicle device 1 and the mobile phone 2 according to the present embodiment. Note that FIG. 5 illustrates only the configuration requirements regarding the character input function of the in-vehicle display system S, and other configuration requirements, for example, the configuration requirements regarding the audio reproduction function by the cooperation between the in-vehicle device 1 and the mobile phone 2. Is not shown.

  As shown in FIG. 5, the in-vehicle device 1 includes a display operation unit 101, a control unit 110, and a communication unit 120.

  The display operation unit 101 is configured by a liquid crystal display device having a touch panel function, and displays various information including image information received from the character conversion screen 102 and the mobile phone 2 according to the control of the display control unit 111 described later. While displaying, the operation information according to the touch operation by the user is output to the communication unit 120.

  The control unit 110 has a function of controlling the overall operation of the in-vehicle device 1 and is configured by an information processing device including a CPU (Central Processing Unit), a ROM (Read Only Memory), and a RAM (Random Access Memory). ing.

  The control unit 110 includes a display control unit 111 that functions when the CPU executes a predetermined cooperative application, and a storage unit 112 that stores character conversion screen information 113.

  When the communication unit 120 receives a character conversion screen display request from the mobile phone 2, the display control unit 111 reads the character conversion screen information 113 from the storage unit 112 and displays it on the display operation unit 101. Is a processing unit that, when receiving image information from the mobile phone 2, displays the image information on the display operation unit 101 converted into an image.

  The communication unit 120 is a processing unit that transmits and receives various types of information to and from the mobile phone 2, and includes an operation information transmission unit 121, a conversion request transmission unit 122, an image information reception unit 123, and the like. Although not shown here, the communication unit 120 also includes a receiving unit that receives a character conversion screen display request from the mobile phone 2.

  When the operation information corresponding to the operation position of the display operation unit 101 by the user is input from the display operation unit 101, the operation information transmission unit 121 receives coordinate information corresponding to the operation position in the kana input area 103 from the operation information. And the coordinate information is transmitted to the mobile phone 2.

  The conversion request transmission unit 122 receives the operation information corresponding to the operation position of the display operation unit 101 by the user from the display operation unit 101, and determines that the operation information is a conversion operation by the “conversion” key. It is a processing unit that transmits a character conversion request to the telephone 2.

  In addition, the conversion request transmission unit 122 transmits a determination request to the mobile phone 2 when it is determined that the operation information input from the display operation unit 101 is a determination operation using the right-direction “direction” key. And functions as a search request transmission unit that transmits a search request to the mobile phone 2 when it is determined that the operation information input from the display operation unit 101 is a search operation using the “search” key.

  The image information receiving unit 123 is a processing unit that receives image information from the mobile phone 2 and outputs the image information to the display control unit 111. The display control unit 111 causes the display operation unit 101 to display the image information input from the image information receiving unit 123 as an image.

  The mobile phone 2 includes a display unit 201, a control unit 210, and a communication unit 220. The display unit 201 is configured by a liquid crystal display device, and displays various types of information according to the control of the display control unit 211 described later.

  The control unit 210 has a function of controlling the overall operation of the mobile phone 2 and is configured by an information processing device including a CPU, a ROM, and a RAM (Random Access Memory).

  The control unit 210 includes a display control unit 211, a determination unit 212, an image information extraction unit 213, a conversion unit 214, and various characters (such as kana and kanji) that function when the CPU executes a predetermined cooperative application. And a storage unit 215 that stores dictionary data 216 including image information.

  The display control unit 211 is a processing unit that causes the display unit 201 to display an image including image information of characters corresponding to the determination result of the determination unit 212 and image information of words that have been converted to kana / kanji by the conversion unit 214.

  The determination unit 212 determines characters corresponding to the operation of the kana input area 103 by the user based on the coordinate time information input from the communication unit 220, and the determination result is sent to the display control unit 211 and the image information extraction unit 213. It is a processing part to output.

  When this determination result is input, the display control unit 211 retrieves and reads out the image information of the character corresponding to the determination result of the determination unit 212 from the dictionary data 216 and causes the display unit 201 to display an image including the character. .

  In addition, when a character conversion request or a determination request is input together with coordinate information from the communication unit 220, the determination unit 212 outputs a determination result indicating that to the display control unit 211 and the image information extraction unit 213.

  When a character conversion request is input, the display control unit 211 outputs information indicating a character (word) being displayed on the display unit 210 to the conversion unit 214. When this information is input, the conversion unit 214 performs character conversion.

  The image information extraction unit 213 is a processing unit that extracts a partial image of a predetermined area from the screen being displayed on the display unit 201 and outputs image information corresponding to the image to the communication unit 220.

  The image information extraction unit 213 uses the image information of the communication unit 220 as the image information of the partial image obtained by selectively cutting out the partial image including the character corresponding to the determination result input from the determination unit 212 from the display screen of the display unit 201. The data is output to the transmission unit 222.

  In addition, when the determination result input from the determination unit 212 includes a character conversion request or determination request, the image information extraction unit 213 displays a partial image including characters corresponding to the character conversion request or determination request. The image information of the partial image selectively cut out from the display screen of the unit 201 is output to the image information transmission unit 222 of the communication unit 220.

  When information indicating a character (word) being displayed on the display unit 201 is input from the display control unit 211 to the conversion unit 214, the conversion unit 214 searches the dictionary data 216 for a word having the same sound as the character, and image information of the corresponding character. Is output to the display control unit 211 as a character conversion result candidate. The display control unit 211 causes the display unit 201 to display each candidate character based on the image information input from the conversion unit 214 as a character conversion result candidate.

  The communication unit 220 is a processing unit that transmits and receives various types of information to and from the in-vehicle device 1, and includes an operation information reception unit 221 and an image information transmission unit 222.

  The operation information receiving unit 221 is a processing unit that outputs information such as coordinate information, a character conversion request, a determination request, and a search request received from the mobile phone 2 to the determination unit 212. The image information transmission unit 222 is a processing unit that transmits the image information of the partial image extracted by the image information extraction unit 213 to the mobile phone 2.

  Next, with reference to FIG. 6, the process which the control part 110 of the vehicle-mounted apparatus 1 which concerns on this embodiment performs is demonstrated. FIG. 6 is a flowchart illustrating processing executed by the control unit 110 of the in-vehicle device 1 according to the present embodiment. Here, a process executed by the control unit 110 when the in-vehicle device 1 receives a character conversion screen display request from the mobile phone 2 will be described.

  Upon receiving the character conversion screen display request, the control unit 110 displays the character conversion screen 102 on the display operation unit 101 as shown in FIG. 6 (step S101). A determination is made (step S102).

  When determining that there is no kana input operation (step S102: No), the control unit 110 repeats the determination process of step S102 until there is a kana input operation, and when determining that there is a kana input operation (step S102: Yes), the coordinate information of the position corresponding to the kana input operation in the kana input area 103 is transmitted from the communication unit 120 to the mobile phone 2 (step S103).

  Subsequently, the control unit 110 determines whether or not image information has been received from the mobile phone 2 (step S104). When it is determined that image information has not been received (step S104: No), the image information is received. The determination process in step S104 is repeated until

  On the other hand, when it is determined that the image information has been received (step S104: Yes), the control unit 110 performs input character display for displaying characters based on the received image information in the character display area 104 (step S105). It is determined whether or not the user has performed a conversion operation on the “conversion” key (step S106).

  If the control unit 110 determines that a conversion operation has been performed (step S106: Yes), the control unit 110 transmits a character conversion request from the communication unit 120 to the mobile phone 2 (step S107), and then the process proceeds to step S104. Move.

  On the other hand, when determining that the conversion operation has not been performed (step S106: No), the control unit 110 determines whether or not the user has determined the “direction” key (step S108), and determines that there has been no determination operation. If so (step S108: No), the process proceeds to step S106.

  In addition, when it is determined that the determination operation has been performed (step S108: Yes), the control unit 110 transmits a determination request from the communication unit 120 to the mobile phone 2 (step S109), and then the “search” key by the user It is determined whether or not there has been a search operation (step S110).

  Then, when it is determined that there is no search operation (step S110: No), the control unit 110 moves the process to step S102. A search request is transmitted to the telephone 2 (step S111), and then the process ends.

  Next, processing executed by the control unit 210 of the mobile phone 2 according to the present embodiment will be described with reference to FIG. FIG. 7 is a flowchart showing processing executed by the control unit 210 of the mobile phone 2 according to the present embodiment. Here, a process executed by the control unit 210 when a screen for allowing the user to input characters is displayed on the mobile phone 2 will be described.

  When the screen for allowing the user to input characters is displayed on the display unit 201, the control unit 210 transmits a character conversion screen display request from the communication unit 220 to the in-vehicle device 1 (see FIG. 7) ( Thereafter, it is determined whether or not the communication unit 220 has received coordinate information from the in-vehicle device 1 (step S202).

  And when it judges with control part 210 not receiving coordinate information (Step S202: No), it repeats the judgment processing of Step S202 until it receives coordinate information, and when it judges with having received coordinate information (Step S202) S202: Yes), a character corresponding to the received coordinate information is determined (step S203).

  Subsequently, the control unit 210 causes the display unit 201 to display a screen including the character determined in step S203, and extracts image information of the image of the character part determined in step S203 from the screen (step S204).

  Thereafter, the control unit 210 causes the image information extracted in step S204 to be transmitted from the communication unit 220 to the in-vehicle device 1 (step S205), and the process proceeds to step S206.

  In step S206, the control unit 210 determines whether or not a character conversion request has been received from the in-vehicle device 1. If it is determined that a character conversion request has been received (step S206: Yes), the process proceeds to step S207. If it is determined that the character conversion request has not been received (step S206: No), the process proceeds to step S202.

  In step S207, the control unit 210 converts the characters displayed on the display unit 201, displays the candidate characters obtained as a result on the display unit 201, and among the candidates obtained as a result of the character conversion. Then, “1” is assigned to the variable N indicating the candidate number to be transmitted to the in-vehicle device 1 (step S207), and then the process proceeds to step S208.

  In step S <b> 208, the control unit 210 extracts image information of the Nth candidate character among candidates displayed on the display unit 201. Thereafter, the control unit 210 causes the image information of the Nth candidate character extracted in step S208 to be transmitted from the communication unit 220 to the in-vehicle device 1 (step S209).

  Subsequently, the control unit 210 determines whether or not a determination request has been received from the in-vehicle device 1 (step S210). If it is determined that the determination request has been received (step S210: Yes), the process proceeds to step S211. Move. On the other hand, when it is determined that the determination request has not been received (step S210: No), the control unit 210 moves the process to step S215.

  In step S215, the control unit 210 determines whether or not a character conversion request has been received from the in-vehicle device 1 again. If it is determined that the character conversion request has not been received (step S215: No), the process is performed. Move to S210.

  On the other hand, when it is determined that the character conversion request has been received (step S215: Yes), the control unit 210 adds “1” to the variable N indicating the candidate number to be transmitted to the in-vehicle device 1 (step S216). The process moves to step S210.

  In step S211, the control unit 210 extracts image information of characters (decision characters) corresponding to the determination request, and then transmits the image information extracted in step S211 from the communication unit 220 to the in-vehicle device 1. (Step S212).

  Subsequently, the control unit 210 determines whether or not a search request has been received from the in-vehicle device 1 (step S213). If it is determined that the search request has been received (step S213: Yes), the process proceeds to step S214. Move. On the other hand, if it is determined that the search request has not been received (step S213: No), the process proceeds to step S202.

  In step S214, the control unit 210 performs a search process using characters corresponding to the search request as keywords. At this time, if the navigation function is being executed, the control unit 210 executes a predetermined application to perform a destination search by the navigation function, and if the Internet connection function is being executed, the control unit 210 executes the predetermined application. Perform a keyword search.

  In the above-described in-vehicle display system S, when a user inputs characters by operating the display operation unit 101 of the in-vehicle device 1, coordinate information corresponding to the operation position in the kana input area 103 is transmitted from the in-vehicle device 1 to the mobile phone 2. However, instead of the coordinate information, a character code assigned to each character stored in the mobile phone 2 may be transmitted. Further, when the user inputs characters by operating the display operation unit 101 of the in-vehicle device 1, the character information is assigned to the coordinate information corresponding to the operation position in the kana input area 103 or each character stored in the mobile phone 2. Any one of the character codes may be transmitted to the mobile phone 2.

  When the character code assigned to each character stored in the mobile phone 2 is transmitted to the mobile phone 2, the character code associated with each character stored in the dictionary data in advance in the determination unit 212 of the mobile phone 2 The character code is stored, and the same character code as that stored in the determination unit 212 of the mobile phone 2 is stored on the in-vehicle device 1 side.

  When the user inputs characters by operating the display operation unit 101 of the in-vehicle device 1, the character code corresponding to the operation position in the kana input area 103 is transmitted from the in-vehicle device 1 to the mobile phone 2.

  The determination unit 212 of the mobile phone 2 determines the character input by the user by collating the character code received from the in-vehicle device 1 with the character code stored in advance.

  After that, the mobile phone 2 transmits image information corresponding to the character determined by the determination unit 212 to the in-vehicle device 1 in the same manner as the above-described in-vehicle display system S, so that a predetermined operation in the display operation unit 101 of the in-vehicle device 1 occurs. The character is displayed in the character display area 104.

  With this configuration, the determination unit 212 of the mobile phone 2 can determine the character input by the user with higher accuracy than when determining the character based on the coordinate information.

  Next, a modification of the in-vehicle display system S will be described with reference to FIG. FIG. 8 is a functional block diagram illustrating configurations of the in-vehicle device and the mobile phone according to the modification.

  As shown in FIG. 8, the in-vehicle device 1a according to the modification includes a display operation unit 101a, a control unit 110a, and a communication unit 120a, as in the in-vehicle device 1 shown in FIG. The information stored in the storage unit 112a and the content of information transmitted and received by the communication unit 120a between the mobile phone 2a and the vehicle-mounted device 1 are different.

  Here, regarding the in-vehicle device 1a according to this modification, the configuration requirements and operations different from the in-vehicle device 1 shown in FIG. 5 will be described, and the same configuration requirements and operations as the in-vehicle device 1 shown in FIG. The description is omitted.

  The control part 110a of the vehicle-mounted apparatus 1a which concerns on this modification is provided with the display control part 111a and the memory | storage part 112a. The storage unit 112a stores kana dictionary data 114a in addition to screen information (character conversion screen information 113a) for displaying the character conversion screen 102. In the kana dictionary data 114a, image information of each character displayed on the character conversion screen 102 is stored.

  When the user operates the kana input area 103 to input a character string, the display control unit 111a reads the image information of the character string corresponding to the operation from the kana dictionary data 114a and displays it on the display operation unit 101a.

  The communication control unit 120a includes an operation information transmission unit 121a, a conversion request transmission unit 122a, and an image information reception unit 123a.

  The operation information transmission unit 121a transmits image information of the input character string to the mobile phone 2a when the “conversion” key is operated after the character string is input by the user. In the mobile phone 2a, the character input by the user is determined based on the character string.

  The conversion request transmission unit 122a transmits a character conversion request to the mobile phone 2a based on the operation of the “conversion” key by the user. The image information receiving unit 123a receives image information transmitted from the mobile phone 2a and outputs the image information to the display control unit 111a. The display control unit 111a causes the display operation unit 101a to display the image information input from the image information receiving unit 123a.

  As described above, when the user performs a character input operation, the in-vehicle device 1a according to the present modification displays the character image information read from the kana dictionary data 114a on the display operation unit 101a, and the user displays the character. When the “conversion” key is operated after confirmation, character image information is transmitted to the mobile phone 2a.

  Therefore, when the user inputs an incorrect character, the character can be corrected before transmitting the character image information to the mobile phone 2a, so that the in-vehicle device 1a and the mobile phone 2a can be corrected. Thus, it is possible to prevent unnecessary transmission / reception of information.

  In addition, the mobile phone 2a according to this modification includes a display unit 201a, a control unit 210a, and a communication unit 220a, similarly to the mobile phone 2 shown in FIG. Similarly, the control unit 210a includes a display control unit 211a, a determination unit 212a, an image information extraction unit 213a, a conversion unit 214a, and a storage unit 215a. Note that dictionary data 216a is stored in the storage unit 215a. The communication unit 220a includes an operation information receiving unit 221a and an image information transmitting unit 222a.

  As described above, the cellular phone 2a according to the present modified example has the same configuration requirements as the cellular phone 2 shown in FIG. 5 with respect to the configuration requirements. Since the image information is received in units of character strings (for example, words), the number of times the image information is received from the in-vehicle device 1a can be kept low, and accordingly, the number of character discrimination processes by the discrimination unit 212a is also kept low. Can do.

  In the present modification, the in-car device 1a is configured to store the kana dictionary data 114a. However, in place of the kana dictionary data 114a, dictionary data including image information related to characters other than kana such as kanji characters, like the mobile phone 215a. And a conversion unit for performing kana-kanji conversion may be provided.

  In the case where the in-vehicle device 1a is configured as described above, the in-vehicle device 1a converts the character input by the user into a kana / kanji character and displays it in the character display area 104 of the display operation unit 101a, and causes the user to convert the character string after the kana / kanji conversion. After confirming (word), when the “OK” key is operated, image information of kanji is transmitted to the mobile phone 2a.

  Then, the mobile phone 2a determines a Chinese character input by the user based on the image information received from the in-vehicle device 1a, and executes various searches using the Chinese character as a keyword.

  With this configuration, even when it is necessary to convert a character string input with a kana multiple times, it is not necessary to transmit and receive image information between the in-vehicle device 1a and the mobile phone 2a every time character conversion is performed. The processing load related to transmission / reception of image information can be reduced.

  Moreover, according to the vehicle-mounted display system S according to the present embodiment, in addition to the navigation function and the Internet connection function of the mobile phone 2 on the vehicle-mounted device 1 side, an email function and a telephone directory function can also be used. The display operation unit 101 can be operated to create an e-mail, edit a phone book, and the like.

It is explanatory drawing which shows the outline | summary of the vehicle-mounted display system which concerns on this embodiment. It is explanatory drawing which shows the predetermined character conversion screen in this embodiment. It is a sequence diagram which shows cooperation operation | movement with a vehicle-mounted apparatus and a mobile telephone. It is a sequence diagram which shows cooperation operation | movement with a vehicle-mounted apparatus and a mobile telephone. It is a functional block diagram which shows the structure of the vehicle-mounted apparatus 1 and the mobile telephone 2 which concern on this embodiment. It is a flowchart which shows the process which the control part of the vehicle equipment which concerns on this embodiment performs. It is a flowchart which shows the process which the control part of the mobile telephone which concerns on this embodiment performs. It is a functional block diagram which shows the structure of the vehicle-mounted apparatus and mobile telephone in a modification.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 In-vehicle apparatus 101 Display operation part 102 Character conversion screen 103 Kana input area 104 Character display area 110 Control part 111 Display control part 112 Storage part 113 Character conversion screen information 120 Communication part 121 Operation information transmission part 122 Conversion request transmission part 123 Image information Reception unit 2 Mobile phone 201 Display unit 210 Control unit 211 Display control unit 212 Discrimination unit 213 Image information extraction unit 214 Conversion unit 215 Storage unit 216 Dictionary data 220 Communication unit 221 Operation information reception unit 222 Image information transmission unit

Claims (5)

An in-vehicle display system comprising a mobile terminal device having a dictionary function and a character conversion function, and an in-vehicle device that displays an image displayed on a display unit of the mobile terminal device,
The in-vehicle device is
Display operation means having a touch panel function capable of displaying a predetermined character conversion screen in which a kana input area and a character display area are defined;
Operation information transmitting means for transmitting operation information corresponding to the operation position of the kana input area to the portable terminal device;
Image information receiving means for receiving character image information corresponding to the operation information from the portable terminal device;
Display control means for displaying the image information received by the image information receiving means in the character display area,
The portable terminal device
Operation information receiving means for receiving the operation information from the in-vehicle device;
Determining means for determining a character corresponding to the operation information received by the operation information receiving means;
Image information extraction means for extracting image information of characters determined by the determination means from image information displayed on the display unit;
An in-vehicle display system comprising: image information transmitting means for transmitting image information extracted by the image information extracting means to the in-vehicle device.   The in-vehicle display according to claim 1, wherein the operation information is coordinate information corresponding to an operation position in the kana input area or a character code assigned to each character stored in the portable terminal device. system. The operation information transmitting means transmits an operation information sequence corresponding to the operation position of the kana input area that has been continuously operated to the portable terminal device,
The determination means determines a word corresponding to the operation information sequence by a dictionary function,
The in-vehicle display system according to claim 1, wherein the image information extraction unit extracts image information of a word determined by the determination unit from image information displayed on the display unit. The in-vehicle device is
Conversion request transmitting means for transmitting a character conversion request for characters corresponding to the image information received by the image information receiving means to the portable terminal device;
The portable terminal device
A conversion means for converting a character corresponding to the character conversion request when the character conversion request is received;
The in-vehicle display according to any one of claims 1 to 3, wherein the image information extraction unit extracts image information of characters converted by the conversion unit from image information displayed on the display unit. system. An in-vehicle device that displays an image displayed on a display unit of a mobile terminal device having a dictionary function and a character conversion function,
The in-vehicle device is
Display operation means having a touch panel function capable of displaying a predetermined character conversion screen in which a kana input area and a character display area are defined;
Operation information transmitting means for transmitting operation information corresponding to the operation position of the kana input area to the portable terminal device;
Image information receiving means for receiving character image information corresponding to the operation information from the portable terminal device;
A vehicle-mounted apparatus comprising: display control means for displaying image information received by the image information receiving means in the character display area.

Images