JP2010272930A - Portable communication terminal, input/output device communicating with this, system equipped with these, and program corresponding to remote control of portable communication terminal - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To operate an action of a portable phone installed with a program dedicated to the portable phone by an input/output device. <P>SOLUTION: A processing part 220 corresponding to remote control for the portable phone 200, transmits code information to the input/output device 100 (S5), and makes it create a conversion table which converts the input/output device code to a portable phone code (S6). If a navigation processing part 230 of the portable phone 200 displays drawing data (S13), the processing part 220 corresponding to the remote control obtains the drawing data, and transmits to the input/output device 100 (S14, 16). The input/output device 100 displays the drawing data (S17), and if some signal is input (S18), the device converts the input code to the portable phone code referring the conversion table (S19), and transmits the portable phone code to the processing part 220 corresponding to the remote control (S21). The processing part 220 corresponding to the remote control delivers the portable phone code to a navigation processing part 230 (S22). <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to a technique for using an application service executed on a mobile communication terminal using an input / output device capable of communicating with the mobile communication terminal.

  In recent years, mobile phones equipped with GPS (Global Positioning System) receivers have become widespread and it has become possible to acquire their own location information. Along with this, there is provided a navigation service that displays a map of the vicinity of the current location on the mobile phone while displaying its location information from the mobile phone and also displays a route to the destination. Mobile phone navigation services are not limited to walking navigation and car navigation, but include the shortest distance route, the fastest route, the eco route, and transfer guidance from all door-to-door routes according to the timetable and operation status of trains and airplanes. Multimodalization for calculating a route that matches a user's request is progressing. In addition, mobile phone navigation services have become widely used because of their high convenience, such as the latest maps being always available and new services being provided one after another. However, the operation of a mobile phone while driving is prohibited due to the revision of the Road Traffic Law, and the driver cannot use the car navigation service of the mobile phone. Furthermore, since the mobile phone has a small screen size, it is difficult for the driver to grasp information displayed on the mobile phone.

  On the other hand, in-car car navigation devices are struggling with telematics services, and many users use car navigation services standalone. This in-vehicle car navigation system has no inconvenience as in the case of receiving a navigation service with a mobile phone, but if the price is as high as more than several hundred thousand yen and it is used as a stand-alone, a map or service The function cannot be updated.

  Therefore, Patent Document 1 discloses a technique for connecting an external input / output unit to a mobile phone with a GPS function and operating the mobile phone with the external input / output unit.

  In this technology, image data including map information received from the outside and route information to the destination is passed to the external input / output unit so that the external input / output unit can view these images. Yes. In this technique, an instruction to the navigation service is made possible by operating an operation key of the external input / output unit.

JP 2008-3093 A

  However, in the technique described in Patent Document 1, the navigation program installed in the mobile phone is a specific external device because the mobile phone needs to understand an instruction from the external input / output unit. The program is premised on being connected to the input / output unit, and there is a problem that a program dedicated to a mobile phone cannot be used.

  The present invention pays attention to such problems of the prior art, and enables an input / output device to operate an operation of a mobile communication terminal even when a program dedicated to the mobile communication terminal is operated on the mobile communication terminal. Objective.

In order to solve the above problems,
The first communication means a that communicates using the cellular phone communication network, the second communication means a of a communication method different from the first communication means a, the display means a, the input means a, and the predetermined information An application processing unit that performs processing including processing to be displayed on the unit, and an input control unit that receives a code indicating the operation content of the input unit a and passes the code to the application processing unit. The invention which concerns on the 1st and 2nd portable communication terminal which performs the process of is provided.

The first mobile communication terminal
For an input / output device comprising a communication means b capable of communicating with the second communication means a, a display means b, and an input means b, a code for each operation of the input / output means a, a plurality of For each code, the second communication means a transmits code information having correspondence information for associating the code with any of the codes for various operations of the input means b of the input / output device. ,
The display on the display means a by the application processing unit is monitored, and when the display of the drawing data on the display means a by the application processing unit is detected, the drawing data is acquired,
The drawing data is transmitted by the second communication means a,
The position at which the operation indicated by the code is performed in the image displayed by the display means b of the input / output device and any code in the code information from the input / output device by the second communication means When the position information indicating is received, the code and the position information are passed to the input control means.
It is characterized by that.

The second mobile communication terminal is
From an input / output device comprising a communication means b capable of communicating with the second communication means a, a display means b, and an input means b, a code for each operation of the input means b and a plurality of codes Code information having correspondence information for associating the code with any one of codes for various operations of the input means a of the portable communication terminal, and transmitting the code information to the second communication means When a receives, the code information is stored in the storage means,
The display on the display means a by the application processing unit is monitored, and when the display of the drawing data on the display means a by the application processing unit is detected, the drawing data is acquired,
The drawing data is transmitted by the second communication means a,
By the second communication means, the code indicating the operation content of the input means b from the input / output device and the operation indicated by the code in the image displayed by the display means b of the input / output device are performed. When position information indicating a position is received, the code from the input / output device is converted into the code of the input means a with reference to the code information,
Passing the position information received by the second communication means and the code converted by the code conversion means to the input control means;
It is characterized by that.

In order to solve the above problems,
The communication means b, the display means b, the input means b, and the memory | storage means b which can communicate with a portable communication terminal are communicated with this portable communication terminal by this communication means b, and the process in this portable communication terminal And an input / output device that executes the following processing.

This I / O device
From a mobile communication terminal provided with communication means a, display means a, and input means a capable of communicating with the communication means b, a code for each operation of the input means a of the mobile communication terminal, and a plurality of codes Code information having correspondence information for associating the code with any one of the codes for the various operations of the input unit b of the input / output device, and the communication unit b When received, the code information is stored in the storage means b,
When the communication means b receives drawing data from the mobile communication terminal, the display means b displays the drawing data,
When an operation area exists in the image indicated by the drawing data, a predetermined operation by the input unit b is performed on the operation area, and the code indicating the predetermined operation and the predetermined operation are When the position information in the image is obtained, the code information is referred to, the code is converted into the code of the input means a, and the position information and the converted code are converted into the communication means b. To transmit to the mobile communication terminal,
It is characterized by that.

  In the present invention, one of the mobile communication terminal and the input / output device sends code information to the other, and on the other hand, the code used on the other is converted into one code based on the code information. Therefore, even when a program dedicated to the mobile communication terminal is operated on the mobile communication terminal, the operation of the mobile communication terminal can be operated from the input / output device.

It is a lineblock diagram of a car navigation system in one embodiment concerning the present invention. It is a block diagram of the mobile telephone in one Embodiment which concerns on this invention. It is a lineblock diagram of an in-vehicle input / output device in one embodiment concerning the present invention. It is a block diagram of the service provision server in one Embodiment which concerns on this invention. It is explanatory drawing which shows the data structure of the code table of the mobile telephone in one Embodiment which concerns on this invention. It is explanatory drawing which shows the data structure of the code table of the input / output device in one Embodiment which concerns on this invention. It is a sequence diagram which shows operation | movement of the car navigation system in one Embodiment which concerns on this invention. It is a flowchart which shows operation | movement of the input / output device in one Embodiment which concerns on this invention. It is a flowchart which shows operation | movement of the processing part corresponding to the remote operation of the mobile telephone in one Embodiment which concerns on this invention. It is a flowchart which shows operation | movement of the car navigation processing part of the mobile telephone in one Embodiment which concerns on this invention. It is a flowchart which shows operation | movement of the service provision server in one Embodiment which concerns on this invention. It is explanatory drawing (the 1) which shows the data structure of the message transmitted / received between the mobile telephone and input / output device in one Embodiment which concerns on this invention. It is explanatory drawing (the 2) which shows the data structure of the message transmitted / received between the mobile telephone and input / output device in one Embodiment which concerns on this invention. It is explanatory drawing which shows the data structure of the message transmitted / received between the mobile telephone and service provision server in one Embodiment which concerns on this invention. It is explanatory drawing which shows the conversion method which converts the code | symbol in the input / output device in one Embodiment which concerns on this invention into the code | symbol in a mobile telephone. It is explanatory drawing (the 1) which shows the relationship between the display form in the mobile telephone in one Embodiment which concerns on this invention, and the display form in an input / output device. It is explanatory drawing (the 1) which shows the relationship between the display form in the mobile telephone in one Embodiment which concerns on this invention, and the display form in an input / output device.

  Hereinafter, an embodiment of an application processing system according to the present invention will be described with reference to the drawings.

  The target application program in the present embodiment is a car navigation program. Therefore, the application processing system of this embodiment is a car navigation system.

  As shown in FIG. 1, the car navigation system of the present embodiment includes an in-vehicle input / output device 100 mounted on a vehicle, a mobile phone 200 that transmits map information and the like to the in-vehicle input / output device 100, And a mobile phone service providing server 300 (hereinafter simply referred to as a service providing server) that provides a navigation service to the mobile phone 100.

  The in-vehicle input / output device 100 and the mobile phone 200 communicate with each other by, for example, short-range wireless communication such as WiFi and Bluetooth, or USB (Universal Serial Bus) standard cable. In the following, it is assumed that wireless communication by Bluetooth is performed between the in-vehicle input / output device 100 and the mobile phone 200. The mobile phone 200 and the service providing server 300 communicate with each other via the mobile phone communication network N.

  As shown in FIG. 2, the mobile phone 200 includes a processor 210 that executes various arithmetic processes, a main memory 201 that serves as a work area for the processor 210, a plurality of input keys 202, a liquid crystal display 203, and a microphone 204. Wireless communication using Bluetooth, speaker 205, mobile phone communication interface 206 for communicating with the other party via mobile phone communication network N, and GPS receiver 208 for receiving GPS (Global Positioning System) signals. A Bluetooth interface 207, a non-volatile memory 240 as a storage device storing various programs and the like, and an internal bus 209 connecting these to each other are provided. Here, an example in which one processor is used is shown, but the number of processors is not necessarily one. For example, in order to realize a main function for causing the mobile phone 200 to function as a mobile phone. In addition to the processor, a processor as a graphic controller for displaying drawing data on a display may be provided.

  The non-volatile memory 240 has a common platform program 241 for causing the mobile phone 200 to perform basic operations as a mobile phone, and a remote operation for dealing with the remote operation of the mobile phone 200 by the in-vehicle input / output device 100. Corresponding program 242, a car navigation program 243 for causing the mobile phone 200 to function as a car navigation device, a code table 244 indicating the codes of the plurality of input keys 202 of the mobile phone 200, and other address books, etc. Various files are stored. The remote operation support program 242 is located above the common platform program 241 and below the car navigation program 243. The common platform program 241 and the code table 244 are stored in the nonvolatile memory 240 in advance, and the remote operation compatible program 242 and the car navigation program 242 are transmitted by the user of the mobile phone 200 via the mobile phone communication network N. Downloaded from outside. However, the remote operation compatible program 242 and the car navigation program 242 may be stored in the nonvolatile memory 240 in advance.

  The processor 210 executes the common platform program 241, the remote operation support program 242, and the car navigation program 243 stored in the nonvolatile memory 240, thereby executing the common platform unit 211, the remote operation support processing unit 220, and the car navigation processing unit. (Application processing unit) 230 functions.

  The common platform unit 211 controls the cellular phone communication interface 206 and the Bluetooth interface 207, and uses them to execute communication processing with the outside, and an input controller that manages key input by the plurality of input keys 202 (Input control means) 213, an LCD driver 214 that controls display on the liquid crystal display 203, and a file management unit 215 that manages various files stored in the nonvolatile memory 240.

  The remote operation support processing unit 220 monitors the reception of network data by the network driver 212. When the network data is received, a network data reception handler 221 for passing the network data to a network data analysis processing unit 222, which will be described later, and the network A network data analysis processing unit 222 that analyzes network data from the data reception handler 221 and a network data generation unit that generates network data transmitted by the network driver 212 (connection request transmission processing unit, code information transmission processing unit, drawing data transmission) Processing means, data generation means) 223, and a network data transmission handler (connection request transmission means, coprocessor) for passing the network data generated by the network data generation unit 223 to the network driver 212. Transmission information transmission processing means, drawing data transmission processing means) 224, a drawing handler (code delivery means) 225 that monitors drawing data output from the car navigation processing unit 230 to the LCD driver 203 and captures the drawing data, The drawing data captured by the drawing handler 225 is analyzed to determine whether or not the drawing data is character input screen data, and the vehicle data received from the network data analysis processing unit 222. And an input key handler 227 for passing received data from the input / output device 100 to the input controller 213. In addition to the above functional units 221 to 227, the remote operation support processing unit 220 monitors the input to the input controller 213, and the input from the input handler 225 and the input from the input key 202 overlap. In this case, an input key priority processing unit 228 that prioritizes input from either one and outputs from the input controller 201 may be provided.

  As shown in FIG. 5, the code table 244 stored in the non-volatile memory 240 includes a first key code table 244A in which key codes for each of the plurality of input keys 202 are stored, and a predetermined number of times for a plurality of numeric keys. And a second key code table 244B in which meanings and key codes associated with operations are stored.

  The first key code table 244A includes a number area 244Aa in which code numbers are stored, a key type area 244Ac in which key types are stored, and a code area 244Ae in which key codes of keys of the key types are stored. ,have.

  For example, as shown in FIGS. 5 and 17, the key code for the center key 202a among the plurality of input keys 202 is “0x0000”, and the key code for the numeric keypad “1” 202b is “0x1001”.

  The second key code table 244B includes a number area 244Ba in which code numbers are stored, a key type area 244Bc in which key types are stored, and a number area 244Bd in which the number of key operations for the key type is stored. , A code area 244Be in which the key code is stored and a semantic area 244Bb in which the meaning of the key code is stored.

  For example, as shown in FIG. 5 and FIG. 17, the key code for a single operation of the numeric keypad “1” 202b among the plurality of input keys 202 is “0x1001”, and the meaning is “A”. The key code in the case of two operations of “1” 202b is “0x1001.2”, and its meaning is “yes”.

  As shown in FIG. 3, the in-vehicle input / output device 100 includes a processor 110 that executes various arithmetic processes, a main memory 101 that serves as a work area of the processor 110, a plurality of input keys 102, and inputs and outputs. Touch panel display 103 that also serves as a microphone, a speaker 104, a Bluetooth interface 107 that performs wireless communication by Bluetooth, a non-volatile memory 140 that stores various programs, and an internal bus that interconnects them 109. Here, an example in which one processor is used is shown, but the number of processors is not necessarily one.

  As shown in FIG. 17, the input keys 102 include a move key 102b for moving a cursor displayed on the touch panel display 103, an enter key 102a for instructing determination, etc. There is no key. This is because a soft keyboard 1035 for inputting characters is displayed on the touch panel display 103, and characters can be input using the soft keyboard 1035.

  As shown in FIG. 17, the screen of the touch panel display 103 is horizontally long and has a larger display area than the vertically long screen of the liquid crystal display 203 of the mobile phone 200.

  The non-volatile memory 140 includes a common platform program 141 for causing the input / output device 100 to perform basic operations as an input / output device, a remote operation program 142 for remotely controlling processing in the mobile phone 200, A plurality of input keys 102 of the input / output device 100 and a code table 144 indicating codes of the soft keyboard displayed on the touch panel display 103 are stored. The common platform program 141 and the code table 144 are stored in the nonvolatile memory 140 in advance, and the remote operation program 142 is transmitted by the user of the mobile phone 200 via the mobile phone communication network N and Bluetooth wireless communication. It was downloaded from the outside. However, the remote operation program 142 may be stored in the nonvolatile memory 140 in advance. The nonvolatile memory 140 stores mobile phone code information 244a in a code table 244 owned by the mobile phone 200 by Bluetooth wireless communication with the mobile phone 200, as will be described later. Further, a code conversion table 145 for converting a code indicated by the input / output device code table 144 into a code indicated by the mobile phone code table 244 is also stored.

  The processor 110 functions as the common platform unit 111 and the remote operation processing unit 120 by executing the common platform program 141 and the remote operation program 142 stored in the nonvolatile memory 140.

  The common platform unit 111 includes a network data receiving unit 112 that receives data received by the Bluetooth interface 107, a network data analysis processing unit 113 that analyzes the data received by the network data receiving unit 112, and a display on the touch panel display 118. An LCD driver 114 that controls the network, a network data generation unit 115 that generates network data, a network data transmission unit 116 that transmits network data from the Bluetooth interface 107, and a key handler 117 that receives input from the input key 102 or the soft keyboard. And an input key analysis processing unit 118 for analyzing the input contents passed from the key handler 117.

  The remote operation processing unit 120 includes a BT connection processing unit 121 that executes connection control of wireless communication by Bluetooth with the mobile phone 200 using the activation of the input / output device 100 as a trigger, and the input / output device 100 and the mobile phone. Drawing data for analyzing drawing data sent from the mobile phone 200 via a code management unit (code information management means) 122 for managing 200 codes, a network data receiving unit 112, and a network data analysis processing unit 113 An analysis processing unit (display control unit) 123, a drawing data generation processing unit (display control unit) 124 that generates drawing data of a soft keyboard, and an input key code passed from the input key analysis processing unit 118 are transmitted to the mobile phone. An input handling unit 125 that converts the code into a code of 200 and passes it to the network data generation unit 115; It has.

  As shown in FIG. 6, the code table 144 stored in the non-volatile memory 140 includes a key code table 144A storing key codes for each of the plurality of input keys 102, the meaning of each key on the soft keyboard, And a soft key code table 144B in which key codes are stored.

  The key code table 144A includes a number area 144Aa in which a code number is stored, a key type area 144Ac in which a key type is stored, and a code area 144Ae in which a key code of a key of the key type is stored. Have.

  For example, as shown in FIGS. 6 and 17, the key code for the enter key 102a among the plurality of input keys 102 is “0000”, and the key code for the cursor up key 102b is “0001”. Also, the key code for the enter key 1035a among the keys in the soft keyboard 1035 shown in FIG. 17 is the same “0000” as the key code for the hard enter key 102a. The key code for 1035b is also “0001”, which is the same as the key code for the hard cursor up key 102b.

  The soft key code table 144B includes a number area 144Ba in which a code number is stored, a key type area 144Bc in which a key type is stored, a number area 144Bd in which the number of operations of a key of the key type is stored, It has a code area 144Be in which a key code is stored and a semantic area 144Bb in which the meaning of the key code is stored.

  For example, as shown in FIG. 5 and FIG. 17, among the keys in the soft keyboard 1035, the key code for the single operation of the “A” key 1035c is “1001”, and the meaning thereof is “A”. The key code in the case of two operations of the “A” key 1035c is “1002”, and its meaning is “Yes”.

  As shown in FIG. 15, the code conversion table 145 stored in the non-volatile memory 140 by the processing of the code information management unit 122 stores a conversion number area 145a for storing a conversion number and a mobile phone key code. Mobile phone code area 145b and an input / output device code area 145c in which an input / output device key code is stored.

  In the conversion table 145, the mobile phone code and the input / output device code corresponding to a certain conversion number are codes indicating the same meaning. For example, the mobile phone key code “0x0000” with the conversion number “0” and the input / output device key code “0000” with the conversion number “0” are both codes indicating enter, OK, or selection.

  As shown in FIG. 4, the service providing server 300 includes a processor 310 that executes various arithmetic processes, a main memory 301 that becomes a work area of the processor 310, an input device 302 such as a keyboard and a mouse, a display, a printer, and the like. And the like, the network interface 306 that communicates with the mobile phone 200 or the like via the mobile phone communication network N, and the hard disk drive device 340 as a storage device that stores various programs and the like are connected to each other. An internal bus 309. Here, an example in which one processor is used is shown, but the number of processors is not necessarily one.

  The hard disk drive 340 obtains the common platform program 341 for causing the service providing server 300 to perform basic operations as the service providing server and the location information of the mobile phone itself from the mobile phone 200, and A navigation program 342 for navigating to a destination, a configuration information table (not shown) of a mobile phone receiving a service from the service providing server 300, map information (not shown), POI (Point Of Interest) information and the like are stored.

  The processor 310 functions as the common platform unit 311 and the navigation processing unit 320 by executing the common platform program 341 and the navigation program 342 stored in the hard disk drive device 340.

  The common platform unit 311 includes a data receiving unit 312 that receives data received by the network interface 306, a data analysis processing unit 313 that analyzes data received by the data receiving unit 312, and a map generated by the navigation processing unit 320. The data generation unit 315 that processes information or the like into a format according to the transmission format, the data transmission unit 316 that transmits the data generated by the data generation unit 315 from the network interface 306, and the mobile phone 100 using the configuration information table A terminal configuration management unit 317 that manages configuration information and status information; an input controller (not shown) that controls input from the input device 302; and an output device driver (not shown) that controls the output device 303. ,have.

  The navigation processing unit 320 includes a walking mode 321 that performs navigation when walking, a car mode 322 that performs navigation when riding a car, and a railroad mode 323 that performs navigation when a public transportation vehicle such as a railroad, a subway, or a bus rides. And a multimodal cooperation processing unit 324 that adjusts each mode and comprehensively determines a route and the like in consideration of a transportation means to the destination. In addition, since this embodiment is related with the navigation at the time of boarding a car, if the navigation process part 320 has only the car mode 322, there will be no inconvenience.

  Next, the operation of the navigation system of the present embodiment will be described according to the sequence diagram shown in FIG.

  When the power switch 102c (FIG. 17) of the input / output device 100 is turned on (S1), the power is turned on and the common platform unit 111 and the remote operation processing unit 120 are activated. Then, the remote operation processing unit 120 of the input / output device 100 sends a car navigation service connection request to the mobile phone 200 via the Bluetooth interface 107 (S2). At this time, when the mobile phone 200 is turned on and the common platform unit 211 and the remote operation support processing unit 220 of the mobile phone 200 are activated, the remote operation support processing unit 220 is connected to the Bluetooth of the mobile phone 200. The car navigation service connection request is received via the interface 207, a start instruction is output to the car navigation processing unit 230 (S7), and a connection response is transmitted to the input / output device 100 via the Bluetooth interface 207. (S3). When receiving the connection response, the input / output device 100 requests mobile phone code information (S4). When receiving this request, the remote operation handling processing unit 220 of the mobile phone 200 receives the mobile phone code information, which is data in the mobile phone code table 244 (FIG. 5) stored in the nonvolatile memory 240. (S5). Specifically, the mobile phone code information is a combination of each code in the code areas 244Ae and 244Be in the mobile phone code tables 244A and 244B shown in FIG. 5 and a code number predetermined for each code. . When the input / output device 100 receives the mobile phone code information 244a, the input / output device 100 stores it in the nonvolatile memory 140, and then compares each code in the input / output device code table 144 with the code of the input / output device code table 144. A code conversion table 145 (FIG. 15) is created from the correspondence with each code in the mobile phone code information 244a (S6).

  On the other hand, the car navigation processing unit 230 of the mobile phone 200 receives the start instruction from the remote operation support processing unit 220 of the mobile phone 200 (S7) and starts up (S8). The car navigation processing unit 230 transmits a connection request for receiving the car navigation service to the service providing server 300 via the mobile phone communication interface 206 (S9).

  Upon receiving this connection request, the service providing server 300 secures resources for providing the car navigation service to the requesting mobile phone 200 (S10), and returns a connection response to the mobile phone 200 ( S11).

  Subsequently, the service providing server 300 creates drawing data such as a destination designation request and sends the drawing data to the mobile phone 200 (S12). The car navigation processing unit 230 of the mobile phone 200 passes the drawing data to the LCD driver 214 and displays it on the liquid crystal display 203 (S13). The remote operation support processing unit 220 monitors drawing data input to the LCD driver 214. When drawing data is input to the LCD driver 214, the remote operation corresponding processing unit 220 acquires the drawing data (S14), and characters are included in the drawing data. It is determined whether or not an input area exists (S15). When the character input area exists, the remote operation support processing unit 220 sends a message to the input / output device 100 together with the drawing data that the character input area exists (S16).

  When the input / output device 100 receives a message indicating that there is a character input area together with the drawing data, the input / output device 100 displays a soft keyboard 1035 (FIG. 17) on the touch panel display 103 together with the drawing data (S17). When this soft keyboard is operated, for example, an address of the destination is input (S18), the input / output device 100 stores the code of the soft key used in this operation in the code conversion table 145. The code is converted into a code compatible with a mobile phone (S19), and position information indicating the position of the input on the screen is acquired (S20). Then, the input / output device 100 sends the position information to the mobile phone 200 as an event notification together with the code converted to be compatible with the mobile phone (S21). Thus, the reason why the position information is sent to the mobile phone 200 together with the code is to allow the mobile phone 200 to know which character input area is input when there are a plurality of character input areas. In addition, even when the soft keyboard is not displayed, a plurality of selection items are included in the drawing data, and when a specific selection item is selected from these, the enter key is input to the specific selection item. When operated or when an area of a specific selection item on the screen is touched, information on a position where an input has been made on the screen is sent to the mobile phone 200 together with a code relating to the enter key.

  The remote operation support processing unit 220 of the mobile phone 200 monitors the input to the network driver 212 of the mobile phone 200, and when the data from the input / output device 100 is input to the network driver 212, this is input. It passes to the controller 213. For this reason, the car navigation processing unit 230 recognizes that any of the plurality of input keys 202 of the mobile phone 200 has been operated, and performs processing corresponding to this operation. That is, the data transmitted from the input / output device 100 is input to the car navigation processing unit 230 of the mobile phone 200 via the remote operation handling processing unit 220 of the mobile phone 200.

  Accordingly, when the code and the position information are transmitted from the input / output device 100 (S21), the code and the position information are transmitted to the car navigation processing unit 230 of the mobile phone 200 via the remote operation corresponding processing unit 220 of the mobile phone 200. (S22). The car navigation processing unit 230 analyzes the code and the position information, and determines whether or not to send the data to the service providing server 300 as it is or after a predetermined processing. When the car navigation processing unit 230 determines that it is necessary to send predetermined data to the service providing server 300, the car navigation processing unit 230 sends the predetermined data to the service providing server 300 (S23).

  When receiving the predetermined data, the service providing server 300 creates drawing data as a response and sends it to the mobile phone 200 (S24).

  When receiving the drawing data, the car navigation processing unit 230 of the mobile phone 200 passes the drawing data to the LCD driver 214 and displays it on the liquid crystal display 203 (S25), as in the case described above (S13). The remote operation support processing unit 220 acquires drawing data input to the LCD driver 214 (S26), and determines whether or not a character input area exists in the drawing data (S27). If the character input area does not exist, the remote operation support processing unit 220 sends the drawing data to the input / output device 100 without attaching the message as described above (S28).

  Upon receiving the drawing data, the input / output device 100 displays the drawing data on the touch panel display 103 (S29).

  The car navigation processing unit 230 of the mobile phone 200 periodically acquires GPS data (data indicating the position of the mobile phone) from the GPS receiver 208 and sends it to the service providing server 300 (S30). Upon receiving the GPS data, the service providing server 300 creates map drawing data centered on the position indicated by the GPS data, for example, and sends it to the mobile phone 200 (S31).

  When receiving the drawing data, the car navigation processing unit 230 of the mobile phone 200 displays the image data on the liquid crystal display 203 as in the case described above (S32). The remote operation response processing unit 220 acquires the drawing data (S33), and determines whether or not a character input area exists in the drawing data (S34). If there is no character input area, the drawing data is sent to the input / output device 100 without attaching the message as described above (S35).

  When receiving the drawing data, the input / output device 100 displays the drawing data (for example, a map) on the touch panel display 103 (S36).

  When the power switch 102c (FIG. 17) is turned off (S37), the input / output device 100 sends a termination request to the mobile phone 200 (S38). When the remote operation handling processing unit 220 of the mobile phone 200 receives this end request, it sends an end response to the input / output device 100 (S39) and sends an end request to the car navigation processing unit 230 of the mobile phone 200 (S41). . When receiving the termination request from the mobile phone 200, the input / output device 100 stops the common platform unit 111 and the remote operation processing unit 120 and turns off the power (S40).

  When the car navigation processing unit 230 of the mobile phone 200 receives the termination request, it sends it to the service providing server 300 (S42). Upon receiving this termination request, the service providing server 300 returns a termination response to the mobile phone 200 (S43), and then releases the resources secured in step 10 (S44).

  When receiving the end response from the service providing server 300, the car navigation processing unit 230 of the mobile phone 200 stops (S45).

  Thus, a series of operations of the navigation system of the present embodiment is completed.

  Next, a format of a message transmitted / received between the devices 100, 200, and 300 will be described.

  First, a format of a message transmitted / received between the input / output device 100 and the mobile phone 200 will be described.

  As shown in FIG. 12, a message 10 transmitted / received between the input / output device 100 and the mobile phone 200 includes an access code 11 indicating a destination address and a packet header 12 indicating parameters for managing a communication link. And a payload 13 for storing actual user data. In addition, although the packet format in Bluetooth is shown here, for example, when communication between the mobile phone 200 and the input / output device 100 is performed by WiFi, the header part before the payload is the packet format used by WiFi. Follow.

  The payload 13 includes a data type identifier 14 indicating what information is included in the payload 13 and data 15.

  Next, the configuration of the data 15 in the message 10 will be specifically described with reference to FIGS. 12 and 13.

  The data of the car navigation service connection request message 10a transmitted from the input / output device 100 in step 2 in FIG. 7 includes, as shown in FIG. 12, a “car navigation service connection request” 16a that is the content of the message sent to the transmission destination. It includes an identifier 17a of a message transmission source, and an option 18a used when expanding service contents in the future.

  The data of the car navigation service connection response 10b transmitted from the mobile phone 200 in step 3 in FIG. 7 includes a “car navigation service connection response” 16b that is the content of the message sent to the transmission destination, an identifier 17b of the transmission source of this message, And a response 18b to the option included in the request message.

  The data of the code information request message 10c transmitted from the input / output device 100 in step 4 in FIG. 7 includes, as shown in FIG. 13, the “code information request” 16c that is the content of the message sent to the transmission destination, A transmission source identifier 17c.

  As shown in FIG. 13, the data of the code information response message 10d transmitted from the mobile phone 200 in step 5 in FIG. 7 includes the “code information response” 16d that is the content of the message sent to the transmission destination, and the transmission of this message. It has an original identifier 17d, code information 19d, and a data length 18d of the code information 19d. As described above, the code information 19d is a combination of each code stored in the code areas 244Ae and 244Be in the key code tables 244A and 244B shown in FIG. 5 and a code number predetermined for each code. It is.

  The drawing data message 10e transmitted from the mobile phone 200 in steps 28 and 35 in FIG. 7 includes, as shown in FIG. 13, a “drawing data notification” 16e that is the content of the message sent to the transmission destination, and the sender of this message. Identifier 17e, drawing data 26e, X coordinate value 22e of the starting position of the drawing data in the current screen, Y coordinate value 23e of the starting position of the drawing data in the current screen, and the drawing data It has a width 24e and a height 25e of this drawing data.

  The drawing data message with character input area 10f transmitted from the mobile phone 200 in step 16 in FIG. 7 includes, as shown in FIG. 13, a “drawing data notification with character area” 16f, which is the content of the message sent to the transmission destination. The identifier 17f of the sender of this message, the drawing data 26f, the X coordinate value 22f of the starting position of this drawing data in the current screen, and the Y coordinate value 23f of the starting position of this drawing data in the current screen The drawing data has a width 24f and a drawing data height 25f. That is, the drawing data message with character input area 10f differs from the drawing data message 10e described above only in the message content. In the drawing data message with character input area 10f, the message content indicates that there is a character input area in the drawing data. However, as in the above-described drawing data message 10e, the message content is simply “drawn”. Data notification ”may be used, and data indicating the presence or absence of a character input area may be separately attached to the drawing data.

  As shown in FIG. 13, the event notification message 10g transmitted from the input / output device 100 in step 21 in FIG. 7 includes the “event notification” 16g that is the content of the message sent to the transmission destination and the identifier of the transmission source of this message. 17g, event data 24g, X coordinate value 22g of the position where the event occurred on the current screen, and Y coordinate value 23g of the position where the event occurred on the current screen. The event data 24g is a combination of one or more codes shown in the code data tables 244A and 244B shown in FIG.

  As shown in FIG. 14, the connection request message 30a transmitted from the mobile phone 200 in step 9 in FIG. 7 includes a header 32a in which the communication address of the transmission destination and the transmission source is stored, and a payload. The payload includes a “car navigation service connection request” 36a that is a content of a message to be transmitted to the transmission destination, a transmission source device identifier 37a, and whether or not the transmission source mobile phone 200 is connected to the input / output device 100. A mode (in this case, a connection mode) 38a and a Round Trip Time (round-trip delay time) 39a are included.

  Here, the Round Trip Time is a Round Trip Time in communication between the mobile phone 200 and the input / output device 100, and is detected by the network data analysis processing unit 222 of the mobile phone 200.

  As shown in FIG. 14, the connection response message 30a transmitted from the service providing server 300 in step 11 in FIG. 7 includes a header 32b in which the communication address of the transmission destination and the transmission source is stored, and a payload. The payload includes a “car navigation service connection response” 36b, which is the content of a message to be sent to the transmission destination, and a device identifier 37b of the transmission source.

  As shown in FIG. 15, the drawing message 30c transmitted from the service providing server 300 in steps 12, 24, and 31 in FIG. 7 includes a header 32c in which a communication address of a transmission destination and a transmission source is stored, a payload, Have The payload includes a “drawing data notification” 36c that is the content of the message to be sent to the transmission destination, a device identifier 37c of the transmission source, drawing data 26c, and an X coordinate value 22c of the starting position of the drawing data in the current screen. The Y coordinate value 23c of the starting position of the drawing data in the current screen, the width 24c of the drawing data, and the height 25c of the drawing data. The drawing data message 30c, the drawing data message 10e, and the drawing data message with character input area 10f include the image format and compression type of the drawing data, which are not shown, in addition to the data described above. It is.

  Next, detailed operations for each of the devices 100, 200, and 300 will be described with reference to the flowcharts shown in FIGS.

  First, the operation of the input / output device 100 will be described with reference to the flowchart shown in FIG.

  As described above, when the power switch 102c (FIG. 17) of the input / output device 100 is turned on (S100 (S1)), the power is turned on and the common platform unit 111 and the remote operation processing unit 120 are activated. In addition, Sxxx which is a process number, for example, SOO in () after S100 shows the process number in FIG. 7 corresponding to this Sxxx.

  The BT connection processing unit 121 of the remote operation processing unit 120 controls the network data generation unit 115 and the network data transmission unit 116 according to the Bluetooth connection procedure, and sends a message for communication connection with the mobile phone 200 from the Bluetooth interface 107. Send it. When the Bluetooth wireless connection with the mobile phone 200 is completed, the BT connection processing unit 121 causes the network data generation unit 115 to create a car navigation service connection request message 10a (FIG. 12) according to a predetermined format. The request message 10a is sent to the mobile phone 200 via the network data transmitter 116 and the Bluetooth interface 107 (S101 (S2)).

  Then, the BT connection processing unit 121 waits for a connection response message for the connection request message to be returned from the mobile phone 200 (S102). If a connection response message is not returned from the mobile phone 200 even after the predetermined time has elapsed, the drawing data generation processing unit 124 is caused to create drawing data indicating a communication error. This drawing data is transferred to the LCD driver 114 and displayed on the touch panel display 103. That is, the touch panel display 103 displays a communication error (S103).

  As a case where a communication error is displayed, there is no target mobile phone 200 at a distance where wireless connection by Bluetooth is possible, or the mobile phone 200 is not turned on. When a communication error is displayed in this manner, the user places the mobile phone 200 in a position where wireless connection can be established with the input / output device 100 via Bluetooth, or the mobile phone 200 is turned on. I do.

  The car navigation service connection response message 10b (FIG. 12) from the mobile phone 200 is sent to the network data analysis unit 113 via the Bluetooth interface 107 and the network data reception unit 112. As a result of analyzing the network data, the network data analyzing unit 113 notifies the BT connection processing unit 121 of the fact that the network data is recognized as a connection response. Upon receiving the connection response, the BT connection processing unit 121 notifies the code information management unit 122 that the mobile phone 200 is connected. Upon receiving this, the code information management unit 122 causes the network data generation unit 115 to create a mobile phone code information request message 10c (FIG. 13) according to a predetermined format, and the network data transmission unit 116 and the Bluetooth interface 107 are connected. Then, this request message 10c is sent to the mobile phone 200 (S104 (S4)).

  The code information management unit 122 waits for reception of a mobile phone code information response message from the mobile phone 200 (S105). If the code information management unit 122 cannot receive the mobile phone code information response message after a predetermined time has elapsed, the code information management unit 122 returns to step 104 again. In response, the mobile phone code information request message is transmitted from the Bluetooth interface 107. When the code information management unit 122 receives the mobile phone code information response message 10d (FIG. 13) from the mobile phone 200 via the Bluetooth interface 107, the network data reception unit 112, and the network data analysis unit 113, the code information The code information 19d (FIG. 13) included in the response message is stored in the nonvolatile memory 140 as the mobile phone code information 244a, and the input handling unit 125 indicates that the mobile phone code information 244a is stored in the nonvolatile memory 140. To inform.

  The input handling unit 125 creates a code conversion table 145 from the correspondence between each code in the input / output device code table 144 and each code in the mobile phone code table 244a, and stores this in the nonvolatile memory 140. (S106 (S6)).

  Here, a method of creating the code conversion table 145 will be described.

  As described above, the code information 19d (FIG. 13) (244a in FIG. 3) included in the mobile phone code information response message 10d (FIG. 13) is stored in the key code tables 244A and 244B shown in FIG. Each code stored in the code areas 244Ae and 244Be is a combination of a code number predetermined for each code. The code number is a number given to the meaning of the code. For example, the code of the center key enter of the mobile phone 200 is assigned the code number “0” meaning enter, OK, selection, “50” meaning “A” is added to the code “A” of the mobile phone 200. Therefore, this code number is basically different from the code numbers stored in the number areas 244Aa and 244Ba in the key code tables 224A and 244B shown in FIG.

  The input handling unit 125 knows in advance what the code number in the mobile phone code information 19d (FIG. 13) is attached to the code, that is, the code number and the meaning The code of the mobile phone 200 is associated with the code of the input / output device 100 by associating each code number with each meaning stored in the input / output device code table 144. . For example, since the code number “0” (the number corresponding to the center key of the mobile phone 200) in the mobile phone code information 19d is a code number meaning enter, OK, and selection as described above, the input handling unit 125 In the input / output device code table 144, a code having this meaning, that is, an enter key code is associated. In addition, since the code number “50” (the number corresponding to “A” of the mobile phone 200) in the mobile phone code information 19d is a code number meaning “A” as described above, the input handling unit 125 In the input / output device code table 144, this meaning code, that is, the code “A” is associated.

  Next, as shown in FIG. 15, the input handling unit 125 stores the code number and code in the mobile phone code information 19d in the conversion number area 145a and the mobile phone code area 145b in the code conversion table 145, respectively. The code of the input / output device 100 corresponding to the code number stored in the number area 145a is stored in the input / output apparatus code area 145c.

  The input handling unit 125 executes the above processing for all code numbers in the mobile phone code information 19d, and completes the code conversion table 145.

  As described above, since the code number in the mobile phone code information 19d is data for associating the mobile phone code with the input / output device code, it is interpreted by both the mobile phone 200 and the input / output device 100 instead. A common code that can be used may be used, or the meaning of the code may be used.

  When the code conversion table 145 is completed (S106), the drawing data analysis processing unit 123 waits for reception of a drawing data message from the mobile phone 200 (S107). When the drawing data message from the mobile phone 200 is received by the Bluetooth interface 107, the network data receiving unit 112 passes this to the network data analyzing unit 113. The network data analysis unit 113 determines whether or not the network data is a drawing data message, and if it is a drawing data message, passes it to the drawing data analysis unit 123. The drawing data analysis unit 123 analyzes the message contents 16e and 16f in the drawing data messages 10e and 10f (FIG. 13), and determines whether or not a character input area exists in the drawing data (S108). If the character input area exists, the process proceeds to step 111. If the character input area does not exist, the process proceeds to step 109.

  In step 109, the drawing data generation processing unit 124 receives the drawing data from the drawing data analysis processing unit 123, passes it to the LCD driver 114, and displays it on the touch panel display 103 (S109 (S29, S36)). Then, the input key analysis processing unit 118 waits for key input. If there is a key input, the process proceeds to step 113. If there is no key input, the process returns to step 107. When the user operates the input key 102 or the touch panel display 103, the key handler 117 accepts this and passes it to the input key analysis processing unit 118. When the operation content is received from the key handler 117, that is, when there is a key input, the input key analysis processing unit 118 converts the operation content into an input / output device code and passes this input device code to the code conversion unit 125.

  For example, as illustrated in FIG. 16, it is assumed that the input / output device 100 receives the destination search drawing data and displays the destination search screen 1030 on the touch panel display 103 as illustrated in FIG. 16. The destination search screen 1030 displays three search methods: free keyword search, telephone number or zip code search, and map search. In this case, the user selects one of the three search methods. Note that a character input frame is shown in the destination search screen 1030, but this input frame cannot be treated as having a character input region because character input cannot be performed at this stage.

  In the above case, since there is no character input area in the drawing data, it is determined in step 108 whether or not there is a character input area. In step 109, the destination search screen shown in FIG. 1030 is displayed, and the soft keyboard is not displayed as will be described later. When the user touches one of the three search methods on the touch panel display 103, it is determined in step 110 that there is a key input, and the process proceeds to step 113.

  Further, for example, when a map screen is displayed on the touch panel display 103 while the vehicle is traveling, there is no character input area in the drawing data. It is determined that there is no area, a map screen is displayed in step 109, it is determined in step 110 that there is no key input, and the process returns to step 107 to receive new map screen drawing data.

  On the other hand, when it is determined in step 108 that there is a character input area and the process proceeds to step 111, the drawing data generation processing unit 124 receives the drawing data from the drawing data analysis processing unit 123 and A display instruction is received, drawing data for the soft keyboard is created, and the drawing data for the soft keyboard is transferred to the LCD driver 114 together with the drawing data received from the drawing data analysis processing unit 123, as shown in FIG. A screen 1030a indicated by drawing data received from the mobile phone 200, a soft keyboard 1035, and an input character display area 1036 are displayed on the top. This screen 1030a is a screen displayed by selecting a free keyword search on the destination search screen 1030 shown in FIG. 16, and is a screen for inputting characters for inputting a destination character.

  When the screen showing the drawing data and the soft keyboard are displayed, the input key analysis processing unit 118 waits for the key input, and if there is a key input, the key input is the enter key ( (Including selection of items by touching the touch panel display 103), power switch off, or other key input (S112).

  If the key input is neither enter key nor power switch off, it is determined that the character input is in progress and the process returns to step 112 to wait for key input. If the power switch is off, the process proceeds to step 118. If the power key is the enter key, the process proceeds to step 114.

  In step 114, the input handling unit 125 acquires one input device code or a plurality of input device codes from the input key analysis processing unit 118. The input handling unit 125 converts the input device code acquired from the input key analysis processing unit 118 into a mobile phone code with reference to the code conversion table 145 (S115).

  For example, as shown in FIG. 16, when the destination search screen 1030 is displayed and the user selects one of the three search methods described above, the input handling unit 125 performs input key analysis processing. The input / output device code “0000” of the enter key is acquired from the unit 118, and the input / output device code “0000” is converted into the mobile phone code “0x0000” with reference to the code conversion table 145 shown in FIG.

  In addition, as shown in FIG. 17, when the character input screen 1030 a is displayed and the user inputs “Ariake” as the destination name and then operates the enter key, the input handling unit 125 performs input key analysis processing. The input / output device codes “1001,...” Of “Ariake” and the input / output device code “0000” of the enter key are acquired from the section 118, and these input / output device codes “100” are referred to the code conversion table 145. 1001... 0000 ”is converted into a mobile phone code“ 0x1001,. As shown in this example, when “Ariake” is input, the drawing data generation unit 124 creates drawing data for displaying “Ariake”, passes it to the LCD driver 114, and FIG. As shown in the drawing, “Ariake” is displayed in the input character display area 1036 on the touch panel display 103.

  Subsequently, the input handling unit 125 acquires position information on the code input screen from the input key analysis processing unit 118 (S116 (S20)). Then, the input handling unit 125 passes the mobile phone code together with the location information to the network data generation unit 115, and causes the network data generation unit 115 to generate an event notification message 10g (FIG. 13) to transmit network data. This message is transmitted to the mobile phone 200 via the unit 116 and the Bluetooth interface 107 (S117 (S21)).

  Here, the code conversion unit 115 acquires the position information after the code conversion (S115), but actually, the input / output analysis unit 118 inputs / outputs the input event when acquiring the input event (S114). The position information is also acquired together with the device code. Also, here, when there is a series of character string input and then the enter key is operated, the code of the series of character strings is converted at once. The converted code may be sent to the mobile phone.

  When the event notification message is transmitted to the mobile phone 200, the process returns to step 107 and waits for reception of drawing data.

  If the input key analysis processing unit 118 determines in step 113 that the key input is a power switch off, the input handling unit 125 causes the network data generation unit 115 to generate an end request message, and the network data transmission unit. This message is transmitted to the mobile phone 200 via the 116 and the Bluetooth interface 107 (S118 (S38)).

  The input key analysis processing unit 118 waits for reception of an end response from the mobile phone 200 (S19). If no end response is received even after a predetermined time has elapsed, the process returns to step 118, and if an end response is received, This is notified to the input handling unit 125. The input handling unit 125 instructs the power control unit (not shown) to power off, and stops the power supply from the power control unit to each unit (S120 (S46)).

  Thus, the processing in the input / output device 100 ends.

  Next, according to the flowchart shown in FIG. 9, the detailed operation of the remote operation handling processing unit 220 of the mobile phone 200 will be described.

  The remote operation support processing unit 220 is in an activated state together with the common platform unit 211 as long as the mobile phone 200 is powered on.

  The network data analysis processing unit 222 of the remote operation handling processing unit 220 in the activated state waits for the Bluetooth interface 207 to receive the car navigation service connection request message 10a (FIG. 12) from the input / output device 100 (S200). This connection request message is passed to the network data analysis processing unit 222 via the Bluetooth interface 207, the network driver 212, and the network reception handler 221. When the network data analysis processing unit 222 analyzes the network data passed from the network reception handler 221 and determines that the network data is a connection request message, the network data processing processing unit 222 instructs the car navigation processing unit 230 to start up, and The processing unit 230 is activated (S201 (S7)). Further, the network data analysis unit 222 causes the network data generation unit 223 to create a connection response message 10b (FIG. 12) for this connection request message, and through the network data transmission handler 224, the network driver 212, and the Bluetooth interface 207, This connection response message is transmitted to the input / output device 100 (S202 (S3)).

  Next, the network data analysis processing unit 222 waits for the Bluetooth interface 207 to receive the mobile phone code information request message 10c (FIG. 13) from the input / output device 100 (S203). When the network data analysis processing unit 222 analyzes the network data received by the Bluetooth interface 207 and passed from the network reception handler 221, and determines that the network data is a mobile phone code information request message, the network data generation unit 223 is instructed to generate a mobile phone code information response message 10d (FIG. 13). Upon receiving this instruction, the network data generation unit 223 extracts a plurality of mobile phone codes from the mobile phone code table 244 (FIGS. 2 and 5) stored in the non-volatile memory 240, and pre-loads each code in advance. A mobile phone code information response message 10d including code information 19d (FIG. 13), which is a plurality of combinations of codes and code numbers, is created with a predetermined code number, and this message is passed to the network data transmission handler 224. Upon receiving this code information response message, the network data transmission handler 224 transmits this code information response message to the input / output device 100 via the network driver 212 and the Bluetooth interface 207 (S204 (S5)).

  The drawing handler 225 monitors the drawing data input to the LCD driver 214 (S205). If there is drawing data input, the process proceeds to step 206. If there is no drawing data input, the process proceeds to step 210. Note that the input of drawing data to the LCD driver 214 is executed by the car navigation processing unit 200 as described later.

  In step 206, the drawing handler 225 acquires the drawing data input to the LCD driver 214 and passes it to the drawing data analysis processing unit 226 (S206 (S14, 26, 33)). The drawing data analysis processing unit 226 analyzes the drawing data to determine whether or not a character input area exists in the drawing data (S207 (S15, 27, 34)).

  When the drawing data analysis processing unit 226 determines that there is a character input area in the drawing data, the drawing data analysis processing unit 226 passes a message indicating that the character input area exists in the drawing data to the network data generation unit 223 together with the drawing data. A drawing data notification message with input area 10f (FIG. 13) is generated. The drawing data notification message with character input area 10f is transferred to the network data transmission handler 224 and transmitted to the input / output device 100 via the network driver 212 and the Bluetooth interface 207 (S208 (S16)).

  When the drawing data analysis processing unit 226 determines that there is no character input area in the drawing data, the drawing data analysis processing unit 226 passes the drawing data to the network data generation unit 223 to generate the drawing data notification message 10e (FIG. 13). The drawing data notification message 10e is transmitted to the input / output device 100 via the data transmission handler 224, the network driver 212, and the Bluetooth interface 207 (S209 (S28, 35)).

  If the drawing handler 225 determines in step 205 that there is no drawing data input to the LCD driver 214, the drawing data notification messages 10 e and 10 f are transmitted to the input / output device 100 in steps 208 and 209. In this case, the network data analysis processing unit 222 waits for the event notification message 10g (FIG. 13) from the input / output device 100 to be received by the Bluetooth interface 207 (S210). When the network data analysis processing unit 222 analyzes the network data received by the Bluetooth interface 207 and passed from the network reception handler 221 and determines that the network data is not an event notification message, the network data analysis processing unit 222 returns to step 205 and draws the drawing handler 225. Thus, the input of drawing data to the LCD driver 214 is monitored. If the network data analysis processing unit 222 determines that the network data received by the Bluetooth interface 207 is an event notification message, the input event information input by the input / output device 100 included in the event notification message. Is passed to the input controller 213 via the input key handler 227 (S211). As shown in FIG. 13, the input event information in the event notification message 10g includes the x-coordinate value 22g of the input position on the screen of the input / output device 100, its y-coordinate value 23g, and one or more mobile phone codes. Event data 24g which is a combination. When the input event information is passed to the input controller 213, the car navigation processing unit 230 recognizes that an instruction or the like has been input from the input key 202 and performs predetermined processing, as will be described later.

  Next, when the input event information passed to the input controller 227 in step 211 is not an end request, the network data analysis processing unit 222 returns to step 205 and the drawing handler 225 inputs drawing data to the LCD driver 214. Be monitored. When the input event information indicates a termination request, the network data analysis processing unit 222 causes the network data generation unit 223 to generate a termination response message, via the network data transmission handler 224, the network driver 212, and the Bluetooth interface 207. The end response message is transmitted to the input / output device 100 (S213 (S39)).

  This completes the processing in the remote operation handling processing unit 220 of the mobile phone 200.

  Next, detailed operation of the car navigation processing unit 230 of the mobile phone 200 will be described with reference to the flowchart shown in FIG.

  The car navigation processing unit 230 is activated (S230 (S8)) when an activation instruction is input from the remote operation handling processing unit 220 (S230 (S7)). That is, the remote operation handling processing unit 220 of the mobile phone 200 receives a car navigation service connection request from the input / output device 100 (S200 in FIG. 9), and gives a start instruction to the car navigation processing unit 230 (FIG. 9). S201), the remote operation handling processing unit 220 is activated.

  Upon activation, the car navigation processing unit 230 immediately transmits a car navigation service connection request message 30a (FIG. 14) to the service providing server 300 via the network driver 212 and the mobile phone communication interface 206 (S232 (S9)). ), And waits for reception of a response message to the connection request message (S233). If a response message to the connection request message cannot be received even after a predetermined time has elapsed, the process returns to step 232 and transmits the connection request message to the service providing server 300 again. Further, when the response message 30b (FIG. 14) for the connection request message is received, the car navigation processing unit 230 causes the mobile phone communication interface 206 to receive the drawing data notification message 30c (FIG. 14) from the service providing server 300. Wait (S234).

  When the mobile phone communication interface 206 receives the drawing data notification message 30 c from the service providing server 300, the car navigation processing unit 230 passes the drawing data in the message to the LCD driver 214 and displays it on the liquid crystal display 203. (S235 (S13, 25, 32)). In this process, the remote operation handling processing unit 220 acquires the drawing data input to the LCD driver 214 (S206 in FIG. 9) and sends it to the input / output device 100 (S208 in FIG. 9). 209).

  Next, the car navigation processing unit 230 waits for a key code to be input to the input controller 213 (S236). Here, a code may be input to the input controller 213 by operating the input key 202 of the mobile phone 200, but basically, the input controller 213 sends the code from the input / output device 100 via the remote operation processing unit 220. The code (the code converted into the code of the mobile phone 200) has been input. If there is no key code input in the input controller 213, the car navigation processing unit 230 determines whether or not it is a transmission timing of GPS data (position data of the mobile phone 200) (S237). Returning to FIG. 2, the reception of drawing data from the service providing server 300 is awaited. If it is the transmission timing of the GPS data, the car navigation processing unit 230 acquires the GPS data from the GPS receiver 208 (S238), converts it into a message, and then sends it via the network driver 212 and the mobile phone communication interface 206. Then, the data is transmitted to the service providing server 300 (S241 (S30)), and the process returns to step 234 again to wait for reception of drawing data from the service providing server 300.

  If it is determined in step 236 that a key code has been input to the input controller 213, the code is acquired and analyzed to determine whether communication with the service providing server 300 is required (S239). ). If the car navigation processing unit 230 determines that communication with the service providing server 300 is not necessary, the car navigation processing unit 230 returns to step 236 and waits for reception of drawing data from the service providing server 300. If it is determined that communication with the service providing server 300 is necessary, it is determined whether or not this input is a termination request (S240).

  When the car navigation processing unit 230 determines that this input is not an end request, the car navigation processing unit 230 sends this input code to the service providing server 300 as it is or after changing it to a format that the service providing server 300 can understand (S241 (S23)). )). If it is determined that the input is an end request, the car navigation processing unit 230 converts the end request into a message, and then sends the end request message to the service providing server via the network driver 212 and the mobile phone communication interface 206. It transmits to 300 (S242 (S42)). Then, the car navigation processing unit 230 waits for the mobile phone communication interface 206 to receive an end response message from the service providing server 300 (S243). If the end response message is received, the car navigation processing unit 230 stops. .

  Thus, the process in the car navigation processing unit 230 of the mobile phone 200 is completed.

  Next, detailed operation of the service providing server 300 will be described with reference to the flowchart shown in FIG.

  The multimodal cooperation processing unit 324 of the service providing server 300 waits for the network interface 306 to receive the car navigation service connection request message 30a (FIG. 14) from the mobile phone 200 (S300). Upon receiving the car navigation service connection request message 30a, the multimodal cooperation processing unit 234 determines whether the connection mode (the mode in which the input / output device is connected) or the single mode (from the mode information 38a included in the message 30a). It is determined whether the input / output device is not connected (S301).

  When determining that the mode is the single mode, the multimodal cooperation processing unit 234 secures the resource for the single mode in the car mode 322 (S302). Secure (S303 (S10)).

  In the car mode 322, when resources are secured, the data generation unit 315 causes the car navigation service connection response message 30b (FIG. 14) to be generated, and this message is transmitted from the network interface 306 to the mobile phone via the data transmission unit 316. 200 (S304 (S10)).

  Next, the car mode 322 creates drawing data for the initial screen, causes the data generation unit 315 to create the drawing data notification message 30c (FIG. 14), and transmits it from the network interface 306 via the data transmission unit 316. This message is transmitted to the mobile phone 200 (S305).

  Subsequently, the car mode 322 waits for the network interface 306 to receive a predetermined data message from the mobile phone 200 (S306). When the network interface 306 receives a data message, the car mode 322 determines whether this message is a GPS data message, a message indicating a termination request, or another message (S307).

  When the data message received by the network interface 306 is a GPS data message, the car mode 322 creates map drawing data centered on the position indicated by the GPS data included in the GPS message (S308). ). At this time, if the resource for the connection mode is secured in step 303, drawing data corresponding to the landscape screen is created. If the resource for the single mode is secured in step 302, the mobile phone Drawing data corresponding to 200 portrait screens is created.

  In the car mode 322, when the map drawing data is created, the mobile phone 200 and the input / output device 100 correspond to the round trip time 39a in the car navigation service connection request message 30a (FIG. 14) received in step 300. Map drawing data centering on the position of the future vehicle may be created for the communication time between the two and the other.

  In this case, the communication time between the mobile phone 200 and the input / output device 100 is obtained from the Round Trip Time 39a in the car navigation service connection request message 30a (FIG. 14), and the mobile phone 200 determines from the change in GPS data at a predetermined time. Find the average speed of the vehicle on board. When the communication time exceeds the threshold determined by the average speed, the position of the future vehicle is determined by shifting the distance when moving for the communication time at the average speed with respect to the vehicle position determined by the acquired GPS data. .

  In addition, when the data message received by the network interface 306 is another message, the car mode 322 creates response drawing data corresponding to the message content (S309).

  The car mode 322 causes the data generation unit 315 to create the drawing data notification message 30c (FIG. 14) based on the drawing data created in steps 308 and 309, and the network interface 306 via the data transmission unit 316. Then, after transmitting this message to the mobile phone 200 (S310 (S12, 24, 31)), the process returns to step 306 to wait for reception of predetermined message data from the mobile phone 200.

  If it is determined in step 307 that the message indicates an end request, the car mode 322 causes the data generation unit 315 to generate an end response message and the network interface via the data transmission unit 316. From 306, this message is transmitted to the mobile phone 200. In the car mode 322, the multi-modal cooperation processing unit 324 releases the resources secured in steps 302 and 303 (S312 (S44)).

  Above, the process of the service provision server 300 is complete | finished.

  As described above, in the present embodiment, the data displayed on the liquid crystal display 203 of the mobile phone 200 is displayed on the touch panel display 103 of the input / output device 100 having a larger display area. Furthermore, since the contents of instructions can be input with the soft keyboard 1035 on the touch panel display 103, the contents of instructions can be easily input.

  In the present embodiment, the code indicating the instruction content or the like input by the input / output device 100 is converted into a code corresponding to the mobile phone 200 and then sent to the mobile phone 200, so that it is installed in the mobile phone 200. The car navigation program 243 (FIG. 2) can be expanded even if it is a program dedicated to mobile phones, and the range of options for the car navigation program can be expanded.

  In this embodiment, when the power switch of the input / output device 100 is turned on, the input / output device 100 automatically transmits a car navigation connection request to the mobile phone 200. After the power switch is turned on, a car navigation connection request may be transmitted from the input / output device 100 to the mobile phone 200 on condition that the user performs a predetermined operation. In this embodiment, the target to be operated from the input / output device 100 is only the car navigation program installed in the mobile phone 200. However, when targeting a plurality of application programs, Therefore, it is necessary to send a connection request or the like from the input / output device 100 after the user selects the one program. In this case, a plurality of target program names may be transmitted from the mobile phone 200 to the input / output device 100, and these program names may be displayed on the display of the input / output device.

  In the present embodiment, the input code of the input / output device 100 is converted into the input code of the mobile phone 200 in the input / output device 100, and the converted input code is transmitted to the mobile phone 200. The input code of the apparatus 100 may be transmitted to the mobile phone 200 without conversion, and the input code may be converted in the mobile phone 200. In this case, in the above embodiment, the code information management unit 122 and the input handling unit 125 provided in the input / output device 100 are provided in the mobile phone 200.

  In the above description, the code conversion table 145 is created and the code conversion is performed by referring to the code conversion table 145. However, the code conversion table 145 is not created, and the input handling unit 125 performs this code conversion table. When creating 145, code conversion may be performed using the same method as that for associating the mobile phone code with the input / output code.

  Furthermore, in the present embodiment, the target application program is a car navigation program, but the present invention is not limited to this, and may be another application program.

  DESCRIPTION OF SYMBOLS 100: In-vehicle input / output device, 101: Main memory, 102: Input key, 103: Touch panel display, 107: Bluetooth interface, 110: Processor, 111: Common platform part, 120: Remote operation processing part, 121: Bluetooth connection process 122: Code information management unit 123: Drawing data analysis processing unit 124: Drawing data generation processing unit 125: Input handling unit 140: Non-volatile memory 141: Common platform program 142: Remote operation program 144 : I / O device code table, 244a: k mobile phone code information, 145: code conversion table, 200: mobile phone, 201; main memory, 202: input key, 203: liquid crystal display, 206: mobile phone communication interface, 207: Bluetooth interface 208: GPS receiver 210: Processor 211: Common platform unit 220: Remote operation processing unit 221: Network data reception handler 222: Network data analysis processing unit 223: Network data generation unit 224 Network data transmission handler, 225: Drawing handler, 226: Drawing data analysis processing unit, 227: Input key handler, 230: Car navigation processing unit, 240: Non-volatile memory, 241: Common platform program, 242: Remote operation compatible program, 243: Car navigation program, 244: Mobile phone code table, 300: Service providing server, 306: Network interface, 310: Processor, 311: Common platform section, 320: Navige Deployment unit, 321: walking mode, 322: Kermode, 323: Rail Mode, 324: Multimodal cooperation module, 340: hard disk drive, 341: Common platform program, 342: navigation program

Claims (13)

The first communication means a that communicates using the cellular phone communication network, the second communication means a of a communication method different from the first communication means a, the display means a, the input means a, and the predetermined information A mobile communication terminal comprising: an application processing unit that performs processing including processing to be displayed on the unit; and an input control unit that receives a code indicating the operation content of the input unit a and passes the code to the application processing unit In
For an input / output device comprising a communication means b capable of communicating with the second communication means a, a display means b, and an input means b, a code for each operation of the input / output means a, a plurality of For each code, the second communication means a transmits code information having correspondence information for associating the code with one of codes for various operations of the input means b of the input / output device. Code information transmission processing means;
Drawing data acquisition means for monitoring the display on the display means a by the application processing section and acquiring the drawing data when the display of the drawing data on the display means a by the application processing section is detected;
Drawing data transmission processing means for causing the second communication means a to transmit the drawing data acquired by the drawing data acquisition means;
The position at which the operation indicated by the code is performed in the image displayed by the display means b of the input / output device and any code in the code information from the input / output device by the second communication means When the position information indicating is received, the code and the code delivery means for passing the position information to the input control means,
A mobile communication terminal comprising: The first communication means a that communicates using the cellular phone communication network, the second communication means a of a communication method different from the first communication means a, the display means a, the input means a, and the predetermined information A mobile communication terminal comprising: an application processing unit that performs processing including processing to be displayed on the unit; and an input control unit that receives a code indicating the operation content of the input unit a and passes the code to the application processing unit In
From an input / output device comprising a communication means b capable of communicating with the second communication means a, a display means b, and an input means b, a code for each operation of the input means b and a plurality of codes Code information having correspondence information for associating the code with any one of codes for various operations of the input means a of the portable communication terminal, and transmitting the code information to the second communication means When a receives the code information management means for storing the code information in the storage means,
Drawing data acquisition means for monitoring the display on the display means a by the application processing section and acquiring the drawing data when the display of the drawing data on the display means a by the application processing section is detected;
Drawing data transmission processing means for causing the second communication means a to transmit the drawing data acquired by the drawing data acquisition means;
By the second communication means, the code indicating the operation content of the input means b from the input / output device and the operation indicated by the code in the image displayed by the display means b of the input / output device are performed. When position information indicating a position is received, code conversion means for converting the code from the input / output device into a code of the input means a with reference to the code information;
A code delivery means for passing the position information received by the second communication means and the code converted by the code conversion means to the input control means;
A mobile communication terminal comprising: The portable communication terminal according to any one of claims 1 and 2,
When the application processing unit displays the drawing data on the display unit a, the drawing data transmission processing unit includes the drawing data and the drawing data in a case where the drawing data is a character input area in the image indicated by the drawing data. A message indicating the character input area is transmitted by the second communication means a.
A mobile communication terminal characterized by the above. In the portable communication terminal according to any one of claims 1 to 4,
A GPS receiver for receiving GPS data;
The application processing unit is a car navigation processing unit, transmits GPS data acquired from the GPS receiver to the navigation service providing server by the first communication unit a, and the navigation service provides the navigation service by the first communication unit a. Obtaining drawing data of the map from the providing server and displaying the drawing data of the map on the display means a.
A mobile communication terminal characterized by the above. The communication means b, the display means b, the input means b, and the memory | storage means b which can communicate with a portable communication terminal are communicated with this portable communication terminal by this communication means b, and the process in this portable communication terminal In the input / output device to remotely control
From a mobile communication terminal provided with communication means a, display means a, and input means a capable of communicating with the communication means b, a code for each operation of the input means a of the mobile communication terminal, and a plurality of codes Code information having correspondence information for associating the code with any one of the codes for the various operations of the input unit b of the input / output device, and the communication unit b When received, code information management means for storing the code information in the storage means b;
When the communication means b receives drawing data from the mobile communication terminal, display control means for displaying the drawing data on the display means b;
When an operation area exists in the image indicated by the drawing data, a predetermined operation by the input unit b is performed on the operation area, and the code indicating the predetermined operation and the predetermined operation are When the position information in the image is obtained, the code information is referred to, the code is converted into the code of the input means a, and the position information and the converted code are converted into the communication means b. Input handling means for transmitting to the portable communication terminal,
An input / output device comprising: The input / output device according to claim 5,
It has a touch panel display,
The display means b and the input means b are configured to include the touch panel display,
When the communication means b receives from the portable communication terminal a message indicating that there is a character input area in the drawing data together with the drawing data, the display control means displays the drawing data on the touch panel display, and Display keyboard image data including character input keys,
An input / output device characterized by that. A portable communication terminal according to claim 1;
The input / output device according to any one of claims 5 and 6,
An application processing system comprising: The application processing system according to claim 7.
A navigation service providing server,
The mobile communication terminal is
It has a GPS receiver that receives GPS (Global Positioning System) data,
The application processing unit is a car navigation processing unit, transmits GPS data acquired from the GPS receiver to the navigation service providing server by the first communication unit a, and the navigation service provides the navigation service by the first communication unit a. Obtaining drawing data of the map from the providing server and displaying the drawing data of the map on the display means a.
An application processing system characterized by that. The application processing system according to claim 8,
The mobile communication terminal is
Connection request transmission processing means for transmitting a connection request to the navigation service providing server by the first communication means a;
Data generation means for incorporating mode information indicating whether or not the portable communication terminal is in a connection mode capable of communicating with the input / output device during the connection request;
Have
When the navigation service providing server indicates that the mode information in the connection request from the mobile communication terminal indicates the connection mode, at least the drawing data of the map is horizontally long among the drawing data transmitted to the mobile terminal. Drawing data corresponding to the screen of
An application processing system characterized by that. In the application processing system according to any one of claims 8 and 9,
The mobile communication terminal is
Round Trip Time acquisition means for acquiring Round Trip Time in communication with the input / output device,
Incorporating the Round Trip Time in the message to the navigation service providing server by the first communication means a,
The navigation service providing server includes:
Obtaining the communication time between the mobile phone and the input / output device from Round Trip Time in the message,
An average moving speed of a mobile phone is obtained from a change in GPS data at a predetermined time, and when the communication time exceeds a threshold determined by the average moving speed, the position of the mobile communication terminal determined by the GPS data is The position shifted by the distance when moving for the communication time at the average moving speed is set as the position of the mobile communication terminal in the future, the drawing data of the map is created based on the position of the communication terminal in the future, Transmitting map drawing data to the mobile communication terminal;
An application processing system characterized by that. The first communication means a that communicates using the cellular phone communication network, the second communication means a of a communication method different from the first communication means a, the display means a, the input means a, and the predetermined information A mobile communication terminal comprising: an application processing unit that performs processing including processing to be displayed on the unit; and an input control unit that receives a code indicating the operation content of the input unit a and passes the code to the application processing unit In remote control compatible programs,
For an input / output device comprising a communication means b capable of communicating with the second communication means a, a display means b, and an input means b, a code for each operation of the input / output means a, a plurality of For each code, the second communication means a transmits code information having correspondence information for associating the code with one of codes for various operations of the input means b of the input / output device. A code information transmission step;
A drawing data acquisition step of monitoring the display on the display means a by the application processing unit and acquiring the drawing data when the display of the drawing data on the display means a by the application processing unit is detected;
A drawing data transmission step of causing the second communication means a to transmit the drawing data acquired in the drawing data acquisition step;
The position at which the operation indicated by the code is performed in the image displayed by the display means b of the input / output device and any code in the code information from the input / output device by the second communication means And a code delivery step of passing the code and the position information to the input control means;
A program for remote operation of a portable communication terminal, characterized in that a processor is executed. The first communication means a that communicates using the cellular phone communication network, the second communication means a of a communication method different from the first communication means a, the display means a, the input means a, and the predetermined information A mobile communication terminal comprising: an application processing unit that performs processing including processing to be displayed on the unit; and an input control unit that receives a code indicating the operation content of the input unit a and passes the code to the application processing unit In remote control compatible programs,
From an input / output device comprising a communication means b capable of communicating with the second communication means a, a display means b, and an input means b, a code for each operation of the input means b and a plurality of codes Code information having correspondence information for associating the code with any of the codes for various operations of the input means a of the portable communication terminal is transmitted, and the second communication means a When received, a code information storage step for storing the code information in a storage means;
A drawing data acquisition step of monitoring the display on the display means a by the application processing unit and acquiring the drawing data when the display of the drawing data on the display means a by the application processing unit is detected;
A drawing data transmission step of causing the second communication means a to transmit the drawing data acquired in the drawing data acquisition step;
The position at which the operation indicated by the code is performed in the image displayed by the display means b of the input / output device and any code in the code information from the input / output device by the second communication means A code conversion step of converting the code from the input / output device into a code of the input means a with reference to the code information;
A code delivery step of passing the position information received by the second communication means and the code converted in the code conversion step to the input control means;
A program for remote operation of a portable communication terminal, characterized in that a processor is executed. In the remote operation corresponding program of the portable communication terminal according to any one of claims 11 and 12,
When the application processing unit displays the drawing data on the display means a, if the character input area is in the image indicated by the drawing data, the drawing data transmission step includes the drawing data and the character in the drawing data. A message indicating that it is an input area is transmitted by the second communication means a.
A program for remote operation of a portable communication terminal characterized by the above.

Images