JP5503490B2 - COMMUNICATION SYSTEM, CONTROL DEVICE, AND CONTROL METHOD - Google Patents

Description

  The present invention relates to a communication system, a control device, and a control method.

  With the advancement of functions of mobile terminals, mobile terminals for users who are unfamiliar with operations have been developed. For example, a button layout design that emphasizes operability, an optical navigation function in which a button to be operated when a videophone call is received, and the like are employed in portable terminals (see Non-Patent Document 1). The optical navigation function is a function for notifying which button should be pressed by lighting the button in an appropriate order when a videophone call is received.

Satoshi Irie et al., “Efforts to Universal Design for Mobile Phone“ Raku Raku Phone ””, FUJITSU.56, 2, pp.146-152, March 2005 Norihiro Ishikawa et al., "Home Network Control Technology from Mobile Terminals that Create New Use Scenes for Living Mobile Phones", NTT DoCoMo Technical Journal, Vol. 16, No. 1, pp. 26-35, April 2008

  On the other hand, remote control of various devices from a mobile terminal has been studied (see Non-Patent Document 2).

  As one application technique of remote control by a mobile terminal, it is conceivable to remotely control a connection destination mobile terminal from a transmission source mobile terminal. For example, for a user who does not know the operation of the mobile terminal (a person to be assisted), an assist function in which the teaching user (assist) guides the operation procedure from the mobile terminal to the other mobile terminal can be considered. By displaying the screen of the assisting person's mobile terminal on the assisting person's mobile terminal, the assisting person can remotely guide the operation of the assisting person while confirming the assisting person's screen. The assisted person operates the mobile terminal in accordance with an instruction from the assisted person.

  In the assist function, when the terminal of the assisting person and the terminal of the person being assisted are the same model, an instruction from the assistant is easily transmitted to the person being assisted. However, the terminal of the assisting person and the terminal of the person being assisted are not necessarily the same model. There is a possibility that proper operation guidance cannot be realized even though the key operation is correct for the terminal of the assisting person when the action executed on the terminal is different due to the key pressing, for example, due to the key arrangement being different. There is. For example, if the assist person has instructed to press the [*] for the purpose of instructing to switch the drive mode, the long press of [*] indicates that the assisted person's terminal is on / off of the manner mode. The person may press and hold [*] to turn on / off the manner mode.

  In view of the problems as described above, the present invention has an object to provide means for accurately transmitting key press information of one terminal to the other terminal even when the action executed on the terminal differs depending on the key press. And

The communication system of the present invention includes:
A communication system including a first terminal and a second terminal,
The first terminal is
A first action storage unit for storing a key of the first terminal and an action executed by the first terminal by pressing the key in association with each other;
A first key press detection unit for detecting a pressed key;
A first action derivation unit for deriving an action corresponding to the detected key from the first action storage unit;
A first transmitter for notifying the second terminal of the derived action;
Have
The second terminal is
A second action storage unit for storing a key of the second terminal and an action executed by the second terminal by pressing the key in association with each other;
A second receiver for receiving an action notified from the first terminal;
A second terminal key press information deriving unit for deriving a key corresponding to the notified action from the second action storage unit;
A second key control unit for lighting the derived key;
It is characterized by having.

The control device of the present invention
A control device capable of communicating with the first terminal and the second terminal,
An action storage unit that stores a terminal identification number, a terminal key, and an action executed on the terminal by pressing the key in association with each other;
A terminal identification number acquisition unit for acquiring a terminal identification number from the first terminal and the second terminal;
A key press information receiving unit that receives key press information indicating a key pressed on the first terminal from the first terminal;
An action derivation unit for deriving an action corresponding to the pressed terminal identification number and the key pressed from the action storage unit;
A key press information deriving unit for deriving a key corresponding to the derived action and the terminal identification number of the second terminal from the action storage unit;
A key control signal transmitter for transmitting a key control signal indicating the derived key to the second terminal;
It is characterized by having.

The control method of the present invention includes:
A first terminal having a first action storage unit for storing a key of the first terminal and an action executed by the first terminal by pressing the key, a key of the second terminal, and a key pressing A control method in a communication system including a second terminal having a second action storage unit that stores an action executed by the second terminal in association with the second terminal;
The first terminal detecting a pressed key;
The first terminal deriving an action corresponding to the detected key from the first action storage unit;
The first terminal notifying the second terminal of the derived action;
The second terminal receiving an action notified from the first terminal;
The second terminal deriving a key corresponding to the notified action from the second action storage unit;
The second terminal lighting a derived key;
It is characterized by having.

The control method of the present invention includes:
A control method in a control device capable of communicating with a first terminal and a second terminal and having an action storage unit that stores a terminal identification number, a key of the terminal, and an action executed by the terminal by pressing the key in association with each other Because
Obtaining a terminal identification number from the first terminal and the second terminal;
Receiving, from the first terminal, key press information indicating a key pressed at the first terminal;
Deriving an action corresponding to the terminal identification number of the first terminal and the pressed key from the action storage unit;
Deriving a key corresponding to the derived action and the terminal identification number of the second terminal from the action storage unit;
Transmitting a key control signal indicating the derived key to the second terminal;
It is characterized by having.

  According to the embodiment of the present invention, it is possible to accurately convey the key press information of one terminal to the other terminal even when the action executed on the terminal differs depending on the key press.

Schematic diagram of a communication system according to an embodiment of the present invention. Example of key arrangement used in an embodiment of the present invention Example of action database in assist terminal or assisted terminal according to an embodiment of the present invention Block diagram of an assist terminal according to an embodiment of the present invention Block diagram of a terminal to be assisted according to an embodiment of the present invention Another block diagram of the assist terminal according to the embodiment of the present invention Another block diagram of the assisted terminal according to the embodiment of the present invention The flowchart of the control method concerning the example of the present invention. Schematic of a communication system according to a modification of the present invention Example of action database in terminal control server according to modification of the present invention The block diagram of the terminal control server which concerns on the modification of this invention The sequence diagram of the control method which concerns on the modification of this invention

  In an embodiment of the present invention, an assist function in which an assisting person who teaches a person who does not know how to operate the terminal guides the operation procedure to the partner terminal will be described. The terminal of the assisting person on the teaching side is called an assist terminal, and the terminal of the person being assisted on the teaching side is called an assisted terminal. The key arrangement of the assist terminal may be different from the key arrangement of the assisted terminal. As a specific method for guiding the key operation from the assist terminal to the assisting terminal, it is assumed that the key of the assisting terminal corresponding to the key pressed on the assist terminal is turned on.

  The assist terminal has an action storage unit that stores a key of the assist terminal and an action executed by the assist terminal by pressing the key in association with each other. The action storage unit may store the key of the assist terminal and the length of the key pressing time in association with the action executed by the assist terminal when the key is pressed. The assist terminal detects a key pressed by the assistant, derives an action corresponding to the detected key from the action storage unit, and notifies the assisted terminal of the derived action. Further, the assist terminal may detect the key pressing time and derive an action corresponding to the length of the key pressing time.

  The assisted terminal has an action storage unit that stores a key of the assisted terminal and an action executed by the assisted terminal by pressing the key in association with each other. The action storage unit may store the key of the assisted terminal and the length of the key pressing time in association with the action executed by the assisted terminal when the key is pressed. The assisted terminal receives the action notified from the assist terminal, derives a key corresponding to the notified action from the action storage unit, and lights the derived key. Further, the assisted terminal may derive the length of the key press time corresponding to the action.

  In this way, even when the action executed on the terminal differs depending on the key press, the key press information of one terminal can be accurately transmitted to the other terminal.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

<System configuration>
FIG. 1 is a schematic diagram of a communication system according to an embodiment of the present invention. The communication system includes an assist terminal 10 and an assisted terminal 20.

  The assist terminal 10 is a communication terminal having an assist function for guiding an operation procedure to a partner terminal. The assist terminal 10 is generally a mobile communication terminal such as a mobile phone, but may be a fixed communication terminal such as a personal computer. For example, the assist terminal 10 can display the screen of the assisted terminal 20 or can instruct the assisted terminal 20 to press a key to be pressed. Each key of the assist terminal 10 may be provided with a light emitting element such as a light emitting diode (LED) or a light source.

  The assisted terminal 20 is a communication terminal having an assisted function for receiving an operation procedure from the partner terminal. The assisted terminal 20 is generally a mobile communication terminal such as a mobile phone, but may be a fixed communication terminal such as a fixed telephone. Each key of the terminal 20 to be assisted is provided with a light emitting element such as a light emitting diode (LED) or a light source. The assisted terminal 20 can light a key to be pressed that is instructed from the assist terminal 10.

  Here, the key of the terminal includes a pressable button provided in the terminal and a key of a software key displayed on the terminal screen. For example, the keys include [start], [end talk], [clear], [up], [down], [left], [right], [1], [2]... [0], [ *], [#] And the like are included. Even when the same key is pressed, the action when the key is pressed for a longer time (long press) is different from the action when the key is pressed for a shorter time. Whether or not the key is long-pressed is determined by whether or not the time during which the key is pressed is, for example, 1 second or longer. For example, the action when pressing [End] shortly is on-hook, and the action when pressing [End] long is power off. Depending on the terminal, the action when the key is pressed may be different. For example, in one terminal, the action when [*] is long pressed is drive mode switching, and in another terminal, the action when [*] is long pressed is on / off of the manner mode.

  The key arrangement of the terminal includes a numeric keypad arrangement and a QWERTY arrangement. A general mobile phone can press a key from a numeric keypad layout. In addition, there are terminals that can press a key from the QWERTY layout, and there are terminals that can switch a numeric keypad layout and a QWERTY layout as software keys.

  FIG. 2A shows an example of software key arrangement of a terminal that can switch between ten-key arrangement and QWERTY arrangement. Each key of the software key can be input by touching the touch panel with a finger. Here, the key input of the software key is also referred to as pressing. The key for executing the same action may be different between the numeric keypad arrangement and the QWERTY arrangement. For example, in order to input “no”, it is necessary to press [5] five times in the numeric keypad arrangement, but it is necessary to press [N] / [O] in the QWERTY arrangement.

  Furthermore, the character types in the numeric keypad layout include Hiragana direct input, half-width kana input, half-width alphabet input, half-width numeric input, and the like, and the character types in the QWERTY layout include Roman character input, kana input, alphanumeric input, and the like.

  As shown in FIG. 2B, the correspondence between the keys in the numeric keypad arrangement for executing an action and the keys in the QWERTY arrangement is determined in advance. For example, in order to input “0” to “9”, it is necessary to press [0] to [9] in the numeric keypad half-width numeric input, but in the QWERTY alphanumeric input, [0] to [9] is required. 9] must be pressed. For example, in order to input “ka”, it is necessary to press [2] for Hiragana direct input with numeric keypad layout, but it is necessary to press [K] / [A] for Roman character input with QWERTY layout. For example, in order to execute the direct number input action, it is necessary to press [Start] in the numeric keypad arrangement, but it is necessary to press [Ctrl] + [S] in the QWERTY arrangement.

  As described above, the action executed on the terminal is the key indicating which key was pressed, whether the key was pressed short or long, and how many times it was pressed, depending on the key layout and character type. Determined by pressing information.

  In an embodiment of the present invention, between the terminal with the assist terminal 10 and the terminal to be assisted 20 in order to accurately transmit information about the key pressed by the assist terminal 10 (key pressing information) between terminals having different key arrangements. Information is transmitted between them as follows.

  The assist terminal 10 has an action database that stores the keys of the assist terminal and the length of the key press time in association with the actions executed by the assist terminal 10 when the key is pressed. The assisting person displays the screen of the assisted terminal 20 on the screen of the assist terminal 10 and presses the key to be operated next by the assisting person. The assist terminal 10 derives an action corresponding to the pressed key and the key pressing time from the action database of the assist terminal 10, and transmits action information indicating the derived action to the assisted terminal 20.

  The assisted terminal 20 has an action database that stores the key of the assisted terminal and the length of the key pressing time in association with the action executed by the assisted terminal 20 when the key is pressed. The assisted terminal 20 receives the action information from the assist terminal 10 and derives the key corresponding to the action notified by the action information and the length of the key pressing time from the action database. The assisted terminal 20 lights the derived key. In this way, the person being assisted can recognize the key to be pressed.

  Further, when the derived key is pressed and the notified action is completed, the assisted terminal 20 may turn off the key and transmit an action completion notification to the assist terminal 10. When receiving an action completion notification, the assist terminal 10 may light a key corresponding to the completed action. In this way, the assisting person can recognize that the person being assisted actually executed the action.

  FIG. 3 is an example of an action database in the assist terminal 10 or the assisted terminal 20 according to the embodiment of the present invention.

  The action database is a storage device that stores a terminal key and a key pressing time length in association with an action (operation) executed by the terminal when the key is pressed. For example, the action when pressing [End] shortly is on-hook, and the action when pressing [End] long is power off. For example, when [1] is pressed briefly, the digit "1" input (single-byte numeric input), A-line input (Hiragana direct input, single-byte kana input) or ".", "@" Input (single-byte alphabet input) The action when [1] is held down is the GPS current location confirmation activation. In some cases, there is no action corresponding to a long press. For example, the action when pressing [Start] briefly is direct telephone number input, but there is no action when pressing [Start] for a long time.

  FIG. 3 shows an action database of one terminal. The action database may be different for each terminal or each terminal model. For example, in the assist terminal 10, the action when [*] is long pressed is drive mode switching, and in the assisted terminal 20, the action when [*] is long pressed is on / off of the manner mode. Thus, since the action database may be different for each terminal or each terminal model, the assist terminal 10 and the assisted terminal 20 have an action database corresponding to the own terminal.

  FIG. 3 shows an action database with a numeric keypad arrangement, but a terminal having a key with a QWERTY arrangement has an action database with a QWERTY arrangement. A terminal that can switch between a numeric keypad layout and a QWERTY layout as software keys may have both a numeric keypad action database and a QWERTY layout action database. Further, as described with reference to FIG. 2B, the terminal that can switch between the ten key arrangement and the QWERTY arrangement has a predetermined correspondence relationship between the keys in the ten key arrangement and the keys in the QWERTY arrangement. Only one action database may be included. In the case of having only one action database, the action is determined from the key and the key pressing time by using both the action database in FIG. 3 and the correspondence relationship between the key in the numeric keypad arrangement in FIG. The key and the key press time can be derived from the action.

<Terminal configuration>
Next, the configuration of the assist terminal 10 and the assisted terminal 20 when the assist terminal 10 instructs a key to be pressed to the assisted terminal 20 will be described.

  FIG. 4 is a block diagram of the assist terminal 10 according to the embodiment of the present invention. The assist terminal 10 includes a key input unit 101, a key input information analysis unit 103, and a transmission / reception unit 113.

  The key input unit 101 accepts key input by an assistant. For example, the key input unit 101 may be a button of the assist terminal 10 or a touch panel.

  The key input information analysis unit 103 derives an action to be executed by the assist terminal 10 from the key pressed by the key input unit 101 and the length of the key press time.

  The transmission / reception unit 113 transmits the derived action information to the assisted terminal 20.

  More specifically, the key input information analysis unit 103 includes a key press detection unit 105, a key arrangement / character type storage unit 107, an action derivation unit 109, and an action storage unit 111.

  The key press detection unit 105 detects the key pressed by the key input unit 101 and the key press time. When the assist terminal 10 can switch the key arrangement, the key arrangement / character type storage unit 107 stores the key arrangement (tenkey arrangement or QWERTY arrangement) set in the assist terminal 10. The key press detection unit 105 detects which key is pressed and whether the key is pressed shortly or longly according to the key layout stored in the key layout / character type storage unit 107.

  In addition, the key arrangement / character type storage unit 107 stores the character type set in the assist terminal 10 (such as direct hiragana input, numeric half-width kana input, half-width alphabet input, half-width numeric input, etc. in QWERTY layout, kana Input, alphanumeric input, etc.). Depending on the character type, one action is determined by pressing the key once or more. Therefore, the key press detection unit 105 determines which key depending on the key arrangement and the character type stored in the key arrangement / character type storage unit 107. Detects how many times is pressed. For example, when “NO” is input by direct input of the hiragana on the ten key layout, the key press detection unit 105 holds information on the pressed key, and detects that [5] is pressed five times in succession. . Further, for example, when inputting ““ ”in the Roman letter input of the QWERTY layout, the key press detection unit 105 holds information on the pressed key, and [N] is pressed once and [O] is pressed once. Detects pressing. When the key press detection unit 105 does not detect the key press within a predetermined time, that is, when the key press interval is equal to or longer than the predetermined time (for example, when one second or more has elapsed after the key is pressed). It may be considered that the key press for one action is finished. Further, the key press detection unit 105 may consider that the key press for one action is completed when a predetermined key such as [Determination] is pressed. Note that when an action for a plurality of key presses is not defined, such as [Start] and [End Call], the key press detection unit 105 does not wait for a certain period of time and detects the detected key and key press. The time is notified to the action deriving unit 109.

  The action deriving unit 109 derives an action corresponding to the detected key and key pressing time. As described with reference to FIG. 3, the action storage unit 111 stores the key of the assist terminal 10 and the length of the key press time and the action executed by the assist terminal 10 in association with each other. The action deriving unit 109 derives an action stored in the action storage unit 111 from the detected key and key pressing time. If the action differs depending on the key arrangement, the action deriving unit 109 derives the action according to the key arrangement stored in the key arrangement / character type storage unit 107. Furthermore, when one action is determined by pressing one or more keys, the action deriving unit 109 derives an action according to which key is pressed how many times. The derived action information is transmitted to the assisted terminal 20 via the transmission / reception unit 113.

  For example, when it is detected that [5] is pressed five times in the Hiragana direct input of the numeric keypad as described above, the action deriving unit 109 uses the key layout stored in the key layout / character type storage unit 107. In response, it derives that the action is an input of “of”. For example, when detecting a press of [N] / [O] in the Roman character input of the QWERTY layout as described above, the action deriving unit 109 responds to the key layout stored in the key layout / character type storage unit 107. Deriving that the action is an input of "of". As described above, since the correspondence between the keys in the numeric keypad arrangement and the keys in the QWERTY arrangement is determined in advance, the action deriving unit 109 determines [N] / [O] in the QWERTY arrangement from this correspondence. It may be derived that the pressing corresponds to five pressings of [5] in the numeric keypad arrangement, and that the action is an input of “no”.

  FIG. 5 is a block diagram of the assisted terminal 20 according to the embodiment of the present invention. The assisted terminal 20 includes a transmission / reception unit 201, a key control information analysis unit 203, and a key input unit 213.

  The transmission / reception unit 201 receives the action information transmitted from the assist terminal 10.

  The key control information analysis unit 203 derives the key to be pressed and the length of the key pressing time from the action notified by the action information. Then, the key to be pressed is turned on.

  The key input unit 213 may be a button of the assisted terminal 20 or a touch panel. The key input unit 213 includes a light emitting element or light source such as a light emitting diode (LED). The light emitting element or light source of the key input unit 213 is turned on by a key lighting instruction from the key control information analysis unit 203. .

  More specifically, the key control information analysis unit 203 includes a key press information deriving unit 205, an action storage unit 207, a key control unit 209, and a key arrangement / character type storage unit 211.

  The key press information deriving unit 205 receives the action information transmitted from the assist terminal 10 via the transmission / reception unit 201, and derives the key corresponding to the action notified by the action information and the length of the key press time. As described with reference to FIG. 3, the action storage unit 207 stores the key of the assisted terminal 20 and the length of the key press time in association with the action executed by the assisted terminal 20. . The key press information deriving unit 205 derives the key stored in the action storage unit 207 and the length of the key press time from the action notified by the action information. The key arrangement / character type storage unit 211 stores the key arrangement and the character type set in the assisted terminal 20. When the action differs depending on the key arrangement, the key press information deriving unit 205 derives the length of the key and the key press time according to the key arrangement stored in the key arrangement / character type storage unit 211. When one action requires one or more key presses, the key press information deriving unit 207 derives which key needs to be pressed how many times.

  For example, when it is notified that the action is an input of “no” as described above, the key press information deriving unit 205 needs to press [5] five times when the numeric keypad is arranged. In the case of the QWERTY arrangement, it is derived that it is necessary to press [N] / [O]. As described above, since the correspondence between the keys in the numeric keypad layout and the keys in the QWERTY layout is determined in advance, the key press information deriving unit 205 determines that the input of “5” is [5] 5 in the numeric keypad layout. From the correspondence between the ten key arrangement key and the QWERTY arrangement key, [5] five depressions in the ten key arrangement are [N] / [O] in the QWERTY arrangement. You may derive | lead-out corresponding to pressing.

  The key control unit 209 turns on the key derived by the key pressing information deriving unit 205 in accordance with the key arrangement stored in the key arrangement / character type storage unit 211. For example, when it is derived that it is necessary to press [5] on the numeric keypad five times, the key control unit 209 turns on [5] on the numeric keypad. The key control unit 209 keeps turning on [5] until [5] is pressed five times, and turns off [5] when [5] is pressed five times. For example, if it is derived that it is necessary to press [N] / [O] in the QWERTY layout, the key control unit 209 first turns on [N] in the QWERTY layout and presses [N]. Sometimes [N] is turned off and [O] is turned on. When [O] is pressed, [O] is turned off. For example, when it is necessary to hold down the key, the key control unit 209 keeps the key on until the key is pressed for a long time, and turns off the key when the key is pressed for a long time. When the action is completed, the transmission / reception unit 201 may transmit an action completion notification to the assist terminal 10. The action completion notification will be described below with reference to FIGS.

  Next, the configuration of the assisted terminal 20 and the assist terminal 10 when an action completion notification indicating that the action has been completed is transmitted from the assisted terminal 20 to the assist terminal 10 will be described. Completion of the action is made to be recognized by the assist person by turning on the key of the assist terminal 10. In this case, each function of the assist terminal 10 in FIG. 4 is included in the assisted terminal 20, and each function of the assist terminal 20 in FIG. 5 is included in the assist terminal 10. A more specific configuration will be described below.

  FIG. 6 is another block diagram of the assisted terminal 20 according to the embodiment of the present invention. The assisted terminal 20 includes a transmission / reception unit 201, a key control information analysis unit 203, and a key input unit 213.

  The key input unit 213 receives key input by the person being assisted. For example, the key input unit 213 may be a button of the assisted terminal 20 or a touch panel.

  The key control information analysis unit 203 determines that the action is completed from the key pressed by the key input unit 213 and the length of the key pressing time.

  The transmission / reception unit 201 transmits an action completion notification to the assist terminal 10 when the action is completed.

  More specifically, the key control information analysis unit 203 includes a key press detection unit 215 and an action derivation unit 217 in addition to the components shown in FIG.

  The key press detection unit 215 detects the key pressed by the key input unit 213 and the key press time. When the assisted terminal 20 can switch the key arrangement, the key arrangement / character type storage unit 211 stores the key arrangement set in the assisted terminal 20. The key press detection unit 215 detects which key is pressed and whether the key is pressed shortly or longly according to the key layout stored in the key layout / character type storage unit 211.

  The key arrangement / character type storage unit 211 stores the character type set in the assisted terminal 20. Depending on the character type, one action is determined by pressing the key one or more times. Therefore, the key press detection unit 215 selects which key depending on the key arrangement and the character type stored in the key arrangement / character type storage unit 211. Detects how many times is pressed.

  The action deriving unit 217 derives an action corresponding to the detected key and key pressing time. The action storage unit 207 stores the key of the assisted terminal 20 and the length of the key pressing time and the action executed by the assisted terminal 20 in association with each other. The action deriving unit 217 derives an action stored in the action storage unit 207 from the detected key and key pressing time. If the action differs depending on the key arrangement, the action deriving unit 217 derives the action according to the key arrangement stored in the key arrangement / character type storage unit 211. Furthermore, when one action is determined by pressing the key one or more times, the action deriving unit 217 derives the action according to which key is pressed and how many times. The derived action information is transmitted to the assist terminal 10 via the transmission / reception unit 201 as an action completion notification.

  FIG. 7 is another block diagram of the assist terminal 10 according to the embodiment of the present invention. The assist terminal 10 includes a key input unit 101, a key input information analysis unit 103, and a transmission / reception unit 113.

  The transmission / reception unit 113 receives the action completion notification transmitted from the assisted terminal 20.

  The key input information analysis unit 103 derives the key corresponding to the completed action and the length of the key pressing time. Then, the derived key is turned on.

  The key input unit 101 may be a button of the assist terminal 10 or a touch panel. The key input unit 101 includes a light emitting element or light source such as a light emitting diode (LED), and the light emitting element or light source of the key input unit 101 is turned on by a key lighting instruction from the key input information analysis unit 103. .

  More specifically, the key input information analysis unit 103 includes a key press information deriving unit 115 and a key control unit 117 in addition to the components shown in FIG.

  The key press information deriving unit 115 receives the action completion notification transmitted from the assisted terminal 20 via the transmission / reception unit 113, and derives the key corresponding to the completed action and the length of the key press time. The action storage unit 111 stores the key of the assist terminal 10 and the length of the key press time in association with the action executed by the assist terminal 10. The key press information deriving unit 115 derives the key stored in the action storage unit 111 and the length of the key press time from the completed action. The key arrangement / character type storage unit 107 stores the key arrangement and the character type set in the assist terminal 10. When the action differs depending on the key arrangement, the key press information deriving unit 115 derives the length of the key and the key press time according to the key arrangement stored in the key arrangement / character type storage unit 107. When one action requires one or more key presses, the key press information deriving unit 115 derives which key needs to be pressed how many times.

  Note that the key press information deriving unit 115 has been described as having the same function as the key press information deriving unit 205 of the terminal 20 to be assisted, but in this embodiment, the assisting person only needs to recognize that the action has been completed. Therefore, the key pressing information deriving unit 115 only has to derive the key to be lit, and does not have to derive the length of the key pressing time and which key needs to be pressed.

  The key control unit 117 turns on the key derived by the key pressing information deriving unit 115 according to the key arrangement stored in the key arrangement / character type storage unit 107. The lit key may be turned off after a predetermined time, or may be turned off by pressing any key.

  Next, a specific example in which the assist terminal 10 instructs the assisted terminal 20 to input “no” will be described with reference to FIG. 8.

  First, the key pressed by the key input unit 101 of the assist terminal 10 and the key pressing time are notified to the key input analysis unit 103 (S101). The key press detection unit 105 in the key input analysis unit 103 confirms the current key arrangement / character type of the assist terminal 10 from the key arrangement / character type storage unit 107 (S103). When the current key layout is the numeric keypad layout and the character type is direct input of hiragana, the key press detection unit 105 detects that [5] has been pressed for a short time. The information on the pressed key is held in the key press detection unit 105 in order to determine whether the input is “NA” or “NO” (S105). The key press detection unit 105 determines whether or not the key input is completed (S107). For example, if the key press detection unit 105 detects a key press within a certain time, the key press detection unit 105 determines that the key input has not ended (S107: NO), and holds information on the pressed key (S105). For example, the key press detection unit 105 determines that the key input is completed when the key press is not detected within a predetermined time or when a predetermined key such as [Determination] is pressed (S107: YES). In this way, the key press detection unit detects that [5] has been pressed for a short time five times.

  The action deriving unit 109 derives an action corresponding to the detected key and key pressing time from the action storage unit 111 (S109). The action deriving unit 109 derives that “5” pressing of [5] in the direct hiragana input of ten-key layout is an input of “no”. The action information of “NO” input is transmitted to the assisted terminal 20 via the transmission / reception unit 113 (S111).

  The transmission / reception unit 201 of the terminal 20 to be assisted receives the action information of “NO” input (S113). The key press information deriving unit 205 checks the current key arrangement / character type of the assisted terminal 20 from the key arrangement / character type storage unit 211 (S115). If the current key layout is QWERTY layout and the character type is Roman character input, the key press information deriving unit 205 derives that it is necessary to press [N] briefly and press [O] briefly ( S117).

  The key control unit 209 lights [N] in the QWERTY arrangement (S119). When [N] is pressed, the key control unit 209 determines whether or not the action is completed (S121). Since it is necessary to continue to press [O], the key control unit 209 determines that the action is not completed (S121: NO), and lights [O] in the QWERTY layout (S119). When [O] is pressed, the key control unit 209 determines that the action is completed (S121: YES), and turns off [O] (S123).

  Similar to the procedure of the assist terminal 10, the key press detection unit 215 of the assisted terminal 20 detects pressing of [N] and [O], and the action deriving unit 217 derives an action. The derived action is transmitted to the assist terminal 10 via the transmission / reception unit 201 as an action completion notification (S125).

Here, a specific example in which the assist terminal 10 instructs the assisted terminal 20 to input “no” has been described. However, the flowchart shown in FIG. 8 can be similarly applied to pressing other keys. is there.
<Modification>
Next, a modification using a terminal control server that centrally manages a terminal action database will be described.

  FIG. 9 is a schematic diagram of a communication system according to a modification of the present invention. The communication system includes an assist terminal 10, an assisted terminal 20, and a terminal control server 30. The assist terminal 10 and the assisted terminal 20 do not include an action database, and the action database of each terminal is managed by the terminal control server 30.

  The terminal control server 30 includes, for each terminal, an action database that stores a terminal key and a key pressing time length in association with an action executed on the terminal when the key is pressed. The terminal control server 30 acquires a terminal identification number from the assist terminal 10 and the assisted terminal 20 when the assist function is started by the assist terminal 10 or the assisted terminal. The terminal control server 30 refers to the action database of the assist terminal 10 and the action database of the assisted terminal 20 based on the acquired identification number. The terminal control server 30 receives key press information indicating the key pressed by the assist terminal 10 and the length of the key press time, and performs an action corresponding to the pressed key and the length of the key press time. Derived from the action database. Further, the key corresponding to the derived action and the length of the key pressing time are derived from the action database of the assisted terminal 20. Then, in order to light the key of the assisted terminal 20, a key control signal indicating the key of the assisted terminal 20 and the length of the key pressing time is transmitted.

  Similarly, when the action is completed in the assisted terminal 20, the terminal control server 30 receives the key pressed information indicating the key pressed and the key pressing time in the assisted terminal 20, and turns on the key of the assist terminal 10. Therefore, a key control signal indicating the key of the assist terminal 10 and the length of the key pressing time is transmitted.

  FIG. 10 is an example of an action database in the terminal control server 30 according to a modification of the present invention.

  The action database in this case stores a terminal identification number in addition to the action database of FIG. The terminal identification number is an identifier unique to the terminal such as IMEI (International Mobile Equipment Identity). The terminal identification number can be acquired at the start of communication. Further, the terminal control server 30 may acquire the key arrangement and the character type set in the assist terminal 10 and the assisted terminal 20 when acquiring the terminal identification number.

  In this way, the terminal control server 30 manages the action database of each terminal, and the processes in the action deriving unit 109 of the assist terminal 10 in FIG. 4 and the key press information deriving unit 205 of the assisted terminal 20 in FIG. Implemented by the server 30. That is, the assist terminal 10 does not need the action deriving unit 109 and the action storage unit 111 in the configuration of FIG. Similarly, the assisted terminal 20 does not need the key press information deriving unit 205 and the action storage unit 207 in the configuration of FIG.

  The key press detection unit 105 of the assist terminal 10 detects the key pressed by the key input unit 101 and the key press time. The key press detection unit 105 detects which key is pressed and whether the key is pressed shortly or longly according to the key layout stored in the key layout / character type storage unit 107. Also, depending on the character type, one action is determined by pressing the key one or more times. Therefore, the key press detection unit 105 corresponds to the key arrangement and character type stored in the key arrangement / character type storage unit 107. Detect which key is pressed how many times. The transmission unit of the assist terminal 10 transmits key press information indicating the key pressed by the assist terminal 10 and the length of the key press time to the terminal control server 30.

  The terminal control server 30 converts the key press information from the assist terminal 10 into a key control signal indicating the key to be pressed and the length of the key press time, as will be described in detail below with reference to FIG. . Then, the terminal control server 30 transmits a key control signal to the assisted terminal 20. For example, the terminal control server 30 transmits to the assisted terminal 20 a key control signal indicating which key should be pressed, whether the key should be pressed short or long, and how many times the key should be pressed.

  The key control unit 209 of the assisted terminal 20 turns on the key indicated by the key control signal in accordance with the key arrangement stored in the key arrangement / character type storage unit 211. When the action is completed by pressing the key, the key control unit 209 turns off the key.

  FIG. 11 is a block diagram of the terminal control server 30 according to a modification of the present invention. The terminal control server 30 includes a key press information receiving unit 301, a key arrangement / character type storage unit 303, an action derivation unit 305, an action storage unit 307, a key press information derivation unit 309, and a key control signal transmission unit 311. And have.

  The key press information receiving unit 301 receives key press information indicating the key pressed by the assist terminal 10 and the length of the key press time from the assist terminal 10.

  The key arrangement / character type storage unit 303 stores key arrangements and character types set in the assist terminal 10 and the assisted terminal 20. Each time the key arrangement or the character type is changed at the assist terminal 10 or the assisted terminal 20, the change notification is received and the information in the key arrangement / character type storage unit 303 is updated.

  The action deriving unit 305 derives an action corresponding to the key pressed by the assist terminal 10 and the length of the key pressing time. As described with reference to FIG. 10, the action storage unit 307 stores the terminal identification number, the terminal key and the key press time length, and the action executed by the terminal in association with each other. The action deriving unit 305 derives an action stored in the action storage unit 307 from the terminal identification number of the assist terminal 10, the key pressed by the assist terminal 10, and the key pressing time. If the action differs depending on the key arrangement, the action deriving unit 305 derives the action according to the key arrangement stored in the key arrangement / character type storage unit 303. Furthermore, when one action is determined by pressing the key one or more times, the action deriving unit 305 derives an action according to which key is pressed how many times.

  The key pressing information deriving unit 309 derives the key of the assisted terminal 20 corresponding to the derived action and the length of the key pressing time. The key press information deriving unit 309 derives the key stored in the action storage unit 307 and the length of the key press time from the terminal identification number of the assisted terminal 20 and the derived action. When the action differs depending on the key arrangement, the key pressing information deriving unit 309 derives the length of the key and the key pressing time according to the key arrangement stored in the key arrangement / character type storage unit 303. When one action requires one or more key presses, the key press information deriving unit 309 derives which key needs to be pressed how many times.

  The key control signal transmission unit 311 transmits to the assisted terminal 20 a key control signal indicating which key should be pressed, whether the key should be pressed shortly or long, and how many times the key should be pressed.

  FIG. 11 shows only the key control signal from the assist terminal 10 to the assisted terminal 20, but the same applies to the key control signal from the assisting terminal 20 to the assist terminal 10 when the action is completed. Can be realized.

  FIG. 12 is a sequence diagram of a control method according to a modified example of the present invention.

  When the assist terminal 10 makes a call to the assisted terminal 20 to provide an assist function (S201), the assist terminal 10 transmits a terminal identification number to the terminal control server 30 together with a service request for the assist function ( S203). The terminal control server 30 holds the terminal identification number of the assist terminal 10 (S205). The service request is transferred to the assisted terminal 20 (S207). When the assisted terminal 20 accepts the service request (S209), the assisted terminal 20 transmits a terminal identification number to the terminal control server 30 together with the service response (S211). The terminal control server 30 holds the terminal identification number of the assisted terminal 20 (S213). The service response is transferred to the assist terminal 10. Note that steps S201 to S213 show the case where the assist terminal 10 starts a service request. However, the terminal control server 30 also includes the assist terminal 10 and the assist terminal 10 when the assisted terminal 20 starts a service request. The terminal identification code of the assisted terminal 20 is acquired and held.

  The assister uses the assist terminal 10 to start operation guidance for the assisted terminal 20. For example, in order to instruct the assisted terminal 20 to input [5], [5] is pressed by half-width numeric input with a numeric keypad (S217). Key press information indicating that [5] is pressed is transmitted to the terminal control server 30 (S219).

  The terminal control server 30 maps the key press information and derives a key to be pressed on the assisted terminal 20 (S221). Specifically, the terminal control server 30 refers to the action database of the assist terminal 10 based on the key pressing information that [5] is pressed, and derives that the digit “5” is input. Then, from the action of inputting the digit “5”, the action database of the assisted terminal 20 is referred to generate a key control signal indicating that [5] should be pressed. The key control signal is transmitted to the assisted terminal 20 (S223).

  [5] of the assisted terminal 20 is turned on by the key control signal. When [5] is pressed on the assisted terminal 20 (S225), [5] is turned off, and the assisted terminal 20 generates key press information indicating that [5] is pressed. The key press information is transmitted to the terminal control server 30 (S227). The terminal control server 30 maps the key press information and derives a key to be lit on the assist terminal 10 (S229). The terminal control server 30 refers to the action database in the same manner as described above, and generates a key control signal for lighting [5]. The key control signal is transmitted to the assist terminal 10 (S231).

  The assist person recognizes that the action has been completed by turning on [5], and uses the assist terminal 10 to start the next operation guidance. For example, in order to instruct the assisted terminal 20 to turn on the manner mode, the key [#] corresponding to turning on / off the manner mode on the assist terminal 10 is pressed long (S233). Key press information indicating that [#] is long pressed is transmitted to the terminal control server 30 (S235).

  The terminal control server 30 maps the key press information and derives a key to be pressed on the assisted terminal 20 (S237). Specifically, the terminal control server 30 refers to the action database of the assist terminal 10 from the key press information indicating that [#] is long pressed, and derives that the manner mode is on / off. Then, from the action of the manner mode on / off, the action database of the assisted terminal 20 is referred to generate a key control signal indicating that [*] should be pressed and held. The key control signal is transmitted to the assisted terminal 20 (S239).

  [*] Of the assisted terminal 20 is turned on by the key control signal. When [*] is long pressed on the assisted terminal 20 (S241), [*] is turned off, and the assisted terminal 20 generates key press information indicating that [*] is long pressed. The key press information is transmitted to the terminal control server 30 (S243). The terminal control server 30 maps the key press information and derives a key to be lit on the assist terminal 10 (S245). The terminal control server 30 refers to the action database in the same manner as described above, and generates a key control signal for lighting [#]. The key control signal is transmitted to the assist terminal 10 (S247). The assisting person recognizes that the action is completed by turning on [#].

  Next, when the assistant changes the key layout from the numeric keypad layout to the QWERTY layout on the assist terminal 10 (S249), key layout information indicating that the assist terminal 10 has been switched to the numeric keypad layout is transmitted to the terminal control server 30 (S251). ). The key arrangement information is held in the terminal control server 30 (S253).

  Furthermore, the assistant uses the assist terminal 10 to start the next operation guidance. For example, in order to instruct the assisted terminal 20 to input “ka”, the user presses [K] / [A] in the Roman character input in the QWERTY layout (S255). Key press information indicating that [K] / [A] is pressed is transmitted to the terminal control server 30 (S257).

  The terminal control server 30 maps the key press information and derives a key to be pressed on the assisted terminal 20 (S259). Specifically, the terminal control server 30 refers to the action database of the assist terminal 10 based on the key press information indicating that [K] / [A] is pressed in the Roman character input in the QWERTY layout, and inputs “ka”. Deriving that. Then, from the action of inputting “ka”, the action database of the assisted terminal 20 is referred to generate a key control signal indicating that [2] should be pressed. The key control signal is transmitted to the assisted terminal 20 (S261).

  [2] of the assisted terminal 20 is turned on by the key control signal. When [2] is pressed on the assisted terminal 20 (S263), [2] is turned off, and the assisted terminal 20 generates key pressing information indicating that [2] is long pressed. The key press information is transmitted to the terminal control server 30 (S265). The terminal control server 30 maps the key press information and derives a key to be lit on the assist terminal 10 (S267). The terminal control server 30 refers to the action database in the same manner as described above, and generates a key control signal for lighting [2]. The key control signal is transmitted to the assist terminal 10 (S269). The assisting person recognizes that the action is completed by turning on [2].

  In this manner, terminal operation can be guided from the assist terminal 10 to the assisted terminal 20.

<Effect of Example>
According to the embodiment of the present invention, instead of transmitting the information of the pressed key as it is, the action executed at the terminal when the key is pressed is notified by changing to the action executed at the own terminal. Even when they are different, the key press information of one terminal can be accurately transmitted to the other terminal. The assisting person can instruct the assisted person by looking at the key arrangement of the assist terminal without having to recognize how the key arrangement of the assisted person is specifically set.

  Further, by turning on a key to be pressed on the assisted terminal, the assisted person can easily operate the terminal.

  Further, when the action is completed, the person to be assisted can recognize that the action is completed by turning off the key. In addition, by transmitting this action completion notification to the assistant and lighting the key of the assistant, the assistant can recognize that the action has been completed.

  Although the action by long press and the action by continuous key input are defined in the portable terminal, according to the embodiment of the present invention, such an action can be dealt with. Furthermore, it is possible to cope with switching of key arrangement such as numeric keypad arrangement and QWERTY arrangement.

  In addition, terminal processing can be reduced by using a terminal control server that centrally manages the terminal action database.

  For convenience of explanation, the apparatus according to the embodiment of the present invention is described using a functional block diagram, but the apparatus of the present invention may be realized by hardware, software, or a combination thereof. In addition, the functional units may be used in combination as necessary.

  For convenience of explanation, the method according to the embodiment of the present invention has been described by using a flowchart and a sequence diagram showing the flow of processing. Good.

  As mentioned above, although the Example of this invention was described, this invention is not limited to said Example, A various change and application are possible within a claim.

DESCRIPTION OF SYMBOLS 10 Assist terminal 101 Key input part 103 Key input information analysis part 105 Key press detection part 107 Key arrangement | positioning / character type memory | storage part 109 Action derivation part 111 Action storage part 113 Transmission / reception part 115 Key press information derivation part 117 Key control part 20 Assisted Terminal 201 Transmission / reception unit 203 Key control information analysis unit 205 Key press information derivation unit 207 Action storage unit 209 Key control unit 211 Key arrangement / character type storage unit 213 Key input unit 215 Key press detection unit 217 Action derivation unit 30 Terminal control server 301 Key pressing information receiving unit 303 Key arrangement / character type storing unit 305 Action deriving unit 307 Action storing unit 309 Key pressing information deriving unit 311 Key control signal transmitting unit

Claims (9)

A communication system including a first terminal and a second terminal,
The first terminal is
A first action storage unit for storing a key of the first terminal and an action executed by the first terminal by pressing the key in association with each other;
A first key press detection unit for detecting a pressed key;
A first action derivation unit for deriving an action corresponding to the detected key from the first action storage unit;
A first transmitter for notifying the second terminal of the derived action;
Have
The second terminal is
A second action storage unit for storing a key of the second terminal and an action executed by the second terminal by pressing the key in association with each other;
A second receiver for receiving an action notified from the first terminal;
A second key press information deriving unit for deriving a key corresponding to the notified action from the second action storage unit;
A second key control unit for lighting the derived key;
A communication system.   The communication system according to claim 1, wherein the second key control unit turns off the key when the derived key is pressed. The first action storage unit stores the key of the first terminal and the length of the key pressing time in association with the action executed by the first terminal by pressing the key,
The first key press detection unit further detects a key press time,
The first action derivation unit derives an action corresponding to the detected key and key pressing time from the first action storage unit,
The second action storage unit stores the key of the second terminal and the length of the key pressing time in association with the action executed on the second terminal by pressing the key,
The second key press information deriving unit derives the key corresponding to the notified action and the length of the key press time from the second action storage unit,
The second key control unit turns off the key when the derived key press time is longer than a predetermined time and the derived key is pressed longer than the predetermined time. The communication system according to 1. The first key press detection unit holds key press information whose key press interval is within a predetermined time,
The first action derivation unit derives an action corresponding to the held key press information,
The second key control unit may turn off the key when the derived key needs to be pressed a plurality of times or when the derived key is pressed a plurality of times. The communication system according to item. The first key press detection unit detects a key pressed according to a key arrangement set in the first terminal,
The first action deriving unit derives an action according to a key arrangement set in the first terminal,
The second key press information deriving unit derives a key according to a key arrangement set in the second terminal,
The communication system according to any one of claims 1 to 4, wherein the second key control unit lights a key according to a key arrangement set in the second terminal. The second terminal is
A second transmitter for transmitting an action completion notification indicating that the action has been completed by pressing the derived key to the first terminal;
The first terminal is
A first receiver for receiving an action completion notification from the second terminal;
A first key press information deriving unit for deriving a key corresponding to the completed action from the first action storage unit when an action completion notification is received by the first receiving unit;
A first key control unit for lighting the derived key;
The communication system according to any one of claims 1 to 5, further comprising: A control device capable of communicating with the first terminal and the second terminal,
An action storage unit that stores a terminal identification number, a terminal key, and an action executed on the terminal by pressing the key in association with each other;
A terminal identification number acquisition unit for acquiring a terminal identification number from the first terminal and the second terminal;
A key press information receiving unit that receives key press information indicating a key pressed on the first terminal from the first terminal;
An action derivation unit for deriving an action corresponding to the pressed terminal identification number and the key pressed from the action storage unit;
A key press information deriving unit for deriving a key corresponding to the derived action and the terminal identification number of the second terminal from the action storage unit;
A key control signal transmitter for transmitting a key control signal indicating the derived key to the second terminal;
Control device. A first terminal having a first action storage unit for storing a key of the first terminal and an action executed by the first terminal by pressing the key, a key of the second terminal, and a key pressing A control method in a communication system including a second terminal having a second action storage unit that stores an action executed by the second terminal in association with the second terminal;
The first terminal detecting a pressed key;
The first terminal deriving an action corresponding to the detected key from the first action storage unit;
The first terminal notifying the second terminal of the derived action;
The second terminal receiving an action notified from the first terminal;
The second terminal deriving a key corresponding to the notified action from the second action storage unit;
The second terminal lighting a derived key;
Control method. A control method in a control device capable of communicating with a first terminal and a second terminal and having an action storage unit that stores a terminal identification number, a key of the terminal, and an action executed by the terminal by pressing the key in association with each other Because
Obtaining a terminal identification number from the first terminal and the second terminal;
Receiving, from the first terminal, key press information indicating a key pressed at the first terminal;
Deriving an action corresponding to the terminal identification number of the first terminal and the pressed key from the action storage unit;
Deriving a key corresponding to the derived action and the terminal identification number of the second terminal from the action storage unit;
Transmitting a key control signal indicating the derived key to the second terminal;
Control method.

Images