JP2011221669A - Input system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an input system which allows a simple input operation without a need of operating a mobile terminal body.SOLUTION: In an input system that includes a mobile terminal device with a short-distance communication function and an article such as a ring to be worn on a user's body, the article comprises: an article body; a gesture recognition device which detects a movement of the article body and calculates a trajectory thereof so as to recognize the movement as a character or a figure; and a short-distance communication device which transmits the character or the figure recognized at the gesture recognition device to the mobile terminal device. The mobile terminal device comprises an operation determination unit which determines an operation corresponding to the character or the figure received from the article and executes processing corresponding to the operation.

Description

  The present invention relates to an input system, and more particularly to an input system including a mobile terminal device and an article to be worn on a user's body.

  In recent years, many portable terminal devices such as cellular phones have various functions such as a camera function and a projector function in addition to a call function and an e-mail function. When using such various functions, menu operations and character input operations must be performed on the mobile terminal device body, which is complicated. Against this background, there is a demand for a method for simplifying the input operation.

  Although the field is different from the mobile terminal device, as a technique for simplifying the input operation of the in-vehicle device, for example, the following Patent Document 1 is for operating a device having a plurality of operation items, Among the operation items, a selection means for selecting operation items that can be selected by the user one by one at a predetermined interval according to a predetermined order, and an interval for selecting the operation target, Notification means for notifying the user of operation items that are the operation target, instruction input means for inputting various instructions from the user, and the operation target when a predetermined selection instruction is input by the instruction input means. An input interface device is disclosed that includes means for performing an operation on the device based on an operation item.

JP 2007-164814 A

  It is possible to simplify the input operation by applying the technique of Patent Document 1 to a mobile terminal device. However, the technique described above recognizes an operation by processing an image of a finger acquired by an image input device. When such image processing is performed by a mobile terminal device, the configuration of the mobile terminal device becomes complicated. This impedes the operation of other functions of the mobile terminal device.

  In addition, since the above technique captures an image of a finger holding the handle, the image input device only needs to capture a certain direction, but when using the camera function of the mobile terminal device, a specific part of the user Cannot always be imaged.

  The present invention has been made in view of the above problems, and a main object of the present invention is to provide an input system capable of easily performing an input operation without operating a mobile terminal device body.

  In order to achieve the above object, the present invention provides an input system including a portable terminal device having a short-range communication function and an article to be worn on a user's body, wherein the article is an article main body and the article. A gesture recognition device that detects the movement of the main body to obtain a trajectory and recognizes it as a character or a graphic, and a short-range communication device that transmits the character or graphic recognized by the gesture recognition device to the mobile terminal device, The portable terminal device includes an operation determination unit that determines an operation corresponding to a character or a graphic received from the article and executes a process based on the operation.

  In addition, the present invention provides an input system including a mobile terminal device having a short-range communication function and an article to be worn on a user's body, wherein the article is an article main body and detects the movement of the article main body. A gesture recognizing device for obtaining a trajectory and a short-range communication device for transmitting the trajectory obtained by the gesture recognizing device to the mobile terminal device, wherein the mobile terminal device uses the trajectory received from the article as a character Alternatively, an operation discriminating unit that recognizes as a graphic, discriminates an operation corresponding to the recognized character or graphic, and executes processing based on the operation is provided.

  According to the input system of the present invention, it is possible to easily perform an input operation without operating the mobile terminal body. The reason for this is that, in an input system including a portable terminal device having a short-range wireless communication function such as Bluetooth and an article worn on the user's body such as a ring, the short-range communication device and the gesture recognition device are connected to the article. The gesture recognition function recognizes characters and graphics based on the movement of the article, transmits the recognized characters and graphics to the mobile terminal device by the short-range communication device, and the mobile terminal device supports the received characters and graphics. This is because control for determining an operation to be performed and executing processing based on the operation is performed.

  The gesture recognition function obtains a trajectory based on the movement of the article, transmits the obtained trajectory to the mobile terminal device by the short-range communication device, and the mobile terminal device recognizes and recognizes the received trajectory as a character or a figure. This is because control is performed to determine an operation corresponding to a character or a figure and execute processing based on the operation.

  Thereby, the menu operation, scroll operation, character input operation, etc. of the mobile terminal device can be executed from a place away from the mobile terminal device body, and the convenience of the user can be improved.

It is a figure which shows typically the structure of the input system which concerns on one Example of this invention. It is a block diagram which shows the structure of the portable terminal device which concerns on one Example of this invention. It is a block diagram which shows the structure of the gesture recognition apparatus provided in the ring which concerns on one Example of this invention.

  As shown in the background art, recent mobile terminal devices are provided with various functions, and in order to execute these functions, the mobile terminal device body must be operated, which makes the operation complicated. There is a problem.

  To solve this problem, it is possible to recognize the motion of the user's body and execute an operation corresponding to the motion as in Patent Document 1, but this method complicates the configuration of the apparatus. In addition, the operation of other functions is hindered. In addition, it is difficult to always capture a specific part of the user using the camera function of the mobile terminal device.

  Therefore, in one embodiment of the present invention, in an input system including a mobile terminal device having a short-range communication function such as Bluetooth and an article worn on the user's body such as a ring, the short-range communication is performed on the article. A device and a gesture recognition device, the gesture recognition device recognizes characters and figures based on the movement of the article, and transmits the characters and figures to the mobile terminal device using a short-range communication device. Control is performed to determine an operation corresponding to a character or graphic and execute processing based on the operation.

  This makes it possible to easily perform an input operation without causing the mobile terminal device to perform advanced image processing.

  In order to describe the above-described embodiment of the present invention in more detail, an input system according to an embodiment of the present invention will be described with reference to FIGS. FIG. 1 is a diagram schematically illustrating the configuration of the input system according to the present embodiment. FIG. 2 is a block diagram showing the configuration of the mobile terminal device of the present embodiment, and FIG. 3 is a block diagram showing the configuration of the gesture recognition device of the present embodiment.

  As shown in FIG. 1, the input system of this embodiment includes a mobile terminal device 10 such as a mobile phone or a PDA (Personal Digital Cellular), and an article to be worn on a user's body (a so-called accessory, a ring 20 in this embodiment). And).

  2, the mobile terminal device 10 includes a control unit 11, a wireless communication unit 12, a short-range communication unit 13, a camera unit 14, a voice processing unit 15, a display unit 16, an operation unit 17, and a storage unit 18. And a power source (not shown).

  The control unit 11 includes a CPU (Central Processing Unit) and a memory such as a ROM (Read Only Memory) and a RAM (Random Access Memory). The CPU performs a telephone function, a mail function, an Internet (web) connection function, a camera function, other functions of the portable terminal device, and control of each unit. The memory is a part that temporarily stores various data read from the storage unit 18, and the stored data is processed by the CPU and transferred to the storage unit 18 as necessary.

  The control unit 11 also functions as an operation determination unit 11 a that determines and executes an operation corresponding to a character or a graphic transmitted from the ring 20 with reference to a table stored in advance in the storage unit 19. The operation determination unit 11a may be configured as hardware, or may be configured as a control program that causes a computer to function as the operation determination unit 11a, and the control program may be operated on the control unit 11.

  The wireless communication unit 12 transmits and receives information to and from the wireless base station device via an antenna.

  The short-range communication unit 13 communicates with the short-range communication device 23 of the ring 20 using Bluetooth or infrared communication technology using a 2.45 GHz band radio wave, and recognizes characters or characters recognized by the gesture recognition device 22 of the ring 20. Receive shapes.

  The camera unit 14 acquires (shoots) image information.

  The voice processing unit 15 processes a voice signal input / output via the transmission unit (microphone 15b) and the reception unit (speaker 15a).

  The display unit 16 includes a liquid crystal display (LCD), an organic EL (electroluminescence) display device, and the like, and performs information display output (video signal processing) of images, figures, characters, symbols, and the like.

  The operation unit 17 includes a numeric keypad, a scroll key, a cross key, a determination key, and the like, and enables various information to be input to the mobile terminal device 10.

  The storage unit 19 includes a flash memory or the like, and includes phone book information, sent / received mail information, incoming / outgoing call information, application program information, captured images, various settings of the mobile terminal device 10, a table that associates characters, figures, and operations, and the like Store.

  The ring 20 includes a ring body 21 to be worn on the user's body (finger), a gesture recognition device 22, a short-range communication device 23, a power source (not shown), and the like.

  The gesture recognition device 22 is fixed to the ring body 21 and recognizes the movement (gesture) of the user's finger. Specifically, as shown in FIG. 3, the motion detection unit 22a, the gesture determination unit 22b, and the storage unit 22c are configured. The motion detection unit 22a is configured by an acceleration sensor or the like, detects a motion (gesture) of the user's finger, and transmits the motion to the gesture determination unit 22b. The gesture determination unit 22b calculates a movement distance and a movement direction from the output and time of the acceleration sensor, converts them into coordinates, obtains a trajectory obtained by connecting the coordinates, and refers to a table stored in advance in the storage unit 22c. And identify shapes. The memory | storage part 22c memorize | stores the shape of the character and figure used as object.

  The short-range communication device 23 communicates with the short-range communication unit 13 of the mobile terminal device 10 using Bluetooth or the like, and transmits characters and figures recognized by the gesture recognition device 22 to the mobile terminal device 10.

  1 to 3 are examples of the present embodiment, and the configuration thereof can be changed as appropriate without departing from the gist of the present invention. For example, in FIG. 1, the gesture recognition device 22 and the short-range communication device 23 are arranged around the ring body 21, but these devices may be embedded inside the ring body 21.

  Hereinafter, the operation of the input system of this embodiment will be described.

  First, the user wears the ring body 21 of the ring 20 on the finger. If a switch for operating the gesture recognition device 22 or the short-range communication device 23 of the ring 20 is provided, the switch is turned on. Moreover, when the switch for functioning the near field communication part 13 of the portable terminal device 10 is provided, the said switch is turned ON.

  Next, the user moves his / her finger to perform a predetermined gesture. In addition, how to move a finger is arbitrary, For example, operations, such as drawing a character, a figure, etc. with a finger, or shaking a finger up and down or right and left, are performed.

  Then, the gesture recognition device 22 of the ring 20 detects the movement of the user's finger, calculates the movement distance and the movement direction from the output and time of the acceleration sensor, obtains a locus, and stores a table stored in advance in the storage unit 22c. Referring to it, the locus drawn by the fingertip is recognized as a character or figure.

  Next, the short-range communication device 23 of the ring 20 transmits the characters and graphics recognized by the gesture recognition device 22 to the short-range communication unit 13 of the mobile terminal device 10.

  The control unit 11 (operation determination unit 11a) of the mobile terminal device 10 refers to a table stored in advance in the storage unit 18, determines an operation corresponding to the character or figure received from the ring 20, and performs processing based on the operation Execute.

  For example, when the user draws characters such as “M”, “Me”, “Me” or a specific figure, the operation determination unit 11 a determines that the operation is a menu operation and displays the menu screen on the display unit 16. Let Further, when the user swings his / her finger up / down or left / right, the operation determination unit 11a determines that the operation is scrolling the screen and scrolls the screen. In the case of creating a mail, the characters and figures received from the ring 20 are inserted into the text.

  As described above, when the ring 20 including the gesture recognition device 22 is moved, the movement of the ring 20 is recognized as a character or a graphic and transmitted to the mobile terminal device 10, and the mobile terminal device 10 performs an operation corresponding to the character or the graphic. Therefore, the user can perform a specific operation without operating the operation unit 17 of the mobile terminal device 10, and can easily perform an input operation.

  In the above description, the gesture recognition device 22 of the ring 20 recognizes characters or graphics. However, the gesture recognition device 22 recognizes the locus drawn by the user's fingertip as it is as locus information, and the locus information. May be transmitted to the mobile terminal device 10. In that case, a table for associating trajectory information with characters and graphics is stored in the storage unit 18 of the mobile terminal device 10, and the operation determination unit 11a may recognize the characters and graphics with reference to this table.

  Moreover, in the said Example, although the one ring 20 provided with the gesture recognition apparatus 22 was used, this invention is not limited to the said Example, The ring 20 provided with the gesture recognition apparatus 22 is made into several fingers. It is also possible to wear gestures with a plurality of fingers. Moreover, in the said Example, although the gesture recognition apparatus 22 and the short-distance communication apparatus 23 were provided in the ring 20, you may give a similar function to a timepiece.

  INDUSTRIAL APPLICABILITY The present invention can be used for any input system that performs communication between an article worn on a user's body and a mobile communication terminal using a short-range communication function.

DESCRIPTION OF SYMBOLS 10 Portable terminal device 11 Control part 11a Operation discrimination | determination part 12 Wireless communication part 13 Near field communication part 14 Camera part 15 Audio | voice process part 15a Speaker 15b Microphone 16 Display part 17 Operation part 18 Storage part 20 Ring 21 Ring main body 22 Gesture recognition apparatus 22a Motion detection unit 22b Gesture determination unit 22c Storage unit 23 Short-range communication unit

Claims (4)

In an input system composed of a mobile terminal device having a short-range communication function and an article to be worn on the user's body,
The article is an article body, a movement is detected by detecting the movement of the article body, a trajectory is obtained, and a character recognition or a figure recognized by the gesture recognition apparatus is transmitted to the portable terminal device. A short-range communication device,
The mobile terminal device includes an operation determination unit that determines an operation corresponding to a character or a graphic received from the article and executes a process based on the operation. In an input system composed of a mobile terminal device having a short-range communication function and an article to be worn on the user's body,
The article includes an article main body, a gesture recognition device that detects a movement of the article main body and obtains a locus, and a short-range communication device that transmits the locus obtained by the gesture recognition device to the mobile terminal device. ,
The mobile terminal device includes an operation determination unit that recognizes a trajectory received from the article as a character or a graphic, determines an operation corresponding to the recognized character or graphic, and executes a process based on the operation. And input system.   The input system according to claim 1, wherein the operation corresponding to the character or the figure is any one of a menu operation, a scroll operation, and a character input operation.   The input system according to claim 1, wherein the article main body is a ring.

Images