KR20110013076A - Ring input device for gestural and touch interface use camera system - Google Patents
Ring input device for gestural and touch interface use camera system Download PDFInfo
- Publication number
- KR20110013076A KR20110013076A KR1020090071074A KR20090071074A KR20110013076A KR 20110013076 A KR20110013076 A KR 20110013076A KR 1020090071074 A KR1020090071074 A KR 1020090071074A KR 20090071074 A KR20090071074 A KR 20090071074A KR 20110013076 A KR20110013076 A KR 20110013076A
- Authority
- KR
- South Korea
- Prior art keywords
- ring
- mouse
- input
- camera
- information
- Prior art date
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
- G06F3/0346—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/002—Specific input/output arrangements not covered by G06F3/01 - G06F3/16
- G06F3/005—Input arrangements through a video camera
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/014—Hand-worn input/output arrangements, e.g. data gloves
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
- G06F3/038—Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
- G06F3/0383—Signal control means within the pointing device
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/042—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means
- G06F3/0425—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/033—Indexing scheme relating to G06F3/033
- G06F2203/0331—Finger worn pointing device
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/038—Indexing scheme relating to G06F3/038
- G06F2203/0384—Wireless input, i.e. hardware and software details of wireless interface arrangements for pointing devices
Abstract
The present invention relates to an input device that allows a user to conveniently control the operation of various multimedia devices by receiving an input of a ring-shaped mouse that is easy to carry and carry.
Description
Auxiliary input devices of existing electronic products and computer systems have disadvantages of being inconvenient to carry and difficult to input variously by the input means itself. In particular, IPTV has different characteristics from conventional TV in that it provides various contents and interactive services. However, the auxiliary input device of the IPTV uses the same remote control as the conventional TV, and has a disadvantage in that it is difficult for users to easily use the increased number of buttons.
While many contents on the web are composed of multimedia contents such as UCC in text-based contents, existing input devices are limited in producing such multimedia contents. Representatively, content creation using 3D graphic tools is difficult to express what the user intended by inputting with a mouse.
In addition, in the era of ubiquitous network, there is a need for an auxiliary input device for easily inputting and obtaining information desired by a user by accessing a network system providing a large amount of information through a personalized input device anytime and anywhere.
Due to this necessity, the present invention has been invented a ring-type input device system having a high portability since it can be worn on a person's hand (gesture) and hand so that information can be easily input and obtained anytime and anywhere.
Most laptops in recent releases are equipped with webcams, and desktop computers often use external webcams. In addition, devices such as mobile phones are equipped with a camera as a standard, and most multimedia devices are generally equipped with at least one camera. In order to recognize human gestures, it is essential to accurately distinguish objects from objects based on distance information in three-dimensional space. Therefore, recently, a stereo camera capable of reading three-dimensional stereoscopic information through two cameras similar to the human eye has been used. However, as mentioned earlier, two cameras are often not configurable elements.
It is recommended to use a stereo camera with a display device that is not equipped with a webcam, such as a TV, and to configure a recognition system using a single camera basically so that no additional cost or effort is incurred for many multimedia devices. . In the existing technology of recognizing motion through a single camera, a camera continuously tracks a particular color through a learning process called machine learning. In general, however, an auxiliary sensor such as an infrared sensor or a distance sensor should be used for a sense of space.
However, since the infrared sensor and the distance sensor need to be additionally installed, it is necessary to use a method of recognizing the distance between the two markers through two markers in order to accurately recognize the motion without these elements.
In order to recognize gestures, I had to think about the form of attachment to the hand. In addition, considering the portability, the input device is made in the form of a ring, which can be easily worn on the hand. In addition, two markers were required to take into account the camera's accuracy, so one ring must be made in each hand to make it applicable in any environment.
It is necessary to make a device that can be accessed from the outside using a wireless network environment (Wi-Fi) by applying two-way data exchange and real-time communication Bluetooth, which are recently applied to many multimedia devices.
An object of the present invention is to enable a variety of input and expression through the hand gesture and the ring-shaped mouse by easily connected to various types of multimedia display device anytime, anywhere.
It can be connected to the device remotely by using wireless communication, so that the user can do anytime and anywhere desired gestures. When the gestures are recognized by the camera at the same time, 3D graphic work can be performed by using the hand gesture and the ring-shaped mouse. An object of the present invention is to be able to more effectively express stereoscopic images using a keyboard and a mouse, which are conventional computer auxiliary input devices.
The present invention RingMote can send an input signal to various multimedia devices (IPTV, computer, mobile phone, digital camera, kiosk, etc.) by using a ring-shaped mouse equipped with a touch screen fitted to both hands through wireless communication, It is an input device that can easily input information and use contents anytime and anywhere when the user uses a multimedia device by recognizing the motion of a hand through one or more cameras.
Cell phones equipped with cameras, digital cameras, and laptops equipped with recently released webcams can use Bluetooth communication to make gestures and input various types of ringMotes. In addition, a TV can be equipped with an external webcam and transmit input information using Bluetooth and Wi-Fi wireless communication. In addition, using a stereo camera consisting of two or more cameras makes it easier to track hand gestures.
The same applies to kiosks that are installed in public places for unmanned systems and information. Those with ordinary knowledge can recognize that more than one camera recognizes gestures and that fine input is possible through a ring-shaped mouse with a touch screen.
In addition, it is highly versatile in systems without cameras because most of the functions implemented in existing mice can be used using only a ring-type mouse with a touch screen. In the touch screen of the ring-shaped mouse, it is used as a connection information indicating which device is currently connected, and a status information window indicating which operation is being performed. In addition, it performs a function of receiving simple information.
Under the ubiquitous network system, all devices are networked to provide information anytime, anywhere. In the ubiquitous era, users will need personalized input devices that can easily access the network and input information anytime, anywhere. The present invention in the form of a highly portable ring is an item that can satisfy the needs of individual users in accordance with the trend of this era.
The present invention relates to an input device that allows a user to conveniently control the operation of various multimedia devices by receiving an input of a ring-shaped mouse that is easy to carry and carry.
The camera, ring-shaped mouse, and hand gestures eliminate the inconvenience of input methods such as the keyboard, mouse, and TV remote control of the existing computer, and can easily control the information of various contents such as the multimedia contents of the Internet and IPTV service. There is this.
Basically, it is possible to use a stereo camera that can easily process three-dimensional information, but the focus is on using a single camera system that is widely used, such as a webcam mounted on a laptop and a camera mounted on a mobile phone. It is possible to recognize the gesture and input only the present invention without the need for additional configuration has a good marketability for many users.
In addition, the present invention can use the function of the existing mouse through the touch screen of the present invention if the device supports a wireless communication (Bluetooth, Wi-Fi) even without a camera. The user can carry the input device which is easy to carry anytime, anywhere in the daily life, and access the system that provides the information such as the kiosk installed in the public place, which makes it convenient to input and acquire the information.
1 is a view showing an embodiment of the present invention. As shown in the figure, one or more camera lenses mounted on the TV display capture hand movements to recognize gestures. In addition, detailed input is possible through a ring-shaped mouse equipped with a touch screen fitted to both index fingers of the user.
In particular, the present invention, which consists of two rings, can recognize distance and identify even a device such as a laptop, a desktop computer, a mobile phone, and a digital camera equipped with a general webcam composed of one camera lens. This is because one ring becomes a reference point and can recognize gestures by triangulation by recognizing the distance from the other ring position. Therefore, it is possible to freely input and express by easily accessing the device only by the present invention without the need for additional additional camera configuration.
Furthermore, the present invention is a convenient input means even for a digital device without a camera. Since the functions of the existing mouse can be easily implemented only by the present invention in both ring shapes, the user can input or express by connecting to the device through wireless communication anytime and anywhere.
Figure 2 shows a ring-shaped mouse to be fitted to the finger, the outer side of the ring is configured as a touch screen has the same function as the click, drag and the like through the conventional mouse. In addition, when used in combination with hand gestures (gestures), it is possible to express a three-dimensional form or to rotate a 3D object in the air.
For example, if you touch the touch screen of the left ring once, it will be one-click (select), if you touch it twice, two-click (execute), and if you move it with the feeling of pressing it down or up, you can drag it (select by dragging). And so on. In addition, when viewing a 3D graphic screen, the user can use the hand gestures and the mouse simultaneously to rotate and zoom the screen.
In addition, the screen of the touch screen portion is characterized in that the function to sequentially display the associated device and the necessary information accordingly.
The above embodiment is only a description of the method to help understand the present invention, and those skilled in the relevant art will be able to interpret the true scope of the invention in the claims.
The gesture interface can be input by various settings input by the user. For example, a function of enlarging the screen as shown in FIG. 3 and a function of reducing the screen as shown in FIG. 4 may be set through two rings.
FIG. 5 is a diagram illustrating character input in the air through hand gestures recognized through one or more camera lenses. Character input is possible without a separate device such as a keyboard.
FIG. 6 is a diagram illustrating an embodiment in response to 3D work and content through the system of the present invention. When it is necessary to express 3D graphic content or 3D graphic on the display screen, it is easier than inputting information with existing mouse and keyboard and receiving or expressing content information through hand movement and ring touch screen operation. Have
1 is a diagram showing an application example of the IPTV of the present invention.
2 is a view showing a ring-shaped mouse fitted to the present finger.
3 is a diagram showing a representative example of a gesture (gesture) interface of the present invention (a situation of inputting a magnification command of a screen).
4 is a diagram showing a representative example of a gesture (gesture) interface of the present invention (a situation of inputting a reduction command of a screen).
FIG. 5 is a diagram illustrating character input in the air through a gesture recognized through a camera lens of the present invention.
6 is a view showing an embodiment in response to 3D work and content through the present invention.
* Explanation of symbols for the main parts of the drawings
110: the present invention in the form of a ring equipped with a touch screen
111: touch screen that functions as a command input
120: both hands
121: left hand
122: right hand
130: one or more cameras mounted on the TV display
140: multimedia display
150: 3D content
Claims (3)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| KR1020090071074A KR20110013076A (en) | 2009-08-01 | 2009-08-01 | Ring input device for gestural and touch interface use camera system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| KR1020090071074A KR20110013076A (en) | 2009-08-01 | 2009-08-01 | Ring input device for gestural and touch interface use camera system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| KR20110013076A true KR20110013076A (en) | 2011-02-09 |
Family
ID=43772905
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| KR1020090071074A KR20110013076A (en) | 2009-08-01 | 2009-08-01 | Ring input device for gestural and touch interface use camera system |
Country Status (1)
| Country | Link |
|---|---|
| KR (1) | KR20110013076A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103645803A (en) * | 2013-12-18 | 2014-03-19 | 王大鹏 | Miniature portable multifunctional wireless body feeling capture control system |
| CN111766941A (en) * | 2020-05-15 | 2020-10-13 | 中国科学院计算技术研究所 | Gesture recognition method and system based on intelligent ring |
| KR20200122202A (en) * | 2019-04-17 | 2020-10-27 | 주식회사 지티온 | system for executing virtual interactive contents software using recognition of player's kinetic movement |
-
2009
- 2009-08-01 KR KR1020090071074A patent/KR20110013076A/en not_active Application Discontinuation
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103645803A (en) * | 2013-12-18 | 2014-03-19 | 王大鹏 | Miniature portable multifunctional wireless body feeling capture control system |
| KR20200122202A (en) * | 2019-04-17 | 2020-10-27 | 주식회사 지티온 | system for executing virtual interactive contents software using recognition of player's kinetic movement |
| CN111766941A (en) * | 2020-05-15 | 2020-10-13 | 中国科学院计算技术研究所 | Gesture recognition method and system based on intelligent ring |
| CN111766941B (en) * | 2020-05-15 | 2021-11-09 | 中国科学院计算技术研究所 | Gesture recognition method and system based on intelligent ring |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Lee et al. | Interaction methods for smart glasses: A survey | |
| US9389779B2 (en) | Depth-based user interface gesture control | |
| KR101896947B1 (en) | An apparatus and method for inputting command using gesture | |
| KR102091028B1 (en) | Method for providing user's interaction using multi hovering gesture | |
| US8555171B2 (en) | Portable virtual human-machine interaction device and operation method thereof | |
| US20150220158A1 (en) | Methods and Apparatus for Mapping of Arbitrary Human Motion Within an Arbitrary Space Bounded by a User's Range of Motion | |
| US20100171696A1 (en) | Motion actuation system and related motion database | |
| KR20130105725A (en) | Computer vision based two hand control of content | |
| CN103729054A (en) | Multi display device and control method thereof | |
| KR20140114913A (en) | Apparatus and Method for operating sensors in user device | |
| US20110250929A1 (en) | Cursor control device and apparatus having same | |
| KR20150031986A (en) | Display apparatus and control method thereof | |
| TW201528048A (en) | Image-based virtual interactive device and method thereof | |
| KR200477008Y1 (en) | Smart phone with mouse module | |
| US20160147294A1 (en) | Apparatus and Method for Recognizing Motion in Spatial Interaction | |
| KR101435773B1 (en) | Remote control device and remote control method of smart TV. | |
| KR20120061169A (en) | Object control system using the mobile with touch screen | |
| KR20110013076A (en) | Ring input device for gestural and touch interface use camera system | |
| TWM485448U (en) | Image-based virtual interaction device | |
| JP2023179345A (en) | Information input method, information input device, electronic equipment, and storage medium | |
| US9348461B2 (en) | Input system | |
| TWI547862B (en) | Multi - point handwriting input control system and method | |
| CN105389031A (en) | Man-machine interaction method and device | |
| KR101439178B1 (en) | System and Method for remote control using camera | |
| KR101491648B1 (en) | System and Method for remote control using camera |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| WITN | Withdrawal due to no request for examination |