CN112987930A - Method for realizing convenient interaction with large-size electronic product - Google Patents
Method for realizing convenient interaction with large-size electronic product Download PDFInfo
- Publication number
- CN112987930A CN112987930A CN202110287527.7A CN202110287527A CN112987930A CN 112987930 A CN112987930 A CN 112987930A CN 202110287527 A CN202110287527 A CN 202110287527A CN 112987930 A CN112987930 A CN 112987930A
- Authority
- CN
- China
- Prior art keywords
- finger
- point
- touch screen
- electronic product
- touched
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/013—Eye tracking input arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses a method for realizing convenient interaction with a large-size electronic product, which combines retina tracking and trajectory drawing to determine an area which a user wants to touch and realize touch. By using the method and the device, when a user interacts with a large-size electronic product, the touch interaction is realized without repeatedly adjusting the hand-holding position for the area which can not be touched by the hand, so that the method and the device are more convenient.
Description
Technical Field
The invention relates to the technical field of electronic equipment, in particular to a method for realizing convenient interaction with a large-size electronic product.
Background
The size of a display screen of electronic equipment such as a smart phone or a flat panel mainly sold in the market at present is more than 6 inches, and the following defects exist during interaction through a touch screen:
1. the upper half position of the screen of the mobile phone can not be touched when the mobile phone is operated by one hand;
2. when the mobile phone is operated by one hand, the position far away from the other side of the tiger's mouth cannot be touched, and the tiger's mouth is easy to contact the touch screen, so that the touch is mistakenly touched.
3. When a large-sized machine (such as a flat panel) is held by both hands, most areas of the touch screen cannot be touched without adjusting the hand-held position.
Disclosure of Invention
Aiming at the defects of the prior art, the invention aims to provide a method for realizing convenient interaction with a large-size electronic product.
In order to achieve the purpose, the invention adopts the following technical scheme:
a method for realizing convenient interaction with a large-size electronic product comprises the following specific processes:
s1, arranging a retina tracker on one side of a front camera of the electronic product; the retina tracker is used for continuously tracking the retina of the user and determining the current position where the eyeballs of the user look;
s2, the user looks at a point to be touched on the touch screen, and points the finger to the point to be touched and attaches the finger to the touch screen of the electronic product; the touch screen senses a contact signal of a finger and identifies the direction pointed by the finger according to the contact signal, and the retina tracker determines the current point where eyeballs of a user look;
and S3, when the direction pointed by the finger of the user is the same as the direction of the point looked at by the current eyeball, executing the click operation on the point on the touch screen.
Further, in step S2, the signal of the point touched by the finger on the touch screen is increased, the image of the point touched by the finger is drawn by plotting all the signal values exceeding the threshold value, and the direction pointed by the finger can be identified according to the obtained image.
The invention has the beneficial effects that: by using the method and the device, when a user interacts with a large-size electronic product, the touch interaction is realized without repeatedly adjusting the hand-holding position for the area which can not be touched by the hand, so that the method and the device are more convenient.
Detailed Description
The present invention will be further described below, and it should be noted that the present embodiment is based on the technical solution, and a detailed implementation manner and a specific operation process are provided, but the protection scope of the present invention is not limited to the present embodiment.
The embodiment provides a method for realizing convenient interaction with a large-size electronic product, which specifically comprises the following steps:
s1, arranging a retina tracker on one side of a front camera of the electronic product; the retina tracker is used for continuously tracking the retina of the user and determining the current eyeball looking position of the user.
S2, the user looks at a point (an icon or a menu) which is desired to be touched on the touch screen, and simultaneously points the finger at the point which is desired to be touched and attaches the finger on the touch screen of the electronic product; the touch screen senses a contact signal of a finger and accordingly recognizes a direction in which the finger points, and the retina tracker determines a point at which a user currently looks with an eyeball.
It should be noted that the touch screen is equivalent to a rectangular dot array, signals of dots touched by a finger are increased, an image of all dots with signal values exceeding a threshold value is an image of the touch screen touched by the finger, and a direction pointed by the finger can be identified according to the obtained image.
And S3, when the direction pointed by the finger of the user is the same as the direction of the point looked at by the current eyeball, executing the click operation on the point on the touch screen.
Various corresponding changes and modifications can be made by those skilled in the art based on the above technical solutions and concepts, and all such changes and modifications should be included in the protection scope of the present invention.
Claims (2)
1. A method for realizing convenient interaction with a large-size electronic product is characterized by comprising the following specific processes:
s1, arranging a retina tracker on one side of a front camera of the electronic product; the retina tracker is used for continuously tracking the retina of the user and determining the current position where the eyeballs of the user look;
s2, the user looks at a point to be touched on the touch screen, and points the finger to the point to be touched and attaches the finger to the touch screen of the electronic product; the touch screen senses a contact signal of a finger and identifies the direction pointed by the finger according to the contact signal, and the retina tracker determines the current point where eyeballs of a user look;
and S3, when the direction pointed by the finger of the user is the same as the direction of the point looked at by the current eyeball, executing the click operation on the point on the touch screen.
2. The method for facilitating interaction with large-sized electronic products according to claim 1, wherein in step S2, the signal of the point touched by the finger on the touch screen is increased, and the image of the point where all signal values exceed the threshold is the image of the touch screen touched by the finger, and the direction pointed by the finger can be identified according to the obtained image.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110287527.7A CN112987930A (en) | 2021-03-17 | 2021-03-17 | Method for realizing convenient interaction with large-size electronic product |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110287527.7A CN112987930A (en) | 2021-03-17 | 2021-03-17 | Method for realizing convenient interaction with large-size electronic product |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112987930A true CN112987930A (en) | 2021-06-18 |
Family
ID=76334115
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110287527.7A Pending CN112987930A (en) | 2021-03-17 | 2021-03-17 | Method for realizing convenient interaction with large-size electronic product |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112987930A (en) |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101382836A (en) * | 2008-09-05 | 2009-03-11 | 浙江大学 | Electronic painting creative method based on multi-medium user interaction |
| CN102834789A (en) * | 2010-04-16 | 2012-12-19 | 高通股份有限公司 | Apparatus and methods for dynamically correlating virtual keyboard dimensions to user finger size |
| CN103052937A (en) * | 2010-08-08 | 2013-04-17 | 高通股份有限公司 | Method and system for adjusting display content |
| CN104679312A (en) * | 2013-11-30 | 2015-06-03 | 鸿富锦精密工业(武汉)有限公司 | Electronic device as well as touch system and touch method of electronic device |
| CN105302419A (en) * | 2015-11-14 | 2016-02-03 | 华中师范大学 | Touch screen achieving various gesture operations and operation method of touch screen |
| CN105593785A (en) * | 2013-11-01 | 2016-05-18 | 英特尔公司 | Gaze-assisted touchscreen inputs |
| CN106575170A (en) * | 2014-07-07 | 2017-04-19 | 三星电子株式会社 | Method of performing a touch action in a touch sensitive device |
| CN106598422A (en) * | 2016-10-25 | 2017-04-26 | 深圳奥比中光科技有限公司 | Directivity-based control and hybrid control methods, control system and electronic equipment |
| CN111831112A (en) * | 2020-05-26 | 2020-10-27 | 北京理工大学 | Text input system and method based on eye movement and finger micro-gesture |
-
2021
- 2021-03-17 CN CN202110287527.7A patent/CN112987930A/en active Pending
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101382836A (en) * | 2008-09-05 | 2009-03-11 | 浙江大学 | Electronic painting creative method based on multi-medium user interaction |
| CN102834789A (en) * | 2010-04-16 | 2012-12-19 | 高通股份有限公司 | Apparatus and methods for dynamically correlating virtual keyboard dimensions to user finger size |
| CN103052937A (en) * | 2010-08-08 | 2013-04-17 | 高通股份有限公司 | Method and system for adjusting display content |
| CN105593785A (en) * | 2013-11-01 | 2016-05-18 | 英特尔公司 | Gaze-assisted touchscreen inputs |
| CN104679312A (en) * | 2013-11-30 | 2015-06-03 | 鸿富锦精密工业(武汉)有限公司 | Electronic device as well as touch system and touch method of electronic device |
| CN106575170A (en) * | 2014-07-07 | 2017-04-19 | 三星电子株式会社 | Method of performing a touch action in a touch sensitive device |
| CN105302419A (en) * | 2015-11-14 | 2016-02-03 | 华中师范大学 | Touch screen achieving various gesture operations and operation method of touch screen |
| CN106598422A (en) * | 2016-10-25 | 2017-04-26 | 深圳奥比中光科技有限公司 | Directivity-based control and hybrid control methods, control system and electronic equipment |
| CN111831112A (en) * | 2020-05-26 | 2020-10-27 | 北京理工大学 | Text input system and method based on eye movement and finger micro-gesture |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108958615B (en) | Display control method, terminal and computer readable storage medium | |
| KR102476976B1 (en) | Image processing method and flexible screen terminal | |
| CN103294180B (en) | Man-machine interaction control method and electronic terminal | |
| CN103593136A (en) | Touch terminal, and one-hand operation method and device of large-screen touch terminal | |
| CN109375890A (en) | A kind of screen display method and Multi-screen electronic equipment | |
| CN109800045B (en) | Display method and terminal | |
| CN107809534B (en) | Control method, terminal and computer storage medium | |
| CN109558061A (en) | A kind of method of controlling operation thereof and terminal | |
| CN110780769A (en) | Control method, control device, wearable device and medium | |
| CN108008859A (en) | A kind of screen control method and mobile terminal | |
| CN113541721A (en) | Method for adjusting antenna communication and terminal equipment | |
| WO2023016372A1 (en) | Control method and apparatus, and electronic device and storage medium | |
| CN210401976U (en) | Cloud platform camera | |
| CN103354619A (en) | Method and system for remotely controlling digital television terminal through mobile terminal | |
| CN111026321A (en) | Touch control method and electronic equipment | |
| CN112987930A (en) | Method for realizing convenient interaction with large-size electronic product | |
| CN110780751A (en) | Information processing method and electronic equipment | |
| CN108023994B (en) | Side key structure and mobile terminal with same | |
| CN110794998B (en) | Control method of application icon and electronic equipment | |
| CN202721714U (en) | A cell phone equipped with a virtual projective keyboard | |
| CN109445656B (en) | Screen control method and terminal equipment | |
| CN105320418A (en) | Handheld electronic device, outer touch cover and computer executing method | |
| CN209746519U (en) | mobile phone mouse input system | |
| CN107613108B (en) | Operation processing method and device and computer readable storage medium | |
| CN110536009B (en) | Communication establishing method and mobile terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |