CN112987930A - Method for realizing convenient interaction with large-size electronic product - Google Patents

Method for realizing convenient interaction with large-size electronic product Download PDF

Info

Publication number
CN112987930A
CN112987930A CN202110287527.7A CN202110287527A CN112987930A CN 112987930 A CN112987930 A CN 112987930A CN 202110287527 A CN202110287527 A CN 202110287527A CN 112987930 A CN112987930 A CN 112987930A
Authority
CN
China
Prior art keywords
finger
point
touch screen
electronic product
touched
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202110287527.7A
Other languages
Chinese (zh)
Inventor
刘苏生
朱坤
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Readboy Education Technology Co Ltd
Original Assignee
Readboy Education Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Readboy Education Technology Co Ltd filed Critical Readboy Education Technology Co Ltd
Priority to CN202110287527.7A priority Critical patent/CN112987930A/en
Publication of CN112987930A publication Critical patent/CN112987930A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013Eye tracking input arrangements
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures

Abstract

The invention discloses a method for realizing convenient interaction with a large-size electronic product, which combines retina tracking and trajectory drawing to determine an area which a user wants to touch and realize touch. By using the method and the device, when a user interacts with a large-size electronic product, the touch interaction is realized without repeatedly adjusting the hand-holding position for the area which can not be touched by the hand, so that the method and the device are more convenient.

Description

Method for realizing convenient interaction with large-size electronic product
Technical Field
The invention relates to the technical field of electronic equipment, in particular to a method for realizing convenient interaction with a large-size electronic product.
Background
The size of a display screen of electronic equipment such as a smart phone or a flat panel mainly sold in the market at present is more than 6 inches, and the following defects exist during interaction through a touch screen:
1. the upper half position of the screen of the mobile phone can not be touched when the mobile phone is operated by one hand;
2. when the mobile phone is operated by one hand, the position far away from the other side of the tiger's mouth cannot be touched, and the tiger's mouth is easy to contact the touch screen, so that the touch is mistakenly touched.
3. When a large-sized machine (such as a flat panel) is held by both hands, most areas of the touch screen cannot be touched without adjusting the hand-held position.
Disclosure of Invention
Aiming at the defects of the prior art, the invention aims to provide a method for realizing convenient interaction with a large-size electronic product.
In order to achieve the purpose, the invention adopts the following technical scheme:
a method for realizing convenient interaction with a large-size electronic product comprises the following specific processes:
s1, arranging a retina tracker on one side of a front camera of the electronic product; the retina tracker is used for continuously tracking the retina of the user and determining the current position where the eyeballs of the user look;
s2, the user looks at a point to be touched on the touch screen, and points the finger to the point to be touched and attaches the finger to the touch screen of the electronic product; the touch screen senses a contact signal of a finger and identifies the direction pointed by the finger according to the contact signal, and the retina tracker determines the current point where eyeballs of a user look;
and S3, when the direction pointed by the finger of the user is the same as the direction of the point looked at by the current eyeball, executing the click operation on the point on the touch screen.
Further, in step S2, the signal of the point touched by the finger on the touch screen is increased, the image of the point touched by the finger is drawn by plotting all the signal values exceeding the threshold value, and the direction pointed by the finger can be identified according to the obtained image.
The invention has the beneficial effects that: by using the method and the device, when a user interacts with a large-size electronic product, the touch interaction is realized without repeatedly adjusting the hand-holding position for the area which can not be touched by the hand, so that the method and the device are more convenient.
Detailed Description
The present invention will be further described below, and it should be noted that the present embodiment is based on the technical solution, and a detailed implementation manner and a specific operation process are provided, but the protection scope of the present invention is not limited to the present embodiment.
The embodiment provides a method for realizing convenient interaction with a large-size electronic product, which specifically comprises the following steps:
s1, arranging a retina tracker on one side of a front camera of the electronic product; the retina tracker is used for continuously tracking the retina of the user and determining the current eyeball looking position of the user.
S2, the user looks at a point (an icon or a menu) which is desired to be touched on the touch screen, and simultaneously points the finger at the point which is desired to be touched and attaches the finger on the touch screen of the electronic product; the touch screen senses a contact signal of a finger and accordingly recognizes a direction in which the finger points, and the retina tracker determines a point at which a user currently looks with an eyeball.
It should be noted that the touch screen is equivalent to a rectangular dot array, signals of dots touched by a finger are increased, an image of all dots with signal values exceeding a threshold value is an image of the touch screen touched by the finger, and a direction pointed by the finger can be identified according to the obtained image.
And S3, when the direction pointed by the finger of the user is the same as the direction of the point looked at by the current eyeball, executing the click operation on the point on the touch screen.
Various corresponding changes and modifications can be made by those skilled in the art based on the above technical solutions and concepts, and all such changes and modifications should be included in the protection scope of the present invention.

Claims (2)

1. A method for realizing convenient interaction with a large-size electronic product is characterized by comprising the following specific processes:
s1, arranging a retina tracker on one side of a front camera of the electronic product; the retina tracker is used for continuously tracking the retina of the user and determining the current position where the eyeballs of the user look;
s2, the user looks at a point to be touched on the touch screen, and points the finger to the point to be touched and attaches the finger to the touch screen of the electronic product; the touch screen senses a contact signal of a finger and identifies the direction pointed by the finger according to the contact signal, and the retina tracker determines the current point where eyeballs of a user look;
and S3, when the direction pointed by the finger of the user is the same as the direction of the point looked at by the current eyeball, executing the click operation on the point on the touch screen.
2. The method for facilitating interaction with large-sized electronic products according to claim 1, wherein in step S2, the signal of the point touched by the finger on the touch screen is increased, and the image of the point where all signal values exceed the threshold is the image of the touch screen touched by the finger, and the direction pointed by the finger can be identified according to the obtained image.
CN202110287527.7A 2021-03-17 2021-03-17 Method for realizing convenient interaction with large-size electronic product Pending CN112987930A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110287527.7A CN112987930A (en) 2021-03-17 2021-03-17 Method for realizing convenient interaction with large-size electronic product

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110287527.7A CN112987930A (en) 2021-03-17 2021-03-17 Method for realizing convenient interaction with large-size electronic product

Publications (1)

Publication Number Publication Date
CN112987930A true CN112987930A (en) 2021-06-18

Family

ID=76334115

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110287527.7A Pending CN112987930A (en) 2021-03-17 2021-03-17 Method for realizing convenient interaction with large-size electronic product

Country Status (1)

Country Link
CN (1) CN112987930A (en)

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101382836A (en) * 2008-09-05 2009-03-11 浙江大学 Electronic painting creative method based on multi-medium user interaction
CN102834789A (en) * 2010-04-16 2012-12-19 高通股份有限公司 Apparatus and methods for dynamically correlating virtual keyboard dimensions to user finger size
CN103052937A (en) * 2010-08-08 2013-04-17 高通股份有限公司 Method and system for adjusting display content
CN104679312A (en) * 2013-11-30 2015-06-03 鸿富锦精密工业(武汉)有限公司 Electronic device as well as touch system and touch method of electronic device
CN105302419A (en) * 2015-11-14 2016-02-03 华中师范大学 Touch screen achieving various gesture operations and operation method of touch screen
CN105593785A (en) * 2013-11-01 2016-05-18 英特尔公司 Gaze-assisted touchscreen inputs
CN106575170A (en) * 2014-07-07 2017-04-19 三星电子株式会社 Method of performing a touch action in a touch sensitive device
CN106598422A (en) * 2016-10-25 2017-04-26 深圳奥比中光科技有限公司 Directivity-based control and hybrid control methods, control system and electronic equipment
CN111831112A (en) * 2020-05-26 2020-10-27 北京理工大学 Text input system and method based on eye movement and finger micro-gesture

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101382836A (en) * 2008-09-05 2009-03-11 浙江大学 Electronic painting creative method based on multi-medium user interaction
CN102834789A (en) * 2010-04-16 2012-12-19 高通股份有限公司 Apparatus and methods for dynamically correlating virtual keyboard dimensions to user finger size
CN103052937A (en) * 2010-08-08 2013-04-17 高通股份有限公司 Method and system for adjusting display content
CN105593785A (en) * 2013-11-01 2016-05-18 英特尔公司 Gaze-assisted touchscreen inputs
CN104679312A (en) * 2013-11-30 2015-06-03 鸿富锦精密工业(武汉)有限公司 Electronic device as well as touch system and touch method of electronic device
CN106575170A (en) * 2014-07-07 2017-04-19 三星电子株式会社 Method of performing a touch action in a touch sensitive device
CN105302419A (en) * 2015-11-14 2016-02-03 华中师范大学 Touch screen achieving various gesture operations and operation method of touch screen
CN106598422A (en) * 2016-10-25 2017-04-26 深圳奥比中光科技有限公司 Directivity-based control and hybrid control methods, control system and electronic equipment
CN111831112A (en) * 2020-05-26 2020-10-27 北京理工大学 Text input system and method based on eye movement and finger micro-gesture

Similar Documents

Publication Publication Date Title
CN102905182B (en) A kind of input method, intelligent TV set and intelligent interactive system
CN103294180B (en) Man-machine interaction control method and electronic terminal
CN103593136A (en) Touch terminal, and one-hand operation method and device of large-screen touch terminal
CN109375890A (en) A kind of screen display method and Multi-screen electronic equipment
CN109558061B (en) Operation control method and terminal
CN104932809A (en) Device and method for controlling a display panel
JP2002366297A (en) Device and method for controlling operation of appliance
CN102880405A (en) Information processing apparatus, information processing method, program and remote control system
CN109683785B (en) Information processing method and mobile terminal
CN110519512B (en) Object processing method and terminal
CN108446156B (en) Application program control method and terminal
CN113541721B (en) Method for adjusting antenna communication and terminal equipment
CN110737374A (en) Operation method and electronic equipment
CN108008859A (en) A kind of screen control method and mobile terminal
CN111240545A (en) Application switching method and electronic equipment
CN111026321A (en) Touch control method and electronic equipment
CN112987930A (en) Method for realizing convenient interaction with large-size electronic product
CN108023994B (en) Side key structure and mobile terminal with same
CN110519517B (en) Copy guiding method, electronic device and computer readable storage medium
CN210401976U (en) Cloud platform camera
CN105320418A (en) Handheld electronic device, outer touch cover and computer executing method
CN109885242B (en) Method for executing operation and electronic equipment
CN110794998A (en) Control method of application icon and electronic equipment
CN110780751A (en) Information processing method and electronic equipment
CN202721714U (en) A cell phone equipped with a virtual projective keyboard

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination