CN105739877A - Distance sensor based zoom method and system - Google Patents

Distance sensor based zoom method and system Download PDF

Info

Publication number
CN105739877A
CN105739877A CN201610044378.0A CN201610044378A CN105739877A CN 105739877 A CN105739877 A CN 105739877A CN 201610044378 A CN201610044378 A CN 201610044378A CN 105739877 A CN105739877 A CN 105739877A
Authority
CN
China
Prior art keywords
distance
omega
scaling
user
quaternion
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201610044378.0A
Other languages
Chinese (zh)
Other versions
CN105739877B (en
Inventor
罗春
张世民
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Suzhou Xiangcheng Daichen Science And Technology Industrial Park Operation Management Co Ltd
Original Assignee
Suzhou Parktech Iot Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Suzhou Parktech Iot Co Ltd filed Critical Suzhou Parktech Iot Co Ltd
Priority to CN201610044378.0A priority Critical patent/CN105739877B/en
Publication of CN105739877A publication Critical patent/CN105739877A/en
Application granted granted Critical
Publication of CN105739877B publication Critical patent/CN105739877B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/048Indexing scheme relating to G06F3/048
    • G06F2203/04806Zoom, i.e. interaction techniques or interactors for controlling the zooming operation

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Gyroscopes (AREA)
  • Navigation (AREA)

Abstract

The invention provides a distance sensor based zoom mode for a mobile device. A distance c from the mobile device to the eyes of a user is obtained in real time, and the mobile device determines a zoom ratio according to the distance c to zoom out a display object. The zoom mode comprises the following steps of S1, obtaining data of an accelerometer and a gyroscope of a distance sensor in real time; and S2, according to the data obtained in the step S1, obtaining the distance c by adopting a quaternion method. When the mobile device is taken far away from the eyes of the user, the display object such as a picture and the like is automatically zoomed in; and when the mobile device is close to the eyes of the user, the display object is automaically zoomed out. The usage mode meets the ergonomics design, the user experience can be improved, and especially the large-sized mobile device is more convenient and comfortable to use.

Description

Zooming method and system based on distance sensor
Technical Field
The present invention relates to a scaling method and system, and more particularly, to a scaling method and system based on a distance reactor.
Background
Manual zooming is widely used in mobile devices for browsing pictures and taking photos. Generally, pressing the screen with two fingers simultaneously and pulling to both sides can zoom in, and moving closer together can zoom out. Holding the device in one hand and touching the screen with two fingers on the other hand is a current simple and popular implementation. This approach requires both fingers of one hand holding the device and the other hand to operate simultaneously to achieve zooming, but becomes increasingly difficult as the size of the handset and the panel become larger. Such as a 12-inch or larger screen, it is not convenient to use the current two-finger touch method for zooming.
Disclosure of Invention
In view of the above problems, an object of the present invention is to provide a distance sensor-based zooming method and system for a mobile device, in which a display object such as a picture is automatically zoomed in when the mobile device is far away from the eyes of a user, and the display object is automatically zoomed out when the mobile device is close to the eyes of the user. The use mode is in accordance with ergonomics, and simultaneously, the user experience can be improved, and particularly, the use of a large-size mobile device is more convenient and comfortable.
In order to solve the technical problems, the technical scheme adopted by the invention is as follows:
a zooming method based on a distance sensor is characterized in that: and acquiring the distance c from the mobile equipment to the eyes of the user in real time, and determining the scaling ratio by the mobile equipment according to the distance c to scale the display object.
Preferably, the method comprises the following steps:
s1, acquiring data of an accelerometer and a gyroscope of the distance sensor in real time;
and S2, obtaining the distance c by adopting a quaternion method according to the data acquired in the step S1.
More preferably, step S2 includes:
s21, defining the posture of the mobile device in the geographic coordinate system as a quaternion (q)0,q1,q2,q3) The quaternion (q) is obtained by solving the following differential equation0,q1,q2,q3):
q · 0 q · 1 q · 2 q · 3 = 1 2 ω ( t ) Q ( t ) = 1 2 0 - ω n x b - ω n y b - ω n z b ω n x b 0 ω n z b - ω n y b ω n y b - ω n z b 0 ω n x b ω n z b ω n y b - ω n x b 0 q 0 q 1 q 2 q 3
Wherein,is the derivative of the quaternion, ω (t) is the angular velocity, Q (t) is the current quaternion,the angular velocities of the x axis, the y axis and the z axis output by the gyroscope are respectively, n is a geographic coordinate system, and b is a distance sensor coordinate system;
s22, obtaining the included angle gamma between the connecting line of the wrist and the elbow joint of the user and the connecting line of the elbow joint and the eye part by the following formula:
γ = 1 - 2 q 1 2 - 2 q 2 2 ;
s23, obtaining the distance c by:
c2=a2+b2-2abcos(γ)
wherein, a is the distance from the wrist to the elbow joint of the user, and b is the distance from the elbow joint of the user to the eyes.
More preferably, the included angle γ, the distance c and the scaling are obtained by a system-on-chip operation.
Further, the display object is zoomed by the CPU of the system-on-chip according to the zoom scale.
Preferably, the scaling is proportional to the distance c.
A zooming system for realizing any one of the zooming methods based on the distance sensor comprises an accelerometer and a gyroscope and further comprises a chip, wherein the chip comprises:
the distance sensing processing module is used for receiving data output by the accelerometer and the gyroscope in real time and calculating a scaling ratio through a quaternion method;
and the CPU is used for receiving the scaling output by the distance sensing processing module and scaling the display object according to the scaling.
Preferably, the chip is a system-on-chip.
By adopting the technical scheme, compared with the prior art, the invention has the following advantages: the mobile equipment is automatically enlarged when the mobile equipment is taken away from the display objects such as the eye images, the web pages and the like of the user, the display objects close to the eyes of the user are automatically reduced, the user can hold the mobile equipment with two hands, the use mode accords with human engineering, and meanwhile, the use mode can improve the user experience, is comfortable and more reasonable to use, and is suitable for large-size mobile equipment; and for small-sized tablet or mobile phone, the method is also suitable, and the zooming can be realized by holding with only one hand.
Drawings
FIG. 1 is a diagram illustrating a usage status of a mobile device according to the present invention;
FIG. 2 is a schematic diagram of the zooming principle of the present invention;
FIG. 3 is a schematic diagram illustrating the solution of the distance γ according to the present invention;
FIG. 4 is a block diagram of a zoom system of the present invention.
Wherein, 1, an accelerometer; 2. a gyroscope; 3. a system-on-chip; 31. a distance sensing processing module; 32. a CPU.
Detailed Description
Preferred embodiments of the present invention will be described in detail below with reference to the accompanying drawings so that the advantages and features of the invention may be more readily understood by those skilled in the art.
A user holds a large-sized mobile device, such as a tablet, using two hands in a manner as shown in fig. 1. As shown in fig. 2, the scaling method of the present invention includes: the distance between the flat plate and the eyes of a user is obtained in real time through the distance reactor of the flat plate, the scaling of display objects such as pictures, web pages and the like displayed on the flat plate screen is determined according to the distance, and then the display objects are correspondingly scaled according to the scaling. Specifically, the distance is proportional to the size of the display object, and as the distance increases, the display object increases; the subtended distance decreases and the display object shrinks.
As shown in fig. 3, a is a distance from the wrist to the elbow joint of the user, and is substantially constant; b is the distance from the elbow joint of the user to the eyes and is basically a constant; the angle gamma between the connecting line of the wrist and elbow joint of the user and the connecting line of the elbow joint and eye changes with the change of the using posture of the user, and is a variable which can be obtained by a distance sensor in the flat plate. Thus, the distance c between the plate and the user's eyes can be calculated by a, b and γ. Since a, b are both constants, c depends only on γ. According to the invention, the included angle gamma is calculated by adopting a quaternion method according to the three-axis accelerometer and the three-axis gyroscope of the distance sensor.
The scaling method based on the distance reactor specifically comprises the following steps:
s1, acquiring data of an accelerometer and a gyroscope of the distance sensor in real time;
s2, obtaining the distance c by a quaternion method according to the data acquired in the step S1;
and S3, determining the scaling of the display object according to the distance c.
Step S2 specifically includes:
s21, defining the posture of the mobile device in the geographic coordinate system as a quaternion (q)0,q1,q2,q3) The quaternion (q) is obtained by solving the following differential equation0,q1,q2,q3):
q · 0 q · 1 q · 2 q · 3 = 1 2 ω ( t ) Q ( t ) = 1 2 0 - ω n x b - ω n y b - ω n z b ω n x b 0 ω n z b - ω n y b ω n y b - ω n z b 0 ω n x b ω n z b ω n y b - ω n x b 0 q 0 q 1 q 2 q 3
Wherein,determining an initial value for the quaternion differential by the accelerometer; ω (t) is the angular velocity, Q (t) is the current quaternion,the angular velocities of the x axis, the y axis and the z axis output by the gyroscope are respectively, n is a geographic coordinate system, and b is a distance sensor coordinate system;
s22, obtaining the included angle γ by the following formula:
γ = 1 - 2 q 1 2 - 2 q 2 2 ;
s23, obtaining the distance c by the following formula
c2=a2+b2-2abcos(γ)。
Referring to fig. 4, a distance sensor-based scaling system for implementing the above scaling method includes a three-axis accelerometer 1 and a three-axis gyroscope 2, and further includes a system on chip 3 (SOC), where the SOC3 includes:
a distance sensing processing module 31(SensorSignalProcessing) for receiving data output by the triaxial accelerometer 1 and triaxial gyroscope 2 in real time and calculating a scaling ratio by a quaternion method;
and a CPU32 for receiving the scaling ratio output by the distance sensing processing module 31 and scaling the display object according to the scaling ratio.
The above embodiments are merely illustrative of the technical ideas and features of the present invention, and are preferred embodiments, which are intended to enable those skilled in the art to understand the contents of the present invention and implement the present invention, and not to limit the scope of the present invention. All equivalent changes or modifications made according to the spirit of the present invention should be covered within the protection scope of the present invention.

Claims (8)

1. A zooming method based on a distance sensor is characterized in that: and acquiring the distance c from the mobile equipment to the eyes of the user in real time, and determining the scaling ratio by the mobile equipment according to the distance c to scale the display object.
2. The distance sensor-based scaling method according to claim 1, comprising the steps of:
s1, acquiring data of an accelerometer and a gyroscope of the distance sensor in real time;
and S2, obtaining the distance c by adopting a quaternion method according to the data acquired in the step S1.
3. The method for scaling based on a distance sensor according to claim 2, wherein step S2 comprises:
s21, defining the posture of the mobile device in the geographic coordinate system as a quaternion (q)0,q1,q2,q3) The quaternion (q) is obtained by solving the following differential equation0,q1,q2,q3):
q · 0 q · 1 q · 2 q · 3 = 1 2 ω ( t ) Q ( t ) = 1 2 0 - ω n x b - ω n y b - ω n z b ω n x b 0 ω n z b - ω n y b ω n y b - ω n z b 0 ω n x b ω n z b ω n y b - ω n x b 0 q o q 1 q 2 q 3
Wherein,is the derivative of the quaternion, ω (t) is the angular velocity, Q (t) is the current quaternion,the angular velocities of the x axis, the y axis and the z axis output by the gyroscope are respectively, n is a geographic coordinate system, and b is a distance sensor coordinate system;
s22, obtaining the included angle gamma between the connecting line of the wrist and the elbow joint of the user and the connecting line of the elbow joint and the eye part by the following formula:
γ = 1 - 2 q 1 2 - 2 q 2 2 ;
s23, obtaining the distance c by:
c2=a2+b2-2abcos(γ)
wherein, a is the distance from the wrist to the elbow joint of the user, and b is the distance from the elbow joint of the user to the eyes.
4. The distance sensor-based scaling method of claim 3, wherein: and obtaining the included angle gamma, the distance c and the scaling through system-level chip operation.
5. The distance-sensor-based scaling method of claim 4, wherein: and zooming the display object according to the zooming proportion by the CPU of the system-on-chip.
6. The range-sensor-based scaling method of claim 1, wherein: the scaling is proportional to the distance c.
7. A zooming system for realizing any one of the zooming methods based on the distance sensor comprises an accelerometer and a gyroscope, and is characterized by further comprising a chip, wherein the chip comprises:
the distance sensing processing module is used for receiving data output by the accelerometer and the gyroscope in real time and calculating a scaling ratio through a quaternion method;
and the CPU is used for receiving the scaling output by the distance sensing processing module and scaling the display object according to the scaling.
8. The zoom system of claim 7, wherein: the chip is a system-on-chip.
CN201610044378.0A 2016-01-22 2016-01-22 Zoom method and system based on distance-sensor Active CN105739877B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610044378.0A CN105739877B (en) 2016-01-22 2016-01-22 Zoom method and system based on distance-sensor

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610044378.0A CN105739877B (en) 2016-01-22 2016-01-22 Zoom method and system based on distance-sensor

Publications (2)

Publication Number Publication Date
CN105739877A true CN105739877A (en) 2016-07-06
CN105739877B CN105739877B (en) 2019-06-18

Family

ID=56247491

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610044378.0A Active CN105739877B (en) 2016-01-22 2016-01-22 Zoom method and system based on distance-sensor

Country Status (1)

Country Link
CN (1) CN105739877B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11302294B2 (en) 2019-05-15 2022-04-12 Boe Technology Group Co., Ltd. Display device, and control method, control apparatus and control system therefor

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100194880A1 (en) * 2009-02-05 2010-08-05 Masahiro Furutani Image photographing apparatus, method of controlling image photographing apparatus and control program
CN101931692A (en) * 2010-07-14 2010-12-29 康佳集团股份有限公司 Mobile terminal and method for automatically adjusting display size of image
CN102375678A (en) * 2010-08-10 2012-03-14 联想(新加坡)私人有限公司 Device and method for gesture control

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100194880A1 (en) * 2009-02-05 2010-08-05 Masahiro Furutani Image photographing apparatus, method of controlling image photographing apparatus and control program
CN101931692A (en) * 2010-07-14 2010-12-29 康佳集团股份有限公司 Mobile terminal and method for automatically adjusting display size of image
CN102375678A (en) * 2010-08-10 2012-03-14 联想(新加坡)私人有限公司 Device and method for gesture control

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11302294B2 (en) 2019-05-15 2022-04-12 Boe Technology Group Co., Ltd. Display device, and control method, control apparatus and control system therefor

Also Published As

Publication number Publication date
CN105739877B (en) 2019-06-18

Similar Documents

Publication Publication Date Title
EP3707584B1 (en) Method for tracking hand pose and electronic device thereof
US8933885B2 (en) Method, apparatus, and computer program product for reducing hand or pointing device occlusions of a display
US20090207138A1 (en) Selecting a layout
US9448638B2 (en) Mobile devices for transmitting and receiving data using gesture
EP2902867A1 (en) Portable apparatus and method for adjusting window size thereof
CN111005715B (en) Method and device for determining yield of gas well and storage medium
US10120444B2 (en) Wearable device
TWI311741B (en) Intuitive display controller
CN107886481B (en) Image processing method and device and mobile terminal
CN203376687U (en) Intelligent sensing glove system
WO2016165420A1 (en) Picture display method on mobile terminal and corresponding mobile terminal
JP2004288188A (en) Pen type input system using magnetic sensor, and its trajectory restoration method
CN111177137A (en) Data deduplication method, device, equipment and storage medium
CN105493020B (en) Touch screen display control method and mobile device
WO2022033445A1 (en) Interactive dynamic fluid effect processing method and device , and electronic device
CN105739877B (en) Zoom method and system based on distance-sensor
KR20100136289A (en) A display controlling method for a mobile terminal
US20130201157A1 (en) User interface device and method of providing user interface
US20190212834A1 (en) Software gyroscope apparatus
EP2717139B1 (en) Method, device and terminal for adjusting display region of page
TWI487878B (en) Object dimension measure system and method thereof
US20110037779A1 (en) Large size image browsing apparatus and method thereof
CN108733902A (en) Method and device for determining permeability of oil reservoir and storage medium
CN110865170B (en) Method and device for determining sand content and storage medium
CN112764864A (en) Display direction adjusting method and device

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information
CB02 Change of applicant information

Address after: 215123 Unit 6-404, 328 Xinghu Street, Suzhou Industrial Park, Jiangsu Province

Applicant after: Suzhou Lianyeng Intelligent Technology Co., Ltd.

Address before: 215123 Unit 6-404, 328 Xinghu Street, Suzhou Industrial Park, Jiangsu Province

Applicant before: SUZHOU PARKTECH IOT CO., LTD.

GR01 Patent grant
GR01 Patent grant
TR01 Transfer of patent right
TR01 Transfer of patent right

Effective date of registration: 20200703

Address after: 361000 Room 501, No.85, Xiaguang Dongli, Haicang District, Xiamen City, Fujian Province

Patentee after: Xiamen Jiupin sesame Information Technology Co.,Ltd.

Address before: Xinghu Street Industrial Park of Suzhou city in Jiangsu province 215123 328 6-404 unit

Patentee before: Suzhou Lianyeng Intelligent Technology Co.,Ltd.

TR01 Transfer of patent right
TR01 Transfer of patent right

Effective date of registration: 20201126

Address after: Room 501, Jianshe building, No.20, Zhongshi Road, Huangdai Town, Xiangcheng District, Suzhou City, Jiangsu Province

Patentee after: Suzhou Xiangcheng Daichen science and Technology Industrial Park Operation Management Co., Ltd

Address before: 361000 Room 501, No.85, Xiaguang Dongli, Haicang District, Xiamen City, Fujian Province

Patentee before: Xiamen Jiupin sesame Information Technology Co.,Ltd.