WO2016165358A1

WO2016165358A1 - Terminal clicking and reading method and apparatus, and terminal

Info

Publication number: WO2016165358A1
Application number: PCT/CN2015/096851
Authority: WO
Inventors: 时光兵
Original assignee: 中兴通讯股份有限公司
Priority date: 2015-09-29
Filing date: 2015-12-09
Publication date: 2016-10-20
Also published as: CN106557235A

Abstract

A terminal clicking and reading method and apparatus, and a terminal. The method comprises: determining a position correlation between book pages and terminal pages (100); acquiring a first clicking position on the book pages, and acquiring a second requested position on the terminal pages which corresponds to a requested position according to the position correlation (200); and playing a playing content corresponding to the second requested position (300).

Description

Terminal point reading method and device, and terminal

Technical field

This document relates to, but is not limited to, the field of terminal devices, and in particular, to a terminal point reading method and device, and a terminal.

Background technique

Terminal devices such as smart phones have been widely used in daily life. At present, many children use smartphones to favor games. For a long time, obsessed with games is a kind of harm to children. In the smart terminals on the market, the applications that can be used for children's learning are relatively lacking. In fact, with the popularity of smart terminals, smart terminals can be fully utilized to improve children's learning interest. Many smart phones can read e-books, which can be easily located and searched for explanations. People also hope that e-books on smartphones can be more flexible.

Summary of the invention

The following is a summary of the subject matter described in detail herein, and is not intended to limit the scope of the claims.

In order to solve the above problems, the present invention discloses a terminal point reading method and device, and a terminal, which can improve the flexibility of the e-book application mode on the smart phone.

A terminal point reading method, the method comprising:

Determining a positional correspondence between the book page and the terminal page;

Obtaining a first click location on the page of the book, and acquiring a second request location on the terminal page corresponding to the request location according to the location correspondence relationship;

Playing the playback content corresponding to the second request location.

Optionally, the determining a location correspondence between the book page and the terminal page includes:

Determining the location area where the book page is located according to the coordinate positions of a plurality of predetermined positioning points on the book page;

The location correspondence between the book page and the terminal page is determined by the location area where the book page is located and the location area of the terminal page.

Optionally, the predetermined plurality of positioning points specifically include a first positioning point P1, a second positioning point P2, and a third positioning point P3;

Determining, according to a plurality of predetermined positioning points on the book, a location area where the book page is located includes:

Receiving a first ultrasonic signal from a predetermined first positioning point; receiving a second ultrasonic signal from a predetermined second positioning point; and receiving an ultrasonic signal corresponding to a predetermined third positioning point;

Determining, according to the first ultrasonic signal, coordinates of the first positioning point; determining coordinates of the second positioning point according to the second ultrasonic signal; and determining coordinates of the third positioning point according to the third ultrasonic signal;

Determining a location area of the book page according to coordinates of the first positioning point, coordinates of the second positioning point, and coordinates of the third positioning point;

Determining, by the location area where the book page is located, and the location area of the terminal page, determining a location correspondence between the book page and the terminal page includes:

Determine the scale factor of the location area of the book page and the area of the terminal page.

Optionally, determining the location area of the book page according to the coordinates of the first positioning point, the coordinates of the second positioning point, and the coordinates of the third positioning point includes:

Determining the location area of the book page in the X direction value range X _in , the Y direction value range Y _in , and the Z direction value range Z _in ;

X1<X _in <x3;

Y1<Y _in <y2;

Z _min <Z _in <Z _max ;

Z _max =k1*max(z1,z2,z3);

Z _min =k2*min(z1,z2,z3);

Wherein the coordinates of the first positioning point are (x1, y1, z1), the coordinates of the second positioning point are (x2, y2, z2), and the coordinates of the third positioning point are (x3, y3, z3); k1 and K2 is a predetermined thickness Degree factor coefficient, k1>0, k2>0;

The predetermined first positioning point is located at the lower left end of the book page, the second positioning point is located at the upper left end of the book page, and the third positioning point is located at the lower right end of the book page; the lower left end of the terminal page P _A corresponds to the coordinate position of the mobile phone Yes (0,0,0), the coordinates of the upper left end P _{B of the} terminal page are (0, Ymax, 0), and the corresponding coordinates of the lower right end P _C are (Xmax, 0, 0);

Determining the proportional coefficient Kx in the X direction and the proportional coefficient Ky in the Y direction; wherein

Kx=(x3-x1)/Xmax;

Ky = (y2-y1) / Ymax.

Optionally, the acquiring the second request location on the terminal page corresponding to the first click location according to the location correspondence relationship specifically includes:

x _out0 =(x _in0 -x1)/Kx;

y _out0 =(y _in0 -y1)/Ky; where

(x _in0 , y _in0 ) is the horizontal coordinate corresponding to the first click position; (x _out0 , y _out0 ) is the horizontal coordinate corresponding to the second requested position.

Or determining, according to the plurality of positioning points preset on the book, a location area where the book page is located, including:

0<X _in <|x1-x2|+x3;

0<Y _in <|y1-y3|+y3;

Z _min <Z _in <Z _max ;

Z _max =k1*max(z1,z2,z3);

Z _min =k2*min(z1,z2,z3);

Wherein the coordinates of the first positioning point are (x1, y1, z1), the coordinates of the second positioning point are (x2, y2, z2), and the coordinates of the third positioning point are (x3, y3, z3); k1 and K2 is a predetermined thickness factor coefficient; k1>0, k2>0;

Upper left end point is positioned a predetermined first lower left corner of a book page, the second page of a book located anchor point, the third point positioned at the lower right end of the book pages; lower left end terminal corresponding to the phone page P _A is the coordinate position ( 0,0,0), the coordinates of the upper left end P _{B of the} terminal page are (0, Ymax, 0), and the corresponding coordinates of the lower right end P _C are (Xmax, 0, 0);

Determining a scale factor of a location area of the book page and an area of the terminal page, including:

Determine the proportional coefficient Kx in the X direction and the proportional coefficient Ky in the Y direction;

Kx=sqrt[(x3-x1)(x3-x1)+(y3-y1)(y3-y1)]/Xmax;

Ky=sqrt[(x2-x1)(x2-x1)+(y2-y1)(y2-y1)]/Ymax.

Obtaining the second request location corresponding to the second request location on the terminal page includes:

The coordinates of the first click position are (x4, y4, z4), the first click position is at the first anchor point, and the coordinates of the projection point on the line connecting the second anchor point are (x, y, z) The first positioning point, the second positioning point, the third positioning point, the first click position, and the projection point satisfy the following relationship:

(y2-y1)/(x2-x1)=(y-y1)/(x-x1)..........................................(1)

(x2-x1)*(x4-x)+(y2-y1)*(y4-y)=0.......................................(2)

Obtaining the plane coordinate (x, y) of the projection point according to the formula (1)(2)

Obtaining, according to the plane coordinate of the projection point, the plane coordinate of the first click position at the first positioning point, the second positioning point, and the coordinate position determined by the third positioning point (x _in0 , y _In0 ), where:

x _in0 =sqrt[(x4-x)(x4-x)+(y4-y)(y4-y)];

y _in0 =sqrt[(x-x1)(x-x1)+(y-y1)(y-y1)];

Determining, according to the plane coordinate (x _in0 , y _in0 ), a plane coordinate (x _out0 , y _out0 ) of the second request position on the terminal page, where:

x _out0 =(x _in0 -x1)/Kx;

y _out0 = (y _in0 -y1)/Ky.

In order to achieve the above object, the present invention also provides a terminal point reading device, the device comprising:

a location correspondence acquiring unit configured to determine a position correspondence relationship between the book page and the terminal page;

a location obtaining unit, configured to acquire a first click location on a page of the book, and obtain a second request location on the terminal page corresponding to the request location according to the location correspondence relationship;

The playing unit is configured to play the playing content corresponding to the second request position.

Optionally, the location correspondence acquiring unit includes:

a book page determining module, configured to determine a location area where the book page is located according to coordinate positions of a plurality of predetermined positioning points on the book page surface;

The location correspondence determining module is configured to determine a position correspondence relationship between the book page and the terminal page by using a location area where the book page is located and a location area of the terminal page.

The book page determining module includes:

a receiving submodule configured to receive a first ultrasonic signal from a predetermined first positioning point; receive a second ultrasonic signal from a predetermined second positioning point; receive an ultrasonic signal corresponding to a predetermined third positioning point;

a coordinate determining submodule configured to determine coordinates of the first positioning point according to the first ultrasonic signal; determine coordinates of the second positioning point according to the second ultrasonic signal; and determine a third positioning according to the third ultrasonic signal The coordinates of the point;

The book page determining submodule is configured to determine a location area of the book page according to coordinates of the first positioning point, coordinates of the second positioning point, and coordinates of the third positioning point;

The location correspondence determining module includes:

The correspondence determination sub-module is set to determine a scale factor of a location area of the book page and an area of the terminal page.

Optionally, the book page determining submodule is set to:

X1<X _in <x3;

Y1<Y _in <y2;

Z _min <Z _in <Z _max ;

Z _max =k1*max(z1,z2,z3);

Z _min =k2*min(z1,z2,z3);

Wherein the coordinates of the first positioning point are (x1, y1, z1), the coordinates of the second positioning point are (x2, y2, z2), and the coordinates of the third positioning point are (x3, y3, z3); k1 and K2 is a predetermined thickness factor coefficient;

The corresponding relationship determining submodule is configured to determine a proportional coefficient Kx in the X direction and a proportional coefficient Ky in the Y direction; wherein

Kx=(x3-x1)/Xmax;

Ky = (y2-y1) / Ymax.

Optionally, the location obtaining unit is configured to calculate a horizontal plane coordinate (x _out0 , y _out0 ) corresponding to the second request location;

x _out0 =(x _in0 -x1)/Kx;

y _out0 =(y _in0 -y1)/Ky; where

Alternatively, the book page determines that the submodule is set to:

0<X _in <|x1-x2|+x3;

0<Y _in <|y1-y3|+y3;

Z _min <Z _in <Z _max ;

Z _max =k1*max(z1,z2,z3);

Z _min =k2*min(z1,z2,z3);

The correspondence determining submodule is configured to determine a proportional coefficient Kx in the X direction and a proportional coefficient Ky in the Y direction;

Kx=sqrt[(x3-x1)(x3-x1)+(y3-y1)(y3-y1)]/Xmax;

Ky=sqrt[(x2-x1)(x2-x1)+(y2-y1)(y2-y1)]/Ymax.

The location obtaining unit is configured to calculate a plane coordinate (x _out0 , y _out0 ) corresponding to the second request location, including:

The coordinates (x4, y4, z4) of the first click position P4, the coordinates of the projection point P on the line connecting the first positioning point P1 and the second positioning point P2 are (x, y, z), the first positioning point P1, the second positioning point P2, the third positioning point P3, the first click position P4, and the projection point P satisfy the following relationship:

(y2-y1)/(x2-x1)=(y-y1)/(x-x1)..........................................(1)

(x2-x1)*(x4-x)+(y2-y1)*(y4-y)=0.......................................(2)

The position obtaining unit is configured to obtain a plane coordinate (x, y) of the projection point P according to the formula (1)(2)

The position obtaining unit is further configured to acquire a plane coordinate (x _in0 , y _in0 ) of the first click position P4 under the coordinate axis determined by P1P2P3 according to the plane coordinate of the projection point P, where:

x _in0 =sqrt[(x4-x)(x4-x)+(y4-y)(y4-y)];

y _in0 =sqrt[(x-x1)(x-x1)+(y-y1)(y-y1)];

The location obtaining unit is further configured to determine a plane coordinate (x _out0 , y _out0 ) of the second request location on the terminal page according to the plane coordinate (x _in0 , y _in0 ), where:

x _out0 =(x _in0 -x1)/Kx;

y _out0 = (y _in0 -y1)/Ky.

In order to achieve the above object, the present invention also provides a terminal, which includes any of the above-described terminal point reading devices.

Compared with the prior art, the technical solution provided by the embodiment of the present invention includes: determining a position correspondence relationship between a book page and a terminal page; acquiring a first click position on a page of the book, and obtaining a request according to the position correspondence relationship; a second request location on the terminal page corresponding to the location; playing the playback content corresponding to the second request location. Through the above technical solution, when the user uses the real book to read, the user can use the ultrasonic pen to point to any position of the book, and the terminal can play the content of the corresponding position of the book, thereby improving the learning efficiency of the user. And the use of interest, improve the user's reading experience, combine the superiority of e-book multimedia and the use of real books, providing a new way of reading.

Other aspects will be apparent upon reading and understanding the drawings and detailed description.

BRIEF abstract

The drawings in the following description of the embodiments of the present invention are intended to illustrate the invention, and are not intended to limit the scope of the invention.

1 is a flowchart of a method for reading a terminal according to an embodiment of the present invention;

2 is a schematic view showing a location area of a book page and a terminal page in the first embodiment;

3 is a schematic diagram of determining coordinates of an anchor point according to an ultrasonic signal;

4 is a schematic diagram showing a location area of a book page and a terminal page in Embodiment 2;

FIG. 5 is a schematic structural diagram of a terminal point reading device according to an embodiment of the present invention.

Preferred embodiment of the invention

The embodiments of the present invention are further described below in conjunction with the accompanying drawings, and are not intended to limit the scope of the present invention. It should be noted that the embodiments in the present application and the various manners in the embodiments may be combined with each other without conflict.

Embodiment 1

Referring to FIG. 1, a method for reading a terminal point is disclosed. The method includes:

Step 100: Determine a position correspondence relationship between the book page and the terminal page;

Step 200: Acquire a first click location on a page of the book, and obtain a second request location on the terminal page corresponding to the request location according to the location correspondence relationship;

Step 300: Play the play content corresponding to the second request location.

Through the above technical solution, when the user uses the real book to read, the ultrasonic pen can be used to point to any position of the book, and the terminal can play the content of the corresponding position of the book, for example, the book content can be read out and provided. The corresponding explanation, in this way, can improve the user's learning efficiency and use interest, improve the user's reading experience, combine the superiority of the electronic book's multimedia and the real book's use feeling, and provide a new way of reading. .

In the embodiment of the present invention, step 100 is actually a positioning process, and the terminal obtains the actual location of the book. In step 100, determining a location correspondence between the book page and the terminal page includes:

Step 110: Determine a location area where the book page is located according to coordinate positions of a plurality of predetermined positioning points on the book page surface;

Step 120: Determine, by using a location area where the book page is located and a location area of the terminal page, a position correspondence relationship between the book page and the terminal page.

In the embodiment of the present invention, the location area of the book page is determined by using three points as an example, and the location area of the book page may also be determined by other numbers of positioning points. The anchor point is a vertex on the edge of the book page. Usually, the book page is a rectangle. The position of the book page can be determined by three vertices, or the position of the book page can be determined by two vertices on the diagonal line. The ability to have better error tolerance through three vertices, for example, where the book is placed is not placed parallel to the terminal.

Optionally, the preset plurality of positioning points may include a first positioning point P1, a second positioning point P2, and a third positioning point P3; each positioning point is a vertex on an edge of the book page; for example, An anchor point P1 is a vertex at the lower left end of the book page, a second anchor point P2 is a vertex at the upper left end of the book page, and a third anchor point P3 is a vertex at the lower right end of the book page.

In step 110, the determining, according to a plurality of predetermined positioning points on the book, determining a bit of the book page The area includes:

The coordinates of the first positioning point, the coordinates of the second positioning point, and the coordinates of the third positioning point are respectively acquired.

The method includes: receiving a first ultrasonic signal from a preset first positioning point; receiving a second ultrasonic signal from the preset second positioning point; and receiving an ultrasonic signal corresponding to the preset third positioning point;

The location area of the book page is determined according to the coordinates of the first positioning point, the coordinates of the second positioning point, and the coordinates of the third positioning point.

In step 120, the location correspondence between the book page and the terminal page is determined by the location area where the book page is located and the location area of the terminal page, including:

Referring to FIG. 2 , which is a schematic diagram of a location area of a book page and a terminal page, a process of determining a position correspondence relationship between a book page and a terminal page in step 100 will be described below with reference to FIG. 2 .

In step 110, determining the location area of the book page according to the coordinates of the first positioning point, the coordinates of the second positioning point, and the coordinates of the third positioning point includes:

X1<X _in <x3;

Y1<Y _in <y2;

Z _min <Z _in <Z _max ;

Z _max =k1*max(z1,z2,z3);

Z _min =k2*min(z1,z2,z3);

Wherein; the coordinates of the first positioning point are (x1, y1, z1), the coordinates of the second positioning point are (x2, y2, z2), the coordinates of the third positioning point are (x3, y3, z3); k1 and k2 The factor of the predetermined thickness factor. K1>0, k2>0, k1 and k2 may be the same; or they may be different, for example, both are set to 1.5 to 2.

That is to say, the positional area of the book page has a value range X _{in the} X direction is [x1, x3], the value range Y _{in the} Y direction is [y1, y2], and the value range Z _{in the} Z direction is [ Z _min , Z _max ].

During the point reading process, the click position of the ultrasonic pen is obtained, and according to the click position, combined with the position area of the book page determined above, it is determined whether the click position is within the position area of the book page; if the click position of the ultrasonic pen is located on the book page If the click position of the ultrasonic pen is not within the position area of the book page, the click operation is determined to be valid, and the corresponding point processing is not performed.

The predetermined first positioning point is located at a vertex of the lower left end of the book page, the second positioning point is located at a vertex of the upper left end of the book page, and the third positioning point is located at a vertex of the lower right end of the book page.

Correspondingly, the location area of the terminal page is known by the terminal, and the location area of the terminal page is represented by the corresponding vertex. As shown in FIG. 2, when the terminal displays the book corresponding content in the rectangle shown in FIG. 2, the coordinates of the vertex corresponding to the terminal page can be acquired.

Wherein, the bottom left page P _A terminal corresponding to the coordinate position of the mobile phone is (0,0,0), an upper left end of the page P _B corresponding to the coordinates (0, Ymax, 0), corresponding to the lower right end coordinates P _C Yes (Xmax, 0, 0).

In the embodiment of the present invention, the position correspondence relationship between the book page and the terminal page refers to a proportional coefficient and a vertex correspondence relationship; wherein the vertex correspondence relationship is preset, and when the user is in the positioning process, according to the preset vertex The terminal records the coordinates of each point according to the preset vertex correspondence relationship. For example, when the user holds the ultrasonic pen to sequentially click the first positioning point, the second positioning point, and the third positioning point, the terminal can determine the first positioning point, the second positioning point, and the third positioning point by determining three clicks respectively, that is, determining The first positioning point P1 corresponds to the lower left end P _{A of the} terminal page, the second positioning point P2 corresponds to the upper left end P _{B of the} terminal page, and the third positioning point P3 corresponds to the lower right end P _{C of the} terminal page. In determining the location correspondence between the book page and the terminal page, the terminal may prompt the user to operate on the vertex, and the user may operate according to the prompt sequence of the terminal.

In step 120, after determining the location area of the written page, since the location area of the terminal page is known, the scale factor Kx in the X direction and the scale factor Ky in the Y direction can be acquired.

Step 120 includes: determining a proportional coefficient Kx in the X direction and a proportional coefficient Ky in the Y direction; wherein

Kx=(x3-x1)/Xmax;

Ky = (y2-y1) / Ymax.

It can be understood that when the book position changes with respect to the terminal, the positioning process in step 100 needs to be re-executed.

In step 200, the first click location on the page of the book page is obtained, and the second request location on the terminal page corresponding to the request location is obtained according to the location correspondence relationship, and specifically includes:

Determining a corresponding second request location according to the first click position and the scale factor;

Wherein step 200 includes:

Step 210: When the click position is (x _in0 , y _in0 , z _in0 ), it is determined that (x _in0 , y _in0 , z _in0 ) is located in the location area of the book page, that is, whether x _in0 is respectively located at [x1, x3 ], whether y _in0 is at [y1, y 2], and whether z _in0 is at [Z _min , Z _max ].

Step 220: When the judgment result is yes, determining that the click position is in the book page is a legal point reading operation;

Step 230: Acquire a horizontal coordinate (x _out0 , y _out0 ) corresponding to the second request position according to the horizontal coordinate (x _in0 , y _in0 ) corresponding to the first click position.

x _out0 =(x _in0 -x1)/Kx;

y _out0 = (y _in0 -y1)/Ky.

According to the horizontal coordinate (x _out0 , y _out0 ) corresponding to the second request position, the play content corresponding to the position can be called. In the terminal, the correspondence between each location in the terminal page and the played content is stored in advance.

In step 300, in order to realize the playing of the playing content in the book, it is necessary to store the book in the terminal in advance, and store each point reading position and its corresponding playing content in the book, and the playing content may be a corresponding picture, animation, text, and comment. Information content such as links, videos or voices.

The process of determining the coordinates of the first positioning point based on the first ultrasonic signal will be described below with reference to FIG. 3. Three ultrasonic sensors are disposed on the terminal. For example, three ultrasonic mics are set in the embodiment, and the three-dimensional x, y, and z directions of the pointing space are pointed. When the ultrasonic pen clicks to a certain point P (x, y, z), the ultrasonic signal of the corresponding frequency will be emitted, and all three ultrasonic mics will be received. The ultrasonic signal passes through the three sets of ultrasonic signals received, and the coordinates of the first positioning point can be determined.

After the ultrasonic click operation, the terminal is notified to start calculating the time of the ultrasonic signal received by the three ultrasonic mics respectively as t1, t2, t3, because the speed v constant of the ultrasonic wave propagating in the air is constant, so that the ultrasonic pen can be obtained from the three The distance of the ultrasonic mic, d1=v*t1, d2=v*t2, d3=v*t3.

Assume that the three ultrasonic mics are at the three points A, B, and C, respectively, when the ultrasonic pen point is in the space for a point P (x, y, z) click operation (ie, point read operation), because AP = d1, BP = d2 , CP = d3, AB is the distance between the ultrasonic mic1 and 2, AC is the distance between the ultrasonic mic1 and 3, which is known at the time of terminal design, and the following results can be obtained by orthogonal 3D:

x ² + y ² + z ² = AP ² ;

AP ² -y ² =BP ² -(AB-y) ² ;

AP ² -z ² =CP ² -(AC-z) ² ;

The coordinates of P(x, y, z) can be calculated by the above three equations.

Therefore, when the ultrasonic point reading pen clicks at any point in the space, the terminal can obtain the specific coordinates of the click position by setting the three mics.

A specific example will be described below.

The user puts the smart terminal and the book on the table, places the book next to the smart terminal, starts the positioning process in step 100, and uses the ultrasonic pen to click each positioning point in the preset order, thereby calibrating the screen and the book, so that the screen and the book are calibrated. The two correspond. During the user reading process, the page of the APP on the terminal needs to be set to be consistent with the number of pages of the actual book. When the user clicks on the book with the ultrasonic pen, the terminal can obtain the corresponding position and play the corresponding content.

Embodiment 2

A terminal point reading method, the method comprising the

steps

100, 200, 300 being the same as in the first embodiment. In the embodiment of the present invention, optionally, the step 100 is actually a positioning process, and the terminal obtains the actual location of the book. In step 100, determining a location correspondence between the book page and the terminal page includes:

Step 111: Determine a location area where the book page is located according to coordinate positions of a plurality of predetermined positioning points on the book page surface;

Step 121, passing the location area where the book page is located, and the location area of the terminal page The domain determines a positional correspondence between the book page and the terminal page.

In the embodiment of the present invention, the location area of the book page is determined by using three points as an example, and the location area of the book page may also be determined by other numbers of positioning points.

The preset plurality of positioning points include a first positioning point P1, a second positioning point P2, and a third positioning point P3; each positioning point is a vertex on the edge of the book page; for example, the first positioning point P1 is the vertex of the lower left end of the book page, the second positioning point P2 is the vertex of the upper left end of the book page, and the third positioning point P3 is the vertex of the lower right end of the book page.

In step 111, determining, according to a plurality of predetermined positioning points on the book, a location area where the book page is located includes:

In step 121, the location correspondence between the book page and the terminal page is determined by the location area where the book page is located and the location area of the terminal page, including:

Referring to FIG. 4, a schematic diagram of a location area of a book page and a terminal page, and a process of determining a position correspondence relationship between a book page and a terminal page will be described below with reference to FIG. 4.

In step 111, determining the location area of the book page according to the coordinates of the first positioning point, the coordinates of the second positioning point, and the coordinates of the third positioning point includes:

0<X _in <|x1-x2|+x3;

0<Y _in <|y1-y3|+y3;

Z _min <Z _in <Z _max ;

Z _max =k1*max(z1,z2,z3);

Z _min =k2*min(z1,z2,z3);

Wherein the coordinates of the first positioning point are (x1, y1, z1), the coordinates of the second positioning point are (x2, y2, z2), and the coordinates of the third positioning point are (x3, y3, z3); k1 and K2 is a predetermined thickness factor coefficient; k1>0, k2>0, which may or may not be the same, for example, 1.5 to 2.

That is to say, the positional area of the book page has a value range X _{in the} X direction [0, |x1-x2|+x3], and the value range Y _{in the} Y direction is [0,|y1-y3|+y3] , in the Z direction, the value range Z _in is [Z _min , Z _max ].

P4 is the first click position, the coordinates are (x4, y4, z4); P is the projection point of P4 on the P1P2 line, and the coordinates are (x, y, z).

In this embodiment, step 200 includes:

In step 211, when the first click position is P4 (x4, y4, z4), it is determined whether P4 (x4, y4, z4) is located in the location area of the book page.

Step 221, when the result of the determination is that the first click position P4 is in the book page, the point read operation determined to be valid is performed, and the subsequent step 231 is performed. If the first click position is not within the position area of the book page, the determination is invalid. Click to read the operation, do not do the corresponding processing.

Step 231: Acquire a plane coordinate (x _out0 , y _out0 ) corresponding to the second request position on the terminal according to the first click position P4 (x4, y4, z4), including:

Kx=sqrt[(x3-x1)(x3-x1)+(y3-y1)(y3-y1)]/Xmax;

Ky=sqrt[(x2-x1)(x2-x1)+(y2-y1)(y2-y1)]/Ymax;

The following relationships are satisfied between P1, P2, P3, P4, and P:

(y2-y1)/(x2-x1)=(y-y1)/(x-x1)..........................................1

(x2-x1)*(x4-x)+(y2-y1)*(y4-y)=0.............................................2

According to the formula 12, the coordinates of the P point x, y can be calculated:

According to the calculated P point coordinate x, y value, the plane position of P4 under the P3P1P2 coordinate axis is calculated.

(sqrt[(x4-x)(x4-x)+(y4-y)(y4-y)], sqrt[(x-x1)(x-x1)+(y-y1)(y-y1)] )

and so

x _in0 =sqrt[(x4-x)(x4-x)+(y4-y)(y4-y)];

y _in0 =sqrt[(x-x1)(x-x1)+(y-y1)(y-y1)];

x _out0 =(x _in0 -x1)/Kx;

y _out0 =(y _in0 -y1)/Ky;

(x _in0 , y _in0 ) is the plane coordinate corresponding to the first click position of P4 in the P3P1P2 coordinate axis; (x _out0 , y _out0 ) is the plane coordinate of the second request position on the corresponding terminal page.

After determining the second request location on the terminal page, the playback content corresponding to the location can be called.

Optionally, when the book page is in another shape, the terminal page is also set to a corresponding shape. According to the shape of the book page, multiple positioning points that can reflect the shape of the page are selected, and the location area of the book page is determined to determine whether the first click position is In the location area of the book page, when in the area, according to the correspondence between the book page and the terminal page, the corresponding second request position in the terminal page is obtained, and according to the second request position, the play content corresponding to the position is called.

Embodiment 3

The invention also discloses a terminal point reading device, which is arranged on the terminal. Referring to FIG. 5, a terminal point reading device according to the present invention comprises:

The location correspondence acquiring unit 10 is configured to determine a position correspondence relationship between the book page and the terminal page;

The location obtaining unit 20 is configured to acquire a first click location on the page of the book page, and obtain a second request location on the terminal page corresponding to the request location according to the location correspondence relationship;

The playing unit 30 is configured to play the playing content corresponding to the second request position.

In the embodiment of the present invention, the location correspondence relationship obtaining unit 20 includes:

In the embodiment of the present invention, the preset multiple positioning points include: a first positioning point P1, a second positioning point P2, and a third positioning point P3;

The book page determining module includes:

a receiving submodule configured to receive a first ultrasonic signal from a preset first positioning point; receive a second ultrasonic signal from the preset second positioning point, and receive an ultrasonic wave corresponding to the preset third positioning point signal;

The location correspondence determining module includes:

Optionally, the location correspondence determining module further includes:

Clicking on the location determination sub-module is set to determine whether the first click location is within the location area of the book page.

Optionally, in the embodiment of the present invention, the book page determining submodule is set to:

X1<X _in <x3;

Y1<Y _in <y2;

Z _min <Z _in <Z _max ;

Z _max =k1*max(z1,z2,z3);

Z _min =k2*min(z1,z2,z3);

Kx=(x3-x1)/Xmax;

Ky = (y2-y1) / Ymax.

In the embodiment of the present invention, the location acquiring unit is configured to calculate a horizontal plane coordinate (x _out0 , y _out0 ) corresponding to the second request location;

x _out0 =(x _in0 -x1)/Kx;

y _out0 =(y _in0 -y1)/Ky; where

Alternatively, in the embodiment of the present invention, the book page determining submodule is set to:

0<X _in <|x1-x2|+x3;

0<Y _in <|y1-y3|+y3;

Z _min <Z _in <Z _max ;

Z _max =k1*max(z1,z2,z3);

Z _min =k2*min(z1,z2,z3);

It is judged whether or not the first click position P4 (x4, y4, z4) is located in the position area of the book page.

When the result of the determination is that the first click position P4 is within the book page position area, then the point read operation determined to be valid is performed, and the subsequent step 231 is performed. If the first click position is not within the position area of the book page, the determination is invalid. Click to read the operation, do not do the corresponding processing.

Kx=sqrt[(x3-x1)(x3-x1)+(y3-y1)(y3-y1)]/Xmax;

Ky=sqrt[(x2-x1)(x2-x1)+(y2-y1)(y2-y1)]/Ymax;

The following relationships are satisfied between P1, P2, P3, P4, and P:

(y2-y1)/(x2-x1)=(y-y1)/(x-x1)..........................................1

(x2-x1)*(x4-x)+(y2-y1)*(y4-y)=0.............................................2

The position obtaining unit is configured to calculate the P point coordinate x, y value according to the formula 12:

The position obtaining unit is further configured to calculate a plane position of P4 under the P3P1P2 coordinate axis according to the calculated P point coordinate x, y value.

(sqrt[(x4-x)(x4-x)+(y4-y)(y4-y)], sqrt[(x-x1)(x-x1)+(y-y1)(y-y1)] )

and so

x _in0 =sqrt[(x4-x)(x4-x)+(y4-y)(y4-y)];

y _in0 =sqrt[(x-x1)(x-x1)+(y-y1)(y-y1)];

The location obtaining unit is further configured to acquire plane coordinates of the second request location on the corresponding terminal page:

x _out0 =(x _in0 -x1)/Kx;

y _out0 =(y _in0 -y1)/Ky;

The playing unit 30 plays the playing content corresponding to the second request position after determining the second request position on the terminal page.

Embodiment 4

A terminal includes any terminal point reading device provided by an embodiment of the present invention. A plurality of ultrasonic sensors are disposed on the terminal, and the ultrasonic sensors are set to be respectively set to different receiving directions, thereby positioning the position of the ultrasonic pen.

Optionally, the ultrasonic sensor is ultrasonic mic;

Optionally, three ultrasonic mics are disposed on the terminal.

Embodiment 5

The embodiment of the invention further discloses a point reading system, which comprises a terminal and an ultrasonic pen provided by an embodiment of the invention; the ultrasonic pen is arranged to emit an ultrasonic signal.

Industrial applicability

The technical solution disclosed herein enables the user to use an ultrasonic pen to point to any position of the book when using a real book, and the terminal can play the content of the corresponding position of the book, thereby improving the user's content. Learning efficiency and usage interest have improved the user's reading experience. Combining the superiority of multimedia in e-books with the use of real books, it provides a new way to read

Claims

A terminal point reading method includes:

Determining a positional correspondence between the book page and the terminal page;

Obtaining a first click location on the page of the book, and acquiring, according to the location correspondence, the second request location corresponding to the first click location on the terminal page;

Playing the playback content corresponding to the second request location.
The terminal point reading method according to claim 1, wherein the determining a position correspondence relationship between the book page and the terminal page comprises:

Determining the location area where the book page is located according to the coordinate positions of the plurality of positioning points preset on the book page;

A positional correspondence between the book page and the terminal page is determined by a location area where the book page is located and a location area of the terminal page.
The terminal point reading method according to claim 2, wherein the preset plurality of positioning points comprise: a first positioning point P1, a second positioning point P2, and a third positioning point P3;

Determining, according to the coordinate positions of the plurality of positioning points preset on the page of the book, the location area where the book page is located includes:

Receiving a first ultrasonic signal from a preset first positioning point; receiving a second ultrasonic signal from the preset second positioning point; and receiving an ultrasonic signal corresponding to the preset third positioning point;

Determining coordinates of the first positioning point according to the first ultrasonic signal; determining coordinates of the second positioning point according to the second ultrasonic signal; and determining the third positioning point according to the third ultrasonic signal coordinate of;

Determining a location area where the book page is located according to coordinates of the first positioning point, coordinates of the second positioning point, and coordinates of the third positioning point;

Determining, by the location area where the book page is located, and the location area of the terminal page, determining a location correspondence between the book page and the terminal page includes:

Determining a scale factor of a location area of the book page and an area of the terminal page.
The terminal point reading method according to claim 3, wherein determining a location area of the book page according to coordinates of the first positioning point, coordinates of the second positioning point, and coordinates of the third positioning point includes :

Determining the location area of the book page in the X direction value range X in , the Y direction value range Y in , and the Z direction value range Z in ;

X1<X in <x3;

Y1<Y in <y2;

Z min <Z in <Z max ;

Z max =k1*max(z1,z2,z3);

Z min =k2*min(z1,z2,z3);

Wherein; the coordinates of the first positioning point are (x1, y1, z1), the coordinates of the second positioning point are (x2, y2, z2), the coordinates of the third positioning point are (x3, y3, z3); k1 and k2 For a predetermined thickness factor coefficient, k1>0, k2>0;

The preset first positioning point is located at the lower left end of the book page, the second positioning point is located at the upper left end of the book page, and the third positioning point is located at the lower right end of the book page; the lower left end of the terminal page P A corresponds to the coordinate position of the mobile phone Yes (0,0,0), the coordinates of the upper left end P B of the terminal page are (0, Ymax, 0), and the corresponding coordinates of the lower right end P C are (Xmax, 0, 0);

Determining a scale factor of a location area of the book page and an area of the terminal page, including:

Determining the proportional coefficient Kx in the X direction and the proportional coefficient Ky in the Y direction; wherein

Kx=(x3-x1)/Xmax;

Ky = (y2-y1) / Ymax.
The terminal point reading method according to claim 4, wherein the obtaining the second request location corresponding to the first click location on the terminal page according to the location correspondence relationship comprises:

x out0 =(x in0 -x1)/Kx;

y out0 =(y in0 -y1)/Ky; where

(x in0 , y in0 ) is the horizontal coordinate corresponding to the first click position; (x out0 , y out0 ) is the horizontal coordinate corresponding to the second requested position.
The terminal point reading method according to claim 3, wherein determining a location area of the book page according to coordinates of the first positioning point, coordinates of the second positioning point, and coordinates of the third positioning point includes :

Determining the location area of the book page in the X direction value range X in , the Y direction value range Y in , and the Z direction value range Z in ;

0<X in <|x1-x2|+x3;

0<Y in <|y1-y3|+y3;

Z min <Z in <Z max ;

Z max =k1*max(z1,z2,z3);

Z min =k2*min(z1,z2,z3);

Wherein the coordinates of the first positioning point are (x1, y1, z1), the coordinates of the second positioning point are (x2, y2, z2), and the coordinates of the third positioning point are (x3, y3, z3); k1 and K2 is a predetermined thickness factor coefficient; k1>0, k2>0;

Upper left end point is positioned a predetermined first lower left corner of a book page, the second page of a book located anchor point, the third point positioned at the lower right end of the book pages; lower left end terminal corresponding to the phone page P A is the coordinate position ( 0,0,0), the coordinates of the upper left end P B of the terminal page are (0, Ymax, 0), and the corresponding coordinates of the lower right end P C are (Xmax, 0, 0);

Determining a scale factor of a location area of the book page and an area of the terminal page, including:

Determine the proportional coefficient Kx in the X direction and the proportional coefficient Ky in the Y direction;

Kx=sqrt[(x3-x1)(x3-x1)+(y3-y1)(y3-y1)]/Xmax;

Ky=sqrt[(x2-x1)(x2-x1)+(y2-y1)(y2-y1)]/Ymax.
The terminal point reading method according to claim 6, wherein the acquiring the second request location corresponding to the first click location on the terminal page according to the location correspondence relationship comprises:

The coordinates of the first click position are (x4, y4, z4), the first click position is at the first anchor point, and the coordinates of the projection point on the line connecting the second anchor point are (x, y, z) ), the first positioning Point, the second positioning point, the third positioning point, the first click position, and the projection point satisfy the following relationship:

(y2-y1)/(x2-x1)=(y-y1)/(x-x1)..........................................(1)

(x2-x1)*(x4-x)+(y2-y1)*(y4-y)=0.......................................(2)

Obtaining the plane coordinate (x, y) of the projection point according to the formula (1)(2)

Obtaining, according to the plane coordinate of the projection point, the plane coordinate of the first click position at the first positioning point, the second positioning point, and the coordinate position determined by the third positioning point (x in0 , y In0 ), where:

x in0 =sqrt[(x4-x)(x4-x)+(y4-y)(y4-y)];

y in0 =sqrt[(x-x1)(x-x1)+(y-y1)(y-y1)];

Determining, according to the plane coordinate (x in0 , y in0 ), a plane coordinate (x out0 , y out0 ) of the second request position on the terminal page, where:

x out0 =(x in0 -x1)/Kx;

y out0 = (y in0 -y1)/Ky.
A terminal point reading device comprising:

a location correspondence acquiring unit configured to determine a position correspondence relationship between the book page and the terminal page;

a location obtaining unit, configured to acquire a first click location on a page of the book, and obtain a second request location on the terminal page corresponding to the request location according to the location correspondence relationship;

The playing unit is configured to play the playing content corresponding to the second request position.
The terminal point reading device according to claim 8, wherein the location correspondence relationship obtaining unit comprises:

a book page determining module, configured to determine a location area where the book page is located according to coordinate positions of a plurality of predetermined positioning points on the book page surface;

The location correspondence determining module is configured to determine a position correspondence relationship between the book page and the terminal page by using a location area where the book page is located and a location area of the terminal page.
The terminal point reading device according to claim 9, wherein the predetermined plurality of positioning points specifically include a first positioning point P1, a second positioning point P2, and a third positioning point P3;

The book page determining module includes:

a receiving submodule configured to receive a first ultrasonic signal from a predetermined first positioning point; receive a second ultrasonic signal from a predetermined second positioning point; and receive an ultrasonic signal corresponding to the predetermined third positioning point;

a coordinate determining submodule configured to determine coordinates of the first positioning point according to the first ultrasonic signal; determine coordinates of the second positioning point according to the second ultrasonic signal; and determine a third positioning according to the third ultrasonic signal The coordinates of the point;

The book page determining submodule is configured to determine a location area of the book page according to coordinates of the first positioning point, coordinates of the second positioning point, and coordinates of the third positioning point;

The location correspondence determining module includes:

The correspondence determination sub-module is set to determine a scale factor of a location area of the book page and an area of the terminal page.
The terminal point reading device according to claim 10, wherein said book page determining submodule is set to:

Determining the location area of the book page in the X direction value range X in , the Y direction value range Y in , and the Z direction value range Z in ;

X1<X in <x3;

Y1<Y in <y2;

Z min <Z in <Z max ;

Z max =k1*max(z1,z2,z3);

Z min =k2*min(z1,z2,z3);

Wherein the coordinates of the first positioning point are (x1, y1, z1), the coordinates of the second positioning point are (x2, y2, z2), and the coordinates of the third positioning point are (x3, y3, z3); k1 and K2 is a predetermined thickness factor coefficient;

The predetermined first positioning point is located at the lower left end of the book page, the second positioning point is located at the upper left end of the book page, and the third positioning point is located at the lower right end of the book page; the lower left end of the terminal page P A corresponds to the coordinate position of the mobile phone Yes (0,0,0), the coordinates of the upper left end P B of the terminal page are (0, Ymax, 0), and the corresponding coordinates of the lower right end P C are (Xmax, 0, 0);

The corresponding relationship determining submodule is configured to determine a proportional coefficient Kx in the X direction and a proportional coefficient Ky in the Y direction; wherein

Kx=(x3-x1)/Xmax;

Ky = (y2-y1) / Ymax.
The terminal point reading device according to claim 11, wherein the position obtaining unit is configured to calculate a horizontal plane coordinate (x out0 , y out0 ) corresponding to the second request position; wherein

x out0 =(x in0 -x1)/Kx;

y out0 =(y in0 -y1)/Ky; where

(x in0 , y in0 ) is the horizontal coordinate corresponding to the first click position; (x out0 , y out0 ) is the horizontal coordinate corresponding to the second requested position.
The terminal point reading device according to claim 10, wherein said book page determining submodule is set to:

Determining the location area of the book page in the X direction value range X in , the Y direction value range Y in , and the Z direction value range Z in ;

0<X in <|x1-x2|+x3;

0<Y in <|y1-y3|+y3;

Z min <Z in <Z max ;

Z max =k1*max(z1,z2,z3);

Z min =k2*min(z1,z2,z3);

Wherein the coordinates of the first positioning point are (x1, y1, z1), the coordinates of the second positioning point are (x2, y2, z2), and the coordinates of the third positioning point are (x3, y3, z3); k1 and K2 is a predetermined thickness factor coefficient; k1>0, k2>0;

Upper left end point is positioned a predetermined first lower left corner of a book page, the second page of a book located anchor point, the third point positioned at the lower right end of the book pages; lower left end terminal corresponding to the phone page P A is the coordinate position ( 0,0,0), the coordinates of the upper left end P B of the terminal page are (0, Ymax, 0), and the corresponding coordinates of the lower right end P C are (Xmax, 0, 0);

The corresponding relationship determining submodule is set to determine a scaling factor Kx in the X direction, at Y Directional coefficient Ky;

Kx=sqrt[(x3-x1)(x3-x1)+(y3-y1)(y3-y1)]/Xmax;

Ky=sqrt[(x2-x1)(x2-x1)+(y2-y1)(y2-y1)]/Ymax.
The terminal point reading device according to claim 13, wherein the location obtaining unit is configured to calculate a plane coordinate (x out0 , y out0 ) corresponding to the second request location, including:

The coordinates (x4, y4, z4) of the first click position P4, the coordinates of the projection point P on the line connecting the first positioning point P1 and the second positioning point P2 are (x, y, z), the first positioning point P1, the second positioning point P2, the third positioning point P3, the first click position P4, and the projection point P satisfy the following relationship:

(y2-y1)/(x2-x1)=(y-y1)/(x-x1)..........................................(1)

(x2-x1)*(x4-x)+(y2-y1)*(y4-y)=0.......................................(2)

The position obtaining unit is configured to obtain a plane coordinate (x, y) of the projection point P according to the formula (1) (2);

The position obtaining unit is further configured to acquire a plane coordinate (x in0 , y in0 ) of the first click position P4 under the coordinate axis determined by P1P2P3 according to the plane coordinate of the projection point P, where:

x in0 =sqrt[(x4-x)(x4-x)+(y4-y)(y4-y)];

y in0 =sqrt[(x-x1)(x-x1)+(y-y1)(y-y1)];

The location obtaining unit is further configured to determine a plane coordinate (x out0 , y out0 ) of the second request location on the terminal page according to the plane coordinate (x in0 , y in0 ), where:

x out0 =(x in0 -x1)/Kx;

y out0 = (y in0 -y1)/Ky.
A terminal, characterized in that the terminal comprises any of the terminal point reading devices provided in claims 8 to 14.