CN102937872A

CN102937872A - Interactive system and interactive method of human and touch screen device

Info

Publication number: CN102937872A
Application number: CN2012103715651A
Authority: CN
Inventors: 宋友; 张野; 谢鹏志; 杨帆
Original assignee: Beihang University
Current assignee: Beihang University
Priority date: 2012-09-28
Filing date: 2012-09-28
Publication date: 2013-02-20
Anticipated expiration: 2032-09-28
Also published as: CN102937872B

Abstract

Disclosed is an interactive system and an interactive method of a human and touch screen device. The method of human-machine interaction is achieved by following two operation modes in a program with contents organized according to a tree structure, firstly, a full screen slides at random position, when the sliding distance meets certain requirements, switching of nodes selected from a current directory is achieved, the position of current selected node is broadcasted through speech, or a user returns to a father node directory of the selected node, and the selected node is switched; secondly, the user enters a child node or reads leaf node contents through clicking any position of the full screen, if the current selected node contains the child node, the selected node is switched to a default selected node of the child node directory of the current selected node, after the switching, the position of the current selected node is broadcasted through the speech, and if the current selected node is the leaf node, the touch screen is subjected to partition to respond to functions of pausing, going on, fast forward, fast backward and the like respectively.

Description

The interactive system of a kind of people and touch panel device and exchange method

Technical field

The present invention is interactive system and the exchange method of a kind of people and touch panel device, by realizing full frame slip in touch-screen, click and carry out control operation, and realizes voice broadcast.

Background technology

At present, use on the market for having slip, clicking in the exchange method of equipment of function touch-screen, when the program that to content is tree-shaped institutional framework is carried out interactive operation, the slip operation response all only is defined in a certain specific portion position, clicks operation response and also only is defined in a certain specific localized areas.Current mobile phone music player for example, substantially all provide button and switch, play, suspend etc. operation, only have like this when we click these buttons exactly and just can finish the operation that we want, for the normal people of health, or can finish mutual, but can be very loaded down with trivial details, if for blind users, almost can't respond the particular location that slides, clicks in the positioning equipment touch-screen, can't normally finish mutual.This shows that traditional needs are accurately located the touch screen interaction pattern that could respond, restriction is many, pays inconvenience, especially is not suitable for blind users and carries out alternately.

Summary of the invention

Technology of the present invention is dealt with problems: the deficiency that needs concrete location in order to overcome existing touch panel device exchange method, particularly be difficult to satisfy the mutual defective of blind users and touch panel device, interactive system and the exchange method of a kind of people and touch panel device are provided, do not need accurate location, get final product full frame response, and the interactive mode that provides voice synthesized broadcast to point out, allow the user when the operation touch panel device, can carry out alternately in the system that the optional position is come by sliding, clicking and touch panel device moves of touch-screen.

Technical solution of the present invention: the exchange method of a kind of people and touch panel device, comprise: node creation module, the tree structure molded tissue block, event monitoring control module, full frame any slip signals processing module, full framely click arbitrarily signal processing module, full frame subregion is clicked signal processing module, the massage voice reading module, the custom feature execution module, wherein:

Node creation module, obtain the feature content of interactive system from the external world, the establishment of analytical capabilities content and practical function node, node is as the minimum function carrier of interactive system, wherein leaf node carrying interactive system requires the content of the major function of realization, after establishment is finished, node is consigned to the tree structure molded tissue block; Wherein leaf node refers in tree structure, does not have the node of child node;

The tree structure molded tissue block, reception is from the node of node creation module, with the node that receives, be that the tree structure that designs is organized according to the people, receive all nodes after, composition is had the node set of tree-like institutional framework, during the node set initialization, choose node to be defaulted as the root node of node set in tree structure, current directory is defaulted as the catalogue of root node, will consign to the event monitoring control module by the node set with tree-like institutional framework that node organization is finished; Wherein, choose node, refer to the node of all functions content presentation on touch panel device with the node carrying, current directory, refer in the node set with tree-like institutional framework that node forms, to have the set of all nodes of common father node with choosing node;

The event monitoring control module, reception is from the node set with tree-like institutional framework of tree structure molded tissue block, then receive from the full frame arbitrary region of touch panel device and click or slip signals, realization is to any slip signals and click arbitrarily signal and monitor, and choose the usufructuary distribution of node in the realization node set, to choose the node right to use to distribute to other modules, when module detect from the full frame arbitrary region of touch panel device click or during slip signals, the module that this module will choose the right to use of node to distribute to respective signal is processed, after finishing dealing with, the module of respective signal needs to choose the node right to use to return to this module; The node right to use herein refers to have switching, upgrade the right of choosing node and use to choose the feature content of nodal information that node comprises and carrying;

Full frame any slip signals processing module, the switching of choosing node in the node set of the tree-like institutional framework of realization interactive system, perhaps realize the switching of choosing node in the node set of tree-like institutional framework of interactive system and switch the function of current directory, when the slip signals that receives from the touch-screen arbitrary region, module wait for to receive from what the event monitoring control module was distributed and chooses the node right to use, in case obtaining, module chooses the node right to use, and this sliding distance that slides on touch-screen is at x in the slip signals of obtaining, when the component on the y axle satisfies requiring of setting, to choose the switching of node, perhaps choose the switching of node and switch current directory, after switching is finished, the nodal information of choosing node to comprise after upgrading is consigned to the massage voice reading module process, and the node right to use of choosing after will upgrading is given back the event monitoring control module; Wherein, nodal information refers to the position of node in tree structure etc. the information relevant with node;

The full frame signal processing module of clicking arbitrarily, realization enters to choose the sub-directory of node and switch in the node set of tree-like institutional framework of interactive system chooses node, perhaps carry out leaf node feature content in the node set of tree-like institutional framework of interactive system, when receive from the touch-screen arbitrary region click signal the time, module wait for to receive from what the event monitoring control module was distributed and chooses the node right to use, after module receives the right to use, node leaf node whether in the node set of the tree-like institutional framework of interactive system is chosen in judgement, what if so, then will receive chooses the node right to use to consign to full frame subregion to click signal processing module and process; If not, then switch to the catalogue of the child node of choosing node, and then switch and to choose node, switch finish after, the nodal information of choosing node to comprise after upgrading is consigned to the massage voice reading module process, and the node right to use of choosing after will upgrading is given back the event monitoring control module;

Full frame subregion is clicked signal processing module, realize suspending, beginning, accelerate, retreat the voice reading to the leaf node content, this module receive from full frame click arbitrarily that signal processing module pays choose the node right to use, and reception is from the signal of clicking of touch-screen arbitrary region, choose node this moment is leaf node, touch-screen is divided into 3 zones, be designated as the A district, the B district, the C district, and the feature content that will choose the node carrying consigns to the processing of custom feature execution module, when the trigger point of the signal that receives in the B district, send the signal of representative " time-out is carried out " or " beginning to carry out " to the custom feature execution module, when the trigger point of the signal that receives in the A district, send the signal of representative " quickening is carried out " to the custom feature execution module, when the trigger point of the signal that receives in the C district, send the signal of representative " retreating execution " to the custom feature execution module; After function is finished, the right to use of choosing node is given back the event monitoring control module;

The massage voice reading module receives from full frame any slip signals processing module, the full frame nodal information of clicking arbitrarily signal processing module, and information is advanced voice broadcast and prompting;

The custom feature execution module, reception is clicked the feature content of choosing node that signal processing module is paid from full frame subregion, then carry out feature content, receive simultaneously the representative of clicking signal processing module from full frame subregion and suspend to carry out, continue to carry out, accelerate to carry out, retreat the signal of execution, and the time-out of correspondingly carrying out is carried out feature content, continuation is carried out feature content, accelerated to carry out feature content, retreats the execution feature content; This module is that artificial designed system major function is carried out platform;

Described node creation module implementation procedure is as follows:

(1) obtains the feature content of interactive system from the external world;

(2) create node, it is little feature content piece that feature content is organized structure elucidation according to the attribute of artificial setting, then that feature content is packaged to the node that creates;

(3) node that creates is consigned to the tree structure molded tissue block;

Described tree structure molded tissue block implementation procedure is as follows:

(1) reception is from the node of node creation module;

(2) with the node that the receives tree-like institutional framework according to artificial design, be put in the node set of tree-like institutional framework of artificial setting;

(3) repeat (1), (2) step, after all nodes were received in wait, initialization had the node set of tree-like institutional framework, set root node for choosing node, and the catalogue of root node is current directory;

(4) node with tree-like institutional framework of tissue being finished is in conjunction with consigning to the event monitoring control module;

Described event monitoring control module implementation procedure is as follows:

(1) receives the node set with tree structure tissue from the tree structure molded tissue block, and lock and choose the node right to use;

(2) wait for to receive and to click signal or slip signals from the arbitrary region of touch-screen;

(3) if receive slip signals from the arbitrary region of touch-screen, and locked and chosen the node right to use, then will choose the release of the node right to use, choosing the node right to use to consign to full frame any slip signals processing module, again execution in step (5); If receive the slip signals from the arbitrary region of touch-screen, and the node right to use, then execution in step (5) are not chosen in locking;

(4) if receive the signal of clicking from the arbitrary region of touch-screen, and locked and chosen the node right to use, then will choose the release of the node right to use, choosing the node right to use to consign to the full frame signal processing module of clicking arbitrarily, again execution in step (5); If receive the signal of clicking from the arbitrary region of touch-screen, and the node right to use, then execution in step (5) are not chosen in locking;

(5) the node right to use of choosing to be recycled such as;

(6) reclaimed choose the node right to use after, will choose the node right to use to lock, again execution in step (2);

Described full frame any slip signals processing modules implement process is as follows:

(1) initialization, the artificial setting slided response apart from being Q, P pixel, and wherein Q, P are the integers greater than 0;

(2) wait for the slip signals that receives from the full frame arbitrary region of touch-screen;

(3) receive slip signals from the full frame arbitrary region of touch-screen after, wait for receiving from what the event monitoring control module was distributed and choose the node right to use;

(4) receive from the event monitoring control module distribute choose the node right to use after, execution in step (6);

(5) set that to choose node be A, current directory is S, S={A, and B ... N}; The father node catalogue of setting A is: S ₁={ Ax, A ₁..., An}, wherein Ax is S ₁That gives tacit consent in the catalogue chooses node, can artificially set;

(6) sliding distance of the slip of this slip signals of parsing generation is R, and the component of R on x axle positive dirction is Rx+, and the distance on x axle negative direction is Rx-, and the absolute value of the component on the y axle is Ry; Execution in step (7);

(7) if Rx+ more than or equal to Q, then realize choosing the switching of node, choose node to switch to node adjacent with its left side in current directory, namely choose node to switch to N by A, after switching is finished, the nodal information of choosing node after upgrading is consigned to the massage voice reading module, and execution in step (10); If Rx+ is less than Q, execution in step (8);

(8) if Rx-more than or equal to Q, then realize choosing the switching of node, choose node to switch to node adjacent with its right side in current directory, namely choose node to switch to B by A, after switching is finished, the nodal information of choosing node after upgrading is consigned to the massage voice reading module, and execution in step (10); If Rx-is less than Q, execution in step (9);

(9) if Ry more than or equal to P, is root node if choose node, namely choose node not have father node, withdraw from so interactive system; If choosing node is not root node, namely choose node that father node is arranged, switch so and choose node and switch current directory, choose node to switch to choose the father node of node, current directory switches to the catalogue of choosing the node father node, namely chooses node to switch to Ax by A, and current directory switches to S by S ₁, after switching is finished, the nodal information of choosing node after upgrading is consigned to the massage voice reading module, and execution in step (10); If Ry is less than P, execution in step (10);

(10) the node right to use is given back the event monitoring control module, and execution in step (2);

It is described that full frame to click arbitrarily the signal processing module implementation procedure as follows:

(1) wait for to receive the signal of clicking from the full frame arbitrary region of touch-screen;

(2) receive from the full frame arbitrary region of touch-screen click signal after, wait for receiving from what the event monitoring control module was distributed and choose the node right to use;

(3) receive from the event monitoring control module distribute choose the node right to use after, execution in step (5);

(4) remember that choosing node is the A node, current directory is S, S={A, and B ..., N}; If the A node comprises child node the catalogue of the child node of A node is designated as S ₁, S ₁={ Ax, A ₁..., A _n, and S ₁It is Ax that middle acquiescence is chosen node, artificially appointment of Ax;

(5) if choosing node is leaf node, then will choose the node right to use to consign to full frame subregion and click signal processing module, and execution in step (1); If choosing node is not leaf node, then switch and choose node and switch current directory, the node of choosing of choosing node to switch to give tacit consent in its child node catalogue, current directory switches to the catalogue of choosing the node child node, namely choose node to switch to Ax by A, current directory switches to S by S ₁, after switching is finished, the nodal information of choosing node after upgrading is consigned to the massage voice reading module, and execution in step (6);

(6) the node right to use is given back the event monitoring control module, and execution in step (1);

It is as follows that described full frame subregion is clicked the signal processing module implementation procedure:

(1) initialization is set three parameter alpha+beta+γ=1.0, α〉0, β〉0, γ〉0; Wherein α, β, γ are artificial three floating numbers that satisfy condition noted earlier of setting; It is S that the executing state of the feature content of node carrying is chosen in setting, and the S value is S1, any one among the S2, and wherein S1 representative " halted state ", S2 represents " normal execution mode ", and S original state default value is S1; Setting the last node of choosing that receives when choosing the node right to use is Ar, and the initial value of Ar is empty (NULL);

(2) length of touch-screen on the y axle of setting touch panel device is L, with touch-screen on Y direction according to α: the ratio of β: γ is divided into three parts, the touch-screen length that every part occupies at the y axle is respectively α L, β L, γ L, and this three part is designated as respectively A district, B district, C district;

(3) wait for to receive the signal of clicking from the full frame arbitrary region of touch-screen; Receive from the full frame arbitrary region of touch-screen click signal after, execution in step (3);

(4) receive from full frame click arbitrarily that signal processing module pays choose the node right to use, the node of choosing of this moment is A, execution in step (5);

(5) if A and Ar are same nodes, execution in step (6) then; If not, then will choose the feature content of node carrying to consign to the custom feature execution module, the value of Ar is updated to A, execution in step (6);

(6) be S1 if choose the executing state S of the feature content of node carrying, and the full frame arbitrary region that receives is clicked the triggering coordinate position of signal in the B district, the executive signal that then transmission representative " begins to carry out " is to the custom feature execution module, the value of state S is updated to S2 simultaneously, after complete, execution in step (8); If choosing the executing state S of the feature content of node carrying is S1, and the triggering coordinate position that the full frame arbitrary region that receives is clicked signal is in the A district or the C district, execution in step (8); If choosing the executing state S of the feature content of node carrying is S2, execution in step (7);

(7) if the full frame arbitrary region that receives is clicked the trigger position coordinate of signal in the B district, then send the executive signal of representative " time-out is carried out " to the custom feature execution module; If the full frame arbitrary region that receives is clicked the trigger position coordinate of signal in the A district, then send the executive signal of representative " quickening is carried out " to the custom feature execution module; If the full frame arbitrary region that receives is clicked the trigger position coordinate of signal in the C district, then send the executive signal of representative " retreating execution " to the custom feature execution module; After finishing, execution in step (8);

(8) the node right to use is given back the event monitoring control module, and execution in step (3);

Described massage voice reading module implementation procedure is as follows:

(1) waits for that reception is from full frame any slip signals processing module, the full frame nodal information of clicking arbitrarily signal processing module; Execution in step (2);

(2) receive from behind full frame any slip signals processing module, the full frame nodal information of clicking arbitrarily signal processing module, start voice broadcast function, report nodal information content and prompting; Execution in step (3);

(3) execution in step (1);

Described custom feature execution module implementation procedure is as follows:

(1) the current feature content of record is R, is empty (NULL) during initialization;

(2) wait receives from full frame subregion and clicks feature content and the executive signal that signal processing module is paid; After receiving executive signal, carry out (3); After receiving feature content, execution in step (4);

(3) if the executive signal representative " begins to carry out ", then current feature content (R) is carried out; If the executive signal representative " suspends and carries out ", then suspend the execution to current feature content (R); If the executive signal representative " is accelerated to carry out ", then accelerate the execution to current feature content (R); If executive signal representative " retreating execution " then retreats the execution to current feature content (R); Execution in step (2);

(4) current feature content R is updated to the feature content of new reception.

The exchange method of a kind of people and touch panel device, step is as follows:

(1) interactive system in the initialization claim 1, the current node of choosing is designated as A, and current catalogue is designated as S={A, B, C ..., N}; A node father node catalogue S ₀={ A ₀..., N ₀, it is A that acquiescence is chosen node ₀, can artificially set; The child node catalogue S of A node ₁={ A ₁..., N ₁, acquiescence is chosen node A ₁, can artificially set;

(2) node creation module, create the node of carrying interactive system function, and the node that creates consigned to the tree structure molded tissue block, tree structure according to artificial design is assembled, the final node set with tree-like institutional framework that forms, and the node set that will have tree-like institutional framework consigns to the event monitoring control module, execution in step (3);

(3) the event monitoring control module receives the node set with tree-like institutional framework from the tree structure molded tissue block, and locking chooses the node right to use, waits for from the slip signals of the arbitrary region of touch-screen or clicks signal; If receive the slip signals from the arbitrary region of touch-screen, the event monitoring control module will be carried out release to choosing the node right to use, then will choose the node right to use to distribute to full frame any slip signals processing module processes, etc. to be recycled, the latch node right to use, and continue to monitor, reception is from the slip signals of the arbitrary region of touch-screen or click signal, execution in step (4), if receive the signal of clicking from the arbitrary region of touch-screen, the event monitoring control module will be carried out release to choosing the node right to use, then will choose the node right to use to distribute to the full frame signal processing module of clicking arbitrarily processes, etc. to be recycled, the latch node right to use, and continue to monitor, reception is from the slip signals of the arbitrary region of touch-screen or click signal, then execution in step (5);

(4) full frame any slip signals processing module receives the slip signals from the full frame arbitrary region of touch-screen, receives from what the event monitoring control module was distributed again and chooses the node right to use; Resolve the sliding distance that triggers this slip signals, choose node if the component of this sliding distance on x axle positive dirction more than or equal to the artificial value of setting, then switches, choose node to switch to node adjacent with its left side in the current directory, switching is finished, execution in step (6); Choose node if the component of this sliding distance on x axle negative direction more than or equal to the artificial value of setting, then switches, choose node to switch to node adjacent with its right side in the current directory, switching is finished, execution in step (6); If the absolute value of the component of this sliding distance on the y direction of principal axis is more than or equal to the artificial value of setting, if choosing node is root node, then withdraw from interactive system, if choosing node is not root node, then switch and choose node, switch simultaneously current directory, choose node to switch to choose the node of choosing of giving tacit consent in the father node catalogue of node, current directory switches to the catalogue of the father node of choosing node, and switching is finished, execution in step (6);

(5) the full frame signal processing module of clicking arbitrarily receives the signal of clicking from the full frame arbitrary region of touch-screen, and receives from what the event monitoring control module was distributed again and chooses the node right to use; Node is chosen in parsing, is leaf node if choose node, then will choose the node right to use to consign to full frame subregion and click signal processing module and process execution in step (7); If choosing node is not leaf node, then switch and choose node, switch simultaneously current directory, choose node to switch to choose the node of choosing of giving tacit consent in the child node catalogue of node, current directory switches to the catalogue of the child node of choosing node, and switching is finished, execution in step (6);

(6) nodal information of choosing node after will upgrading consigns to the massage voice reading module and carries out voice broadcast and prompting, and will choose the node right to use to return to the event monitoring control module;

(7) full frame subregion is clicked signal processing module and is received the signal of clicking from the full frame arbitrary region of touch-screen; Receive again from full frame click arbitrarily that signal processing module pays choose the node right to use; During initialization, set current executing state and be " time-out executing state ", the node of choosing of the previous step of setting recording is empty (NULL); Touch panel coordinates is divided into A, B, C Three regions according to the y axle; Execution in step (8);

(8) if usufructuary to choose the node of choosing of the previous step of node and record be not same node to the node of choosing that obtains this moment, then will choose the feature content of node to consign to the custom feature execution module, execution in step (9); If same node, execution in step (9);

(9) if current executing state is " time-out executing state ", if the trigger position coordinate of clicking signal that receives is in the B district, the executive signal that then transmission representative " begins to carry out " is to the custom feature execution module, and current executing state switches to " beginning executing state "; If current executing state is " beginning executing state ", if the trigger position coordinate of clicking signal that receives is in the B district, then send the executive signal of representative " time-out is carried out " to the custom feature execution module, current executing state switches to " time-out executing state " simultaneously, if the trigger position coordinate of clicking signal that receives is in the A district, then send the executive signal of representative " quickening is carried out " to the custom feature execution module, if the trigger position coordinate of clicking signal that receives, then sends the executive signal of representative " retreating execution " in the C district to the custom feature execution module; After finishing, will choose the node right to use to return to the event monitoring control module, execution in step (10);

(10) the custom feature execution module receives feature content and the executive signal of clicking signal processing module from full frame subregion; If what receive is feature content, the more current feature content of new record is the new feature content that receives; If what receive is executive signal, if executive signal representative this moment " begins to carry out ", then begin or continue to carry out current feature content, thus the realization of beginning or continue function content; If the executive signal representative " suspended and carried out " this moment, then suspend and carry out current feature content, thus the realization of pause function content; If executive signal representative this moment " is accelerated to carry out ", then accelerate to carry out current feature content, thereby accelerate the realization of feature content; If executive signal representative this moment " retreating execution " then retreats and carries out current feature content, thereby the realization of fallback function content;

The present invention's advantage compared with prior art is: the present invention is in mutual, avoid sliding, the trigger point of clicking response events is fixed on the deficiency of concrete local location, realized full frame response, add simultaneously voice synthesized broadcast function, can in time tell the user current position in program, more can read the content of leaf node, thereby avoid the complex operations that need to find the ad-hoc location of program setting just can pay at touch-screen, greatly make things convenient for the mutual of each customer group and touch panel device, especially blind users, as long as according to the voice broadcast prompting, just can carry out obtaining final information alternately with program easily.

Description of drawings

Fig. 1 is system framework figure of the present invention;

Fig. 2 is node creation module process flow diagram of the present invention;

Fig. 3 is tree structure molded tissue block process flow diagram of the present invention;

Fig. 4 is event monitoring control module process flow diagram of the present invention;

Fig. 5 is the full frame any slip signals processing module process flow diagram of the present invention;

Fig. 6 is the full frame signal processing module process flow diagram of clicking arbitrarily of the present invention;

Fig. 7 is that screen with partitioned of the present invention is clicked the signal processing module process flow diagram;

Fig. 8 is massage voice reading module process flow diagram of the present invention;

Fig. 9 is custom feature execution module process flow diagram of the present invention;

Figure 10 is tree-like institutional framework structural drawing of the present invention;

Figure 11 is constitutional diagram of the present invention;

Wherein: state set: S0: original state/done state, S1: first class catalogue, i.e. child node take root node as father node among the T, Sn: n level catalogue, be among the T in the n-1 level child node be the child node of father node, R1: F.F. state, R2: reading content state, R3: rewind down state, R4: reading content halted state, P0: root node, P1: child node, P2: any a plurality of child nodes, P3: leaf node;

Set of actions: a: full framely click arbitrarily b: return, c: full frame any slip, d: 1/3 part is clicked on the touch-screen, e: 1/3 part is clicked in the touch-screen, f: 1/3 part is clicked under the touch-screen

Embodiment

As shown in Figure 1, the interactive system of a kind of people of the present invention and touch panel device is by node creation module, the tree structure molded tissue block, event monitoring control module, full frame any slip signals processing module, full framely click arbitrarily signal processing module, full frame subregion is clicked signal processing module, the massage voice reading module, the custom feature execution module forms, and whole process implementation is as follows:

(1) node creation module, obtain the feature content of interactive system from the external world, the establishment of analytical capabilities content and practical function node, node is as the minimum function carrier of interactive system, wherein leaf node carrying interactive system requires the content of the major function of realization, after establishment is finished, node is consigned to the tree structure molded tissue block; Wherein leaf node refers in tree structure, does not have the node of child node;

(2) tree structure molded tissue block, reception is from the node of node creation module, with the node that receives, organize according to the tree structure that designs, receive all nodes after, composition is had the node set of tree-like institutional framework, during the node set initialization, choose node to be defaulted as the root node of node set in tree structure, current directory is defaulted as the catalogue of root node, will consign to the event monitoring control module by the node set with tree-like institutional framework that node organization is finished; Wherein, choose node, refer to the node of all functions content presentation on touch panel device with the node carrying, current directory, refer in the node set with tree-like institutional framework that node forms, to have the set of all nodes of common father node with choosing node;

(3) event monitoring control module, reception is from the node set with tree-like institutional framework of tree structure molded tissue block, then receive from the full frame arbitrary region of touch panel device and click or slip signals, realization is to any slip signals and click arbitrarily signal and monitor, and choose the usufructuary distribution of node in the realization node set, to choose the node right to use to distribute to other modules, when module detect from the full frame arbitrary region of touch panel device click or during slip signals, the module that this module will choose the right to use of node to distribute to respective signal is processed, after finishing dealing with, the module of respective signal needs to choose the node right to use to return to this module; The node right to use herein refers to have switching, upgrade the right of choosing node and use to choose the feature content of nodal information that node comprises and carrying;

(4) full frame any slip signals processing module, the switching of choosing node in the node set of the tree-like institutional framework of realization interactive system, perhaps realize the switching of choosing node in the node set of tree-like institutional framework of interactive system and switch the function of current directory, when the slip signals that receives from the touch-screen arbitrary region, module wait for to receive from what the event monitoring control module was distributed and chooses the node right to use, in case obtaining, module chooses the node right to use, and this sliding distance that slides on touch-screen is at x in the slip signals of obtaining, when the component on the y axle satisfies requiring of setting, to choose the switching of node, perhaps choose the switching of node and switch current directory, after switching is finished, the nodal information of choosing node to comprise after upgrading is consigned to the massage voice reading module process, and the node right to use of choosing after will upgrading is given back the event monitoring control module; Wherein, nodal information refers to the position of node in tree structure etc. the information relevant with node;

(5) the full frame signal processing module of clicking arbitrarily, realization enters to choose the sub-directory of node and switch in the node set of tree-like institutional framework of interactive system chooses node, perhaps carry out leaf node feature content in the node set of tree-like institutional framework of interactive system, when receive from the touch-screen arbitrary region click signal the time, module wait for to receive from what the event monitoring control module was distributed and chooses the node right to use, after module receives the right to use, node leaf node whether in the node set of the tree-like institutional framework of interactive system is chosen in judgement, what if so, then will receive chooses the node right to use to consign to full frame subregion to click signal processing module and process; If not, then switch to the catalogue of the child node of choosing node, and then switch and to choose node, switch finish after, the nodal information of choosing node to comprise after upgrading is consigned to the massage voice reading module process, and the node right to use of choosing after will upgrading is given back the event monitoring control module;

(6) full frame subregion is clicked signal processing module, realize suspending, beginning, accelerate, retreat the voice reading to the leaf node content, this module receive from full frame click arbitrarily that signal processing module pays choose the node right to use, and reception is from the signal of clicking of touch-screen arbitrary region, choose node this moment is leaf node, touch-screen is divided into 3 zones, be designated as the A district, the B district, the C district, and the feature content that will choose the node carrying consigns to the processing of custom feature execution module, when the trigger point of the signal that receives in the B district, send the signal of representative " time-out is carried out " or " beginning to carry out " to the custom feature execution module, when the trigger point of the signal that receives in the A district, send the signal of representative " quickening is carried out " to the custom feature execution module, when the trigger point of the signal that receives in the C district, send the signal of representative " retreating execution " to the custom feature execution module; After function is finished, the right to use of choosing node is given back the event monitoring control module;

(7) massage voice reading module receives from full frame any slip signals processing module, the full frame nodal information of clicking arbitrarily signal processing module, and information is advanced voice broadcast and prompting;

(8) custom feature execution module, reception is clicked the feature content of choosing node that signal processing module is paid from full frame subregion, then carry out feature content, receive simultaneously the representative of clicking signal processing module from full frame subregion and suspend to carry out, continue to carry out, accelerate to carry out, retreat the signal of execution, and the time-out of correspondingly carrying out is carried out feature content, continuation is carried out feature content, accelerated to carry out feature content, retreats the execution feature content; This module is that artificial designed system major function is carried out platform;

Above-mentioned each Model Implement process is as follows:

1, the implementation procedure of node creation module, as shown in Figure 2:

(1) obtains the feature content of system from the external world; Then execution in step (2);

(2) be the tree-like institutional framework analytical capabilities content that designs according to the people, with the feature content unit of resolving to feature content, the unit feature content refers to feature content is resolved into one by one function point; Execution in step (3);

(3) create node, and with unit function content carrying to the node that creates, each node becomes the underlying carrier of systemic-function content like this; Execution in step (4);

(4) node that creates is consigned to the tree structure molded tissue block;

2, tree structure molded tissue block implementation procedure, as shown in Figure 3:

(1) reception is from the node of node creation module; Execution in step (2);

(2) be that the tree-like institutional framework that designs is organized with the node that receives according to the people, the tree-like institutional framework that is used for the resolution system feature content in tree-like institutional framework herein and the node creation module is complementary; Execution in step (3);

(3) repeat (1), (2) step, all nodes have been accepted, this be all node form have a node set that the people is the tree-like institutional framework that designs (be that the tree-like institutional framework that design identical with people in the step (2)), the node of choosing in the initialization node set is root node, current directory is the catalogue of root node, and node set is consigned to the event monitoring control module;

3, the implementation procedure of event monitoring control module, as shown in Figure 4:

(1) reception is from the node set of tree structure molded tissue block; Execution in step (2);

(2) right to use of node is chosen in locking; Execution in step (3);

(3) detect, receive from the clicking or slip signals of the full frame arbitrary region of touch-screen, will choose the release of the node right to use, prepare to distribute and chooses the node right to use; Execution in step (4);

(4) if the signal from touch-screen that receives is the slip signals of full frame arbitrary region, then will choose the node right to use to distribute to full frame any slip signals processing module, execution in step (6); If not, execution in step (5) then;

(5) if the signal from touch-screen that receives is the signal of clicking of full frame arbitrary region, then will choose the node right to use to distribute to the full frame signal processing module of clicking arbitrarily, execution in step (6);

(6) etc. the node right to use to be recycled is returned execution in step (2);

4, the implementation procedure of full frame any slip signals processing module, as shown in Figure 5:

(1) setting the current node of choosing is A, and current directory is S={A, B ... N}; The father node of choosing node is S1={A1, B1 ... N1}, the node of choosing of giving tacit consent among the S1 is A1, A1 is any one node among the S1, can artificially set;

(2) reception is from the slip signals of the full frame arbitrary region of touch-screen, execution in step (3);

(3) receive from what the event monitoring control module was distributed and choose the node right to use, execution in step (4);

The sliding distance of (4) resolving this slip signals is L1 at the component of x axle positive dirction, and the component on x axle negative direction is L2, and the absolute value of the component on the y axle is L3, execution in step (5);

(5) detect L1, choose node if L1 more than or equal to the response that has artificially set, then switches, with choosing node to switch to node adjacent with its left side in the current directory, namely choose node to switch to N by A, execution in step (8); If L1 is less than the response that has artificially set, then execution in step (6);

(6) detect L2, choose node if L2 more than or equal to the response that has artificially set, then switches, with choosing node to switch to node adjacent with its right side in the current directory, namely choose node to switch to B by A, execution in step (8); If L1 is less than the response that has artificially set, then execution in step (7);

(7) detect L3, if L3 more than or equal to the response that has artificially set, detects and chooses node, is root node if choose node, then withdraw from interactive system, if choosing node is not root node, then switches and choose node, with the node of choosing of choosing node to switch to give tacit consent in its catalogue of father node, current directory also switches to the catalogue of the father node of choosing node simultaneously, namely choose node to switch to A1 by A, current directory switches to S1 by S, execution in step (8); If L3 is less than the response that has artificially set, execution in step (9);

(8) after switching is finished, the nodal information of choosing node that upgrades is sent to the massage voice reading module process; Execution in step (9);

(9) will choose the node right to use of node to give back the event monitoring control module, and wait for the slip signals that receives from the full frame arbitrary region of touch-screen, and return execution in step (2);

5, the full frame signal processing module implementation procedure of clicking arbitrarily, as shown in Figure 6:

(1) setting the current node of choosing is A, and current directory is S={A, B...N}; The child node of choosing node is S1={A1, B1...N1}, and the node of choosing of giving tacit consent among the S1 is A1, A1 is any one node among the S1, can artificially set;

(2) receive and to click signal, execution in step (3) from the full frame arbitrary region of touch-screen;

(4) node is chosen in detection, if choose node to comprise child node, then switch and choose node, the node of choosing of choosing node to switch to give tacit consent in its catalogue of child node, current directory also switches to the catalogue of the child node of choosing node, namely choose node to switch to A1 by A, current directory has S to switch to S1, execution in step (5); If choosing node is leaf node, namely choose node not comprise child node, then will choose the node right to use to consign to full frame subregion and click signal processing module, execution in step (6);

(5) after switching is finished, the nodal information of choosing node that upgrades is sent to the massage voice reading module process, and will choose the node right to use to give back the event monitoring control module, execution in step (6);

(6) wait for to receive the signal of clicking from the full frame arbitrary region of touch-screen, return execution in step (2);

6, full frame subregion is clicked the signal processing module implementation procedure, as shown in Figure 7:

(1) record is last, and to choose the node of choosing under the node right to use be Ar, be initialized as sky (NULL), current executing state St, be initialized as " time-out executing state ", with touch-screen be divided into A, B, C Three regions according to the y axle, the size in each zone can artificially be set;

(3) receive from full frame click arbitrarily that signal processing module pays choose the node right to use, execution in step (4);

(4) detect choosing of Ar and this and choose whether same node of node under node right to use, if not, then will choose the feature content of node to consign to the custom feature execution module and process, and Ar is updated to this the node of choosing under the node right to use chosen; Detection is finished, execution in step (5);

(5) detect St, if St is " time-out executing state ", and receive the trigger position coordinate of the relative touch-screen of clicking signal in the B district, the executive signal that then transmission representative " begins to carry out " is to the custom feature execution module, and Sr is updated to " beginning executing state ", execution in step (6); If St is " time-out executing state ", and the trigger position coordinate that receives the relative touch-screen click signal is in the A district or the C district, execution in step (6); If St is " beginning executing state ", that detects reception this moment clicks signal with respect to the trigger position coordinate of touch-screen, if receive the trigger position coordinate of the relative touch-screen of clicking signal in the B district, then send the executive signal of representative " time-out is carried out " to the custom feature execution module, and Sr is updated to " time-out executing state ", if receive the trigger position coordinate of the relative touch-screen of clicking signal in the A district, then send the executive signal of representative " quickening is carried out " to the custom feature execution module, if receive the trigger position coordinate of the relative touch-screen of clicking signal in the C district, then send the executive signal of representative " retreating execution " to the custom feature execution module, execution in step (6);

(6) will choose the node right to use to give back the event monitoring control module, wait receives the signal of clicking from the full frame arbitrary region of touch-screen, returns execution in step (2);

7, massage voice reading module implementation procedure, as shown in Figure 8:

(1) receives the nodal information of clicking arbitrarily signal processing module or full frame any slip signals processing module payment from full frame;

(2) start the massage voice reading function, report nodal information and prompting;

(3) return execution in step (1);

8, the implementation procedure of custom feature execution module, as shown in Figure 9:

(1) the current feature content of record is R;

(2) detect reception and click the content that signal processing module is paid from full frame subregion, if content is executive signal, then execution in step (3) if content is the feature content of choosing node of paying, then is updated to R the feature content that newly receives;

(3) detect executive signal, if the executive signal representative " begins to carry out ", then begin or continue to carry out current feature content R; If the executive signal representative " suspends and carries out ", then suspend and carry out current feature content R; If the executive signal representative " is accelerated to carry out ", then accelerate to carry out current feature content R; If executive signal representative " retreating " then retreats and carries out current feature content R; Execution in step (4);

(4) wait receives from full frame subregion and clicks the content that signal processing module is paid, and returns execution in step (2).

As shown in figure 10, the Content Organizing structure of the inventive method is tree structure as shown in the figure, P0 is root node, can comprise any a plurality of child node P2 under the root node, also can comprise any a plurality of child node under the child node P1, if do not comprise any child node under certain node, then this node is the leafy node P3 of this tree structure.

As shown in figure 11, in mobile device, enter tree-shaped institutional framework T method, S0 enters first class catalogue by initial state, and choose acquiescence to choose node S1, carrying out full frame any slip (c) switches and chooses node S1, and enable speech-sound synthesizing function, the position of node is chosen in report, after again choosing a certain node by a series of slides, carry out full frame click arbitrarily (a) and enter second-level directory under this node, and choose acquiescence to choose node, and enable speech-sound synthesizing function, node location is chosen in report, carries out when returning (b), returns done state S0; Repeat said process, after entering n level catalogue, that carries out that full frame any slip (c) switches catalogue chooses node Sn, and enable speech-sound synthesizing function, the related content of node is chosen in report, when (b) returned in execution, be back to the upper level catalogue, and enable speech-sound synthesizing function, the position of node is chosen in report, carries out full frame click arbitrarily (a) and enters this node, and enable speech-sound synthesizing function, read current leaf node content, carry out full frame any slip (c) this moment and switch the leaf node function of choosing after node Sn and execution are switched, and enable speech-sound synthesizing function, read current leaf node content, if click 1/3(d on the touch-screen), then accelerate to read the content of current leaf node Sn, if click 1/3(e in the touch-screen), then suspend the content of reading current leaf node Sn, if click 1/3(f under the touch-screen), then retreat the content of reading current leaf node Sn.When method is suspended the function of carrying out current leaf node Sn, full frame click arbitrarily (a), the content that then continues to read current leaf node Sn.When (b) returned in execution, stop to carry out current leaf node Sn function, be back to n level catalogue, what switch to current directory chooses node Sn, and enables speech-sound synthesizing function, reports current leaf node related content.

The content that is not described in detail in the instructions of the present invention belongs to the known prior art of this area professional and technical personnel.

The above only is preferred implementation of the present invention; should be pointed out that for those skilled in the art, under the prerequisite that does not break away from the principle of the invention; can also make some improvements and modifications, these improvements and modifications also should be considered as protection scope of the present invention.

Claims

1. the interactive system of a people and touch panel device, it is characterized in that: comprise, node creation module, tree structure molded tissue block, event monitoring control module, full frame any slip signals processing module, full framely click arbitrarily signal processing module, full frame subregion is clicked signal processing module, massage voice reading module, custom feature execution module, wherein:

Node creation module is obtained the feature content of interactive system, the establishment of analytical capabilities content and practical function node from the external world; Node is as the minimum function carrier of interactive system, and wherein leaf node carrying interactive system requires the content of the major function of realization, after establishment is finished, node is consigned to the tree structure molded tissue block; Wherein leaf node refers to not have the node of child node in tree structure;

The tree structure molded tissue block receives the node from node creation module, with the node that receives, is that the tree structure that designs is organized according to the people, receive all nodes after, composition is had the node set of tree-like institutional framework; During the node set initialization, choose node to be defaulted as the root node of node set in tree structure, current directory is defaulted as the catalogue of root node, will consign to the event monitoring control module by the node set with tree-like institutional framework that node organization is finished; Wherein, choose node, refer to the node of all functions content presentation on touch panel device with the node carrying, current directory refers in the node set with tree-like institutional framework that node forms and chooses node to have the set of all nodes of common father node;

The event monitoring control module, reception is from the node set with tree-like institutional framework of tree structure molded tissue block, then receive from the full frame arbitrary region of touch panel device and click or slip signals, realization is to any slip signals and click arbitrarily signal and monitor, and realizes choosing the usufructuary distribution of node in the node set; To choose the node right to use to distribute to full frame any slip signals processing module or the full frame signal processing module of clicking arbitrarily, when the slip signals that detects from the full frame arbitrary region of touch panel device, the right to use of choosing node is distributed to full frame any slip signals processing module to be processed, perhaps when detect from the full frame arbitrary region of touch panel device click signal the time, the right to use of choosing node is distributed to the full frame signal processing module of clicking arbitrarily to be processed, after finishing dealing with, current having obtained chooses the usufructuary module of node to need to choose the node right to use to return to the event monitoring control module; The node right to use herein refers to have switching, upgrade the right of choosing node and use to choose the feature content of nodal information that node comprises and carrying;

Full frame any slip signals processing module, realize the switching of choosing node in the node set of tree-like institutional framework of interactive system, perhaps realize the switching of choosing node in the node set of tree-like institutional framework of interactive system and switch the function of current directory; When the slip signals that receives from the touch-screen arbitrary region, wait for to receive from what the event monitoring control module was distributed and choose the node right to use, choose the node right to use in case obtain, and this sliding distance that slides on touch-screen is at x in the slip signals of obtaining, when the component on the y axle satisfies requiring of setting, to choose the switching of node, perhaps choose the switching of node and switch current directory, after switching is finished, the nodal information of choosing node to comprise after upgrading is consigned to the massage voice reading module process, and the node right to use of choosing after will upgrading is given back the event monitoring control module; Wherein, nodal information refers to the position of node in the tree structure information relevant with node;

The full frame signal processing module of clicking is arbitrarily realized entering choosing the sub-directory of node and switching in the node set of tree-like institutional framework of interactive system and is chosen node, perhaps carries out leaf node feature content in the node set of tree-like institutional framework of interactive system; When receive from the touch-screen arbitrary region click signal the time, module wait for to receive from what the event monitoring control module was distributed and chooses the node right to use, after module receives the right to use, node leaf node whether in the node set of the tree-like institutional framework of interactive system is chosen in judgement, what if so, then will receive chooses the node right to use to consign to full frame subregion to click signal processing module and process; If not, then switch to the catalogue of the child node of choosing node, and then switch and to choose node, switch finish after, the nodal information of choosing node to comprise after upgrading is consigned to the massage voice reading module process, and the node right to use of choosing after will upgrading is given back the event monitoring control module;

Full frame subregion is clicked signal processing module, realizes suspending, begin, accelerate, retreating the voice reading to the leaf node content; Reception from full frame click arbitrarily that signal processing module pays choose the node right to use, and reception is from the signal of clicking of touch-screen arbitrary region, choose node this moment is leaf node, touch-screen is divided into 3 zones, be designated as the A district, the B district, the C district, and the feature content that will choose the node carrying consigns to the processing of custom feature execution module, when the trigger point of the signal that receives in the B district, send the signal of representative " time-out is carried out " or " beginning to carry out " to the custom feature execution module, when the trigger point of the signal that receives in the A district, send the signal of representative " quickening is carried out " to the custom feature execution module, when the trigger point of the signal that receives in the C district, send the signal of representative " retreating execution " to the custom feature execution module; After function is finished, the right to use of choosing node is given back the event monitoring control module;

The custom feature execution module, reception is clicked the feature content of choosing node that signal processing module is paid from full frame subregion, then carry out feature content, receive simultaneously the representative of clicking signal processing module from full frame subregion and suspend to carry out, continue to carry out, accelerate to carry out, retreat the signal of execution, and the time-out of correspondingly carrying out is carried out feature content, continuation is carried out feature content, accelerated to carry out feature content, retreats the execution feature content.

2. the interactive system of people according to claim 1 and touch panel device, it is characterized in that: described node creation module implementation procedure is as follows:

(1) obtains the feature content of interactive system from the external world;

(3) node that creates is consigned to the tree structure molded tissue block.

3. the interactive system of people according to claim 1 and touch panel device, it is characterized in that: described tree structure molded tissue block implementation procedure is as follows:

(1) reception is from the node of node creation module;

(4) node with tree-like institutional framework of tissue being finished is in conjunction with consigning to the event monitoring control module.

4. the interactive system of people according to claim 1 and touch panel device, it is characterized in that: described event monitoring control module implementation procedure is as follows:

(5) the node right to use of choosing to be recycled such as;

(6) reclaimed choose the node right to use after, will choose the node right to use to lock, again execution in step (2).

5. the interactive system of people according to claim 1 and touch panel device, it is characterized in that: described full frame any slip signals processing modules implement process is as follows:

(5) set that to choose node be A, current directory is S, S={A, and B ... N}; The father node catalogue of setting A is: S ₁={ A _x, A ₁..., A _n, wherein Ax is the father node of A;

(6) resolving the sliding distance of slip on touch-screen that produces this slip signals is R, and the component of R on x axle positive dirction is Rx+, and the distance on x axle negative direction is Rx-, and the absolute value of the component on the y axle is Ry; Execution in step (7);

(10) the node right to use is given back the event monitoring control module, and execution in step (2).

6. the interactive system of people according to claim 1 and touch panel device is characterized in that: described full frame to click arbitrarily the signal processing module implementation procedure as follows:

(4) remember that choosing node is the A node, current directory is S, S={A, and B ..., N}; If the A node comprises child node the catalogue of the child node of A node is designated as S ₁, S ₁={ A _x, A ₁..., A _n, and S ₁It is A that middle acquiescence is chosen node _x, A _xArtificially appointment;

(6) the node right to use is given back the event monitoring control module, and execution in step (1).

7. the interactive system of people according to claim 1 and touch panel device, it is characterized in that: it is as follows that described full frame subregion is clicked the signal processing module implementation procedure:

(3) wait for to receive the signal of clicking from the full frame arbitrary region of touch-screen; Receive from the full frame arbitrary region of touch-screen click signal after, execution in step (4);

(8) the node right to use is given back the event monitoring control module, and execution in step (3).

8. the interactive system of people according to claim 1 and touch panel device, it is characterized in that: described massage voice reading module implementation procedure is as follows:

(3) execution in step (1).

9. the interactive system of people according to claim 1 and touch panel device, it is characterized in that: described custom feature execution module implementation procedure is as follows:

10. the exchange method of a people and touch panel device is characterized in that step is as follows:

(1) the described interactive system of initialization claim 1, the current node of choosing is designated as A, and current catalogue is designated as S={A, B, C..., N}; A node father node catalogue S ₀={ A ₀..., N ₀, it is A that acquiescence is chosen node ₀, can artificially set; The child node catalogue S of A node ₁={ A ₁..., N ₁, acquiescence is chosen node A ₁, can artificially set;

(10) the custom feature execution module receives feature content and the executive signal of clicking signal processing module from full frame subregion; If what receive is feature content, the more current feature content of new record is the new feature content that receives; If what receive is executive signal, if executive signal representative this moment " begins to carry out ", then begin or continue to carry out current feature content, thus the realization of beginning or continue function content; If the executive signal representative " suspended and carried out " this moment, then suspend and carry out current feature content, thus the realization of pause function content; If executive signal representative this moment " is accelerated to carry out ", then accelerate to carry out current feature content, thereby accelerate the realization of feature content; If executive signal representative this moment " retreating execution " then retreats and carries out current feature content, thereby the realization of fallback function content.