CN201917894U - Human-machine interaction system and relevant systems and equipment of human-machine interaction system - Google Patents

Abstract

The utility model discloses a human-machine interaction system which comprises an input unit, a storage unit, a processing unit and an output unit, wherein the input unit provides initial input of the original information and the associated information related to the original information for a user; the storage unit is used for storing a database which establishes a mapping relationship between the first information representing the input information of the user and the second information representing the mapping function; the processing unit uses the original information as the first information, and uses the mapping relationship to search the associated second information as the associated information of the original information from the database of the storage unit; the output unit is used for outputting the associated information to make interaction with the user to execute the confirmed input; and the input unit, the output unit and the storage unit are respectively electrically connected with the processing unit. In addition, the utility model also discloses communication equipment related to the human-machine interaction system. The human-machine interaction system realizes the convenient human-machine interaction method, and changes the habit of human-machine interaction.

Description

Man-machine interactive system and related system thereof, equipment

Technical field

The utility model relates to artificial intelligence field, relates in particular to a kind of man-machine interactive system and related system thereof, equipment.

Background technology

It is human since the interactive device that with the computing machine is representative produces, derived and had the multiple intelligence system of different characteristics, comprise that NOVEL, UNIX, LINUX, WINDOWS etc. are applicable to the traditional type of personal computer, comprise that also various operating systems are along with the development of society is constantly developed in depth and breadth based on portable interactive equipment such as mobile phone, various novel intelligence system WINDOWS CE, the SYBIAN of Palm, PDA etc., ANDROID, NOVA etc.The level of operating system has been represented the degree of intelligence of man-machine interactive system to a certain extent.

In all traditional operating systems, the development of its instruction input technology is followed from command mode basically to the process of giving directions schema evolution, during this time towards the appearance of programming, it is the key point that the pattern of indication operating system is pushed to a new high, undoubtedly, the huge leap forward of Industrial Revolution for the third time, the realization of this type of technology of be unableing to do without, simultaneously, the mankind be in the 3rd with the intersection of fourth industrial revolution, the fourth industrial revolution that following human trend is sign with artificial intelligence also needs constantly evolution based on this.

Traditional order input pattern uses order line of character string input, carries out function corresponding by system call and this order line corresponding programs then, so deficiencies such as it is loaded down with trivial details, poor efficiency are unknown naturally.And after the generation of the pattern of indication operating system, immediately popularize, although the contribution of hardware synchronization development is arranged, prior is because it has changed human operation human-computer interaction device's traditional habit, further meets the mode of thinking of the mankind based on object.Just therefore,, in general masses' sieve the daily life, give directions the operating system of input pattern to eliminate the order input pattern, the operating system of order input pattern is present in highly professional fields such as bank, telecommunications more.By the industrial chain that the indication pattern is brought, the fast development that promotes global IT market also is that Shi Suowei has.

Howsoever, the operating system that all are existing still rests on the corresponding one by one level that responds of user's input, machine, can not carry out the intellectuality thinking according to the mankind's the mode of thinking, so that leading property ground provides for the user and imports the out of Memory that is associated.In order to realize similar function, often need additional single or other multiple relevant special procedure can realize that still, these single additional special procedures remain mechanical, be to realize not having general adaptability targetedly at certain concrete function.Enter exactly before this program itself, also need to operate, show on the human thinking it is intermittent operation through loaded down with trivial details giving directions.With the computing machine is example, move certain function, often need in layer manually search along menu, until finding corresponding program can click operation; With the mobile phone is example, as dialing someone phone of having put down in writing in the address list, needs earlier, to call phone module again and to communicate after this people is found in the entry communication record through loaded down with trivial details clicking operation; In like manner, other portable terminal too, all come from the specific implementation of the input pattern of operating system.

Perhaps, because personal computer has been equipped with relatively large keyboard and the screen of volume, the user does not think that subjective this traditional indication input pattern brings great inconvenience based on operational existing custom, but, show that then its contrast is particularly evident on the equipment such as portable terminal interactive device that screen and keyboard are less such as mobile phone, PALM, PDA, MP4, net book.

In the portable interactive equipment, because its keyboard and screen are all less, so the realization to input method brings very high requirement, as in the mobile phone of nine palace lattice keyboard formats, except only plurality of keys, and should not carry other input equipment of mouse and so on, therefore, how to utilize nine palace lattice keyboards to import fast efficiently and just become problem, facts have proved, cell phone keyboard input not only cannot be mentioned in the same breath on speed with the computer keyboard input, and chooses at menu, orders on the speed chosen etc. on the functional performance and the convenience degree and also can not mention in the same breath.Thus, further illustrate,, also wait to improve part during as can be seen even microcosmic is treated the input pattern of traditional operating system.As for the portable interactive equipment of 26 keyboards, then the operational inconvenience of its keypad still can more outstanding same defective.

Although touch-screen mobile phone has adopted the mode of soft keyboard, the realization of soft keyboard also is the extension of hard manual on touch-screen, so not all right giving unnecessary details.

The input tool of instruction, performance on computers, mainly be keyboard and mouse and other phonetic entry instrument, show on the portable interactive equipment, then be mainly keyboard and voice, regardless of concrete input tool and input method thereof, be human thinking's representation aids, prior art can not change all that people carry out single expression and machine carries out the custom of single feedback.Certainly, the mankind utility model equipment such as brain wave translater, iris recognition device, and it is applied as input equipment, but the prematurity still of these technology is had got long long way to go.

In summary, although traditional several operation systems is in other technical continuous evolution, but its intelligent degree still stagnate very important reasons just is to break away from the single expression of user and this directed thinking of the single machine feedback of machine, also promptly can't extend the human thinking, wherein the input method of broad sense (comprises modes such as voice, key, but not specifically certain character code rule representative as five, spelling input method etc.) express approach as the user, play crucial effect therein, but be not whole.

The utility model content

Based on the deficiencies in the prior art, primary and foremost purpose of the present utility model is to provide that a kind of thinking that the user is contained by the expression that input equipment carried out further extends thinks to be the intelligence system of gained (What You ThinkWhat You Get).

A purpose more of the present utility model is to provide a kind of communication facilities that uses described intelligence system principle to realize.

For realizing above-mentioned each purpose, the utility model adopts following technical scheme:

The alleged intelligence system of the utility model primary and foremost purpose, it comprises:

Input block, offer initial input that the user carries out raw information and the related information relevant with this raw information give up really into;

Storage unit is used to store and will have characterized the first information of user's input information and characterize the database of setting up mapping relations between second information of image function item;

Processing unit as the first information, utilizes described mapping relations to retrieve the related information of second information associated therewith as this raw information in the database of storage unit described raw information;

Output unit, export this related information in case with user interactions to carry out described affirmation input;

Input block, output unit, storage unit electrically connect with processing unit respectively.

Described input block has input media, this device in the microphone, keyboard, brain wave translater, iris recognition device, touch-screen any one.

Native system also comprises remote unit, is connected with remote server to realize the renewal of described database.

The alleged a kind of communication facilities of the novel purpose again of the utility model, have with public communication network between set up the interface communicate by letter, it has adopted aforesaid intelligence system.Described communication facilities be in mobile phone, PDA, Palm, desk-top computer, notebook, net book, MP4, electric paper book, the game machine any one.

Compared with prior art, the utility model has the following advantage of enumerating at least:

1, extending human thinking's expression on machine is achieved: adopt method of the present utility model or related system, the user is according to certain input rule, for example adopt five, English, spelling input method, phonitic entry methods etc. are expressed its thinking by input media, equipment is when accepting input, Intelligent Calculation at once, will with the information of user input (for the user, have certain semanteme) deduce, this deduction can utilize the mode of mind map to be realized, the related information that user's raw information is relevant is listed one by one, further supply user's affirmation and carry out the pairing image function of selected related information, and the image function that is comprised in the related information, basically included the intrinsic menu function of this machine on the equipment, executable program, other various files, data even commercial promotion information etc., so in fact, be equivalent to the human thinking is expressed in extension and execution fast easily on the machine, the mutual stage has been submitted man-machine interaction efficient greatly in the middle of having saved.

2, traditional man-machine interaction custom is changed: in traditional input tool, just knock character keys when voice (or simple, careful speech) simply, and make speech output with the combination of character, its processing focus only concentrates on the text editing level; As for need operation function item, then need to search layer by layer and can move by menu, proposition of the present utility model makes this dual mode be able to good integration.The user only needs directly its intention (information) to be expressed on machine with forms such as literal, voice, what machine directly fed back promptly is and the closely related various airborne functions of its intention or other resource, the user only need be confirmed that the selection of concrete function can reach the purpose of oneself, so the machinery that the utility model has fundamentally changed traditional man-machine interaction mode is operating habit one to one, make man-machine interaction become more simple, directly perceived, intelligent, man-machine interaction is entered.

3, operating system and input system are combined together: scheme of the present utility model provides dual mode, one by seizing the right of priority of operating system, ensure that wherein importing relevant function moves in real time in internal memory, so that real-time response is in any input of user, this is especially necessary in the multithreading operation system; The two does not distinguish operating system and input system, can be used as an integral body integrated exploitation in addition of operating system because of input system.Like this, the boundary of operating system and input system just no longer exists, and for the user, input i.e. operation, and thinking needn't be switched input method status to things (Thinking To Thing is called for short 3T) complicatedly.Based on fusion of the present utility model, one well the database of simulating human thinking will in operating system, play the effect of subrogating thinking true to nature that is close to.

4, help being connected of terminal type equipment and common network: the whole world of internet popularize and with the fusion of other common network, round Realization and accelerated development in 10 years in the past, for the mobile network, also the 3G epoch have been entered, and 4G also comes up gradually, and it is more general that the access of terminal type equipment and common network becomes.Information explosion instantly with in the future, the extension of network on terminal device also is trend of the times with merging, " pattern of cloud computing already proposes and realizes, proposition of the present utility model also equals to propose the supplementary measures of a kind of " cloud input " undoubtedly.The scheme that the utility model proposes directly is converted to the human thinking purpose things, has played the effect of quick locating information target, has improved the user and has used network to obtain the efficient of information, also provides a kind of measure of assembling information for eyeball economy simultaneously.

5, change has also defined industry standard: overlap basicization degree than higher technical scheme as one, the utility model is equivalent to propose a kind of new industry standard that is different from the past in fact, this standard not only is different from existing operating system, also be different from existing input system, more be different from both machinery stacks, but a kind of brand-new both packages of integration are proposed, so enforcement of the present utility model will be on the basis that the technology that causes whole field turns to, derive based on a plurality of technique directions of the present utility model, thereby the possibility that also has the birth that causes a new industry, in addition, because the utility model is owing to reserved interface for long-range access, also reserved the possibility of definition database for operator, so commercial, operator can obtain the definition power of database in view of the above, also can cause the coml change naturally.

The beneficial effects of the utility model are far above in above-mentioned and enumerate all main points, add as space is limited and not and give unnecessary details.What need further emphasize is: other any because of the utility model alleged to think to be the technological change that the realization of technical scheme of gained causes, and with the caused beneficial effect of this change, though expressly do not put down in writing, all belong to those skilled in the art and the commercial field personnel can know by inference at this.

Below in conjunction with the drawings and specific embodiments the utility model is specifically described:

Description of drawings

Fig. 1 is the principle schematic of an embodiment of intelligence system of the present utility model;

Fig. 2 is the relational structure mode synoptic diagram of database of the present utility model;

Fig. 3 is the principle schematic of an embodiment of input system of the present utility model;

Fig. 4 is the main flow synoptic diagram of man-machine interaction method of the present utility model.

Embodiment

The intelligence system that the utility model provides, man-machine interactive system and input system, incorporated the alleged man-machine interaction method of the utility model, be based on the evolution of traditional operating system and input method software, form with software is installed in the existing hardware device, for example desk-top computer, notebook computer, mobile phone, Palm, PDA, MP4, electric paper book, game machine or the like terminal type equipment.

Input method that the utility model is alleged and input thereof, refer to broad sense input method and input thereof, be and be used to import the mode that characterizes the expression formula that comprises the human thinking, broadly, at least comprise the phonetic entry mode, the key input mode, the brain wave induction mode, the iris induction mode, and touch sensible mode etc., use the input media of following correspondence respectively: comprise microphone at interior audio receiver, various keyboard and/or button, known and not universal brain wave translater, the iris recognition device of having used in other field and the touch-screen of widespread use etc.Narrow sense for the key input mode, can be used multiple known or unknown input rule, for example five, spelling, Two bors d's oeuveres, Zheng's sign indicating number, natural code, region-position code, Cangjie, English and other national various input rules or the like.

" information " that the utility model is alleged is continued to use common practise, but is necessary to emphasize at this, has the effect of certain hint expression.So " raw information " has promptly comprised the information of the meaning of the original expression of user, " related information " promptly comprised the information that is associated with " raw information " after the system handles, has the effect of hint expression equally.

A kind of intelligence system of the present utility model comprises input block 1, storage unit 2, processing unit 4 and output unit 3, and input block 1, output unit 3 and storage unit 2 are connected with processing unit 4 respectively.

Fig. 1 is the application example synoptic diagram of intelligence system of the present utility model.Input block 1 wherein offers the input that the user carries out raw information.With the mobile phone or the computer that have hard manual among Fig. 1 is example, adopts hard manual as its input media, and 3 of described output units are the display screen of mobile phone or computer; And be example with smart mobile phone or the computer that does not have hard manual, because it is equipped with and provides soft keyboard on touch-screen and the touch-screen, so its touch-screen possesses the function of input and output simultaneously, the operation on touch-screen also will be equivalent to the operation of hard manual.Other only provides unidirectional input function, so do not add special instruction basically such as voice mode, induction mode etc.

For adopting the situation of key instrument among Fig. 1 as input media, the each single input that the user utilizes input block 1 to be carried out, be to be that unit carries out with single button, because each button is represented a numeral (showing as a basic code element on the machine) at least, may comprise a plurality of characters what is more, but for a plurality of characters in each button, system is to be in primary importance respectively when handling.So the possibility of result of formed combination formed character string when a plurality of buttons were imported successively, also may form numeric string, show and then be at least one group of ISN sequence of forming by at least one basic code unit in the internal memory, utilization input rule such as phonetic, five etc. wherein character string organized speech, formed phrase and described numeric string promptly have the effect of certain hint expression, also promptly form the raw information of user's initial input, the form that it can the ISN sequence is stored in the database.Because the corresponding relation of mobile phone key and key (by by the key map reflection) is generally one-to-many, so the general corresponding a plurality of ISN sequences of a string button input, these ISN sequences all constitute described raw information.

It is to be noted, the user is to the input of raw information, retrained by its input rule that adopts, die from an ISN sequence to the corresponding relation its corresponding phrase, by input rule self prebuild, the initial input of the raw information that the utility model is alleged, obviously also comprise selection and the operation of determining to a plurality of phrases that produce by a string button, thereby further, the input operation that the alleged input block 1 of the utility model is given up really and selected speech according to input rule into not comprising.

For example, in nine palace lattice cell phone keyboards, adopt " state's spelling input method ", the button at input " 74744 " place, can form " 74744 ", " pishi ", " qishi ", " rishi ", numeric string or character strings such as " sishi ", these kinds of characters strings all have corresponding vocabulary separately, can be as character string " pishi " according to input rule corresponding to " written instructions ", speech such as " trifling matters ", " qishi " can be corresponding to " in fact ", speech such as " imposing manner " etc., no matter be " pishi ", " written instructions " still are " trifling matter ", though the relation with one-to-many exists, but in this machine internal memory, all show as separate and have the ISN sequence of uniqueness, for the user, all are results of group speech, to system itself, the set of the speech of being made by formed these numeric strings of order button " 74744 " and character string is the raw information corresponding to this logical button operation.And if in above-mentioned these phrases, the user selects " written instructions " according to input rule and adds their confirmation in a plurality of phrases, then Ci Shi raw information has unique determinacy naturally.But confirming the operation of certain phrase itself, is to belong to the intrinsic function of input rule itself.

But,, also can retrain input system and only after the user selects speech to the speech of a plurality of institutes structure, can carry out the retrieval of related information just now as a special case of the present invention.At this moment, select the operation of speech to be regarded as manually carrying out the operation of the retrieval of related information.Also promptly, when the word and search of the present invention's structure utilizing is associated information, two kinds of situations are arranged, one in input in real time and utilize in the process of word-building that the speech of structure carries out the related information retrieval as keyword and shows in real time automatically; Another then for after stopping input the user, clicks in the speech of one or more structures when determining, retrieves related information and demonstration just now.

For 26 keyboards (comprising mobile phone and computing machine) because key and intercharacter have one-to-one relationship, reduce relatively so character string of being formed and the speech made are inevitable, but its manage and the former together.

For other input media that adopts voice, induction and so on, the input rule that is used is different from the key mode, but its only way which must be passed forms the ISN sequence nothing but in internal memory, so its essence is same as the mobile phone of above-mentioned keyboard input.

Input block 1 is except being used to import the raw information, also be used to offer the user carry out to related information give up really into.As defined above, the scope that the operation of this affirmation input does not belong to input rule to be defined, but only to belonging to the affirmation operation of the related information of from second information, selecting, in description described later, will handle input block 1 and confirm that input cooperates description.

In the described storage unit 2, store a database, this database can be realized by those of ordinary skills, alleged herein database is the broad sense database, be meant one group of set that has the information of mapping relations, can realize by text, also can realize, perhaps can realize by other known forms by Hash table with hash memory function.

See also Fig. 2, in this database, exist a kind of mapping relations to set up mapping between the first information and second information, retrieve as key word, can obtain at least one second information associated therewith with the first information.The foregoing a plurality of ISN sequences that formed by one group of button have constituted the raw information of user's input, the corresponding a plurality of ISN sequences of these raw informations are directly as the first information, and second information is default content, each ISN sequence (sign raw information) has been put down in writing in advance at least one information that semantically is associated in its corresponding in advance first information, and the set of these second information that are associated with an ISN sequence promptly forms the alleged related information of the utility model.It is to be noted, mapping relations between the described first information and second information, and non-limiting form realization to write down in the tables of data, it can adopt a plurality of tables of data (as a plurality of Hash tables, other related hash form etc.) to carry out complicated association, need only the mapping relations that directly or indirectly exist in the database between the first information and second information, and the corresponding relation between the first information and second information both can be one to one, also can be one-to-many, promptly be considered as not unconventional connotation of the present utility model.As seen, be expressed in extension on the machine for the human thinking in the native system, the structure of the content that being lifted at of its intelligent degree depend on the mapping relations of the first information and second information in the database to a great extent, comprised second information, and to optimization algorithm of second information institute content etc.

Semantically be associated, be meant according to default semantic rules, exist in second information at least one information and the pairing phrase of certain ISN sequence have certain such as the next, upper, extension, synonym, antisense, accept, side by side, transfer, expand, refer to etc. and get in touch.For example, above-mentioned ISN sequence " 10000001 " phrase corresponding with it is " written instructions ", with the speech of " written instructions " synonym be " indication ", its expansion word can be " file ", " content ", it refers to speech can be its network address, also can be its path, it can also be its certain correlation parameter, as when the pairing speech of ISN sequence " 00000001 " is number series " 13800138000 ", can be the parameter of telephone program, also can be particular, instruction set, even can also comprise the link etc. of the program of using these instruction set, parameter, network address, path.

Semantically be associated and be different semantically equating, semantically equating, be meant according to corresponding certain input rule, exist at least one information equal fully in second information with the corresponding phrase of certain literal of the scheduled justice of certain ISN sequence, as the ISN sequence " 10000001 " that is characterized by " pishi ", its pairing phrase is " written instructions ".As previously mentioned, its corresponding relation is arranged by this kind input rule itself, do not belong to defined second information of the utility model, it is its feature that the corresponding phrase of the relative ISN sequence of second information of the present utility model has certain purpose, but, this is not equal to and shows and can not exist in second information and the identical character of described corresponding phrase, whether having this character is not the emphasis that alleged second informational needs of the utility model is considered, should not limit the definition of the utility model to second information with this.

Above-mentioned all these set in the information that semantically is associated as long as it is associated with same ISN sequence, all are defined as the related information that an ISN sequence (raw information) therewith is associated by the utility model.

The design of the content that second information is comprised realizes with the image function item in the utility model that the image function item can be discerned by native system for abideing by the formed expression formula of native system preset rules.This shows, the image function item also promptly semantically with certain ISN sequence the expression formula that is associated of corresponding vocabulary, and as long as formulate preset rules, the concrete form of expression formula then is flexile.Below illustrate:

As the pairing phrase of certain ISN sequence is " phone ", in design during with image function item that " phone " ISN sequence is associated, both can in this machine, retrieve the All Files name or shortcut name comprises the program of " phone ", as " phone " module or the program that are used to converse in the mobile phone, obtain its Program path and store as second associating information, shape as " make a phone call (markup character string); the call instruction of calling program (directly); c: windows phone.exe (procedure stores path) ", the network address such as the http://www.XXXXXX.com that can give a phone production firm again store as second associating information, shape is as " looking for some phone manufacturers; visit (remote access instruction); www.XXXXXX.com (network address parameter) ", can also identify as the keyword parameter of certain search engine and store, even, when its during as the keyword parameter of search engine, the link of third party's browser or an embedded browser module can also be stored as second information with this parameter.

The aforementioned alleged first information multistage related mapping relations that cause alleged with second information, not only refer to the association that continues of a plurality of epiphases in the same database, also comprise the association between the disparate databases, for example, the vocabulary of certain ISN sequence correspondence is " 1380013800 ", be judged to be numeric string by system, its second information can be defined as: a, the parameter of phone module or program; B, the expression formula of the parameter of phone module or program and phone module or program itself; C, the text parameter of short message; D, the expression formula of short message text parameter and short message program or module itself; E, the telephone number parameter of address list; F, the telephone number parameter of address list program or module itself and address list; G, a specific macro operation comprises a plurality of preset instructions, or the autoexec path of these a plurality of instructions ... or the like.Further, can also express with the telephone number parameter by the information that the interface that address list provides is retrieved the record of this number correspondence and obtained its " name " field.

Therefore, in conjunction with the common practise of the operating platform of smart machines such as the applied computing machine of the utility model, mobile phone, described image function item commonly used may be summarized to be the content of following several aspects basically:

Local executable program or its link are a series of files that can directly move of representative with suffix for the file of " exe " or " lnk ";

Default instruction set or its link, be used to finish the macro operation of a consumer premise justice, form by several basic steps, this instruction set allows that the function of native system further expands, for example, can be used for to be that key word travels through this machine file allocation table, to find certain executable program with the pairing phrase of current ISN sequence when the first step by the edit instruction collection; When second step, be that parameter is moved the relevant program of this phrase with this phrase; The interface move instruction that provides by this program when third step makes this program carry out default instruction;

Remote information is that representative a series of are used for remote access information with network address and correlation parameter thereof even its browser, the expression formula of browsing module;

Default text message, the information based on default content text correspondingly, can expand to information such as picture, audio frequency, and typical example is the brief introduction information that comprises audio communication, video signal and literal etc. of certain manufacturer;

Local text, audio file, video file or the link of one of them, certainly can comprise further also that the program that is used to open these files expresses together, for example both can be " singing the .vob of motherland ", also can be " mediaplayer.exe+ sings the .vob of motherland ";

The parameter of third party's program, certain link and this parameter that also comprises this third party's program, the path of typical example such as telephone program and the telephone number that current phrase is comprised, wherein, the telephone number that current phrase comprised is parameter.

So as can be known, although the utility model is attempted the content that the image function item is comprised is sorted out, but in fact, still there is the intersection part in these classifications, because the purpose of this utility model is to extend the human thinking of expressing, and described image function item is expressed another kind of expression formula after the extension as the human thinking, as long as provide an agreement, system itself just can resolve its expression formula, and express the meaning according to the image function item and contain to carry out, therefore, the image function item that second information is comprised, as the related information that is associated with raw information, it is concrete man-machine, machine machine expression way is can be in the basic enterprising line height design flexible of present embodiment.

For basic technical scheme, wherein the correlation degree of the image function item that comprised of second information determines, mainly the theory according to the artificial intelligence logic realizes, as for its particular content itself, then the utility model naturally can't exhaustive or accurate classification, because artificial intelligence itself promptly belongs to the fuzzy design field.But, those skilled in the art are after reading above-mentioned definition and associated description about second information, related information, image function item, surely on the basis of present embodiment, the utility model is made more diversified and finer variation, but, regardless of intensity of variation, its essence still can't be unconventional outside the utility model.

Described processing unit 4 plays management control total system in intelligence system of the present utility model.It mainly is made up of two parts, and one is ISN modular converter 41, and another then is an information translation module 42.

Described ISN modular converter 41, the action that has the user is converted to machine inner code and the further effect of formation raw information.User's action for the key input mode, is the action of its button; For the phonetic entry mode, for it realizes the action of phonetic entry by acoustic vibration; For other input mode, all can not break away from the most original action of user, the iris motion when brainwave activity when comprising human brain thinking and eye activity etc.So system just possesses the ability of these actions of identification, as the action of the identification of the current potential by button user key-press, the sounding action of the Vibration identification user by receiver etc., and further be converted at least one ISN sequence according to default input rule.For example, adopt as heir precedent, the user is by pressing " 74744 " key on the cell phone keyboard, input rule just carries out intellectuality group speech in real time, in system, there are several combinations such as " pishi ", " qishi ", " rishi ", " sishi " at least, and are transfused to rule and are converted to the ISN sequence of its corresponding phrase " written instructions ", " imposing manner ", " solar eclipse ", " 40 " etc. in machine, to express.The pairing ISN sequence of these real-time phrases just can constitute the raw information of user's input.Meanwhile, processing unit 4 can be exported the pairing phrase of above-mentioned character string " written instructions ", " imposing manner ", " solar eclipse ", " 40 " etc. for the user and be selected.If the user further clicks " written instructions " according to input rule, just the real-time further precision of raw information then.

Described information translation module 42 by in real time the database in the storage unit 2 being operated, realizes the conversion from raw information to the related information.There is the single mapping of the first information and second information in the database of aforementioned known memory units 2 or to many mappings or multistage complex mappings, this information translation module 42 follows each input action of user, also be in the process as the cell phone keyboard input, input rule can make up the possible ISN sequence and the corresponding phrase of key combination instantly in real time, this information translation module 42 is then carried out in phrase (ISN sequence) structure the content of real-time input at input rule, with current ISN sequence is key word, in described database, retrieve second information that has mapping relations with it in real time, because second information relevant with same ISN sequence can have a plurality of, if and the phrase that user's input is in real time constructed has a plurality of a plurality of ISN sequences that just have, so it will retrieve a plurality of second information, as previously mentioned, the combination of these second information that retrieve is the related information of the ISN sequence of using as key word.

Described output unit, as mobile phone display screen, define an output area, be used to export the related information that processing unit 4 has retrieved, certainly, output unit is also done it and is used, for example, the user is after input " 74744 ", and the phrase of " written instructions " of constructing according to input rule, " imposing manner " and so on needs expressly output select input so that raw information is more accurate for the user, so the time also exported in accordance with traditional habit.

It is to be noted, described database also can be stored in the storage unit 2 of remote server, at this moment, intelligence system also should comprise a remote unit, connect by this remote unit and remote server, obtain the renewal version of database from remote server, the database of local storage unit 2 is used for upgrading, mapping relations of the first information and second information in the new database more whereby, thus, also reserved certain definition power of database for the remote server administration person, research and development and management are concentrated in the raising of the intelligent degree when making the utility model man-machine interaction effectively.

In the above-mentioned intelligence system of the utility model, because it has possessed each key element of computing machine, and it is done as a whole, form with operating system nucleus is employed, the thinking association is carried out in intercepting user input in real time, these characteristics make it be different from certain only to have a simple function and need the program of implanted existing operating system, be different from the scheme of certain speech recognition executive routine non real-time response each single input of user and non-kernelised.In a single day this intelligence system is employed, then user's custom changes thereupon, after the system start-up, the user only needs to import by the natural thinking pattern, the intention of its expression just can " be understood " by system, and then present the related information that supplies the user, and saved the complicated processes of man-machine interaction, realized the man-machine interaction mode of (Thinking To Thing) from the thinking to the things.Certainly, intelligence system of the present utility model when using, can obtain comparatively obvious effects on the portable terminal type equipment of mobile phone and so on, and is particularly more outstanding aspect optimization reciprocal process.

As higher this case of technology of basis degree, the superiority of aforesaid intelligence system embodiment from saying more, but, a last embodiment has finished from the raw information of representing human brain thinking to express to the extension of the related information of representing mind over machine to extend, tentatively finish think to be the design of gained, but do not reach the higher level purpose of the utility model as yet.So and then another embodiment is proposed, this embodiment deep-cuts pick on the basis of last embodiment.See for details following:

Another kind of intelligence system of the present utility model, the content that has comprised previous embodiment fully, it is not only considered if make the real-time expression of human thinking on machine, and further make this extension expression be able to direct execution, therefore, need further enrich the content of the processing unit 4 of intelligence system.

As previously mentioned, second information has characterized the image function item, and the image function item is then further expressed with certain expression formula, and the rule of expressing is preset by intelligence system.So described processing unit 4 further comprises a parsing module 43 and an execution module 44.

Described parsing module 43, be used for the user finish related information given up really after, resolve the image function item that selecteed related information comprises.As previously mentioned, the expression formula of image function item is a high flexible, and is not limited to a kind of expression formula, so the concrete meaning of expression formula needs parsing module 43 to be differentiated.As for the aforementioned image function item that is associated with phrase " 13800138000 ", selecting a as the user is the parameter of phone module or program, its at the beginning of making up database by giving the sign meaning of numeric string with telephone number, this sign meaning can be identified in second information, perhaps directly prestore this telephone number as second information, then notice execution module 44 carries out making call.Selecting b as the user is the expression formula of telephone program and parameter thereof, and notice execution module 44 was dialed this telephone number with this telephone program after then parsing module 43 was explained.Selecting g as the user is specific macro operation, may be directed at then whether this phrase is differentiated be numeral, looks it then and differentiates the result and carry out further mutual function.So all, be adapted to the dirigibility in the expression formula design, so the also relative flexibility of its analytic ability.

Described execution module 44, be used to respond the user give up really into, after 43 pairs of parsing modules reflection function items is resolved, according to the true intention of the rule understanding image function item expression formula of systemic presupposition and carry out it.Based on aforementioned content classification about the image function item, adaptively, execution module 44 comprises following submodule:

Functional module, when described image function item is local target program or its link, directly move this target program, target program is generally executable file or its shortcut (link), as " phone " in the systemic-function menu or its program " phone.exe ", if it is expressed with image function item expression formula, then its be output as related information show and selected to confirm by the user after, resolve by parsing module 43 earlier, then, this module can be moved " phone " program pointed " phone.exe ", or direct working procedure " phone.exe ";

Instruction module when described image function item during for default instruction set or its sensing or sign, directly moves this instruction set and carries out macro operation.Set up departments and be preset with the sensing or the sign of following instruction set in the system:

Then, when the sensing of regarding it as above-mentioned instruction set behind parsing module 43 certain image function item of parsing or sign, just can notify this instruction module to start by execution module 44 and carry out above-mentioned instruction set, thereby finish a more complicated function, also reserved interface for the functional depth expansion of this intelligence system;

Mixed-media network modules mixed-media, when described image function item is remote information, with this image function item as the parameter access telecommunication network.The expression formula that is resolved to the image function item as parsing module 43 is www.XXXXXX.com, know that then it is a network address, then notice present networks module is opened this network address of browser access, if perhaps this expression formula includes the appointment of browser simultaneously, then mixed-media network modules mixed-media is responsible for opening the browser of appointment simultaneously.

Text module, when described image function item is text message, the program of text information is read in operation, this reading depends on the program of read text information, can in system registry, find relative program to read, certainly, also can realize by the module that reads text message and show is provided in intelligence system;

File module, as described image function Xiang Weiyi during by the file of program association type or its link, move this associated program visit this document, find " singing the .vob of motherland " as described above, then can call the program mediaplayer.exe that is associated with it voluntarily it is play, also can play certainly by the built-in playing module of intelligence system;

Communication module when described image function item is the parameter of third party's program, transmits this parameter and moves it to this third party's program.Number series " 13800138000 " as the aforementioned, when resolved module 43 is considered as the parameter of telephone program, its also module invokes telephone program thus then, and pass to this telephone program as parameter with " 13800138000 ", telephone program is dialed this telephone number then.And for example, if this number series simultaneously resolved be the telephone number of address list, then this module can retrieve with the user of this number direct correlation by the interface that the address list program provides and enter the state of viewing or editing.

The process that is used for carrying out the image function item that related information comprised that the user confirms at above-mentioned execution module 44 each submodule, note that execution module 44 has dual mode to calling of external program and internal module, the one, comprised the situation of designated program for image function item expression formula, then move this designated program, another then is unspecified situation, in this case, because separate, stored has for example registration table of database that some file or parameter are associated with some program in the system, so execution module 44 can call corresponding program in this case voluntarily.No matter its concrete executive mode how, these processes still are transparent for the user.

Be limited to the chiasmate that the image function item is sorted out, parsing module 43 may be done ambiguity to same functional-image item and explain, thereby may notify two submodules of execution module 44 simultaneously, finally cause having two submodules simultaneously in response to same by the confirmed image function item of user.

Because in the above-mentioned image function item, when itself and other image function item is shown to the user with the form of related information in the lump, for the user, each hint expression has been clear and definite, the user is selected to confirm under the condition of having a clear meaning, and is fuzzy or the situation appearance of repetition so should not cause machine when carrying out.Therefore, for avoiding repeated resolution and repeating, the utility model further proposes a kind of priority mechanism that is used to solve this problem.

In this priority mechanism, confirm any one related information image function item pointed of importing in response to the user, parsing module 43 to the reflection function items parsing in exist two or more execution possible as a result the time, according to the default right of priority size of execution module 44 each submodules quilts, this corresponding parsing of the preferential execution of submodule with the priority valve maximum, when and only have when last selected submodule fails this corresponding analysis result, call the submodule of time high priority value just now and carry out corresponding analysis result.Thus, execution module 44 is after being triggered, and the same time has only a kind of mode to be used to carry out described image function item, thereby has avoided unnecessary conflict or repetition.

Present embodiment continues the function of expansion intelligence system on the basis of last embodiment, be equivalent in fact the human thinking is directly carried out after extending expression on the machine, with think to be that the thinking of gained further expands, wish according to the human thinking is operated machines, and, take into full account the probabilistic problem of machine when understanding the human thinking, designed priority mechanism especially.

Among aforementioned two embodiment, all the form with kernel is disclosed embodiment of the present utility model, and at the reality that has had operating system in present user's existing equipment, the higher corresponding system of transplantability need further be proposed on the basis of intelligence system, so, the utility model and then disclose following embodiment:

A kind of man-machine interactive system that the utility model further provides gives further enriching equally on the basis of aforementioned two kinds of embodiment, mainly is the perfect of its portable function.On the existing basis of aforementioned two embodiment, man-machine interactive system of the present utility model increases by two unit, comprises implanting unit and management and control unit.

Described implantation unit is used for man-machine interactive system self is implanted existing operating system.As in the smart mobile phone that windows CE is installed, be packaged into the installation kit of suffix by the program source file that will comprise man-machine interactive system for " cab ", in mobile phone, move, can finish the implantation of this man-machine interactive system automatically.After native system was mounted, the memory device intrinsic with mobile phone used as storage unit 2, and the CPU intrinsic with mobile phone uses as processing unit 4, and uses as input-output unit 3 respectively with keyboard and display screen.

And then described management and control unit is used to seize the right of priority of operating system, makes the internal memory of native system resident operating system, so that make any input of the input block 1 real-time response user who belongs to this man-machine interactive system.So, in precedent, the user is to any operation of keyboard, the capital is intercepted by this man-machine interactive system, and then its processing unit 4 further is converted to related information in real time with it, can reach the effect that real-time extension human thinking expresses, and after the user confirms related information, if the processing unit 4 of this man-machine interactive system also comprises parsing module 43 and execution module 44, then can further this extension mental representation be carried out.

As seen, present embodiment has further solved the problem of implanting intelligence system in existing operating system, the solution of this problem, be installed in externally hung software on the existing operating system though make native system become needs, but, but can play the effect of adding fuel to the flames to popularizing of the utility model intelligence system.And, to the seizing of operating system right of priority, also ensured that its operating effect will be tantamount to the operating effect of intelligence system among aforementioned two embodiment by it, for the user, still have identical intelligent degree.

By aforementioned some embodiment, also can further amplify out a relevant embodiment, be a kind of fully independently input system that the utility model proposes, its reach equally machine expansion human thinking express and execution effect, but for aforementioned each embodiment, obviously have and more press close to traditional Input Software so that on the basis of existing Input Software, further develop to the technique effect of intelligence system of the present utility model.

Input system of the present utility model is consulted Fig. 3, comprise input media 1 ', words and phrases unit 14 ', storage unit 2 ', retrieval unit 412 ', output unit 3 ' and performance element 434 '.

Described input media 1 ', promptly adopt the input media under the input block 1 among aforementioned each embodiment, offer the user and carry out words input (as key input " 74744 ") and function selecting, in fact, the process that the user carries out words input is equivalent to the process of initial input among aforementioned each embodiment, and the process of function selecting is equivalent to and confirms the process imported among aforementioned each embodiment.

Described words and phrases unit 14 ', the existing formation that belongs to traditional input method, be input as example with the key formula, " natural code ", " five ", " phonetic " or the like input rule is arranged, this unit 14 ' be responsible for utilizing these rules that speech organized in real time in the words of user's input.

Described storage unit 2 ', use the storage unit 2 among aforementioned each embodiment, be for the ease of using the database of same content.

Described retrieval unit 412 ', with words and phrases unit 14 ' synchronously, in fact after each word-building action of words and phrases unit 14 ' carry out in real time, its follow mutually to the speech of words and phrases unit 14 ' made, the image function item that retrieval is associated with these phrases in the database that aforementioned each embodiment adopted in real time.Be the part of functions formation of processing unit 4 among aforementioned some embodiment, be specially organic set of ISN modular converter 41 and information translation module 42.

The described output unit of stating 3 ', adopt the output unit 3 among aforementioned each embodiment, the phrase set output that to organize according to traditional input rule shows for the further word selection of user so that its input precision on the one hand, on the other hand, also show synchronously the relevant image function item of described retrieval unit 412 ' retrieved, mind over machine is represented to the user further to carry out function selecting for the user.

Described performance element 434 ', be equivalent to the integrated of execution module 44 and parsing module 43 in the previous embodiment, the partial function that belongs to processing unit 4 in the previous embodiment constitutes, and it carries out this selecteed image function item after the user selects corresponding image function item.

Owing in preceding some embodiment, introduced key concept of the present utility model and relative theory,, can understand the former purport of this simple description of present embodiment fully so believe those skilled in the art after reading over previous embodiment.

So in like manner, this input system can be connected with remote server to realize the renewal of described database by a remote unit, also can further performance element be refined as functional module, instruction module, mixed-media network modules mixed-media, text module, file module and communication module etc., with the different of aforementioned each embodiment be, parsing module 43 among aforementioned each embodiment be integrated in equally performance element 434 ', so performance element 434 ' after self need being responsible for the reflection function items resolved, assist to carry out by further calling certain corresponding functional modules again.In a word, based on the elaboration of aforementioned each embodiment, those skilled in the art should understand, and the performance element of present embodiment must comprise the function of the alleged parsing module 43 of aforementioned each embodiment.

In like manner, the utility model can further deduce another embodiment, in this embodiment, input system no longer is considered independently system, but considered its portability, promptly, set up function and the former identical implantation unit and management and control unit with reference to aforementioned mode with portable man-machine interactive system.

Intension of the present utility model has been enriched in the proposition of the various embodiments described above, and those skilled in the art are by drawing as drawing a conclusion:

Intelligence system provided by the utility model, man-machine interactive system or be input system, all can be had and public communication network between to set up the communication facilities institute of communication interface integrated, these communication facilitiess are including, but not limited to mobile phone, PDA, Palm, desk-top computer, notebook, net book, MP4, electric paper book, game machine and other interactive terminal etc.

Embodiment of the present utility model naturally can't be exhaustive, but the various embodiments described above but have comparatively typical representative, and have stronger general character, mainly show on its man-machine interaction method, further specify the versatility of this man-machine interaction method below with reference to a concrete application.

A kind of man-machine interaction method of the present utility model for the human-computer interaction device provides operating platform, extends the directly execution of expression back to make us the class mental representation on machine.Be example now with a smart mobile phone, it uses windows CE operating system, and use display screen as its output unit 3, use nine palace lattice hard manuals as its input block (device) 1, and use internal memory to use and use CPU to use as processing unit 4 as storage unit 2, on this machine, prepackage has this method utilized to realize, reality also is the software systems of aforementioned each embodiment of deduction, with management input block 1, output unit 3, storage unit 2 and processing unit 4 wherein.

These software systems with " CAB " file layout packaged after, moved in this mobile phone by the user, promptly finished the installation of whole software voluntarily, and changed turning to of operating system nucleus, made this software obtain resident system internal memory and the preferential ability that obtains user's input information.

See also Fig. 4, after the installation of finishing this software, the user gets final product normal running this method, and it comprises the steps:

1) under the default situations, these software systems receive the user in real time and import by the button (representing some words) that hard manual carried out, at this moment, if the user imports first button " 9 ", it has represented expressing the meaning of user, be raw information, although this raw information is also imperfect, but according to the phonetic input rule, because this key comprised " WXYZ " four characters, so the time can carry out word-building in real time, may with " I ", " letter ", " wanting ", " " the form appearance and export screen display to, meanwhile, promptly trigger next step;

2) import in response to each button of user, in being same as the database of the various embodiments described above, with above-mentioned constructed phrase " I ", " letter ", " wanting ", " " etc. be key word, the second associated related information of retrieval in this database, this retrieval follows the word-building step of user's input and input rule because of it, so carry out in real time, at this moment, establish and retrieve following image function item:

1, airborne function: my data

2, airborne function: photos and sending messages

3, call: 9

4, telereference: I

Do not confirm input if the user makes a choice to above-mentioned image function item to finish, then the user will continue the input button, get back to step 1) thus.By that analogy, after the user pushes button " 94694 " (wherein key " 4 " contains letter " GHI ", may occur following phrase in step 1): " information ", " silver ", " wages " three phrases, at this moment, in step 2) real-time response in, may find following image function item:

1, newly-built short message or multimedia message (relevant with " information ", as to point to airborne function)

2, operation short message program (relevant with " information ", as to point to airborne function)

3, call to the so-and-so, number is 94694 (with digital correlation, call address list and get)

4, go up talent's net money (relevant) of raising salary of looking for a job with " wages "

5, visit certain bank or pawning house website (relevant) with " silver "

And after the user chooses wherein " information " speech, distinct user's hint expression, as the part of the operation of observing input rule but not for the affirmation of related information, at this moment, step 2) retrieves at " information " in real time once more, the tabulation of its image function item may be left 1,2,3, and user's hint expression extends on machine preferably, with this can wait for the user to the reflection function items give up really into;

3) the user import in or afterwards, this method is all exported in different viewing areas respectively with the form of tabulating such as word-building result and relevant image function item thereof its input and its are formed, this is one of steps necessary of complete man-machine interaction.Certainly, as a kind of ancillary method, can also be corresponding to each effective input of user, call the voice playing program and play this and effectively import contained character or the pairing audio file of the meaning of word to inform the user, because of its implementation is known by those of ordinary skills, so do not give unnecessary details;

4) after the user has selected corresponding image function item, for example, if the user has selected image function item " 1, operation short message program ", then this method is further resolved this image function item and is carried out it, and its Analytic principle and manner of execution thereof see also the explanation of aforementioned each embodiment.Corresponding to aforementioned classification to the reflection function items, this step is done following processing targetedly and with priority mechanism:

When image function item that related information comprised is local executable program or its link, directly move its target program;

When image function item that related information comprised during for default instruction set, directly moving this instruction set carries out macro operation;

When image function item that related information comprised is remote information, with this image function item as the parameter access telecommunication network;

When image function item that related information comprised was text message, the program of text information was read in operation;

As image function Xiang Weiyi that related information comprised during, move this associated program visit this document by the file of program association type or its link;

When image function item that related information comprised during, transmit this parameter and move it to this third party's program for the parameter of third party's program.

In like manner, the utility model also should have the step of upgrading its database from remote server, but is limited by user's selection as this step 1.A comparatively practical step is, be software systems configuration one statistics module, in aforementioned processing unit 4, carry out, by it regularly or in real time user input content and word frequency thereof are added up, with certain default analysis rule related information (second information) or raw information (first information) that it is decomposed in the database are upgraded same raw information, perhaps adjust the sequencing of the pairing a plurality of related informations of certain ISN sequence, perhaps increase, delete mapping relations etc. newly.Just make this method have the function of self study thus, its intelligent degree further improves naturally.

In like manner, consider the compatibility of different language system, as the simplified and traditional conversion of Chinese character, can consider in the step 1) of user's input, carry out the conversion of ISN sequence for each user's input, capable again execution in step 2) so that fundamentally solve the problem of output interface font.

In sum, man-machine interactive system that the utility model proposes and related system thereof and method, man-machine interaction mode is thoroughly changed, the human thinking is expressed on machine well and extend and carry out, operating system and Input Software have been merged, and reserved the interface and the agreement of the development of technology deep layer, for the broad sense input method field, had epoch making significance.

Above disclosed only is preferred embodiment of the present utility model, can not limit the interest field of the utility model certainly with this, and therefore the equivalent variations of being done according to the utility model claim still belongs to the scope that the utility model is contained.

Claims (5)

1. intelligence system is characterized in that it comprises:

Input block, offer initial input that the user carries out raw information and the related information relevant with this raw information give up really into;

Storage unit is used to store and will have characterized the first information of user's input information and characterize the database of setting up mapping relations between second information of image function item;

Processing unit as the first information, utilizes described mapping relations to retrieve the related information of second information associated therewith as this raw information in the database of storage unit described raw information;

Output unit, export this related information in case with user interactions to carry out described affirmation input;

Input block, output unit, storage unit electrically connect with processing unit respectively.

2. intelligence system according to claim 1 is characterized in that described input block has input media, this device in the microphone, keyboard, brain wave translater, iris recognition device, touch-screen any one.

3. intelligence system according to claim 1 is characterized in that native system also comprises remote unit, is connected with remote server to realize the renewal of described database.

4. communication facilities, have with public communication network between set up the interface of communicating by letter, it is characterized in that it has adopted as any described intelligence system in the claim 1 to 3.

5. communication facilities according to claim 4 is characterized in that, described communication facilities be in mobile phone, PDA, Palm, desk-top computer, notebook, net book, MP4, electric paper book, the game machine any one.

Images