CN103235643A - Man-machine interactive device adopting voice control type - Google Patents

Man-machine interactive device adopting voice control type Download PDF

Info

Publication number
CN103235643A
CN103235643A CN2013101199893A CN201310119989A CN103235643A CN 103235643 A CN103235643 A CN 103235643A CN 2013101199893 A CN2013101199893 A CN 2013101199893A CN 201310119989 A CN201310119989 A CN 201310119989A CN 103235643 A CN103235643 A CN 103235643A
Authority
CN
China
Prior art keywords
block
interface
module
chunk
auxilliary
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN2013101199893A
Other languages
Chinese (zh)
Inventor
郗登振
王淑荣
纪燕杰
王伟
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
QINGDAO YINGTIANXIA INTELLIGENT TECHNOLOGY Co Ltd
Original Assignee
QINGDAO YINGTIANXIA INTELLIGENT TECHNOLOGY Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by QINGDAO YINGTIANXIA INTELLIGENT TECHNOLOGY Co Ltd filed Critical QINGDAO YINGTIANXIA INTELLIGENT TECHNOLOGY Co Ltd
Priority to CN2013101199893A priority Critical patent/CN103235643A/en
Publication of CN103235643A publication Critical patent/CN103235643A/en
Pending legal-status Critical Current

Links

Images

Abstract

The invention discloses a man-machine interactive device adopting a voice control type. The man-machine interactive device is provided with a display module and a voice control recognition module, wherein the display module is used for presenting an interface; the interface comprises a main display block for displaying a first bearing module, and an auxiliary display block used for displaying a second bearing module; the auxiliary display block is positioned on the periphery of the main display block; the first bearing module and the second bearing module are connected with each other; and the voice control recognition module records voice and recognizes the recorded voice to obtain a corresponding operation command to update the interface in the display module. The man-machine interactive device is easy to know, learn and use, can be applied to different system software in a cross-platform manner, is not restrained by the software platform, has stronger product portability, and normalized layout and content, enables users' experience to have consistency, and achieve a flexible and controllable interactive effect.

Description

Adopt the human-computer interaction device of acoustic control formula
Technical field
The present invention relates to human-computer interaction device's technical field, be specifically related to a kind of human-computer interaction device who adopts the acoustic control formula.
Background technology
Man-machine interaction HCI(Human-Computer Interaction) refers between people and the computing machine to use certain conversational language, with certain interactive mode, for finishing the people that sets the tasks and the information exchanging process between the computing machine.The main effect of man-machine interaction is to control the operation of relevant devices with understanding and carry out relevant various command and the requirement of transmitting by the human-computer interaction device.Human-computer interaction function is a key factor that determines computer system " friendliness ".But the man-machine interaction method for designing of conventional art still rests on basic accessory such as mouse, keyboard, and the mode of operation complexity is in disorder, lacks standardization and logicality, has destroyed user's experience.Along with pattern-recognition, development as input equipments such as speech recognition, Chinese Character Recognition, operator and computing machine are being similar to natural language or this one-level of restricted natural language becomes possibility alternately, and intelligentized man-machine interaction method is also demanded urgently progressive and development.
Summary of the invention
The object of the present invention is to provide a kind of human-computer interaction device who adopts the acoustic control formula, by the mode of operation of acoustic control, liberated both hands, satisfy more convenient user's request accurately, improved user's experience.
The present invention to achieve these goals, the technical solution of employing is:
Adopt the human-computer interaction device of acoustic control formula, have display module and acoustic control identification module;
Described display module is used for presenting the interface, and the content at interface comprises:
The main block that shows is in order to show the first carrying chunk;
The auxilliary block that shows is in order to show the second carrying chunk;
Described auxilliary demonstration block is positioned at the described main periphery that shows block, and the first carrying chunk is associated with the second carrying chunk;
Described acoustic control identification module by voice input module, command process module, and the instruction memory module form;
Described voice input module is recorded user's voice, is passed to command process module with recording the voice messaging of finishing; Described instruction memory module is deposited phonetic order collection, and phonetic order collection and characterize mapping relations storehouse between the operation information of command function; Phonetic order collection in the described command process module call instruction memory module is identified voice messaging, is converted into the sign instruction that can directly carry out, the interface in the update displayed module.
Preferably, the described first carrying chunk is arranged rectangular array; The auxilliary block that shows is positioned at upside, downside, left side, the right side of main demonstration block or is suspended in the top.When a plurality of suspended state block was arranged, the form that adopts level to go forward one by one showed that the suspended state block of i.e. up-to-date ejection always is positioned at highlighting foremost of interface, and the interface block of other levels shows by the level transparency is set.
Preferably, described interface comprises initial interface and a plurality of processes interface, and initial interface is identical with the appearance form at process interface, and the main block that shows has nine first carrying chunks, arranges to be palace lattice shape; If the main block that shows surpasses nine first carrying chunks, the first carrying chunk Pagination Display.Described initial interface has the pattern that presents of 2D or 3D or 2D and 3D combination.
Preferably, be positioned at the main auxilliary demonstration block that shows block left side or right side, described auxilliary demonstration block has nine second carrying chunks, is arranged in order from top to bottom; If the auxilliary block that shows has when surpassing nine second carrying chunks, need the tenth and the second above carrying chunk Pagination Display.
Preferably, be positioned at the main auxilliary demonstration block that shows block upside or downside, described auxilliary demonstration block has nine second carrying chunks, is arranged in order by left-to-right; If the auxilliary block that shows has when surpassing nine second carrying chunks, need the tenth and the second above carrying chunk Pagination Display.
Beneficial effect of the present invention:
The human-computer interaction device that this kind adopts the acoustic control formula can cross-platformly use in different system softwares, and the exchange method of customer-centric is not subjected to the constraint of software platform, has stronger product transplantability.By definition of user's interface, broken through the limitation that traditional acoustic control can only be carried out a spot of interface operation alternately.Because the chunk layout is adopted at the interface, the operation of whole interface can use phonetic order to finish, have easily know, easily learn, easy-to-use characteristic.Each predefined phonetic order is the operation information of chunk in the corresponding interface all, when needs are operated some interfaces chunk, only need send this chunk corresponding voice, system just can judge to have triggered which chunk by the instruction that receives, thereby obtains the event response of corresponding operating information.This kind exchange method is conducive to improve interface operation information to the matching degree of phonetic order collection, and has significantly reduced the complexity of phonetic order collection definition.The present invention can reach accurate, smooth mutual effect by default refining, succinct instruction set, and normalized layout and content can make mode of operation hommization more, thereby the user who promotes product significantly experiences, and realizes the mutual effect of flexible and controllable.
Description of drawings
Fig. 1 is human-computer interaction device's 2D interface synoptic diagram.
Fig. 2 is human-computer interaction device's 2D+3D interface synoptic diagram.
Fig. 3 is human-computer interaction device's 3D interface synoptic diagram.
Fig. 4 is a kind of interactive mode and mapping relations figure.
Fig. 5 is a kind of interactive mode and mapping relations figure.
Fig. 6 is a kind of interactive mode and mapping relations figure.
Fig. 7 is a kind of interactive mode and mapping relations figure.
Fig. 8 is a kind of interactive mode and mapping relations figure.
Fig. 9 is a kind of interactive mode and mapping relations figure.
Figure 10 is interactive voice module principle synoptic diagram.
Figure 11 is the interactive voice operational flowchart.
Embodiment
In conjunction with Fig. 1 to Fig. 3, and Figure 10, the present invention is described in detail:
Adopt the human-computer interaction device of acoustic control formula, have display module and acoustic control identification module;
Described display module is used for presenting the interface, and the content at interface comprises:
The main block E district that shows is in order to show the first carrying chunk;
Assist demonstration block A district, B district, C district, reach the D district, in order to show the second carrying chunk;
Described auxilliary demonstration block is positioned at the described main periphery that shows block, and the first carrying chunk is associated with the second carrying chunk;
Described acoustic control identification module is made up of voice input module, instruction memory module and command process module.
Described voice input module is used for the initial information that provides the user to import by user's voice is recorded.
Described instruction memory module is used for definition phonetic order collection, and the mapping relations storehouse between the operation information of storaged voice instruction set and sign command function, and mapping relations exist with the form of the corresponding key value of key word.The phonetic order collection exists as key word in the described mapping relations storehouse, is used for the voice messaging of match user input, and can is undertaken freely defining by the user's voice information acquisition; The operation information that characterizes command function exists as key value, being mapped as one to one or many-to-one relation of key word and key value.
Described command process module is used for the initial speech information that the user records is identified the operational order that the system of being converted into can directly carry out, and the interface in the update displayed module.
The described first carrying chunk is arranged rectangular array; The auxilliary block that shows is positioned at upside, downside, left side, the right side of main demonstration block or is suspended in the top.When a plurality of suspended state block was arranged, the form that adopts level to go forward one by one showed that the suspended state block of i.e. up-to-date ejection always is positioned at highlighting foremost of interface, and the interface block of other levels shows by the level transparency is set.
Described interface comprises initial interface and a plurality of processes interface, and initial interface is identical with the appearance form at process interface, and the main block that shows has nine first carrying chunks, arranges to be palace lattice shape; If the main block that shows surpasses nine first carrying chunks, the first carrying chunk Pagination Display.Described initial interface has the pattern that presents of 2D or 3D or 2D and 3D combination.
Be positioned at the main auxilliary demonstration block that shows block left side or right side, described auxilliary demonstration block has nine second carrying chunks, is arranged in order from top to bottom; If the auxilliary block that shows has when surpassing nine second carrying chunks, need the tenth and the second above carrying chunk Pagination Display.
Be positioned at the main auxilliary demonstration block that shows block upside or downside, described auxilliary demonstration block has nine second carrying chunks, is arranged in order by left-to-right; If the auxilliary block that shows has when surpassing nine second carrying chunks, need the tenth and the second above carrying chunk Pagination Display.
Below in conjunction with accompanying drawing the present invention is specifically described:
Functional according to operation and control interface divided the phonetic order collection, and following a few class is arranged:
(1) macro-instruction collection
Macro-instruction is to control instruction at the macroscopic view of total system, and priority is the highest, and namely when the instruction that receives was macroscopical function command, the current active window was ignored by system, preferentially carried out the order of its correspondence.According to the functional definition of chunk, that the macro-instruction collection comprises is full frame, global sound such as withdraw from, retreat controls instruction.
(2) chunk instruction set
It is corresponding one by one that chunk instruction and the chunk in the block are operated response events, comprises numeral and be nine sound instructions of 1~9.When interfaces windows presented certain corresponding block, the chunk instruction drove corresponding chunk function by event response.According to the interface layout of chunk, the chunk of chunk instruction set correspondence is the single chunk of block Middle Palace lattice or list placement.
(3) function command collection
Common function instruction comprises phonetic functions instructions such as the page turning of full interface and the page turning of block content, and this instruction set is not subjected to the constraint of block, defines corresponding instruction in conjunction with the operation of interface and block content entirely.For example, page-turning instruction when full interface is defined as: " page up " correspondence " is switched a last interface ", when " following one page " correspondence " is switched next interface ", the page-turning function instruction of block content then needs to redefine to be distinguished, for example block content page-turning instruction is defined as: " prevpage " correspondence " is switched a last block content ", and " the next page " correspondence " is switched next block content ".Opposite, if the mobile attribute definition to whole interface is: " prevpage " correspondence " is switched a last interface ", when " the next page " correspondence " is switched next interface ", the content page turn over operation of block then should be defined as: " page up " correspondence " is switched a last block content ", and " following one page " correspondence " is switched next block content ".According to the interface layout of chunk, the chunk of chunk instruction set correspondence is the single chunk of block Middle Palace lattice or list placement.
The phonetic order of chunk is not limited to above-mentioned several, supports the user to carry out the self study definition of phonetic order according to demand.Because the phonetic order at chunk interface is corresponding one by one with the operational order response events of interface object, therefore for the phonetic order of self study, only need by the self-defining voice of typing, and dispose the mapping relations of this phonetic order and interface chunk operational order, then when triggering phonetic order, namely can respond the interface chunk function of this voice correspondence.
The mapping relations of configured voice instruction and chunk operational order
There are main block and auxilliary two kinds of block types of block that show of showing in the chunk interface, the combination of block has various modes, wherein the master shows that block E district is the block of constant existence in the chunk, all the time present, auxilliary show block A district, B district, C district, reach the D district and then have hiding as required and the demonstration two states.Which kind of state no matter the chunk interface be in, main and auxiliary demonstration block district is layout how, in the mapping relations storehouse, the mapping relations of the voice macro-instruction of chunk and macrotechnique instruction are mapping one to one, namely represent the corresponding information key value jvalue of each information key word jkey, when triggering this voice macro-instruction, instruction corresponding is activated, and carries out corresponding function.For example, when acoustic control triggers " full frame " instruction, the operating result that the system responses current page is full frame.
The chunk interface is triggered and is carried out by the corresponding event that phonetic order is converted into the chunk operational order the response of phonetic order.Because the fundamental element in the zone is chunk, exist with the form of assembly, according to the occupy-place situation of chunk, the different phonetic instruction also has certain difference with the mapping relations of operational order, and is specific as follows:
The main block E district that shows
The chunk of main demonstration block is the general palace lattice form with triplex row three row, and following several form that represents is arranged:
(1) full lattice
As shown in Figure 4, in the mapping relations storehouse of full lattice layout, the phonetic order of chunk and the mapping relations of operational order are mapping one to one, namely represent the corresponding information key value jvalue of each information key word jkey, when triggering this phonetic order, instruction corresponding is activated, and carries out corresponding function.
(2) group lattice
As shown in Figure 5, in the group lattice layout, the phonetic order of chunk and the mapping relations of operational order are for one to one or many-one mapping, the multiple form that represents can be arranged, when chunk accounts for a cell position, be mapping one to one, represent the corresponding information key value jvalue of each information key word jkey; When chunk accounts for a plurality of cell position, be the many-one mapping; Represent the corresponding information key value jvalue of a plurality of information key word jkey, when triggering this phonetic order, instruction corresponding is activated, and carries out corresponding function.
(3) vacancy lattice
As shown in Figure 6, in the vacancy lattice layout, the phonetic order of chunk and the mapping relations of operational order are mapping one to one, but because the lattice of having vacant position, information key word jkey then can occur does not have the situation of corresponding information key value, and expression does not respond any operation when triggering this phonetic order.
(4) group lattice and the simultaneous form of vacancy lattice
As shown in Figure 7, the combination form of group lattice and vacancy lattice, the phonetic order of chunk and the mapping relations of operational order can for one to one, the mapping of many-one or a pair of sky, namely there is the corresponding information key value jvalue of an information key word jkey, or the situation of the corresponding information key value jvalue of a plurality of information key word jkey, when triggering this phonetic order, corresponding chunk operational order is activated, and carries out corresponding function; And exist information key word jkey not have the situation of corresponding information key value, do not respond any operation when triggering this phonetic order.
The auxilliary block that shows---A district, B district, C district, reach the D district
There is auxilliary block A district and the C district of showing, chunk presents the form of vertical lattice, function lattice in its district, the auxilliary chunk in block B district and D district that shows presents forms lined, the function lattice, and the phonetic order of chunk and the mapping relations of operational order have following several according to the combination form of chunk.
(1) in the full lattice layout, as shown in Figure 8, the mapping relations of phonetic order and chunk operational order are mapping one to one, represent vertical lattice or lined phonetic order with the key assignments of jkey1~jkey9, the phonetic order of jkey10~jkeyn presentation function lattice, the operational order of the corresponding chunk of each phonetic order is when selecting a certain phonetic order, corresponding chunk operational order is activated, and carries out corresponding function.
(2) in the group lattice layout, as shown in Figure 9, the mapping relations of phonetic order and chunk operational order are for one to one or many-one mapping, represent general vertical lattice or general lined operation information with the key assignments of jkey1~jkey9, the phonetic order of jkey10~jkeyn presentation function lattice, wherein man-to-man mapping relations represent that a phonetic order triggers its corresponding chunk operational order, many-to-one mapping relations represent that a plurality of phonetic orders trigger the operational order of same chunk, namely be elected to when selecting the many-one instruction, have and have only the operational order of a chunk to be activated.
Interactive operation flow process of the present invention specifically may further comprise the steps as shown in figure 11:
1) display module carries out the presenting of graphical interaction content of initial interface;
2) user begins the typing phonetic order by voice input module;
3) by the phonetic order identification module, whether decision instruction meets default phonetic order collection, namely whether meets the keyword message in the mapping relations storehouse, meets then to continue to carry out, and does not meet then display reminding information.
4) by the key value of this keyword message correspondence in the mapping relations storehouse, trigger this phonetic order instruction corresponding and carry out corresponding function.
5) update displayed module, the interface as a result of display operation correspondence.
Certainly, above-mentioned explanation is not to be limitation of the present invention, and the present invention also is not limited in above-mentioned giving an example, and the variation that those skilled in the art make in essential scope of the present invention, remodeling, interpolation or replacement also should belong to protection scope of the present invention.

Claims (5)

1. adopt the human-computer interaction device of acoustic control formula, it is characterized in that having display module and acoustic control identification module;
Described display module is used for presenting the interface, and the content at interface comprises:
The main block that shows is in order to show the first carrying chunk;
The auxilliary block that shows is in order to show the second carrying chunk;
Described auxilliary demonstration block is positioned at the described main periphery that shows block, and the first carrying chunk is associated with the second carrying chunk;
Described acoustic control identification module by voice input module, command process module, and the instruction memory module form;
Described voice input module is recorded user's voice, is passed to command process module with recording the voice messaging of finishing; Described instruction memory module is deposited phonetic order collection, and phonetic order collection and characterize mapping relations storehouse between the operation information of command function; Phonetic order collection in the described command process module call instruction memory module is identified voice messaging, is converted into the sign instruction that can directly carry out, the interface in the update displayed module.
2. the human-computer interaction device of employing acoustic control formula according to claim 1 is characterized in that, the described first carrying chunk is arranged rectangular array; The auxilliary block that shows is positioned at upside, downside, left side, the right side of main demonstration block or is suspended in the top.
3. the human-computer interaction device of employing acoustic control formula according to claim 1, it is characterized in that, described interface comprises initial interface and a plurality of processes interface, initial interface is identical with the appearance form at process interface, the main block that shows has nine first carrying chunks, arrangement is palace lattice shape, and described initial interface has the pattern that presents of 2D or 3D or 2D and 3D combination.
4. the human-computer interaction device of employing acoustic control formula according to claim 3 is characterized in that, is positioned at the main auxilliary demonstration block that shows block left side or right side, and described auxilliary demonstration block has nine second carrying chunks, is arranged in order from top to bottom.
5. the human-computer interaction device of employing acoustic control formula according to claim 3 is characterized in that, is positioned at the main auxilliary demonstration block that shows block upside or downside, and described auxilliary demonstration block has nine second carrying chunks, is arranged in order by left-to-right.
CN2013101199893A 2013-04-09 2013-04-09 Man-machine interactive device adopting voice control type Pending CN103235643A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN2013101199893A CN103235643A (en) 2013-04-09 2013-04-09 Man-machine interactive device adopting voice control type

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN2013101199893A CN103235643A (en) 2013-04-09 2013-04-09 Man-machine interactive device adopting voice control type

Publications (1)

Publication Number Publication Date
CN103235643A true CN103235643A (en) 2013-08-07

Family

ID=48883689

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2013101199893A Pending CN103235643A (en) 2013-04-09 2013-04-09 Man-machine interactive device adopting voice control type

Country Status (1)

Country Link
CN (1) CN103235643A (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103533415A (en) * 2013-10-12 2014-01-22 青岛旲天下智能科技有限公司 Internet television system based on sound control man-machine interaction technology and implementation method thereof
CN105069119A (en) * 2015-08-12 2015-11-18 北京触控科技有限公司 Cross-platform synchronization method and system
CN105260080A (en) * 2015-09-22 2016-01-20 广东欧珀移动通信有限公司 Method and device for realizing voice control operation on display screen of mobile terminal
CN106251863A (en) * 2016-07-26 2016-12-21 傲爱软件科技(上海)有限公司 A kind of instruction type speech control system based on smart machine and control method
CN108509175A (en) * 2018-03-30 2018-09-07 联想(北京)有限公司 A kind of voice interactive method and electronic equipment

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1537267A (en) * 2001-03-22 2004-10-13 ������������ʽ���� Information processing appartus, method and program
CN1784647A (en) * 2003-05-08 2006-06-07 希尔克瑞斯特实验室公司 Control framework with a zoomable graphical user interface for organizing,selecting and launching media items
CN1936798A (en) * 2005-09-21 2007-03-28 鸿富锦精密工业(深圳)有限公司 Multi-gradation manu displaying device and display control method
CN101855521A (en) * 2007-11-12 2010-10-06 大众汽车有限公司 Multimode user interface of a driver assistance system for inputting and presentation of information
CN101911146A (en) * 2008-01-14 2010-12-08 佳明有限公司 Dynamic user interface for automated speech recognition
CN102197398A (en) * 2008-06-25 2011-09-21 斯坦卡特·恩佐 Multifunction apparatus for telecommunications

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1537267A (en) * 2001-03-22 2004-10-13 ������������ʽ���� Information processing appartus, method and program
CN1784647A (en) * 2003-05-08 2006-06-07 希尔克瑞斯特实验室公司 Control framework with a zoomable graphical user interface for organizing,selecting and launching media items
CN1936798A (en) * 2005-09-21 2007-03-28 鸿富锦精密工业(深圳)有限公司 Multi-gradation manu displaying device and display control method
CN101855521A (en) * 2007-11-12 2010-10-06 大众汽车有限公司 Multimode user interface of a driver assistance system for inputting and presentation of information
CN101911146A (en) * 2008-01-14 2010-12-08 佳明有限公司 Dynamic user interface for automated speech recognition
CN102197398A (en) * 2008-06-25 2011-09-21 斯坦卡特·恩佐 Multifunction apparatus for telecommunications

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103533415A (en) * 2013-10-12 2014-01-22 青岛旲天下智能科技有限公司 Internet television system based on sound control man-machine interaction technology and implementation method thereof
CN103533415B (en) * 2013-10-12 2016-09-14 青岛旲天下智能科技有限公司 Internet television system based on sound control man-machine interaction technology and its implementation
CN105069119A (en) * 2015-08-12 2015-11-18 北京触控科技有限公司 Cross-platform synchronization method and system
CN105069119B (en) * 2015-08-12 2020-06-05 上海触控科技发展有限公司 Cross-platform synchronization method and system
CN105260080A (en) * 2015-09-22 2016-01-20 广东欧珀移动通信有限公司 Method and device for realizing voice control operation on display screen of mobile terminal
CN106251863A (en) * 2016-07-26 2016-12-21 傲爱软件科技(上海)有限公司 A kind of instruction type speech control system based on smart machine and control method
CN108509175A (en) * 2018-03-30 2018-09-07 联想(北京)有限公司 A kind of voice interactive method and electronic equipment

Similar Documents

Publication Publication Date Title
JP5882492B2 (en) Providing keyboard shortcuts mapped to the keyboard
CN104007832B (en) Continuous method, system and the equipment for sliding input text
US20180188885A1 (en) Electronic device operating according to pressure state of touch input and method thereof
US9836192B2 (en) Identifying and displaying overlay markers for voice command user interface
Phiriyapokanon Is a big button interfaceenough for elderly users?: Towards user interface guidelines for elderly users
JP2012504290A5 (en)
US8381119B2 (en) Input device for pictographic languages
CN103235643A (en) Man-machine interactive device adopting voice control type
Chao Human-computer interaction: process and principles of human-computer interface design
US9052819B2 (en) Intelligent gesture-based user's instantaneous interaction and task requirements recognition system and method
US20110171617A1 (en) System and method for teaching pictographic languages
JP5228633B2 (en) Electronic dictionary apparatus and program
JP2015520900A5 (en)
US11755198B2 (en) Method, system and computer program product for operating a keyboard
US20130067306A1 (en) Formula entry for limited display devices
US20150123907A1 (en) Information processing device, display form control method, and non-transitory computer readable medium
US20160124633A1 (en) Electronic apparatus and interaction method for the same
CN107045414A (en) The method and terminal of terminal of the control with touch screen
KR101085702B1 (en) Method and medium for inputting Korean characters for touch screen
Arroba et al. A methodology for developing accessible mobile platforms over leading devices for visually impaired people
CN103164027A (en) Human-computer interaction device adopting gestures
EP2911150A1 (en) Methods and systems for integration of speech into systems
CN102681767A (en) Terminal having touch screen and character input method according to touch event therein
CN102479046B (en) Touch device and operation method thereof
CN103197840A (en) Touch control man-machine interaction device

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C02 Deemed withdrawal of patent application after publication (patent law 2001)
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20130807