CN109992177A - User interaction approach, system, electronic equipment and the computer media of electronic equipment - Google Patents
User interaction approach, system, electronic equipment and the computer media of electronic equipment Download PDFInfo
- Publication number
- CN109992177A CN109992177A CN201711498692.7A CN201711498692A CN109992177A CN 109992177 A CN109992177 A CN 109992177A CN 201711498692 A CN201711498692 A CN 201711498692A CN 109992177 A CN109992177 A CN 109992177A
- Authority
- CN
- China
- Prior art keywords
- information
- electronic equipment
- user
- describing
- user interface
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/04817—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance using icons
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/16—Sound input; Sound output
- G06F3/167—Audio in a user interface, e.g. using voice commands for navigating, audio feedback
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- General Health & Medical Sciences (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
Present disclose provides the user interaction approach of a kind of electronic equipment, comprising: the element shown in the user interface of the electronic equipment is determined according to user's operation；Information relevant to the element is obtained, the information relevant to the element includes following any one or more: the location information of the description information of the element, the functional information of the element, the content information of the element or the element in the user interface；And the first voice messaging for describing the element is generated according to the information relevant to the element of acquisition.
Description
Technical field
This disclosure relates to Internet technical field, more particularly, to a kind of electronic equipment user interaction approach, be
System, electronic equipment and computer media.
Background technique
Universal for twenty-twenty user, the abbreviation operating procedure significantly of touch screen mode, improve mobile phone,
The usage experience of the electronic equipments such as tablet computer, laptop.But for blind person and the user for having vision disorder, a large amount of
After cancelling physical entity key, then allows them to can not find location sense and touch sense, light is the touch screen of one piece of not no concave-convex sense
Actually using instead to them makes troubles.In response to this, the solution of the prior art is using a kind of based on gesture
Screen reader (VoiceOver in iPhone) to user electronic equipment touch screen show user interface on
Operation carries out voice prompting, for example, when user clicks picture or application program on a user interface, screen reader response
User's operation, and the element clicked to user plays out: " picture " or " wechat " is to prompt user.
During realizing present inventive concept, at least there are the following problems in the prior art for inventor's discovery: responding
User's operation when playing out to the element of user interface presentation, can only play the title of the element without other information, cause
The information about its element clicked for obtaining user is very limited.
Summary of the invention
In view of this, present disclose provides the user interaction approach of a kind electronic equipment, system, electronic equipment and calculating
Machine medium.
An aspect of this disclosure provides the user interaction approach of a kind of electronic equipment, comprising: true according to user's operation
The element shown in the user interface of the fixed electronic equipment；Obtain information relevant to the element, the described and element
Relevant information includes following any one or more: the description information of the element, the functional information of the element, the member
Location information of the content information or the element of element in the user interface；And according to the related to the element of acquisition
Information generate the first voice messaging for describing the element.
In accordance with an embodiment of the present disclosure, it is generated according to the information relevant to the element of acquisition for describing the element
The first voice messaging include: that description information based on the element and/or functional information generate the first information, first letter
Breath includes the title of the element and/or the result to the element operation；And it is generated according to the first information for retouching
State the first voice messaging of the element.
In accordance with an embodiment of the present disclosure, the information relevant to the element further includes the appearance information of the element；
And the first voice messaging according to the generation of the information relevant to the element of acquisition for describing the element includes: basis
The appearance information of the element and/or the element are generated in the location information of the user interface for describing the element
First voice messaging.
In accordance with an embodiment of the present disclosure, the appearance information of the element includes the shape and/or size of the element；And
The first voice messaging generated according to the information relevant to the element of acquisition for describing the element includes: according to
The shape and/or size of element, the title of the element, to the result of the element operation, the content information of the element and
The element generates the first voice messaging for describing the element in the location information of the user interface.
In accordance with an embodiment of the present disclosure, the element include it is following any one: application program, control, image file, view
Frequency file, audio file or document.
Another aspect of the disclosure provides the user interaction approach of a kind of electronic equipment, comprising: determining module is used for
According to user's operation, the element shown in the user interface of the electronic equipment is determined；Module is obtained, for obtaining and the member
The relevant information of element, the information relevant to the element includes following any one or more: the description letter of the element
Breath, the functional information of the element, the element content information or state element in the location information of the user interface；With
And generation module, for generating the first voice letter for describing the element according to the information relevant to the element of acquisition
Breath.
In accordance with an embodiment of the present disclosure, the generation module includes: the first generation module, for retouching based on the element
It states information and/or functional information and generates the first information, the first information includes the title of the element and/or to the element
The result of operation；And second generation module, for generating the first language for describing the element according to the first information
Message breath.
In accordance with an embodiment of the present disclosure, the information relevant to the element further includes the appearance information of the element；
And the generation module includes: third generation module, for the appearance information and/or the element according to the element in institute
The location information for stating user interface generates the first voice messaging for describing the element.
In accordance with an embodiment of the present disclosure, the appearance information of the element includes the shape and/or size of the element；And
The generation module includes: the 4th generation module, for according to the shape and/or size of the element, the title of the element,
Location information to the result of the element operation, the content information of the element and the element in the user interface generates
For describing the first voice messaging of the element.
In accordance with an embodiment of the present disclosure, the element include it is following any one: application program, control, image file, view
Frequency file, audio file or document.
Another aspect of the present disclosure provides a kind of electronic equipment, comprising: one or more processors；And one or more
A memory is stored with executable instruction, and described instruction is when being executed by processor, so that for realizing such as when processor executes
The upper method.
Another aspect of the present disclosure provides a kind of computer-readable medium, is stored with computer executable instructions, described
Instruction is when executed for realizing method as described above.
Another aspect of the present disclosure provides a kind of computer program, and the computer program, which includes that computer is executable, to be referred to
It enables, described instruction is when executed for realizing method as described above.
In accordance with an embodiment of the present disclosure, it can at least be partially solved and click the member of the user interface of electronic equipment in user
When plain, electronic equipment can only play the name problem of the element, and electronic equipment therefore may be implemented can play except the element
Title except information, such as other informations such as content information, location information, functional information of the element.
Detailed description of the invention
By referring to the drawings to the description of the embodiment of the present disclosure, the above-mentioned and other purposes of the disclosure, feature and
Advantage will be apparent from, in the accompanying drawings:
Fig. 1 diagrammatically illustrates user interaction approach and systematic difference field according to the electronic equipment of the embodiment of the present disclosure
Scape；
Fig. 2 diagrammatically illustrates the flow chart of the user interaction approach of the electronic equipment according to the embodiment of the present disclosure；
Fig. 3 is diagrammatically illustrated generates the first voice messaging according to the electronic equipment of the embodiment of the present disclosure according to the first information
Flow chart；
Fig. 4 diagrammatically illustrates the appearance information and/or position according to the electronic equipment of the embodiment of the present disclosure according to element
Information generates the flow chart of the first voice messaging；
Fig. 5, which is diagrammatically illustrated, generates the first language according to a plurality of information of element according to the electronic equipment of the embodiment of the present disclosure
The flow chart of message breath；
Fig. 6 A~6D diagrammatically illustrates schematic diagram when interacting according to the user of the embodiment of the present disclosure with electronic equipment；
Fig. 7 diagrammatically illustrates the block diagram of the user interactive system of the electronic equipment according to the embodiment of the present disclosure；
Fig. 8 diagrammatically illustrates the block diagram of the user interactive system of the electronic equipment according to the disclosure another embodiment；
And
Fig. 9 diagrammatically illustrates the box of the computer system for being adapted for carrying out electronic equipment according to the embodiment of the present disclosure
Figure.
Specific embodiment
Hereinafter, will be described with reference to the accompanying drawings embodiment of the disclosure.However, it should be understood that these descriptions are only exemplary
, and it is not intended to limit the scope of the present disclosure.In addition, in the following description, descriptions of well-known structures and technologies are omitted, with
Avoid unnecessarily obscuring the concept of the disclosure.
Term as used herein is not intended to limit the disclosure just for the sake of description specific embodiment.It uses herein
The terms "include", "comprise" etc. show the presence of the feature, step, operation and/or component, but it is not excluded that in the presence of
Or add other one or more features, step, operation or component.
There are all terms (including technical and scientific term) as used herein those skilled in the art to be generally understood
Meaning, unless otherwise defined.It should be noted that term used herein should be interpreted that with consistent with the context of this specification
Meaning, without that should be explained with idealization or excessively mechanical mode.
It, in general should be according to this using statement as " at least one in A, B and C etc. " is similar to
Field technical staff is generally understood the meaning of the statement to make an explanation (for example, " system at least one in A, B and C "
Should include but is not limited to individually with A, individually with B, individually with C, with A and B, with A and C, have B and C, and/or
System etc. with A, B, C).Using statement as " at least one in A, B or C etc. " is similar to, generally come
Saying be generally understood the meaning of the statement according to those skilled in the art to make an explanation (for example, " having in A, B or C at least
One system " should include but is not limited to individually with A, individually with B, individually with C, with A and B, have A and C, have
B and C, and/or the system with A, B, C etc.).It should also be understood by those skilled in the art that substantially arbitrarily indicating two or more
The adversative conjunction and/or phrase of optional project shall be construed as either in specification, claims or attached drawing
A possibility that giving including one of these projects, either one or two projects of these projects.For example, phrase " A or B " should
A possibility that being understood to include " A " or " B " or " A and B ".
Embodiment of the disclosure provides the method for user's interaction of a kind of electronic equipment, comprising: true according to user's operation
Determine the element shown in the user interface of electronic equipment；Obtain information relevant to element, packet relevant to the element
Include following any one or more: the description information of element, the functional information of element, the content information of element or element with
The location information at family interface；And the first voice for describing the element is generated according to the information relevant to element of acquisition and is believed
Breath.
Fig. 1 diagrammatically illustrates user interaction approach and systematic difference field according to the electronic equipment of the embodiment of the present disclosure
Scape 100.It should be noted that being only the example that can apply the application scenarios of the embodiment of the present disclosure shown in Fig. 1, to help ability
Field technique personnel understand the technology contents of the disclosure, but are not meant to that the embodiment of the present disclosure may not be usable for other equipment, be
System, environment or scene.
As shown in Figure 1, system architecture 100 may include terminal device 101,102,103, network according to this embodiment
104 and server 105.Network 104 between terminal device 101,102,103 and server 105 to provide communication link
Medium.Network 104 may include various connection types, such as wired, wireless communication link or fiber optic cables etc..
User can be used terminal device 101,102,103 and be interacted by network 104 with server 105, to receive or send out
Send message etc..Various telecommunication customer end applications, such as the application of shopping class, net can be installed on terminal device 101,102,103
(merely illustrative) such as the application of page browsing device, searching class application, instant messaging tools, mailbox client, social platform softwares.
Terminal device 101,102,103 can be the various electronic equipments with display screen and supported web page browsing, packet
Include but be not limited to smart phone, tablet computer, pocket computer on knee and desktop computer etc..
Server 105 can be to provide the server of various services, such as utilize terminal device 101,102,103 to user
The website browsed provides the back-stage management server (merely illustrative) supported.Back-stage management server can be to the use received
The data such as family request analyze etc. processing, and by processing result (such as according to user's request or the webpage of generation, believe
Breath or data etc.) feed back to terminal device.
The user interaction approach of electronic equipment provided by the embodiment of the present disclosure can be by terminal device 101,102 or 103
It executes.
It should be understood that the number of terminal device, network and server in Fig. 1 is only schematical.According to realization need
It wants, can have any number of terminal device, network and server.
Fig. 2 diagrammatically illustrates the flow chart of the user interaction approach of electronic equipment according to an embodiment of the present disclosure.
As shown in Fig. 2, this method includes operation S201~operation S203.
In operation S201, the element shown in the user interface of electronic equipment is determined according to user's operation.
In operation S202, obtain relevant to element information, information relevant to the element include following any one or
It is multinomial: the location information of the description information of element, the functional information of element, the content information of element or element in user interface.
In accordance with an embodiment of the present disclosure, information relevant to element can be generated by the agreement of understanding of electronic equipment.
For example, UIAccessibility is an agreement of understanding in user interface frame, may be used to provide about user circle
The relevant information of the element in face, the i.e. description information of element, the functional information of element, the content information of element or element with
The location information at family interface.
For example, the description information of element can be a brief localization word or phrase, this phrase succinct can be retouched
Element is stated, but is unable to the type of recognition element, such as " addition ", " broadcasting ".It at this moment can be by associated with electronic equipment
Server issue content described in text, the agreement of understanding of electronic equipment gives element to provide specific description content.Example
Such as, element is wechat icon, and in user when user interface is chosen, server relevant to wechat issues description wechat icon
The agreement of understanding of content, electronic equipment generates description information corresponding with the wechat icon according to the content.
In accordance with an embodiment of the present disclosure, the functional information of element, the content information of element or element are in the position of user interface
Confidence breath is similar with the description information of above-mentioned generation element, need to be issued by server associated with element operated by user
With the functional information of element, the content information of element or element in the corresponding content of location information of user interface, electronics set
It is standby that the functional information of succinct element, the content information or member of element are provided based on the content received by agreement of understanding
Location information of the element in user interface.
In operation S203, the first voice for describing the element is generated according to the information relevant to element of acquisition and is believed
Breath.
In accordance with an embodiment of the present disclosure, when user by gesture (for example, click, dragging or the gestures such as flick) choose electricity
When the element of the user interface presentation of sub- equipment, electronic equipment can obtain letter relevant to the element from server or from local
Breath, for example, information relevant to the element may include following any one or more: the function of the description information of element, element
The location information of energy information, the content information of element or element in user interface.Then, electronic equipment can be according to acquisition
Information relevant to the element generates the first voice messaging for describing the element.In accordance with an embodiment of the present disclosure, Yong Hujie
The element that face is shown can be application program, control, image file, video file, audio file or document.For example, this implementation
The element of example is application program (such as wechat), and the first language for describing wechat can be generated according to information relevant to wechat
Message breath, for example, the first voice messaging can be " you click be the wechat App issued by Tencent's formula, which mainly uses
In chat, positioned at the third line secondary series of user interface ", the element clicked by this method to user carries out voice broadcast and helps
Information relevant to the element is obtained in time in user, so that user can know oneself clicked on user interface in time
Position, the title for the element clicked and the function of the element, this mode can help special population (for example, blind person
Or have the crowd of vision disorder) timely know that it clicks the information of element.
Fig. 3 is diagrammatically illustrated generates the first voice messaging according to the electronic equipment of the embodiment of the present disclosure according to the first information
Flow chart.
As shown in figure 3, in accordance with an embodiment of the present disclosure, the operation S203 in Fig. 2 embodiment includes operation S301~operation
S302。
In operation S301, description information and/or functional information based on element generate the first information, which includes
The title of element and/or result to the element operation.
In operation S302, the first voice messaging for describing the element is generated according to the first information.
In accordance with an embodiment of the present disclosure, the description information of element and/or functional information can be about Jie to the element
It continues.For example, element is wechat, the description information of the element can be " element is Tencent released in 2011 it is a
The free App " of instant messaging service is provided for intelligent terminal, and the functional information of the element can be that " wechat is supported to transport across communication
Battalion quotient, spanning operation system platform quickly send voice messaging, video, picture and text by network ".
In accordance with an embodiment of the present disclosure, the first information can be the title of element and/or the result to the element operation.Example
Such as, which is an application program (wechat), and in this case, the title of the element can be " wechat ", is grasped to the element
The result of work can be " for chatting ", then the first information can be " wechat, for chatting ", electronic equipment can root at this time
According to the first information generate the first voice messaging (for example, you click be wechat, for chatting).In this way, passing through electronic equipment
The extraction and combination producing first of description information and/or functional information progress keyword from the received element of server are believed
Breath, the first voice messaging generated based on the first information is succinctly understandable, thus when reducing user and listening used in the first voice
Between, improve the experience of user.
Fig. 4 diagrammatically illustrates the appearance information and/or position according to the electronic equipment of the embodiment of the present disclosure according to element
Information generates the flow chart of the first voice messaging.
In accordance with an embodiment of the present disclosure, the element that the information relevant to element of acquisition is described in addition to Fig. 2 embodiment is retouched
Information, the functional information of element, the content information of element or the element are stated except the location information of the user interface,
It further include the appearance information of the element, operation 401 as shown in Figure 4.In addition, the operation S203 in Fig. 2 embodiment includes operation
S402。
As shown in figure 4, this method includes operation S201, operation S401 and operation S402.
In operation S201, the element shown in the user interface of electronic equipment is determined according to user's operation.
In operation S401, information relevant to element is obtained, information relevant to element includes following any one or more
: the description information of element, the functional information of element, the content information of element, the appearance information of element or element are in user circle
The location information in face.
In operation S402, generated in the location information of user interface for retouching according to the appearance information of element and/or element
State the first voice messaging of the element.
In accordance with an embodiment of the present disclosure, the frame of the user interface of electronic equipment can be the palace lattice of 5*3, and element is in the use
The location information at family interface for example can be the third line secondary series etc., but not limited to this.
In accordance with an embodiment of the present disclosure, the appearance information of element can refer to the shape and/or size of the element.For example, should
Element can be the application icon of the square of 1.5*1.5.
Electronic equipment can be generated in the location information of user interface for describing according to element appearance information and/or element
First voice messaging of the element, for example, first voice messaging can be, " element that you click is the pros with 1.5*1.5
Shape is shown on a user interface, is located at the third line secondary series ", so that blind person has the crowd of vision disorder right in next time
When the element is clicked, the element can be quickly and accurately found in the position of user interface, avoids false triggering and this yuan
The adjacent element of element.
Fig. 5, which is diagrammatically illustrated, generates the first language according to a plurality of information of element according to the electronic equipment of the embodiment of the present disclosure
The flow chart of message breath.In accordance with an embodiment of the present disclosure, the appearance information of above-mentioned element includes the shape and/or size of element.
As shown in figure 5, this method includes operation S201, operation S501 and operation S502.
In operation S201, the element shown in the user interface of electronic equipment is determined according to user's operation.
In operation S501, information relevant to element is obtained, information relevant to element includes following any one or more
: the description information of element, the functional information of element, the content information of element, the appearance information of element or element are in user circle
The location information in face, wherein the appearance information of element includes the shape and/or size of the element.
In operation S502, according to the shape of element and/or size, the title of element, to the result of element operation, element
Content information and element generate the first voice messaging for describing the element in the location information of user interface.
In accordance with an embodiment of the present disclosure, the shape for the element that electronic equipment can be clicked according to user in user interface and/
Or size, the title of element, the location information to the result of element operation, the content information of element and element in user interface are given birth to
At the first voice messaging for describing the element, the first voice messaging generated by this method can allow user to the element into
The detailed understanding of row, such mode can help to blind person or have the crowd of vision disorder.For example, in user interface presentation
Element be a picture, the first voice messaging generated through the above way allows the user to know that the picture in user circle
Specific location (for example, fourth line secondary series that the picture is located at the Photo folder in the C disk of electronic equipment), the picture in face
Concrete shape and/or size (such as the picture is shown on a user interface with the square of 3*3), the content of the picture
Be an automobile, the entitled picture of the element, to element operation the result is that the picture of an automobile " show " etc..
Fig. 6 A~6D diagrammatically illustrates schematic diagram when interacting according to the user of the embodiment of the present disclosure with electronic equipment.
In accordance with an embodiment of the present disclosure, the above method is applied to electronic equipment 600, interacts in user with electronic equipment 600
When scene may include the scene as shown in Fig. 6 A~6D.
Specifically, as shown in Figure 6A, when the user clicks the wechat of the user interface presentation of electronic equipment 600 when, electronics is set
Standby 600 play A61: " that you click is the wechat App issued by Tencent's formula, which is mainly used for chatting, and is located at user circle
The third line secondary series in face ".
As shown in Figure 6B, when the user clicks the wechat of the user interface presentation of electronic equipment 600 when, electronic equipment 600 is broadcast
Put A62: " you click be wechat, for chatting ".
As shown in Figure 6 C, when the user clicks the wechat of the user interface presentation of electronic equipment 600 when, electronic equipment 600 is broadcast
Put A63: " element that you click is shown on a user interface with the square of 1.5*1.5, and the third line secondary series is located at ".
As shown in Figure 6 D, when the user clicks the wechat of the user interface presentation of electronic equipment 600 when, electronic equipment 600 is broadcast
Put A64: " what you clicked is to show wechat icon on a user interface with the square of 1.5*1.5, for chatting, is located at and uses
The third line secondary series at family interface ".
It is appreciated that element provided above is merely illustrative for wechat, to facilitate apparent accurately understanding originally
The scheme of disclosed technical solution, the disclosure is not limited to this.
Fig. 7 diagrammatically illustrates the block diagram of the user interactive system of electronic equipment according to an embodiment of the present disclosure.
As shown in fig. 7, system 700 includes determining module 710, obtains module 720 and generation module 730.
Determining module 710, for determining the element shown in the user interface of electronic equipment according to user's operation.
Module 720 is obtained, for obtaining information relevant to element, information relevant to element includes following any one
Or multinomial: the description information of element, the functional information of element, the content information of element or element are in the position of the user interface
Confidence breath.
Generation module 730 generates the first language for describing the element for the information relevant to element according to acquisition
Message breath.
Fig. 8 diagrammatically illustrate according to the disclosure another embodiment electronic equipment user interactive system frame
Figure.
As shown in figure 8, in accordance with an embodiment of the present disclosure, generation module 730 is generated including the first generation module 810, second
Module 820, third generation module 830 and the 4th generation module 840.
First generation module 810, for based on element description information and/or functional information generate the first information, this
One information includes the title of element and/or the result to element operation.
Second generation module 820, for generating the first voice messaging for describing the element according to the first information.
Third generation module 830, for raw in the location information of user interface according to the appearance information and/or element of element
At the first voice messaging for describing the element.
4th generation module 840, for according to the shape and/or size of element, the title of element, to the knot of element operation
Fruit, the content information of element and element generate the first voice messaging for describing the element in the location information of user interface.
In accordance with an embodiment of the present disclosure, system 700 can use the generation of any one module in above-mentioned generation module 730
For describing the first voice messaging of the element.
In accordance with an embodiment of the present disclosure, mould is generated about determining module 710, acquisition module 720, generation module 730, first
The specific implementation process and Fig. 2 of block 810, the second generation module 820, third generation module 830 and the 4th generation module 840
The implementation process of method described in~Fig. 5 is same or similar.
It is understood that determining module 710, acquisition module 720, generation module 730, the first generation module 810, second
Generation module 820, third generation module 830 and the 4th generation module 840, which may be incorporated in a module, to be realized, or
Any one module therein can be split into multiple modules.Alternatively, one or more modules in these modules are at least
Partial function can be combined at least partly function of other modules, and be realized in a module.Reality according to the present invention
Example is applied, determining module 710 obtains module 720, generation module 730, the first generation module 810, the second generation module 820, third
At least one of generation module 830 and the 4th generation module 840 can at least be implemented partly as hardware circuit, example
As on field programmable gate array (FPGA), programmable logic array (PLA), system on chip, substrate system, in encapsulation be
System, specific integrated circuit (ASIC), or can be to carry out the hardware such as any other rational method that is integrated or encapsulating to circuit
Or firmware realizes, or is realized with software, the appropriately combined of hardware and firmware three kinds of implementations.Alternatively, determining module
710, obtain module 720, generation module 730, the first generation module 810, the second generation module 820, third generation module 830,
And the 4th at least one of generation module 840 can at least be implemented partly as computer program module, when the program
When being run by computer, the function of corresponding module can be executed.
Fig. 9 diagrammatically illustrates the box of the computer system for being adapted for carrying out electronic equipment according to the embodiment of the present disclosure
Figure.Computer system shown in Fig. 9 is only an example, should not function to the embodiment of the present disclosure and use scope bring and appoint
What is limited.
As shown in figure 9, include processor 901 according to the computer system 900 of the embodiment of the present disclosure, it can be according to storage
It is loaded into random access storage device (RAM) 903 in the program in read-only memory (ROM) 902 or from storage section 908
Program and execute various movements appropriate and processing.Processor 901 for example may include general purpose microprocessor (such as CPU), refer to
Enable set processor and/or related chip group and/or special microprocessor (for example, specific integrated circuit (ASIC)), etc..Processing
Device 901 can also include the onboard storage device for caching purposes.Processor 901 may include for executing with reference to Fig. 2~Fig. 5
Single treatment unit either multiple processing units of the different movements of the method flow according to the embodiment of the present disclosure of description.
In RAM 903, it is stored with system 900 and operates required various programs and data.Processor 901, ROM 902 with
And RAM 903 is connected with each other by bus 904.Processor 901 is held by executing the program in ROM 902 and/or RAM 903
Various operations of the row above with reference to Fig. 2~Fig. 5 method described.It is noted that described program also can store except ROM 902
In one or more memories other than RAM 903.Processor 901 can also be stored in one or more of by execution
Program in memory executes the various operations above with reference to Fig. 2~Fig. 5 method described.
In accordance with an embodiment of the present disclosure, system 900 can also include input/output (I/O) interface 905, input/output
(I/O) interface 905 is also connected to bus 904.System 900 can also include be connected to I/O interface 905 with one in lower component
Item is multinomial: the importation 906 including keyboard, mouse etc.；Including such as cathode-ray tube (CRT), liquid crystal display (LCD)
Deng and loudspeaker etc. output par, c 907；Storage section 908 including hard disk etc.；And including such as LAN card, modulatedemodulate
Adjust the communications portion 909 of the network interface card of device etc..Communications portion 909 executes communication process via the network of such as internet.
Driver 610 is also connected to I/O interface 905 as needed.Detachable media 911, such as disk, CD, magneto-optic disk, semiconductor
Memory etc. is mounted on as needed on driver 910, in order to be pacified as needed from the computer program read thereon
It is packed into storage section 908.
In accordance with an embodiment of the present disclosure, it may be implemented as computer software journey above with reference to the method for flow chart description
Sequence.For example, embodiment of the disclosure includes a kind of computer program product comprising carry meter on a computer-readable medium
Calculation machine program, the computer program include the program code for method shown in execution flow chart.In such embodiments,
The computer program can be downloaded and installed from network by communications portion 909, and/or be pacified from detachable media 611
Dress.When the computer program is executed by processor 901, the above-mentioned function of limiting in the system of the embodiment of the present disclosure is executed.Root
According to embodiment of the disclosure, system as described above, unit, module, unit etc. can by computer program module come
It realizes.
It should be noted that computer-readable medium shown in the disclosure can be computer-readable signal media or meter
Calculation machine readable storage medium storing program for executing either the two any combination.Computer readable storage medium for example can be --- but not
Be limited to --- electricity, magnetic, optical, electromagnetic, infrared ray or semiconductor system, device or device, or any above combination.Meter
The more specific example of calculation machine readable storage medium storing program for executing can include but is not limited to: have the electrical connection, just of one or more conducting wires
Taking formula computer disk, hard disk, random access storage device (RAM), read-only memory (ROM), erasable type may be programmed read-only storage
Device (EPROM or flash memory), optical fiber, portable compact disc read-only memory (CD-ROM), light storage device, magnetic memory device,
Or above-mentioned any appropriate combination.In the disclosure, computer readable storage medium can be it is any include or storage journey
The tangible medium of sequence, the program can be commanded execution system, device or device use or in connection.And at this
In open, computer-readable signal media may include in a base band or as the data-signal that carrier wave a part is propagated,
Wherein carry computer-readable program code.The data-signal of this propagation can take various forms, including but unlimited
In electromagnetic signal, optical signal or above-mentioned any appropriate combination.Computer-readable signal media can also be that computer can
Any computer-readable medium other than storage medium is read, which can send, propagates or transmit and be used for
By the use of instruction execution system, device or device or program in connection.Include on computer-readable medium
Program code can transmit with any suitable medium, including but not limited to: wireless, electric wire, optical cable, RF etc. are above-mentioned
Any appropriate combination.In accordance with an embodiment of the present disclosure, computer-readable medium may include above-described ROM 902
And/or one or more memories other than RAM 903 and/or ROM 902 and RAM 903.
Flow chart and block diagram in attached drawing are illustrated according to the system of the various embodiments of the disclosure, method and computer journey
The architecture, function and operation in the cards of sequence product.In this regard, each box in flowchart or block diagram can generation
A part of one module, program segment or code of table, a part of above-mentioned module, program segment or code include one or more
Executable instruction for implementing the specified logical function.It should also be noted that in some implementations as replacements, institute in box
The function of mark can also occur in a different order than that indicated in the drawings.For example, two boxes succeedingly indicated are practical
On can be basically executed in parallel, they can also be executed in the opposite order sometimes, and this depends on the function involved.Also it wants
It is noted that the combination of each box in block diagram or flow chart and the box in block diagram or flow chart, can use and execute rule
The dedicated hardware based systems of fixed functions or operations is realized, or can use the group of specialized hardware and computer instruction
It closes to realize.
As on the other hand, the disclosure additionally provides a kind of computer-readable medium, which can be
Included in equipment described in above-described embodiment；It is also possible to individualism, and without in the supplying equipment.Above-mentioned calculating
Machine readable medium carries one or more program, when said one or multiple programs are executed by the equipment, makes
It obtains the equipment to execute: determining the element shown in the user interface of electronic equipment according to user's operation；It obtains relevant to element
Information, information relevant to the element include following any one or more: the description information of element, the function of element letter
The location information of breath, the content information of element or element in user interface；And it is raw according to the information relevant to element of acquisition
At the first voice messaging for describing the element.
Embodiment of the disclosure is described above.But the purpose that these embodiments are merely to illustrate that, and
It is not intended to limit the scope of the present disclosure.Although respectively describing each embodiment above, but it is not intended that each reality
Use cannot be advantageously combined by applying the measure in example.The scope of the present disclosure is defined by the appended claims and the equivalents thereof.It does not take off
From the scope of the present disclosure, those skilled in the art can make a variety of alternatives and modifications, these alternatives and modifications should all fall in this
Within scope of disclosure.
Claims (12)
1. the user interaction approach of a kind of electronic equipment, comprising:
The element shown in the user interface of the electronic equipment is determined according to user's operation；
Information relevant to the element is obtained, the information relevant to the element includes following any one or more:
The description information of the element, the functional information of the element, the content information of the element or the element are in the user
The location information at interface；And
The first voice messaging for describing the element is generated according to the information relevant to the element of acquisition.
2. according to the method described in claim 1, wherein, being generated according to the information relevant to the element of acquisition for describing
First voice messaging of the element includes:
Description information and/or functional information based on the element generate the first information, and the first information includes the element
Title and/or result to the element operation；And
The first voice messaging for describing the element is generated according to the first information.
3. according to the method described in claim 1, wherein:
The information relevant to the element further includes the appearance information of the element；And
Include: according to the first voice messaging that the information relevant to the element of acquisition is generated for describing the element
It is generated in the location information of the user interface for describing according to the appearance information of the element and/or the element
State the first voice messaging of element.
4. according to the method described in claim 3, wherein:
The appearance information of the element includes the shape and/or size of the element；And
Include: according to the first voice messaging that the information relevant to the element of acquisition is generated for describing the element
According to the shape of the element and/or size, the title of the element, the result to the element operation, the element
Content information and the element the user interface location information generate for describe the element the first voice believe
Breath.
5. according to the method described in claim 1, wherein, the element include it is following any one: application program, control, figure
As file, video file, audio file or document.
6. the user interactive system of a kind of electronic equipment, comprising:
Determining module, for determining the element shown in the user interface of the electronic equipment according to user's operation；
Module is obtained, for obtaining information relevant to the element, the information relevant to the element includes following
Anticipate one or more: the description information of the element, the functional information of the element, the element content information or described
Location information of the element in the user interface；And
Generation module generates the first voice for describing the element for the information relevant to the element according to acquisition
Information.
7. system according to claim 6, wherein the generation module includes:
First generation module, for based on the element description information and/or functional information generate the first information, described first
Information includes the title of the element and/or the result to the element operation；And
Second generation module, for generating the first voice messaging for describing the element according to the first information.
8. system according to claim 6, in which:
The information relevant to the element further includes the appearance information of the element；And
The generation module includes:
Third generation module, for the appearance information and/or the element according to the element in the position of the user interface
Information generates the first voice messaging for describing the element.
9. system according to claim 8, in which:
The appearance information of the element includes the shape and/or size of the element；And
The generation module includes:
4th generation module, for according to the shape and/or size of the element, the title of the element, to the element grasp
The result of work, the content information of the element and the element generate described for describing in the location information of the user interface
First voice messaging of element.
10. system according to claim 6, wherein the element include it is following any one: application program, control, figure
As file, video file, audio file or document.
11. a kind of electronic equipment, comprising:
One or more processors；And
One or more memories are stored with executable instruction, and described instruction is when being executed by processor, so that processor executes
Method described according to claim 1~any one of 5.
12. a kind of computer-readable medium is stored thereon with for described in execution according to claim 1~any one of 5
The instruction of method.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711498692.7A CN109992177A (en) | 2017-12-29 | 2017-12-29 | User interaction approach, system, electronic equipment and the computer media of electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711498692.7A CN109992177A (en) | 2017-12-29 | 2017-12-29 | User interaction approach, system, electronic equipment and the computer media of electronic equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109992177A true CN109992177A (en) | 2019-07-09 |
Family
ID=67110255
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711498692.7A Pending CN109992177A (en) | 2017-12-29 | 2017-12-29 | User interaction approach, system, electronic equipment and the computer media of electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109992177A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108776580A (en) * | 2018-06-04 | 2018-11-09 | 珠海格力电器股份有限公司 | The reminding method and device of window |
| CN112423066A (en) * | 2020-11-13 | 2021-02-26 | 深圳创维－Rgb电子有限公司 | Television control method and device, intelligent terminal and storage medium |
| WO2022089180A1 (en) * | 2020-10-31 | 2022-05-05 | 华为技术有限公司 | Interaction method and terminal device |
| CN114816618A (en) * | 2021-04-14 | 2022-07-29 | 浙江口碑网络技术有限公司 | Page element display method and device, electronic equipment and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2012104092A (en) * | 2010-11-11 | 2012-05-31 | Atlab Co Ltd | Touch screen device allowing visually impaired person to handle objects thereon, and method of handling objects on touch screen device |
| CN103106031A (en) * | 2013-01-22 | 2013-05-15 | 北京小米科技有限责任公司 | Operation method and operation device of mobile terminal |
| CN103631506A (en) * | 2012-08-24 | 2014-03-12 | 腾讯科技（深圳）有限公司 | Reading method based on terminal and corresponding terminal |
| CN105487744A (en) * | 2014-09-23 | 2016-04-13 | 中兴通讯股份有限公司 | Method and device for realizing interaction on accessible intelligent terminal |
| CN107370670A (en) * | 2017-09-06 | 2017-11-21 | 叶进蓉 | Unread message extracts methods of exhibiting and device |
-
2017
- 2017-12-29 CN CN201711498692.7A patent/CN109992177A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2012104092A (en) * | 2010-11-11 | 2012-05-31 | Atlab Co Ltd | Touch screen device allowing visually impaired person to handle objects thereon, and method of handling objects on touch screen device |
| CN103631506A (en) * | 2012-08-24 | 2014-03-12 | 腾讯科技（深圳）有限公司 | Reading method based on terminal and corresponding terminal |
| CN103106031A (en) * | 2013-01-22 | 2013-05-15 | 北京小米科技有限责任公司 | Operation method and operation device of mobile terminal |
| CN105487744A (en) * | 2014-09-23 | 2016-04-13 | 中兴通讯股份有限公司 | Method and device for realizing interaction on accessible intelligent terminal |
| CN107370670A (en) * | 2017-09-06 | 2017-11-21 | 叶进蓉 | Unread message extracts methods of exhibiting and device |
Non-Patent Citations (1)
| Title |
|---|
| 刘宗意: "iOS UIAccessibility讲解", 《CSDN博客-HTTPS://BLOG.CSDN.NET/CSDN_LIUZONGYI/ARTICLE/DETAILS/53535579》 * |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108776580A (en) * | 2018-06-04 | 2018-11-09 | 珠海格力电器股份有限公司 | The reminding method and device of window |
| WO2022089180A1 (en) * | 2020-10-31 | 2022-05-05 | 华为技术有限公司 | Interaction method and terminal device |
| CN114527894A (en) * | 2020-10-31 | 2022-05-24 | 华为终端有限公司 | Interaction method and terminal equipment |
| CN114527894B (en) * | 2020-10-31 | 2024-05-14 | 华为终端有限公司 | Interaction method and terminal equipment |
| CN112423066A (en) * | 2020-11-13 | 2021-02-26 | 深圳创维－Rgb电子有限公司 | Television control method and device, intelligent terminal and storage medium |
| CN114816618A (en) * | 2021-04-14 | 2022-07-29 | 浙江口碑网络技术有限公司 | Page element display method and device, electronic equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9043412B2 (en) | Computer device for reading e-book and server for being connected with the same | |
| CN110096344A (en) | Task management method, system, server cluster and computer-readable medium | |
| CN109992177A (en) | User interaction approach, system, electronic equipment and the computer media of electronic equipment | |
| KR101622871B1 (en) | Method, system and recording medium for managing conversation contents in messenger | |
| CN110061909A (en) | Method and apparatus for handling information | |
| WO2021223752A1 (en) | Display method and apparatus, and electronic device | |
| CN112015314B (en) | Information display method and device, electronic equipment and medium | |
| WO2023040443A1 (en) | Method and device for drawing canvas | |
| CN110213614A (en) | The method and apparatus of key frame are extracted from video file | |
| CN109981719A (en) | Information processing method and its system, computer system and computer readable medium | |
| CN113536185B (en) | Application page loading method, storage medium and related equipment | |
| CN110020329A (en) | For generating the methods, devices and systems of webpage | |
| CN113031946A (en) | Method and device for rendering page component | |
| CN109491742A (en) | Page tabular rendering method and device | |
| JP2023548485A (en) | Information display method, device, electronic device and computer readable storage medium | |
| CN107766106B (en) | The method and apparatus for generating configuration file | |
| CN109582317A (en) | Method and apparatus for debugging boarding application | |
| CN113407882A (en) | Component generation method and device, computer-readable storage medium and electronic equipment | |
| CN108959642A (en) | Method and apparatus for information to be written | |
| CN111061860A (en) | Abstract generation method and device | |
| CN110135903A (en) | Advertisement position ranks method, system, medium and electronic equipment | |
| CN112307393A (en) | Information issuing method and device and electronic equipment | |
| CN110399059A (en) | Method and apparatus for showing information | |
| CN109472740A (en) | The method and apparatus for generating figure based on web front end | |
| CN112148417A (en) | Page adjusting method and device, electronic equipment and computer readable medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190709 |