CN113296857A - Information barrier-free processing method and device and electronic equipment - Google Patents

Information barrier-free processing method and device and electronic equipment Download PDF

Info

Publication number
CN113296857A
CN113296857A CN202011218405.4A CN202011218405A CN113296857A CN 113296857 A CN113296857 A CN 113296857A CN 202011218405 A CN202011218405 A CN 202011218405A CN 113296857 A CN113296857 A CN 113296857A
Authority
CN
China
Prior art keywords
target
interface
information
page elements
page
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202011218405.4A
Other languages
Chinese (zh)
Inventor
金雅博
张怡远
黄刚
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Alibaba Group Holding Ltd
Original Assignee
Alibaba Group Holding Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Alibaba Group Holding Ltd filed Critical Alibaba Group Holding Ltd
Priority to CN202011218405.4A priority Critical patent/CN113296857A/en
Publication of CN113296857A publication Critical patent/CN113296857A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/451Execution arrangements for user interfaces
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/30Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
    • G06F16/33Querying
    • G06F16/332Query formulation
    • G06F16/3329Natural language query formulation or dialogue systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/30Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
    • G06F16/33Querying
    • G06F16/3331Query processing
    • G06F16/334Query execution
    • G06F16/3343Query execution using phonetics
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/30Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
    • G06F16/33Querying
    • G06F16/338Presentation of query results
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/30Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
    • G06F16/34Browsing; Visualisation therefor

Abstract

The embodiment of the application discloses an information barrier-free processing method, an information barrier-free processing device and electronic equipment, wherein the method comprises the following steps: acquiring information of a plurality of page elements in a source interface; generating a plurality of operation objects corresponding to the plurality of page elements based on the information of the plurality of page elements; and bearing the plurality of operation objects in a target interface and providing the operation objects for a user, so that the user can operate page elements in the source interface based on the operation of the target interface on the operation objects. By the aid of the method and the device, more effective barrier-free support can be provided for users under the condition that specific application programs are not needed to be developed in a barrier-free adaptation mode.

Description

Information barrier-free processing method and device and electronic equipment
Technical Field
The present invention relates to the field of information barrier-free processing technologies, and in particular, to an information barrier-free processing method and apparatus, and an electronic device.
Background
The information barrier-free means that any person (a healthy person or a disabled person, or a young person or an old person) can equally, conveniently and safely acquire, interact and use information by making up for differences in physical functions, environments and the like through an informatization means. To achieve the above, some systems provide related supplementary services that provide better barrier-free user interaction functionality for users with disabilities or users who temporarily fail to fully interact with the device. For example, one of the auxiliary services is a service like "screen reading software", which can provide language assistance for visually impaired users, such as blind people or visually impaired users, so that visually impaired users can conveniently interact with their devices. For example, when a user uses a certain application in a mobile phone, the "screen reading software" can provide language feedback in real time, for example, when the user currently places a finger in an area of a certain operation object (for example, a function option, a link, etc.) on a page, the "screen reading software" can read out the name of the operation object, so that the visually impaired user can learn information about the operation object he is operating by hearing.
In the process of implementing the barrier-free service, besides the support of auxiliary tools such as "screen reading software", specific applications are usually required to perform corresponding barrier-free adaptive development. For example, a page of an application includes a large number of pictures, and in order to enable the "screen reading software" to provide language feedback for the vision-impaired user, when writing page codes, some text-type introduction or description information needs to be added to the pictures, so that the "screen reading software" can tell the vision-impaired user what picture the user is "looking at", and the like.
As can be seen, the development cost of barrier-free adaptation is relatively high for an application, and therefore, except for some large-scale companies which purposefully perform appropriate barrier-free adaptation on relevant internet applications, most applications do not perform barrier-free relevant support. In a common application interface, the amount of information in the application interface may be very large and dense, and even sliding operations in multiple directions are required in the browsing process to obtain complete information. The page is not friendly enough to users with visual impairment, and good experience is difficult to obtain even through screen reading software.
Therefore, how to provide more effective barrier-free support for users becomes a technical problem to be solved by those skilled in the art.
Disclosure of Invention
The application provides an information barrier-free processing method and device and electronic equipment, which can provide more effective barrier-free support for a user under the condition that no specific application program is needed for barrier-free adaptive development.
The application provides the following scheme:
an information barrier-free processing method includes:
acquiring information of a plurality of page elements in a source interface;
generating a plurality of operation objects corresponding to the plurality of page elements based on the information of the plurality of page elements;
and bearing the plurality of operation objects in a target interface and providing the operation objects for a user, so that the user can operate page elements in the source interface based on the operation of the target interface on the operation objects.
An information barrier-free processing apparatus comprising:
the page element information acquisition unit is used for acquiring the information of a plurality of page elements in the source interface;
an operation object generation unit configured to generate a plurality of operation objects corresponding to the plurality of page elements based on information of the plurality of page elements;
and the target interface providing unit is used for bearing the operation objects in a target interface and providing the operation objects for a user, so that the user can operate page elements in the source interface based on the operation of the target interface on the operation objects.
According to the specific embodiments provided herein, the present application discloses the following technical effects:
according to the method and the device for processing the page elements, the source interface to be subjected to barrier-free processing can be determined, the information of the page elements is obtained, and a plurality of operation objects are correspondingly generated. And then, a target interface can be provided, and the plurality of operation objects can be displayed in the target interface. Therefore, as the page elements scattered at a plurality of different positions of the interface in the source interface are rearranged in the target interface, the information of the operation object obtaining the focus can be broadcasted by operating the operation object in the target interface and combining with the screen information reading service such as the screen reading software, so that the user with visual disorder can more conveniently obtain the information of the page elements in the source interface, and further, the operation of the page elements in the source interface can be realized by operating the operation object of the target interface. By the method, barrier-free adaptive development is not required for a specific source interface, and a visually-impaired user can conveniently acquire specific page information, so that the development cost can be reduced.
During specific implementation, a user can also operate an operation object in the target interface, and correspondingly, the operation object can be switched to a receiving interface associated with the page element corresponding to the operation object for displaying. In addition, after the adapting interface is switched to, the adapting interface can be continuously used as a source interface, and the scheme in the embodiment of the application can be used for extracting page elements, generating operation objects, displaying a target interface and the like.
Of course, it is not necessary for any product to achieve all of the above-described advantages at the same time for the practice of the present application.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings without creative efforts.
FIG. 1 is a schematic diagram of a system architecture provided by an embodiment of the present application;
FIG. 2 is a flow chart of a method provided by an embodiment of the present application;
3-1, 3-2 are schematic diagrams of user interfaces provided by embodiments of the present application;
FIG. 4 is a schematic view of an apparatus provided by an embodiment of the present application;
fig. 5 is a schematic diagram of an electronic device provided in an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments that can be derived from the embodiments given herein by a person of ordinary skill in the art are intended to be within the scope of the present disclosure.
It should be noted that, in the process of implementing the present application, the inventor of the present application finds that, in a manner of "browsing" an interface in a specific application program by a visually impaired user through a "screen reading software", a difficulty is that some page elements in the application program interface may need to be slid in a certain direction by the user before entering a window visible range, and the specific direction may be multiple. For example, some page elements can enter the window visible range only by sliding the user up and down, and some page elements are arranged horizontally and can enter the window visible range only by sliding the user left and right. However, the screen reading software can only recognize and output voice of the page elements which enter the visible range of the window and currently obtain the operation focus, which means that if the user wants to know about the complete content in the page, the user needs to perform sliding operations in multiple directions, such as up and down, left and right, and the like, which is often impossible for users with impaired vision because they may have difficulty in determining where to slide up and down, and the like.
In view of the above situation, in the embodiment of the present application, an implementation scheme for performing barrier-free processing on a source interface may be provided, in which page elements in the source interface may be extracted, and operation objects are correspondingly generated, and then the operation objects may be arranged and displayed in a target interface. Therefore, the specific screen reading services such as screen reading software and the like only need to read the information of the operation object in the target interface, so that the target user with visual impairment can obtain the information of the specific page element in the source interface. The source interface may be an interface in a specific third-party application program, or a corresponding barrier-free processing function module integrated inside a certain application program, so that the source interface may be an interface inside the application program where the function module is located, or may be an interface displayed by other tools such as a browser, and the like. Due to the fact that page elements in the source interface are extracted, after the operation objects are generated, the operation objects are rearranged according to a certain mode and then displayed in the target interface, and therefore convenience can be brought to users with visual impairment.
Specifically, in a specific target interface, the plurality of operation objects may be arranged in a target direction (e.g., a longitudinal direction) in a unidirectional manner and then displayed, and the user may sequentially obtain the focus of the operation options during the operation of sliding the screen in the target direction. Therefore, the user only needs to operate in the target direction, so that the information of all the operation objects in the target interface can enter the visual range of the window in sequence, and the opportunity of service voice broadcast of screen reading software and the like is obtained. In other words, in this way, the orientation information of the page elements in the source interface can be "smoothed," and the page elements originally dispersed in a plurality of different orientations of the page are mapped to a plurality of operation objects arranged in a unidirectional chain manner, and can be displayed in the upper view of the source interface. Therefore, the user with the visual disorder can obtain relatively complete information about the current display interface only by performing unidirectional sliding operation in the target direction, and the user experience can be greatly improved. Of course, in a specific implementation, besides the above one-way chain arrangement manner, a column-divided display may be performed, for example, each column may be divided into two columns, and in a process that the target interface is slid, the operation objects in the target interface sequentially obtain focuses from top to bottom and from left to right, and so on.
When the page element information of the source interface is obtained, the node object tree of the source interface can be read, and specific page element information is obtained from the node object tree. Since the information of all page elements in the source interface is usually recorded in the node object tree and is irrelevant to whether the page elements are located in the visible range of the window, the more complete page element information about the source interface can be acquired and then mapped into the operation object.
Of course, in the process of performing operations such as sliding on the target interface, the operation of the user may be recognized to determine the operation object obtaining the focus, and in addition, the information of the operation object obtaining the focus may be converted into voice output through an application having a screen reading function, such as "screen reading software", so that the user obtains the information of the specific operation object through hearing.
In addition, when the user "hears" an interested operation object, the interested target operation object can be determined by executing a target operation in the target interface and the like, and a request for detailed viewing of the target operation object is initiated. For example, if the focus is moved by sliding the screen, the screen reading software may perform double-click on the screen at any position after reading out the information of the operation object currently obtaining the focus, so as to determine the operation object obtaining the focus as the target operation object. Then, according to the corresponding relationship between the operation object and the page element, an identifier (for example, ID, etc.) of the page element corresponding to the operation object may be determined, and then the identifier of the target page element is provided to the original target application program or the current application program, etc., so as to switch to the receiving interface associated with the target page element for display.
From the perspective of system architecture, in an implementation manner, referring to fig. 1, an auxiliary application may be provided in the embodiment of the present application, and the application may exist in a form of a standalone application, and a specific user may download and install the auxiliary application through a specific application store or the like, and the auxiliary application provides barrier-free processing services for other third-party applications. Since the secondary application is mainly used for a service for performing barrier-free processing on an interface of a third-party application, before the secondary application is used, a query can be made to a user about which applications are allowed to use the service, for example, an application already installed in the current terminal device can be displayed, and the user can check the applications which are allowed or need to be subjected to barrier-free processing, and the like. Accordingly, the list of applications permitted by the user can be saved locally in the terminal device, and subsequently, when the user uses the applications, the auxiliary application can determine the displayed relevant interface as the source interface to be subjected to barrier-free processing. In addition, during specific implementation, specific barrier-free information provision can be completed under the coordination of screen information reading services such as screen reading software and the like. For example, by the embodiment of the application, the page elements in the interface of the application program specifically accessed by the user can be processed to generate the corresponding operation objects, and the operation objects are rearranged in the target interface and then displayed, so that the direction information of the page elements in the source interface surface is smoothed, some decorative page elements can be filtered, and the vision-impaired user can sequentially display the information of the main page elements in the source interface only by performing simple operations such as screen sliding in the target interface. In the process of screen operation, along with the change of an operation focus, the screen reading software can convert text information associated with the operation objects which acquire the focus into voice and output the voice.
Or, in another implementation manner, the barrier-free processing function provided in the embodiment of the present application may also exist in the form of a functional module in a specific application program, and in this case, the specific application program may also provide two different modes, such as a "normal mode" and a "barrier-free mode". In the normal mode, normal interface display can be performed for a common user, and in the barrier-free mode, the barrier-free processing function module can be started, the interface to be displayed inside the application program is determined as a source interface, page elements in the source interface are extracted, corresponding operation objects are generated, and then the operation objects are arranged in a uniform mode in a target interface and displayed.
The following describes in detail a specific technical solution provided in an embodiment of the present application.
First, the embodiment of the present application provides an information barrier-free processing method, where an execution main body of the method may be the aforementioned independent auxiliary application program, or may also be a barrier-free processing module integrated in a specific application program. Referring to fig. 2, the method may specifically include:
s210: information of a plurality of page elements in a source interface is obtained.
The specific source interface may be an interface to be subjected to barrier-free processing. Specifically, the interface may be an interface currently being presented at the front end in the associated terminal device. For example, in a specific case where the barrier-free processing service is provided by an independent auxiliary application, the specific source interface to be subjected to barrier-free processing may be: and the interface to be displayed in the third-party application program in the foreground running state currently in the mobile terminal equipment. Of course, in other implementation manners, the interface may also be an application program that enters a background running state, and during the background running of the application program, the barrier-free processing may be performed on the associated interface, and so on. Alternatively, in a case where a specific barrier-free processing module is associated in a specific application program, the source interface to be subjected to barrier-free processing may be an interface to be presented in the application program, and the like.
In a specific implementation, the specific third-party application may be an application that is pre-authorized to be permitted by the user. That is, when a specific secondary application is used to provide a service, a user may specify in advance which applications the service may be used on, and accordingly, the secondary application may store information such as an identifier of the applications permitted by the user. Therefore, when barrier-free processing service is provided for a specific target application program, information interaction with the target application program can be realized through an inter-application communication interface provided by an operating system.
The source interface may be an interface that is triggered to be opened by a user in the process of accessing the target application program, for example, in an initial state, the source interface may be a home page of the target application program, and from the home page, the auxiliary application program or the barrier-free processing module in the embodiment of the present application may perform barrier-free processing on the home page, so that a user with a visual barrier may perform specific information acquisition and further click access on a content that is interested in the user on the basis of the target interface after the barrier-free processing.
After the source interface is determined, information of a plurality of page elements can be obtained from the source interface. In particular implementations, the information of the source interface may be determined in a variety of ways. For example, in one system, it may be determined whether the event is an accessibiiteevevent, type _ WINDOW _ STATE _ CHANGED, which represents an open interface, by monitoring an onassibiiteyevent () method of an accessibiservice service. When the page element information is obtained, there may be multiple ways, for example, in one way, the node object tree accessilinylnodeinfo in the source interface may be obtained, and then, the depth traversal and then the breadth traversal may be performed on the accessilinylnodeinfo object to obtain the page element in the page. In this way, the page elements displayed in different directions in the source interface and the page elements which are out of the window visual range in the default state and can enter the window visual range only through the transverse sliding operation can be acquired. After respective corresponding operation objects are subsequently generated, the operation objects can be arranged in a unified mode, for example, chain arrangement in the same direction can be performed, so that azimuth information in the original display interface is smoothed, sliding operation in multiple different directions which possibly occur is unified to the same direction, and therefore operation of users with visual impairment is facilitated.
In a specific source interface, each page element may correspond to respective text description information and identification information such as an ID. The text description information is mainly used for front-end display, for example, text presented on operation options such as specific buttons, or linked text of links, and the like. The ID is the basis for the application to identify and distinguish the specific page elements.
In an optional implementation manner, after a plurality of page elements in a page are acquired, the types or properties of the page elements can be identified, decorative page elements therein are filtered out, and page elements of the types of operation options (buttons and the like) and links and the like are reserved.
For example, in an application client provided by a commodity object information service system, a currently displayed page is a home page of the client application, as shown in fig. 3-1, a plurality of page elements are included, including operation options for navigating according to categories, such as category 1, category 2, and the like, and further category tags can be viewed by sliding to the right. In addition, the system can also comprise banner advertisement positions which are mainly used for broadcasting information of specific commodity objects or shop objects in turn; further, links to specific "channels" may be included, including a variety of intra-site channels, extra-site channels, and the like. When the links of the channels are specifically displayed, specific icons may be displayed for off-station channels, some representative diagrams may be displayed for on-station channels, and the like. Wherein, the related elements related to the specific banner ad slot display, and the page elements of the icon class and the representative image class can be filtered, and only specific category labels and channel labels are reserved.
S220: and generating a plurality of operation objects corresponding to the plurality of page elements based on the information of the plurality of page elements.
After determining the plurality of page elements included in the interface, a corresponding plurality of operation objects may be generated. In addition, during specific implementation, a corresponding relationship can be established between the specific operation object and the identifier of the page element. The page element identifier may specifically include two types of text description information and an ID associated with the page element, the specific text description information may be used for displaying in a subsequently generated view, and when a specific target operation object is operated, the specific operation information may be synchronized with the target application program through the ID of the associated page element, so that the target application program jumps to a receiving interface corresponding to the page element for displaying.
S230: and bearing the plurality of operation objects in a target interface and providing the operation objects for a user, so that the user can operate page elements in the source interface based on the operation of the target interface on the operation objects.
After the plurality of operation objects are generated, the plurality of operation objects may be arranged in a unified manner and displayed in a target interface, and the target interface may be located on an upper layer of the source interface and used for performing overlay display on the source interface. For example, it may be present in the form of a float layer or the like. Thus, the specific screen reading software reads specific information from the target interface. In specific implementation, a plurality of operation objects in the target interface can be arranged in a unidirectional manner (for example, longitudinally arranged) in the target direction, so that a user only needs to perform screen sliding operation in the target direction, and all the operation objects have the opportunity of obtaining a focus and are read by screen reading software.
Specifically, when the operation object is displayed in the target interface, a list may be generated according to the operation objects, and then the list items may be arranged in the target direction for displaying in the target interface. Of course, the display may be in the form of a card or the like, other than the list form, and is not limited herein.
For example, for the source interface shown in fig. 3-1, after processing by the embodiment of the present application, the display effect in the specific target interface may be as shown in fig. 3-2, and a plurality of operation objects may be arranged in the vertical direction. Specifically, as described above, when page element information is obtained from a source interface of a target application program, identification information of the page element may be obtained, where the identification information may include text description information associated with the page element. Therefore, in a specific target interface, the text description information of the page elements corresponding to the multiple operation objects can be arranged and displayed in a unidirectional manner in the target direction. For example, for the source interface shown in fig. 3-1, the names of a plurality of categories, the names of channels, and the like may be respectively exhibited in the specifically-exhibited target interface. For category labels in the source interface that need to enter the window visible range by sliding left and right, for example, category 5 and more categories N shown in fig. 3-2, may also be displayed in a specific list of the target interface, and a user may also slide up and down to make an operation object corresponding to the category target label obtain a focus, and then perform voice output through screen reading software.
In addition, during specific implementation, personalized processing may be performed on the display of the plurality of operation objects according to the related information of the user (for example, preference information determined according to historical behavior records, or basic attribute information of the user, such as age, sex, occupation, and the like). The specific personalization processing can comprise personalization sorting, or personalization screening and the like. For example, in the personalized sorting, the operation objects corresponding to the page elements which are more interesting to the user can be arranged at the positions which are more front. When the personalized screening is carried out, some contents which are not interesting or useless for the user can be deleted, and the like.
For example, in an application scenario of a specific commodity object information system, a specific page element in a source interface may be a specific commodity object or a link of a store object, and at this time, when performing personalized display, the commodity objects may be screened or sorted according to information such as personalized preference of a user in terms of commodity object selection, and then, a corresponding operation object is displayed in a target interface, and so on.
In addition, besides personalized screening or sorting aiming at the individual users, the embodiment of the application mainly aims at the crowd with visual impairment to carry out barrier-free information processing, so that the information in the source interface can be screened in the group characteristic angle of the crowd, and the information which is not suitable for being provided for the user with visual impairment is filtered. For example, in a specific implementation, in an application scenario of the commodity object information system, a corresponding flag bit may be added to the commodity object in advance to represent whether the commodity object is suitable for the visually impaired user, so that when the operation object is generated, the commodity object unsuitable for the visually impaired user may be filtered, and only the operation object corresponding to the commodity object suitable for the visually impaired user is retained in the target interface, and so on. Before generating a specific target interface, a query may be initiated to the user through a voice conversation or the like, and specific screening conditions, including screening of information of the commodity object, may be determined according to the voice response of the user.
After a specific target interface is displayed, the information of the operation object can be output in a voice mode through the screen information reading service, and therefore a user can understand specific screen content through the received voice information.
In the process of displaying the target interface, the corresponding relationship between the operation object and the identifier of the page element can be further determined, so that the corresponding receiving interface associated with the target page element can be switched to for displaying according to the operation request of the user on the target operation object in the target interface.
Specifically, after the specifically generated operation object is presented through the target interface, the user may cause the operation focus to move on each operation object by performing a specific operation on the target interface. For example, in a specific implementation, in order to facilitate the operation of the user with impaired vision, in the case that the specific operation objects are uniformly arranged in a certain target direction, the user may perform a screen sliding operation in the arrangement direction of the operation objects, so that a plurality of different operation objects sequentially obtain a focus, and the operation object currently obtaining the focus may perform voice output on text description information thereof through screen reading software, so that the user with impaired vision obtains information of the specific operation object through hearing.
And in the process that the user browses in a mode of sliding the screen in the target direction, if the information about a certain operation object broadcasted by the screen reading software is received and is interested in the operation object, the operation request of the operation object can be initiated by executing the predefined target operation. For example, in a specific implementation, after a voice broadcast result of a target operation object which currently obtains a focus is received, and before a next operation object obtains the focus, an operation such as double-click may be quickly performed at any position in a screen (of course, a long press or a voice input may be performed in other manners), at this time, the auxiliary application may monitor the operation, and synchronously provide an identifier of a target page element corresponding to the target operation object to the target application. The identifier of the target page element may specifically refer to an ID of the target page element, so that the target application can identify the specific target page element. And after receiving the ID of the target element, the target application program can be switched to an interface associated with the target page element for displaying.
For example, for the target view shown in fig. 3-2, in the initial state, the first operation object "home page" obtains the focus first, and accordingly, the "screen reading software" can perform voice output on the "home page" and the user can listen to the corresponding voice. Then, the user can interact the target view downwards, then, the focus is obtained in sequence by the category 1, the category 2 and the like, and the screen reading software can also perform voice broadcast in sequence. After the focus is obtained on the channel 3 and the corresponding voice is broadcasted by the screen reading software, the user is interested in the channel, and at this time, the double-click operation can be performed at any position of the screen to indicate that the user wants to further acquire detailed content about the channel. The secondary application may first listen to the operation and may simultaneously provide the ID defined for the page element corresponding to the channel in the target application to the target application, causing the target application to switch to the details interface corresponding to the "channel 3".
It should be noted that, in the specific examples of the embodiment of the present application, the "category 1", "category 2", "channel 1", "channel 2", and the like are all exemplified, and it is understood that, in practical applications, specific names of categories or channels are shown in the target view. For example, "category 1" may correspond to the "women's clothing" category, "category 2" to the "men's clothing" category, "channel 1" to the "New" channel, "channel 2" to the "live" channel, and so on.
In addition, during specific implementation, the focus may also be moved in other manners, for example, a specific clicked operation object is determined as the operation object currently obtaining the focus, and voice output is performed through the screen reading software. At this time, if the user needs to view the details of the operation object, the operation object may be determined as the aforementioned target operation object that needs to be viewed in details by performing double-click operation again at the position where the click operation is performed, and so on.
In addition, after the receiving interface associated with the target page element is switched to be displayed, the new operation object and the new target interface can be generated by continuously taking the receiving interface as a source interface and acquiring the page element from the source interface, and the newly generated operation object is arranged and displayed in the new target interface in a unified manner. That is to say, when a new interface is displayed each time, the page elements in the interface can be extracted again, and after the operation objects are generated, the page elements are displayed after being arranged in the target interface, so that the user with visual impairment can browse conveniently.
It should be noted here that after the generated operation object is displayed in the target interface, the target operation object in the target interface may be operated to trigger detailed viewing of the page element associated with the target operation object. In actual applications, the user may also have a need to return to the previous level of the source interface in the target application for presentation. For example, assuming the source interface is not a home page, the user may need to return to the home page for viewing. Therefore, when the method is specifically implemented, an operation object for returning to the upper level interface can be provided in the target interface. Specifically, the operation object may be displayed at the uppermost or lowermost position of the target view. Or, in another mode, when it is determined that the user may have a need to return to the previous interface according to the operation condition of the user, dynamically inserting the operation object for returning to the previous interface into the target interface. For example, if it is found at some point that the user slides the screen significantly faster, or slides many screens downward and then slides up again, the operation object for returning to the previous interface may be inserted before the position of the next operation object for obtaining focus in the target interface layer, so as to return to the previous interface more quickly, and so on.
In short, according to the embodiment of the application, the source interface to be subjected to barrier-free processing can be determined, the information of the plurality of page elements can be obtained from the source interface, and the plurality of operation objects can be correspondingly generated. And then, a target interface can be provided, and the plurality of operation objects can be displayed in the target interface. Therefore, as the page elements scattered at a plurality of different positions of the interface in the source interface are rearranged in the target interface, the information of the operation object obtaining the focus can be broadcasted by operating the operation object in the target interface and combining with the screen information reading service such as the screen reading software, so that the user with visual disorder can more conveniently obtain the information of the page elements in the source interface, and further, the operation of the page elements in the source interface can be realized by operating the operation object of the target interface. By the method, barrier-free adaptive development is not required for a specific source interface, and a visually-impaired user can conveniently acquire specific page information, so that the development cost can be reduced.
During specific implementation, a user can also operate an operation object in the target interface, and correspondingly, the operation object can be switched to a receiving interface associated with the page element corresponding to the operation object for displaying. In addition, after the adapting interface is switched to, the adapting interface can be continuously used as a source interface, and the scheme in the embodiment of the application can be used for extracting page elements, generating operation objects, displaying a target interface and the like.
It should be noted that, in the embodiments of the present application, the user data may be used, and in practical applications, the user-specific personal data may be used in the scheme described herein within the scope permitted by the applicable law, under the condition of meeting the requirements of the applicable law and regulations in the country (for example, the user explicitly agrees, the user is informed, etc.).
Corresponding to the foregoing method embodiment, an embodiment of the present application further provides an information barrier-free processing apparatus, and referring to fig. 4, the apparatus may include:
a page element information obtaining unit 410, configured to obtain information of a plurality of page elements in a source interface;
an operation object generating unit 420 configured to generate a plurality of operation objects corresponding to the plurality of page elements based on the information of the plurality of page elements;
the target interface providing unit 430 is configured to bear the multiple operation objects in a target interface and provide the operation objects to a user, so that the user can implement an operation on a page element in the source interface based on the operation of the target interface on the operation objects.
Wherein the source interface comprises: and the target third party application program is an application program in a foreground running state in the associated mobile terminal equipment.
Alternatively, the source interface comprises: and the interface to be displayed in the current application program.
Specifically, the page element information obtaining unit may be specifically configured to:
acquiring a node object tree corresponding to the source interface;
and acquiring the information of the plurality of page elements from the node object tree.
Specifically, the plurality of page elements include: the source interface has page elements distributed therein in a plurality of different orientations.
Additionally, the plurality of page elements may further include: and page elements which are out of the visual range of the window in the default state can be entered into the visual range of the window through a horizontal sliding operation.
Furthermore, the page element information obtaining unit may be further specifically configured to:
and acquiring information of the page elements of the operation options and/or the link classes in the source interface, and filtering out decorative page elements in the information.
In a specific implementation, the apparatus may further include:
and the personalized processing unit is used for performing personalized processing on the display of the plurality of operation objects according to the related information of the user.
And the voice output unit is used for performing voice output on the information of the operation object through a screen information reading service.
In addition, the apparatus may further include:
a corresponding relation determining unit, configured to determine a corresponding relation between the operation object and the identifier of the page element;
and the switching display unit is used for switching to a receiving interface associated with the target page element corresponding to the target operation object for display according to the corresponding relation after receiving an operation request for the target operation object in the target interface.
In addition, the target interface may be specifically configured to arrange and display information of the plurality of operation objects in a target direction.
At this time, the apparatus may further include:
a focus determination unit configured to determine a change situation of an operation focus on the plurality of operation objects in a process of receiving a screen sliding operation in the target direction, so as to perform voice output of information of an operation object currently obtaining the focus through a screen information reading service;
and the target operation object determining unit is used for determining the operation object of the current acquired focus as the target operation object to be operated if the target operation is received before the next operation object acquires the focus.
Wherein the target operation comprises a double-click operation at any position of the screen.
If the source interface is an interface to be displayed in the target third-party application program, the method may further include:
and the identification providing unit is used for providing the identification of the target page element corresponding to the target operation object to the target application program so that the third-party application program can execute corresponding interface switching processing.
Wherein the identification of the page element comprises: the target third party application defines an ID for the page element;
the identifier providing unit may be specifically configured to:
and providing the ID of the target page element corresponding to the target operation object to the target application program so that the target application program can identify the target page element through the ID.
In addition, after the receiving interface associated with the target page element is switched to be displayed, the receiving interface associated with the target page element is taken as a new source interface, and a plurality of corresponding operation objects are generated according to the plurality of page elements included in the new source interface and then displayed in the new target interface.
In addition, the present application also provides a computer readable storage medium, on which a computer program is stored, which when executed by a processor implements the steps of the method described in any of the preceding method embodiments.
And an electronic device comprising:
one or more processors; and
a memory associated with the one or more processors for storing program instructions that, when read and executed by the one or more processors, perform the steps of the method of any of the preceding method embodiments.
Where fig. 5 illustrates an architecture of an electronic device, for example, the device 500 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, an aircraft, and so forth.
Referring to fig. 5, device 500 may include one or more of the following components: processing component 502, memory 504, power component 506, multimedia component 508, audio component 510, input/output (I/O) interface 512, sensor component 514, and communication component 516.
The processing component 502 generally controls overall operation of the device 500, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing element 502 may include one or more processors 520 to execute instructions to perform all or a portion of the steps of the methods provided by the presently disclosed subject matter. Further, the processing component 502 can include one or more modules that facilitate interaction between the processing component 502 and other components. For example, the processing component 502 can include a multimedia module to facilitate interaction between the multimedia component 508 and the processing component 502.
The memory 504 is configured to store various types of data to support operation at the device 500. Examples of such data include instructions for any application or method operating on device 500, contact data, phonebook data, messages, pictures, videos, and so forth. The memory 504 may be implemented by any type or combination of volatile or non-volatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.
The power supply component 506 provides power to the various components of the device 500. The power components 506 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the device 500.
The multimedia component 508 includes a screen that provides an output interface between the device 500 and the user. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 508 includes a front facing camera and/or a rear facing camera. The front-facing camera and/or the rear-facing camera may receive external multimedia data when the device 500 is in an operating mode, such as a shooting mode or a video mode. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.
The audio component 510 is configured to output and/or input audio signals. For example, the audio component 510 includes a Microphone (MIC) configured to receive external audio signals when the device 500 is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals may further be stored in the memory 504 or transmitted via the communication component 516. In some embodiments, audio component 510 further includes a speaker for outputting audio signals.
The I/O interface 512 provides an interface between the processing component 502 and peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to: a home button, a volume button, a start button, and a lock button.
The sensor assembly 514 includes one or more sensors for providing various aspects of status assessment for the device 500. For example, the sensor assembly 514 may detect an open/closed state of the device 500, the relative positioning of the components, such as a display and keypad of the device 500, the sensor assembly 514 may also detect a change in the position of the device 500 or a component of the device 500, the presence or absence of user contact with the device 500, orientation or acceleration/deceleration of the device 500, and a change in the temperature of the device 500. The sensor assembly 514 may include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 514 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 514 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
The communication component 516 is configured to facilitate communications between the device 500 and other devices in a wired or wireless manner. The device 500 may access a wireless network based on a communication standard, such as WiFi, or a mobile communication network such as 2G, 3G, 4G/LTE, 5G, etc. In an exemplary embodiment, the communication component 516 receives a broadcast signal or broadcast associated information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communications component 516 further includes a Near Field Communication (NFC) module to facilitate short-range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.
In an exemplary embodiment, the apparatus 500 may be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors or other electronic components for performing the above-described methods.
In an exemplary embodiment, a non-transitory computer-readable storage medium comprising instructions, such as the memory 504 comprising instructions, executable by the processor 520 of the device 500 to perform the methods provided by the present disclosure is also provided. For example, the non-transitory computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.
From the above description of the embodiments, it is clear to those skilled in the art that the present application can be implemented by software plus necessary general hardware platform. Based on such understanding, the technical solutions of the present application may be essentially or partially implemented in the form of a software product, which may be stored in a storage medium, such as a ROM/RAM, a magnetic disk, an optical disk, etc., and includes several instructions for enabling a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the method according to the embodiments or some parts of the embodiments of the present application.
The embodiments in the present specification are described in a progressive manner, and the same and similar parts among the embodiments are referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, the system or system embodiments are substantially similar to the method embodiments and therefore are described in a relatively simple manner, and reference may be made to some of the descriptions of the method embodiments for related points. The above-described system and system embodiments are only illustrative, wherein the units described as separate parts may or may not be physically separate, and the parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.
The information barrier-free processing method, device and electronic device provided by the present application are introduced in detail, and a specific example is applied in the present application to explain the principle and implementation of the present application, and the description of the above embodiment is only used to help understand the method and core ideas of the present application; meanwhile, for a person skilled in the art, according to the idea of the present application, the specific embodiments and the application range may be changed. In view of the above, the description should not be taken as limiting the application.

Claims (19)

1. An information barrier-free processing method is characterized by comprising the following steps:
acquiring information of a plurality of page elements in a source interface;
generating a plurality of operation objects corresponding to the plurality of page elements based on the information of the plurality of page elements;
and bearing the plurality of operation objects in a target interface and providing the operation objects for a user, so that the user can operate page elements in the source interface based on the operation of the target interface on the operation objects.
2. The method of claim 1,
the source interface includes: and the target third party application program is an application program in a foreground running state in the associated mobile terminal equipment.
3. The method of claim 1,
the source interface includes: and the interface to be displayed in the current application program.
4. The method of claim 1,
the acquiring information of a plurality of page elements in the source interface includes:
acquiring a node object tree corresponding to the source interface;
and acquiring the information of the plurality of page elements from the node object tree.
5. The method of claim 1,
the plurality of page elements include: the source interface has page elements distributed therein in a plurality of different orientations.
6. The method of claim 5,
the plurality of page elements include: and page elements which are out of the visual range of the window in the default state can be entered into the visual range of the window through a horizontal sliding operation.
7. The method of claim 1,
the acquiring information of a plurality of page elements in the source interface includes:
and acquiring information of the page elements of the operation options and/or the link classes in the source interface, and filtering out decorative page elements in the information.
8. The method of claim 1, further comprising:
and performing personalized processing on the display of the plurality of operation objects according to the related information of the user.
9. The method of claim 1, further comprising:
and performing voice output on the information of the operation object through a screen information reading service.
10. The method of claim 1,
the target interface is specifically configured to arrange and display information of the plurality of operation objects in a target direction.
11. The method of claim 10, further comprising:
in the process of receiving the screen sliding operation in the target direction, determining the change condition of the operation focus on the plurality of operation objects so as to output the information of the operation object currently obtaining the focus through a screen information reading service in a voice mode;
and if the target operation is received before the next operation object obtains the focus, determining the operation object which currently obtains the focus as the target operation object so as to switch to a carrying interface of a target page element corresponding to the target operation object for displaying.
12. The method of claim 11,
the target operation includes a double-click operation at an arbitrary position on the screen.
13. The method of claim 1, further comprising:
determining the corresponding relation between the operation object and the identification of the page element;
and after receiving an operation request for a target operation object in the target interface, switching to a receiving interface associated with a target page element corresponding to the target operation object for displaying according to the corresponding relation.
14. The method of claim 13,
if the source interface is an interface to be displayed in the target third-party application program, the method further comprises the following steps:
and providing the identification of the target page element corresponding to the target operation object to the target application program so that the third-party application program can execute corresponding interface switching processing.
15. The method of claim 14,
the identification of the page elements includes: the target third party application defines an ID for the page element;
providing the identifier of the target page element corresponding to the target operation object to the target third-party application program, including:
and providing the ID of the target page element corresponding to the target operation object to the target application program so that the target application program can identify the target page element through the ID.
16. The method of any of claims 13 to 15, further comprising:
and after the receiving interface associated with the target page element is switched to be displayed, the receiving interface associated with the target page element is taken as a new source interface, and a plurality of corresponding operation objects are generated according to the plurality of page elements included in the new source interface and then displayed in the new target interface.
17. An information barrier-free processing apparatus, comprising:
the page element information acquisition unit is used for acquiring the information of a plurality of page elements in the source interface;
an operation object generation unit configured to generate a plurality of operation objects corresponding to the plurality of page elements based on information of the plurality of page elements;
and the target interface providing unit is used for bearing the operation objects in a target interface and providing the operation objects for a user, so that the user can operate page elements in the source interface based on the operation of the target interface on the operation objects.
18. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the method of any one of claims 1 to 16.
19. An electronic device, comprising:
one or more processors; and
a memory associated with the one or more processors for storing program instructions that, when read and executed by the one or more processors, perform the steps of the method of any of claims 1 to 16.
CN202011218405.4A 2020-11-04 2020-11-04 Information barrier-free processing method and device and electronic equipment Pending CN113296857A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011218405.4A CN113296857A (en) 2020-11-04 2020-11-04 Information barrier-free processing method and device and electronic equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011218405.4A CN113296857A (en) 2020-11-04 2020-11-04 Information barrier-free processing method and device and electronic equipment

Publications (1)

Publication Number Publication Date
CN113296857A true CN113296857A (en) 2021-08-24

Family

ID=77318430

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011218405.4A Pending CN113296857A (en) 2020-11-04 2020-11-04 Information barrier-free processing method and device and electronic equipment

Country Status (1)

Country Link
CN (1) CN113296857A (en)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040145607A1 (en) * 2001-04-27 2004-07-29 Alderson Graham Richard Method and apparatus for interoperation between legacy software and screen reader programs
US20060150110A1 (en) * 2004-12-30 2006-07-06 Josef Dietl Matching user interface elements to screen reader functions
CN106406867A (en) * 2016-09-05 2017-02-15 深圳市联谛信息无障碍有限责任公司 Android system-based screen reading method and apparatus
CN107885561A (en) * 2016-09-30 2018-04-06 阿里巴巴集团控股有限公司 The method and device of message interface information is provided
US20180285063A1 (en) * 2017-03-28 2018-10-04 Facebook, Inc. Tooltip Surfacing with a Screen Reader
CN111078339A (en) * 2019-11-29 2020-04-28 苏宁云计算有限公司 Interface element positioning method and device, computer equipment and storage medium
CN111626807A (en) * 2019-02-28 2020-09-04 阿里巴巴集团控股有限公司 Commodity object information processing method and device and electronic equipment

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040145607A1 (en) * 2001-04-27 2004-07-29 Alderson Graham Richard Method and apparatus for interoperation between legacy software and screen reader programs
US20060150110A1 (en) * 2004-12-30 2006-07-06 Josef Dietl Matching user interface elements to screen reader functions
CN106406867A (en) * 2016-09-05 2017-02-15 深圳市联谛信息无障碍有限责任公司 Android system-based screen reading method and apparatus
CN107885561A (en) * 2016-09-30 2018-04-06 阿里巴巴集团控股有限公司 The method and device of message interface information is provided
US20180285063A1 (en) * 2017-03-28 2018-10-04 Facebook, Inc. Tooltip Surfacing with a Screen Reader
CN111626807A (en) * 2019-02-28 2020-09-04 阿里巴巴集团控股有限公司 Commodity object information processing method and device and electronic equipment
CN111078339A (en) * 2019-11-29 2020-04-28 苏宁云计算有限公司 Interface element positioning method and device, computer equipment and storage medium

Similar Documents

Publication Publication Date Title
EP3285185A1 (en) Information retrieval method and apparatus, electronic device and server, computer program and recording medium
US10509540B2 (en) Method and device for displaying a message
CN107229527B (en) Information resource collection method and device and computer readable storage medium
CN108038102B (en) Method and device for recommending expression image, terminal and storage medium
CN107193606B (en) Application distribution method and device
US20180341532A1 (en) Method, terminal device, and computer-readable storage medium for collecting information resources
CN107203398B (en) Application distribution method and device
CN108664303B (en) Webpage content display method and device
CN110110315B (en) To-do item management method and device
CN107193441B (en) Desktop pendant previewing method and device
CN106777016B (en) Method and device for information recommendation based on instant messaging
CN105786944A (en) Method and device for automatically turning pages of browser
CN107402767B (en) Method and device for displaying push message
CN111046210A (en) Information recommendation method and device and electronic equipment
CN110413169B (en) Information display method, device and medium
CN109521938B (en) Method and device for determining data evaluation information, electronic device and storage medium
CN110321042B (en) Interface information display method and device and electronic equipment
CN104951522B (en) Method and device for searching
CN105260088B (en) Information classification display processing method and device
CN116186679A (en) Information display method and device, electronic equipment and storage medium
CN113128181B (en) Information processing method and device
CN110502484B (en) Method, device and medium for displaying file information on mobile terminal
CN113296857A (en) Information barrier-free processing method and device and electronic equipment
CN113918661A (en) Knowledge graph generation method and device and electronic equipment
CN110688181B (en) Content display method and device in notification bar and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
REG Reference to a national code

Ref country code: HK

Ref legal event code: DE

Ref document number: 40057545

Country of ref document: HK