CN109893852B - Interface information processing method and device - Google Patents
Interface information processing method and device Download PDFInfo
- Publication number
- CN109893852B CN109893852B CN201910142928.6A CN201910142928A CN109893852B CN 109893852 B CN109893852 B CN 109893852B CN 201910142928 A CN201910142928 A CN 201910142928A CN 109893852 B CN109893852 B CN 109893852B
- Authority
- CN
- China
- Prior art keywords
- interface
- target
- dom element
- information
- current
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Landscapes
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses an interface information processing method and device. The method comprises the following steps: in the process of displaying a current interface, acquiring absolute coordinates of a current touch position of a user on the current interface; acquiring target local interface information of a target DOM element corresponding to the absolute coordinates in the current interface; and broadcasting the target local interface information. Through the technical scheme of the invention, even a user with visual impairment can still acquire local interface information of each part in the current page through touch control, so that the user with visual impairment can effectively identify each interface by virtue of screen reading software, and thus, the user with visual impairment can also perform various operations such as games and the like.
Description
Technical Field
The present invention relates to the field of terminal technologies, and in particular, to an interface information processing method and apparatus.
Background
At present, various interfaces such as game interfaces used by users are usually developed through game development engines on the market, but when the interfaces are identified by screen reading software, all interface information of the interfaces are usually subjected to rasterization processing, and then the whole interface as a whole is displayed through only one picture display control (namely one element capable of displaying pictures), so that the whole interface can be used as a picture which can be identified by the screen reading software, but all part interface information in the interface cannot be identified by the screen reading software, and therefore users needing to have eyesight impairment by means of the screen reading software cannot use games and other applications with the interfaces, and therefore inconvenience is brought to users with eyesight impairment, and the users cannot perform various operations such as games.
Disclosure of Invention
The invention provides an interface information processing method and device, which are used for enabling even a user with visual impairment to acquire local interface information of each part in a current page through touch control, so that the user with visual impairment can effectively identify each interface by means of screen reading software, and thus, the user with visual impairment can also perform various operations such as games.
The invention provides an interface information processing method, which comprises the following steps:
in the process of displaying a current interface, acquiring absolute coordinates of a current touch position of a user on the current interface;
acquiring target local interface information of a target DOM element corresponding to the absolute coordinates in the current interface;
and broadcasting the target local interface information.
In one embodiment, the obtaining target local interface information of a target DOM element corresponding to the absolute coordinates in the current interface includes:
determining a target DOM element corresponding to the absolute coordinates in the current interface according to the prestored absolute coordinates of the DOM elements in each interface; each DOM element corresponds to one UI display object, and the UI display objects are different due to the information types of the local interface information of the DOM elements corresponding to the UI display objects;
determining a target UI display object corresponding to the target DOM element;
and determining the value of the attribute information of the target UI display object as the target local interface information, wherein the value of the attribute information of the target UI display object represents the local interface information displayed by the target UI display object and the interface identifier where the target UI display object is located.
In one embodiment, the method further comprises:
determining the information type of interface information to be displayed in an interface to be developed;
creating independent UI display objects for each category of information;
creating a corresponding DOM element for each independent UI display object;
and configuring absolute coordinates for each DOM element, wherein the local interface information of each DOM element is the value of each item of attribute information of the UI display object corresponding to each DOM element.
In one embodiment, the method further comprises:
determining a target DOM element corresponding to the absolute coordinate as a current focus;
highlighting the current focus.
In one embodiment, the method further comprises:
configuring standard absolute coordinates for each DOM element based on a standard display screen;
determining a size relationship between the actual size of the display screen displaying the current interface and the size of the standard display screen;
adjusting the absolute coordinates of each DOM element according to the size relation and the absolute size; wherein:
the DOM element is a single-layer element; the DOM element comprises a DIV element or a CANVAS element.
The present invention also provides an interface information processing apparatus, including:
the first acquisition module is used for acquiring absolute coordinates of a current touch position of a user on a current interface in the process of displaying the current interface;
the second acquisition module is used for acquiring target local interface information of a target DOM element corresponding to the absolute coordinates in the current interface;
and the broadcasting module is used for broadcasting the target local interface information.
In one embodiment, the second obtaining module comprises:
the first determining submodule is used for determining a target DOM element corresponding to the absolute coordinate in the current interface according to the prestored absolute coordinate of each DOM element in each interface; each DOM element corresponds to one UI display object, and the UI display objects are different due to the information types of the local interface information of the DOM elements corresponding to the UI display objects;
the second determining sub-module is used for determining a target UI display object corresponding to the target DOM element;
and a third determining sub-module, configured to determine a value of the attribute information of the target UI display object as the target local interface information, where the value of the attribute information of the target UI display object represents the local interface information displayed by the target UI display object and an interface identifier where the target UI display object is located.
In one embodiment, the apparatus further comprises:
the first determining module is used for determining the information category of the interface information to be displayed in the interface to be developed;
the first establishing module is used for establishing an independent UI display object for each type of information;
the second creating module is used for creating a corresponding DOM element for each independent UI display object;
and the first configuration module is used for configuring absolute coordinates for each DOM element, wherein the local interface information of each DOM element is the value of each item of attribute information of the UI display object corresponding to each DOM element.
In one embodiment, the apparatus further comprises:
the second determining module is used for determining a target DOM element corresponding to the absolute coordinate as a current focus;
and the display module is used for highlighting the current focus.
In one embodiment, the apparatus further comprises:
the second configuration module is used for configuring standard absolute coordinates for each DOM element based on the standard display screen;
a third determining module, configured to determine a size relationship between an actual size of a display screen displaying the current interface and a size of the standard display screen;
the adjusting module is used for adjusting the absolute coordinates of each DOM element according to the size relation and the absolute size; wherein:
the DOM element is a single-layer element; the DOM element includes a DIV element or a CANVAS element.
The technical scheme provided by the embodiment of the disclosure can have the following beneficial effects:
in the process of displaying any one current interface, screen reading software can acquire target local interface information of a target DOM element corresponding to the current interface according to absolute coordinates of the current touch position, so that the target local interface information displayed at the current touch position of a user is broadcasted to the user in a voice mode, the local interface information of each part in a current page can be acquired through touch even if the user with vision impairment is in the touch mode, the user with vision impairment can be ensured to effectively identify each interface by means of the screen reading software, and therefore the user with vision impairment can also perform various operations such as games.
Additional features and advantages of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. The objectives and other advantages of the invention will be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.
The technical solution of the present invention is further described in detail by the accompanying drawings and embodiments.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the principles of the invention and not to limit the invention. In the drawings:
fig. 1 is a flowchart illustrating an interface information processing method according to an exemplary embodiment.
Fig. 2 is a flowchart illustrating another interface information processing method according to an example embodiment.
Fig. 3 is a flowchart illustrating yet another interface information processing method according to an exemplary embodiment.
FIG. 4 is a screenshot illustrating an interface showing a current focus, according to an exemplary embodiment.
FIG. 5 is a screenshot illustrating another interface displayed with current focus, according to an example embodiment.
Fig. 6 is a block diagram illustrating an interface information processing apparatus according to an exemplary embodiment.
Fig. 7 is a block diagram illustrating another interface information processing apparatus according to an example embodiment.
Detailed Description
The preferred embodiments of the present invention will be described in conjunction with the accompanying drawings, and it will be understood that they are described herein for the purpose of illustration and explanation and not limitation.
At present, various interfaces such as game interfaces used by users are usually developed through game development engines on the market, but when the interfaces are identified by screen reading software, all interface information of the interfaces are usually subjected to rasterization processing, and then the whole interface as a whole is displayed through only one picture display control (also called as an element capable of displaying pictures), so that the whole interface can be used as a picture capable of being identified by the screen reading software, but all part interface information in the interface cannot be identified by the screen reading software, and users needing to have eyesight impairment by means of the screen reading software cannot use games and other applications with the interfaces, so that inconvenience is brought to users with eyesight impairment, and the users cannot perform various operations such as games.
In order to solve the problem, the screen reading software can be adapted to each interface, interface information of different parts in each interface can be identified, and the interface can be developed by using a webpage UI element, so that the screen reading software can identify interface information of different positions in the interface by using nested elements (or controls) or elements (such as layout elements) with display effects like a large number of styles and renderings, but the nested elements or the elements with display effects can cause difficult code maintenance and large workload, bring much confusion or obstruction to users with impaired vision, and simultaneously cause interference to the screen reading software or cause the screen reading software to be unable to identify.
In order to solve the above technical problem, an embodiment of the present disclosure provides an interface information processing method, which is applied to an interface information processing program, system or apparatus, and an execution subject of the method is a current device installed with screen reading software, where the current device may be a terminal such as a mobile phone, a tablet, a computer, or a server, and as shown in fig. 1, the method includes steps S101 to S103, where:
in step S101, in the process of displaying the current interface, acquiring an absolute coordinate of a current touch position of a user on the current interface (by screen reading software);
the absolute coordinates are coordinates of the current touch position relative to a reference point on the display screen displaying the current interface.
In step S102, (screen reading software) obtains target local interface information of a target DOM element corresponding to an absolute coordinate in the current interface;
in step S103, the target local interface information is broadcasted (by the screen reading software).
In the process of displaying any one current interface, screen reading software can acquire target local interface information of a target DOM element corresponding to the current interface according to absolute coordinates of the current touch position, so that the target local interface information displayed at the current touch position of a user is broadcasted to the user in a voice mode, the local interface information of each part in a current page can be acquired through touch even if the user with vision impairment is in the touch mode, the user with vision impairment can be ensured to effectively identify each interface by means of the screen reading software, and therefore the user with vision impairment can also perform various operations such as games.
As shown in fig. 2, in an embodiment, the step S102 shown in fig. 1, namely, acquiring the target local interface information of the target DOM element corresponding to the absolute coordinates in the current interface, may include steps S201 to S203:
in step S201, determining a target DOM element corresponding to the absolute coordinates in the current interface according to the prestored absolute coordinates of each DOM element in each interface; each DOM element corresponds to one UI display object, and the UI display objects are different due to the information types of the local interface information of the DOM elements corresponding to the UI display objects;
the information type can be various types such as pictures, characters, buttons, videos, image-text mixtures and the like, and the UI display object is a JavaScript object, wherein the object of the picture of the information type is a picture object, the object of the character of the information type is a character object, the object of the button of the information type is a button object, the object of the video of the information type is a video object, and the object of the image-text mixtures of the information type is an image-text mixture object.
In step S202, a target UI display object corresponding to the target DOM element is determined;
the DOM (Document Object Model) elements are essentially controls, including DIV (positioning technology in cascading Style sheets, which is called DIVision, i.e., partitioning, which may sometimes be called a layer) and/or CANVAS (CANVAS element is used to draw graphics on a web page in the new HTML standard HTML 5).
In step S203, a value of the attribute information of the target UI display object is determined as target local interface information, where the value of the attribute information of the target UI display object represents the local interface information displayed by the target UI display object and an interface identifier where the target UI display object is located, and the interface identifier is used to uniquely identify each interface, and may be an interface number or the like.
The target DOM element corresponding to the absolute coordinate of the current touch position in the current interface can be accurately determined through the prestored absolute coordinates of the DOM elements in each interface, furthermore, a target UI display object corresponding to the target DOM element is determined, and since the interface information displayed by the target UI display object is also the information to be displayed by the target DOM element, values of various attribute information of the target UI display object are usually transferred to the target DOM element to express the part of the interface information through various attribute information of the target DOM element, and thus, the value of the attribute information of the target UI display object may be automatically determined as the target local interface information, therefore, on the basis of screen reading software, a user with visual impairment can acquire local interface information of any part on the interface through finger touch, and the user with visual impairment can use various applications such as games as freely as possible.
In this embodiment, steps S201 to S203 may be implemented by an operating system executing the main body, that is, the screen reading software sends the absolute coordinates of the current touch position to the operating system, the operating system determines the target DOM element, and transmits values of various attribute information of the target UI display object to the target DOM element, so that the screen reading software can acquire the target local interface information through the target DOM element.
As shown in fig. 3, in an embodiment, the method may further include steps S301 to S304:
in step S301, determining an information category of interface information to be displayed in an interface to be developed;
the interface to be developed may be any interface, such as various game interfaces.
When the information category is determined, the information category can be determined according to a dividing instruction of a user on interface information, if the user possibly wants to take certain pictures and characters as one information category, the part of pictures and characters can be taken as picture-text mixed categories according to the instruction of the user, and if the user wants to respectively take the pictures and the characters in a certain area as different information categories, namely, the pictures and the characters are respectively taken as the picture category and the characters category, the part of pictures and the characters can be respectively divided into the picture category and the characters category according to the instruction of the user.
In step S302, an independent UI display object is created for each category of information; the UI displays the object JS object.
Specifically, in a development engine of a game or the like, independent objects, such as a picture object, a text object, a button object, a text-text mixed object, and the like, can be respectively established for each type of information in interface information to be displayed.
In step S303, a corresponding DOM element is created for each independent UI display object;
in step S304, absolute coordinates are configured for each DOM element, where the local interface information of each DOM element is a value of each item of attribute information of the UI display object corresponding to each DOM element.
By creating a corresponding DOM element for each UI display object, wherein the DOM element is a single-layer element, excessive interface codes and large workload caused by the existence of nested elements in an interface and difficulty in maintenance can be avoided; meanwhile, by using the single-layer element, the problem that screen reading software is interfered or the screen reading software cannot identify due to the fact that a large number of elements with display effects such as styles and renderings are needed due to the fact that interface information and structures in an interface are too rich can be avoided.
In addition, all the steps (step S301 to step S304) in this embodiment may be implemented by a development engine, and step S303 to step S304 are improvements to various development engines (such as game development engines) in the prior art, and by creating a corresponding DOM element for each UI display object, the screen reading software can identify description information of different DOM elements in the interface one by one, so as to avoid that, when the screen reading software identifies the display interface, the screen reading software can identify the entire interface as one picture and cannot identify interface information inside the interface because all the UI display objects in one interface can only be displayed through one control (or one element capable of displaying a picture) after rasterization processing.
In one embodiment, the method further comprises:
determining a target DOM element corresponding to the absolute coordinate as a current focus;
the current focus is highlighted.
Determining a target DOM element corresponding to the absolute coordinate as a current focus, so that a user with visual impairment can change the position of the focus by sliding through screen reading software, and further acquiring interface information of different parts in an interface; of course, after the current focus is determined, the current focus may be highlighted.
In addition, when the focus is on a certain app icon, the user can be prompted by voice to open the app by double clicking, so that the user with visual impairment can also play various applications such as games.
In one embodiment, the method further comprises:
configuring standard absolute coordinates for each DOM element based on a standard display screen;
absolute coordinates refer to the coordinates of the DOM element relative to a reference point on the display screen; relative coordinates refer to the coordinates of a DOM element relative to another DOM element.
Determining the size relation between the actual size of a display screen displaying the current interface and the size of a standard display screen;
adjusting the absolute coordinates of each DOM element according to the size relation and the absolute size; wherein:
DOM elements are single-layer elements; the DOM element includes a DIV element or a CANVAS element.
Because the invention is a single-layer element, elements related to styles and layouts in the interface do not need to be used, and in order to realize the layout of the interface, the invention adds coordinate information in each element. The coordinates are absolute coordinates of the screen, a standard screen is defined in the development engine, the actual screen size of a user is read, the screen proportion (namely the dimension relation) is calculated by the coordinates and the actual screen size, and the absolute coordinates in each element are updated by the proportion, so that the developed interface can adapt to display screens with various dimensions.
Compared with the prior art in which nested DOM elements are used, the DOM elements using a single layer in the development engine can avoid the problem that interface content and structure are too complex to maintain codes, and can also avoid the use of elements with display effects such as interface patterns and layouts, which further avoids interference to screen reading software and enables the screen reading software to recognize each part of content in the interface.
The technical solution of the present invention will be further explained below:
aiming at the software applied by the blind, the invention needs to identify the elements of the independent interface information in the interface, and is convenient for the screen reading software to read each element and output corresponding prompts to the blind.
The invention divides the interface information into independent elements, is convenient for screen reading software to read and can be circled by a cursor. The invention improves the development engine. In the development engine, independent objects such as picture objects, text objects, button objects and image-text mixed objects are established for various interface information. Each object is an independent element and is a single-layer element. Elements include DIV and cavnas. The two elements are the elements which are the best compatible with the screen reading software, and other elements can cause the screen reading software not to recognize the elements. A single-layer element means that there is only one layer of DIV or CANVAS, and the DIV is not nested in the DIV (the web page in the prior art allows nesting). Interface information, styles and the like in the elements are realized through attributes and values in the elements.
Because the present invention is a single layer element, elements related to the style and layout in the interface need not be used. In order to realize the interface layout, the invention adds coordinate information in each element. The coordinates are absolute coordinates of the screen, a standard screen is defined in the development engine, and the actual screen size of the user is read, and the screen proportion is calculated by the coordinates and updated by the proportion.
The invention can reduce the interface elements used when the relative coordinate adapts to the screen by using the absolute coordinate.
By utilizing the development engine, various webpages, APP (application) based on the webpages, games and the like can be developed. The developer may determine the object corresponding to each interface information, and adjust various parameters (size, position, and the like of the object) for the object. The development process is simple and convenient, and screen reading software can be supported.
The technical solution of the present invention will be further explained with reference to fig. 4 and 5:
the florist mini-game of fig. 4 was developed using the improved game engine of the present invention, with all elements being recognizable by the screen. The blind can easily and conveniently play games like a naked eye person and operate buttons and the like in the games.
And corresponding prompts are given to the focal point of the screen reading. As shown in fig. 4, if the finger touch position is the flower faery, the control at the flower faery is taken as a focus (the focus can be highlighted by the first frame in fig. 4), and "the flower faery, the impression: 3 stars, click to view details ";
if the finger touch position is the planted flower, the control where the flower with the flowerpot is located is taken as a focus (the focus can be highlighted through a second frame in fig. 4), and a voice prompt is given to 'clover can be harvested after 5 minutes';
if the finger touch position is an empty flowerpot without flowers, the control where the empty flowerpot without flowers is located is taken as a focus (the focus can be highlighted through a third frame in fig. 4), and a voice prompt is given to 'empty flowerpot, and seeds can be purchased for planting';
if the finger touch position is the flowerpot which is not unlocked, the control where the flowerpot which is not unlocked is taken as a focus (the focus can be highlighted through four frames in fig. 4), and the voice prompt is that the flowerpot which is not unlocked can be purchased by flower 1000. "
In addition, the invention can be used for developing games and making common web pages by improving the game engine, and can be well adapted to screen reading software.
As shown in FIG. 5, the large text segment in the interface of FIG. 5 can be divided into small segments for the blind to read. As shown in fig. 5, each box has a control, and the user can slide from top to bottom to sequentially switch the focus of the screen reading, so that the blind can switch the focus by sliding the display screen, and the screen reading software can recognize elements in the web page without any obstacle.
As shown in fig. 6, the present invention also provides an interface information processing apparatus, including:
the first obtaining module 601 is configured to obtain absolute coordinates of a current touch position of a user on a current interface in a process of displaying the current interface;
a second obtaining module 602, configured to obtain target local interface information of a target DOM element corresponding to an absolute coordinate in a current interface;
and the broadcasting module 603 is configured to broadcast the target local interface information.
In one embodiment, the second obtaining module 602 may include:
the first determining submodule is configured to determine a target DOM element corresponding to the absolute coordinates in the current interface according to the prestored absolute coordinates of the DOM elements in each interface; each DOM element corresponds to one UI display object, and the UI display objects are different due to the information types of the local interface information of the DOM elements corresponding to the UI display objects;
the second determining submodule is configured to determine a target UI display object corresponding to the target DOM element;
and the third determining submodule is configured to determine a value of the attribute information of the target UI display object as target local interface information, wherein the value of the attribute information of the target UI display object represents the local interface information displayed by the target UI display object and an interface identifier where the target UI display object is located.
As shown in fig. 7, in one embodiment, the apparatus further comprises:
the first determining module 701 is configured to determine the information category of interface information to be displayed in an interface to be developed;
a first creation module 702 configured to create independent UI display objects for each category of information;
a second creating module 703 configured to create a corresponding DOM element for each independent UI display object;
and a first configuration module 704 configured to configure absolute coordinates for each DOM element, where the local interface information of each DOM element is a value of each item of attribute information of the UI display object corresponding to each DOM element.
In one embodiment, the apparatus further comprises:
the second determination module is configured to determine a target DOM element corresponding to the absolute coordinates as a current focus;
a display module configured to highlight the current focus.
In one embodiment, the apparatus further comprises:
the second configuration module is configured to configure standard absolute coordinates for each DOM element based on the standard display screen;
a third determining module configured to determine a size relationship between an actual size of a display screen showing the current interface and a size of a standard display screen;
the adjusting module is configured to adjust the absolute coordinates of each DOM element according to the size relation and the absolute size; wherein:
DOM elements are single-layer elements; the DOM element includes a DIV element or a CANVAS element.
With regard to the apparatus in the above embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment related to the method, and will not be described in detail here.
Finally, the interface information processing device is suitable for terminal equipment. For example, it may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, an exercise device, a personal digital assistant, etc.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, optical storage, and the like) having computer-usable program code embodied therein.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present invention without departing from the spirit and scope of the invention. Thus, if such modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include such modifications and variations.
Claims (8)
1. An interface information processing method, comprising:
the method comprises the steps that a development engine determines information categories according to the division of interface information needing to be displayed in an interface to be developed by a user;
the development engine creates an independent UI display object for each type of information in the interface information;
the development engine creates a corresponding DOM element for each independent UI display object, and the DOM element is a single-layer element;
the method comprises the steps that a development engine configures absolute coordinates for each DOM element, wherein local interface information of each DOM element is the value of each item of attribute information of a UI display object corresponding to each DOM element;
the development engine generates an interface which can be displayed by the terminal;
in the process of displaying a current interface by a terminal, screen reading software installed in the terminal acquires absolute coordinates of a current touch position of a user on the current interface;
acquiring target local interface information of a target DOM element corresponding to the absolute coordinates in the current interface by screen reading software;
and the screen reading software broadcasts the target local interface information.
2. The method of claim 1,
the obtaining of the target local interface information of the target DOM element corresponding to the absolute coordinate in the current interface includes:
determining a target DOM element corresponding to the absolute coordinates in the current interface according to the prestored absolute coordinates of the DOM elements in each interface; each DOM element corresponds to one UI display object, and the UI display objects are different due to the information types of the local interface information of the DOM elements corresponding to the UI display objects;
determining a target UI display object corresponding to the target DOM element;
and determining the value of the attribute information of the target UI display object as the target local interface information, wherein the value of the attribute information of the target UI display object represents the local interface information displayed by the target UI display object and the interface identifier where the target UI display object is located.
3. The method of claim 1, further comprising:
the screen reading software determines a target DOM element corresponding to the absolute coordinate as a current focus;
and highlighting the current focus by screen reading software.
4. The method according to any one of claims 1 to 3, further comprising:
the development engine configures standard absolute coordinates for each DOM element based on the standard display screen;
the development engine determines the size relation between the actual size of the display screen displaying the current interface and the size of the standard display screen;
the development engine adjusts the absolute coordinates of each DOM element according to the size relation and the absolute size; wherein:
the DOM element includes a DIV element or a CANVAS element.
5. An interface information processing apparatus for a current device installed with screen reading software, comprising:
the first determining module is used for determining the information category according to the division of interface information to be displayed in an interface to be developed by a user by a development engine;
the first establishing module is used for establishing an independent UI display object for each type of information in the interface information by the development engine;
the second creation module is used for creating a corresponding DOM element for each independent UI display object by the development engine, wherein the DOM element is a single-layer element;
the system comprises a first configuration module, a second configuration module and a third configuration module, wherein the first configuration module is used for configuring absolute coordinates for each DOM element by a development engine, and the local interface information of each DOM element is the value of each item of attribute information of a UI display object corresponding to each DOM element; the development engine generates an interface which can be displayed by the terminal;
the terminal comprises a first acquisition module, a second acquisition module and a display module, wherein the first acquisition module is used for acquiring absolute coordinates of a current touch position of a user on a current interface by screen reading software installed in the terminal in the process of displaying the current interface by the terminal;
the second acquisition module is used for acquiring target local interface information of a target DOM element corresponding to the absolute coordinates in the current interface by screen reading software;
and the broadcasting module is used for broadcasting the target local interface information by the screen reading software.
6. The apparatus of claim 5,
the second acquisition module comprises:
the first determining submodule is used for determining a target DOM element corresponding to the absolute coordinate in the current interface according to the prestored absolute coordinate of each DOM element in each interface; each DOM element corresponds to one UI display object, and the UI display objects are different due to the information types of the local interface information of the DOM elements corresponding to the UI display objects;
the second determining sub-module is used for determining a target UI display object corresponding to the target DOM element;
and the third determining submodule is used for determining the value of the attribute information of the target UI display object as the target local interface information, wherein the value of the attribute information of the target UI display object represents the local interface information displayed by the target UI display object and the interface identifier where the target UI display object is located.
7. The apparatus of claim 5, further comprising:
the second determining module is used for determining the target DOM element corresponding to the absolute coordinate as the current focus by the screen reading software;
and the display module is used for highlighting the current focus by the screen reading software.
8. The apparatus of any of claims 5 to 7, further comprising:
the second configuration module is used for configuring standard absolute coordinates for each DOM element by the development engine based on the standard display screen;
the third determining module is used for determining the size relation between the actual size of the display screen displaying the current interface and the size of the standard display screen by the development engine;
the adjusting module is used for adjusting the absolute coordinates of each DOM element by a development engine according to the size relation and the absolute size; wherein:
the DOM element includes a DIV element or a CANVAS element.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910142928.6A CN109893852B (en) | 2019-02-26 | 2019-02-26 | Interface information processing method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910142928.6A CN109893852B (en) | 2019-02-26 | 2019-02-26 | Interface information processing method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109893852A CN109893852A (en) | 2019-06-18 |
| CN109893852B true CN109893852B (en) | 2022-07-26 |
Family
ID=66945585
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910142928.6A Active CN109893852B (en) | 2019-02-26 | 2019-02-26 | Interface information processing method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109893852B (en) |
Families Citing this family (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110337034B (en) * | 2019-07-12 | 2022-02-11 | 青岛海信传媒网络技术有限公司 | User interface display method and display equipment |
| US11093108B2 (en) | 2019-07-12 | 2021-08-17 | Qingdao Hisense Media Networks Ltd. | Method for displaying user interface and display device |
| CN111104301B (en) * | 2019-12-03 | 2021-08-20 | 深圳市联谛信息无障碍有限责任公司 | Method and system for judging barrier user in webpage |
| CN111104037B (en) * | 2019-12-09 | 2023-05-09 | 深圳市联谛信息无障碍有限责任公司 | Method for helping vision handicapped people browse and mobile terminal |
| CN111143016A (en) * | 2019-12-31 | 2020-05-12 | 维沃移动通信有限公司 | Display method and electronic equipment |
| CN112486451B (en) * | 2020-11-27 | 2022-03-11 | 掌阅科技股份有限公司 | Voice broadcasting method, computing device and computer storage medium |
| CN113900618B (en) * | 2021-05-07 | 2023-12-19 | 浙江口碑网络技术有限公司 | Information playing method and device, electronic equipment and storage medium |
| CN113791967B (en) * | 2021-07-27 | 2023-11-28 | 浙江大学 | Focus trapping detection method for mobile phone APP barrier-free screen reading software |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105354013A (en) * | 2014-08-18 | 2016-02-24 | 阿里巴巴集团控股有限公司 | Application interface rendering method and apparatus |
| CN108854072A (en) * | 2018-06-22 | 2018-11-23 | 北京心智互动科技有限公司 | A kind of voice prompt method and device |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101989303B (en) * | 2010-11-02 | 2012-07-04 | 浙江大学 | Automatic barrier-free network detection method |
| US9632614B2 (en) * | 2014-04-01 | 2017-04-25 | International Business Machines Corporation | Expanding touch zones of graphical user interface widgets displayed on a screen of a device without programming changes |
| CN109145231A (en) * | 2017-06-27 | 2019-01-04 | 阿里巴巴集团控股有限公司 | A kind of generation method, device and the electronic equipment of interface element identifier |
-
2019
- 2019-02-26 CN CN201910142928.6A patent/CN109893852B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105354013A (en) * | 2014-08-18 | 2016-02-24 | 阿里巴巴集团控股有限公司 | Application interface rendering method and apparatus |
| CN108854072A (en) * | 2018-06-22 | 2018-11-23 | 北京心智互动科技有限公司 | A kind of voice prompt method and device |
Non-Patent Citations (1)
| Title |
|---|
| 数值计算方法在生物电磁学中的应用;杨军等;《中国组织工程研究与临床康复》(第52期);全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109893852A (en) | 2019-06-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109893852B (en) | Interface information processing method and device | |
| US9870362B2 (en) | Interactive data-driven presentations | |
| CN109460276A (en) | The page and page configuration document generating method, device, terminal device and medium | |
| US11449573B2 (en) | System and method for smart interaction between website components | |
| WO2009039326A1 (en) | Systems and methods for creating, collaborating, and presenting software demonstrations, and methods of marketing of the same | |
| CN104714714A (en) | Mobile terminal desktop control method and device and mobile terminal | |
| EP3218801B1 (en) | Rapid application development method | |
| US20180025471A1 (en) | System for parametric generation of custom scalable animated characters on the web | |
| CN111949360A (en) | User interface adaptation method and device, electronic equipment and storage medium | |
| WO2014133627A1 (en) | Creation of a content display area on a web page | |
| CN110124322B (en) | Color filling method and device for color filling game | |
| JP2024038342A (en) | System and method for smart interaction between website components | |
| CN105989045A (en) | Method, device and system for recommending persuasion content | |
| CN109040767B (en) | Live broadcast room loading method, system, server and storage medium | |
| CN117939229A (en) | Content display method, device, equipment and storage medium based on media information stream | |
| Kuan | Learning Highcharts | |
| Kuan | Learning highcharts 4 | |
| JP2018508061A (en) | Adaptive electronic documents | |
| CN109634610B (en) | Interface marking data generation method and device | |
| CN113312125B (en) | Multi-window adjusting method, system, readable storage medium and electronic equipment | |
| WO2015105804A1 (en) | System and method for generating and using spatial and temporal metadata | |
| CN109976632A (en) | Text animation control methods and device, storage medium and processor | |
| CN109766530B (en) | Method and device for generating chart frame, storage medium and electronic equipment | |
| CN110971955B (en) | Page processing method and device, electronic equipment and storage medium | |
| CN104461615B (en) | A kind of processing method and electronic equipment of skin resource |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |