CN111190674A - Unified touch penetration processing method and device, storage medium and all-in-one machine equipment - Google Patents

Unified touch penetration processing method and device, storage medium and all-in-one machine equipment Download PDF

Info

Publication number
CN111190674A
CN111190674A CN201911345736.1A CN201911345736A CN111190674A CN 111190674 A CN111190674 A CN 111190674A CN 201911345736 A CN201911345736 A CN 201911345736A CN 111190674 A CN111190674 A CN 111190674A
Authority
CN
China
Prior art keywords
view
touch
information
penetration
display state
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201911345736.1A
Other languages
Chinese (zh)
Other versions
CN111190674B (en
Inventor
黎小辉
罗益峰
谭贵勇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangzhou Lango Electronic Science and Technology Co Ltd
Original Assignee
Guangzhou Lango Electronic Science and Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Family has litigation
First worldwide family litigation filed litigation Critical https://patents.darts-ip.com/?family=70709363&utm_source=google_patent&utm_medium=platform_link&utm_campaign=public_patent_search&patent=CN111190674(A) "Global patent litigation dataset” by Darts-ip is licensed under a Creative Commons Attribution 4.0 International License.
Application filed by Guangzhou Lango Electronic Science and Technology Co Ltd filed Critical Guangzhou Lango Electronic Science and Technology Co Ltd
Priority to CN201911345736.1A priority Critical patent/CN111190674B/en
Publication of CN111190674A publication Critical patent/CN111190674A/en
Application granted granted Critical
Publication of CN111190674B publication Critical patent/CN111190674B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/451Execution arrangements for user interfaces
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/0416Control or interface arrangements specially adapted for digitisers

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Software Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The invention discloses a method and a device for uniformly processing touch penetration on all-in-one machine equipment, a storage medium and the all-in-one machine equipment, wherein the method comprises the following steps: obtaining view information of android application in real time based on a system layer of an android system running on an all-in-one machine, and updating the view information to a view database based on the view information; when the change of the view database is monitored, obtaining the changed view updating information; acquiring a corresponding updated display state in the view update information, and calling a corresponding touch processing interface in a touch penetration program according to the updated display state; and executing touch penetration in the view update information based on a corresponding touch processing interface in the touch penetration program. In the embodiment of the invention, the problem of touch penetration under the signal source of the all-in-one machine is solved in a unified mode.

Description

Unified touch penetration processing method and device, storage medium and all-in-one machine equipment
Technical Field
The invention relates to the technical field of all-in-one machine penetration prevention, in particular to a method and a device for uniformly processing touch penetration on all-in-one machine equipment, a storage medium and all-in-one machine equipment.
Background
The android system and external signal source display and touch operation are supported on the all-in-one machine, and under the default condition, when a touch screen is clicked, both android and touch under a signal source can respond; when the signal source channel is in the OPS (OpenHDMI) channel, popping up an android OSD menu; when the android menu is touched and operated, the signal source touch cannot respond (responding is called a touch penetration problem); to solve the problem of touch penetration, the processing method is as follows: when the android menu pops up, the menu area is given to a processing touch penetration processing program (a touch screen firmware or a touch data processing program on the android platform), the program records the area, and then according to whether a touch point (with x and y representing the coordinates of the touch point) falls down, the recorded area is included, and if the touch point is included, the data of the point is not sent to the signal source equipment. When the touch operation is performed on the android menu, only the android system has touch response, and no touch response exists under the signal source.
The touch penetration processing program needs to process the touch penetration and tell it by knowing the position (upper left corner and lower right corner coordinates) of the android menu (view) display on the android platform, and the position is the area needing to process the penetration (the upper left corner coordinates [ x ] of the rectangular area)1,y1]And the coordinates of the lower right corner [ x ]2,y2]) (ii) a The common practice is: the android OSD menu program knows the coordinates of the upper left corner and the lower right corner of the android OSD menu program, tells the touch penetration processing program about the area of the android OSD menu program when the android OSD menu program is displayed, tells the touch penetration processing program to delete the area when the android OSD menu program is hidden, and tells the touch penetration processing program about a new area after the android OSD menu program moves; in addition, there may be more than one touch program processing area, and the area is set with 1 ID for identification.
The currently common method for acquiring the android view area and hiding the processing mode has the problem of expansibility; because the information of the region and the movement or hiding of the view come from the application to which the android view belongs, the setting region or the deleting region needs to be called in the source code of the corresponding android application, and corresponding adaptation processing needs to be carried out every time a new android application is added; in addition, for a third-party android application (without source code), it is difficult to handle the touch penetration problem under the platform; if the processing is required, a corresponding interface needs to be provided for a third-party application developer to adapt to development processing; this is often not practical.
Disclosure of Invention
The invention aims to overcome the defects of the prior art, and provides a method and a device for uniformly processing touch penetration on all-in-one machine equipment, a storage medium and the all-in-one machine equipment, which solve the problem of touch penetration under an all-in-one machine signal source in a uniform mode.
In order to solve at least one technical problem, an embodiment of the present invention provides a method for uniformly processing touch penetration on a one-piece device, where the method includes:
obtaining view information of android application in real time based on a system layer of an android system running on an all-in-one machine, and updating the view information to a view database based on the view information;
when the change of the view database is monitored, obtaining the changed view updating information;
acquiring a corresponding updated display state in the view update information, and calling a corresponding touch processing interface in a touch penetration program according to the updated display state;
and executing touch penetration in the view update information based on a corresponding touch processing interface in the touch penetration program.
Optionally, the view information includes a display state, a width, a height, an upper left corner coordinate, a layout parameter, a type, a unique ID, a class name, and creation time of the view;
the display state of the view comprises a display view state, a mobile view state and a hidden view state.
Optionally, the obtaining, in real time, view information of the android application based on the system layer of the android system running on the all-in-one machine includes:
and calling a related interface based on Windows manager of Frameworks in a system layer of the android system running on the all-in-one machine to obtain view information of the android application.
Optionally, the obtaining view information of the android application by invoking a relevant interface based on a WindowManager of frames in a system layer of the android system running on the all-in-one machine includes:
when the view needs to be displayed, an addview method is called by a Windows manager of Frameworks in a system layer of the android system running on the all-in-one machine to create the view of the android application;
obtaining view information of the android application based on onPreDraw in the addview method;
when the view is moved, calling an updateview method based on Windows manager of Frameworks in a system layer of an android system running on the all-in-one machine to obtain view information of the android application;
and when the view is hidden, calling a removeview or settostarte method based on WindowManager of Frameworks in a system layer of the android system running on the all-in-one machine to obtain the view information of the android application.
Optionally, after the updating to the view database based on the view information, the method further includes:
obtaining the view information in the view database through settings in ContentObserver-onChange of a system layer of the android system running on the all-in-one machine;
analyzing substrings of the view information to obtain a display state, a width, a height, a coordinate of an upper left corner, a type and a unique ID (identity) in the view;
and monitoring whether the view database changes or not according to the display state, the width, the height, the upper left corner coordinate, the type and the unique ID in the view.
Optionally, the invoking a corresponding touch processing interface in the touch penetration program according to the updated display state includes:
when the updated display state is a display view state or a mobile view state, calling a setTouchhreughzone interface in a touch penetration program according to the updated display state;
and when the updated display state is the hidden view state, calling a deleetouchhreunghzone interface in the touch penetration program according to the updated display state.
Optionally, the executing touch penetration in the view update information based on a corresponding touch processing interface in the touch penetration program includes:
when the updated display state is a view display state, obtaining the width, height and upper left corner coordinates of the view in the view update information through a setTouchTigroughZone interface in the touch penetration program;
the touch penetration program records the position and the area of the view in the updated display state based on the width, the height and the upper left corner coordinate of the view in the view updating information, and when a touch point falls in the position and the area of the view, touch data of the touch point are not sent to signal source equipment;
when the updating display state is a mobile view state, obtaining the unique ID, the width, the height and the upper left corner coordinate in the view updating information through a setTouchTigroughZone interface in the touch penetration program;
the touch penetration program updates and records the position and the area of the view in the updated display state based on the wide unique ID, the width, the height and the upper left corner coordinate of the view in the view updating information
When a touch point falls in the view position and the view area, touch data of the touch point are not sent to signal source equipment;
when the updating display state is a hidden view state, obtaining the width, the height, the coordinates of the upper left corner, the layout parameters, the type, the unique ID, the class name and the creation time in the view updating information through a deleetouchgrouhpzone interface in the touch penetration program;
the touch penetration process is divided by a view deleting position and area instruction formed on the basis of the width, the height, the upper left corner coordinate, the layout parameter, the type, the class name and the creation time of the view in the view updating information;
the touch data processing program deletes the view position and the area for recording the unique ID by executing the delete view position and area instruction according to the unique ID; and the number of the first and second groups,
and sending the touch point touch data of the view position and the area of the unique ID to the signal source equipment.
In addition, an embodiment of the present invention further provides a unified processing touch penetration device on an all-in-one machine device, where the device includes:
an information obtaining module: the method comprises the steps that a system layer of an android system running on an all-in-one machine is used for obtaining view information of android application in real time, and the view information is updated to a view database;
an information updating module: the view updating method comprises the steps of acquiring changed view updating information when the change of the view database is monitored;
an interface calling module: the device is used for obtaining a corresponding updated display state in the view update information and calling a corresponding touch processing interface in a touch penetration program according to the updated display state;
executing a touch penetration module: and the touch processing interface is used for executing the touch penetration in the view updating information based on the corresponding touch processing interface in the touch penetration program.
In addition, the embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the unified processing touch penetration method described in any one of the above.
An all-in-one machine, comprising:
one or more processors;
a memory;
one or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the one or more processors, the one or more applications configured to: executing the unified processing touch penetration method.
In the embodiment of the invention, the problem of touch penetration under the signal source of the all-in-one machine is solved in a unified mode, the android application does not need to process the area for setting the view, hide or move the position and the like, and the touch penetration processing during the view display of all the android applications is supported; the ID used by penetrating through the area to be processed is touched, and the view ID distributed by an android is directly used, so that uniqueness is guaranteed; the touch processing program directly uses it as the ID of the area; the trouble of managing this area ID in the platform interface is eliminated.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
FIG. 1 is a flow chart of a unified touch penetration processing method on a one-machine device according to an embodiment of the present invention;
FIG. 2 is a schematic structural component diagram of a unified processing touch penetration unit on the all-in-one machine device in the embodiment of the invention;
fig. 3 is a schematic structural composition diagram of the all-in-one machine device in the embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Examples
Referring to fig. 1, fig. 1 is a schematic flow chart of a method for uniformly processing touch penetration on an all-in-one machine device according to an embodiment of the present invention.
As shown in fig. 1, a method for uniformly processing touch penetration on a one-machine device includes:
s11: obtaining view information of android application in real time based on a system layer of an android system running on an all-in-one machine, and updating the view information to a view database based on the view information;
in the specific implementation process of the invention, the view information comprises the display state, the width, the height, the upper left corner coordinate, the layout parameter, the type, the unique ID, the class name and the creation time of the view; the display state of the view comprises a display view state, a mobile view state and a hidden view state.
Further, the obtaining of view information of the android application in real time based on the system layer of the android system running on the all-in-one machine includes: and calling a related interface based on Windows manager of Frameworks in a system layer of the android system running on the all-in-one machine to obtain view information of the android application.
Further, the obtaining of view information of the android application by invoking a relevant interface based on windows manager of frames in a system layer of the android system running on the all-in-one machine includes: when the view needs to be displayed, an addview method is called by a Windows manager of Frameworks in a system layer of the android system running on the all-in-one machine to create the view of the android application; obtaining view information of the android application based on onPreDraw in the addview method; when the view is moved, calling an updateview method based on Windows manager of Frameworks in a system layer of an android system running on the all-in-one machine to obtain view information of the android application; and when the view is hidden, calling a removeview or settostarte method based on WindowManager of Frameworks in a system layer of the android system running on the all-in-one machine to obtain the view information of the android application.
Further, after the updating to the view database based on the view information, the method further includes: obtaining the view information in the view database through settings in ContentObserver-onChange of a system layer of the android system running on the all-in-one machine; analyzing substrings of the view information to obtain a display state, a width, a height, a coordinate of an upper left corner, a type and a unique ID (identity) in the view; and monitoring whether the view database changes or not according to the display state, the width, the height, the upper left corner coordinate, the type and the unique ID in the view.
Specifically, the specific implementation of obtaining the area of the android view and creating, updating or hiding the position row is as follows: files that need to be modified: frames, base, core, java, android, view, windowManagerGlobal. java; 2. the concrete implementation introduction: when the View is displayed, an addView method in WindowManagerGlobal is called, and the method obtains the width and height information of the View through onPreDraw (because the View cannot be taken when the View is not drawn, and cannot be taken when match _ parent or wrap _ content is transmitted in WindowManager. Description of related parameters of View:
action: a display state of view, 0 denotes addview (display menu), 1 denotes removeview (hidden menu), 2 denotes updateview (update menu), 3 denotes setpstate (set up state), wherein 1 and 3 denote hidden view states, 0 denotes display view states, and 2 denotes move view states; w: represents the width of view; h: represents a view high; x, y: coordinates representing the top left corner of view; type: indicates the type of view, activity/dialog is 1, arlertdialog is 2, poupwindow is 1000 or more, and windows is 2000 or more (including toast); the gradient: a layout parameter representing view, such as level, right | level, top, which determines the view position information (coordinates x, y of the top left corner of the view) together with x, v; id: a unique ID representing view; name: a class name representing a view; time: the current time is used for ensuring that the attribute value of the database is set to be different value every time; in the onPreDraw method, View related information is acquired and updated to a View database.
When the view moves, the interface updateViewLayout is called, and when the Activity of the dialog theme is hidden, the interface setStopState is called, which is similar to the onsop of Activity; when the view disappears, removeView is called, and in the above 4 states, the information of the view at that time is written into the database (action is 1, or 3, x is-1, y is-1, and type is-1).
Obtaining the view information in the view database through settings in ContentObserver-onChange of a system layer of the android system running on the all-in-one machine; analyzing substrings of the view information to obtain a display state, a width, a height, a coordinate of an upper left corner, a type and a unique ID in the view; and monitoring whether the view database changes or not according to the display state, width, height, upper left corner coordinate, type and unique ID in the view.
S12: when the change of the view database is monitored, obtaining the changed view updating information;
in the specific implementation process of the invention, when the change of the view database is monitored, the changed view updating information needs to be obtained; particularly in touch-through platform interfaces, this data change is monitored.
S13: acquiring a corresponding updated display state in the view update information, and calling a corresponding touch processing interface in a touch penetration program according to the updated display state;
in a specific implementation process of the present invention, the invoking a corresponding touch processing interface in a touch penetration program according to the updated display state includes: when the updated display state is a display view state or a mobile view state, calling a setTouchhreughzone interface in a touch penetration program according to the updated display state; and when the updated display state is the hidden view state, calling a deleetouchhreunghzone interface in the touch penetration program according to the updated display state.
Specifically, the corresponding view information is taken through settings.System.getString in the ContentObserver-onChange, and then the substring is analyzed to obtain the related update information (necessary action, w, h, x, y, id, type) of the view, and the like.
According to the result of the analysis, the specific calling interface is as follows: when action is 0 or 2, the description is to display view, and settouchgroughzone (id, x, y, x + W, y + h) is called; when actiong is 1 or 3, the description is that view is hidden, and deletotuchthrouthzone (int id) is called.
S14: and executing touch penetration in the view update information based on a corresponding touch processing interface in the touch penetration program.
In a specific implementation process of the present invention, the executing touch penetration in the view update information based on a corresponding touch processing interface in the touch penetration program includes: when the updated display state is a view display state, obtaining the width, height and upper left corner coordinates of the view in the view update information through a setTouchTigroughZone interface in the touch penetration program; the touch penetration program records the position and the area of the view in the updated display state based on the width, the height and the upper left corner coordinate of the view in the view updating information, and when a touch point falls in the position and the area of the view, touch data of the touch point are not sent to signal source equipment; when the updating display state is a mobile view state, obtaining the unique ID, the width, the height and the upper left corner coordinate in the view updating information through a setTouchTigroughZone interface in the touch penetration program; updating and recording the position and the area of the view in the updated display state by the touch penetration program based on the wide unique ID, the width, the height and the upper left corner coordinate of the view in the view updating information, wherein when a touch point falls in the position and the area of the view, the touch data of the touch point is not sent to signal source equipment; when the updating display state is a hidden view state, obtaining the width, the height, the coordinates of the upper left corner, the layout parameters, the type, the unique ID, the class name and the creation time in the view updating information through a deleetouchgrouhpzone interface in the touch penetration program; the touch penetration process is divided by a view deleting position and area instruction formed on the basis of the width, the height, the upper left corner coordinate, the layout parameter, the type, the class name and the creation time of the view in the view updating information; the touch data processing program deletes the view position and the area for recording the unique ID by executing the delete view position and area instruction according to the unique ID; and sending the touch point touch data of the view position and the area of the unique ID to the signal source equipment.
Specifically, the touch penetration processing program may be a touch screen firmware (operating on a touch screen end chip, touch point data including android touch and signal source touch is sent by the touch screen end chip), or a touch data processing program (the signal source touch point data is forwarded to the signal source device through the touch data processing program) operating on an android platform.
Interface of touch penetration handler:
(1) setting an area:
/id: view id, x1, yl: coordinates of upper left corner of area, x2, y 2: lower right corner coordinates of region int TouchTiughZone (int id, int x1, int y1, int x2, int y2)
(2) Deleting the area:
/id: hidden view id/, deleTouch hZone (int id)
Processing of the monitored area:
(1) each region includes an ID field (Id of view), the upper left corner coordinate x of the region1、y1Lower right corner coordinate x2、y2(ii) a (2) When the platform interface calls the interface, finding the corresponding area through the ID for processing, and if the received area command is a setting area command and the ID is not available, adding the corresponding ID area item; if the ID exists, updating the area information corresponding to the ID item; and if a deleting instruction is received, clearing the corresponding ID item, and no longer monitoring the ID area.
In the implementation process, different processing modes are selected according to different update display states, wherein the update display states comprise a display view state, a mobile view state and a hidden view state, and when the view state is displayed, the width, the height and the upper left corner coordinate of the view in the view update information are obtained through a setTouchTigroughZone interface in the touch penetration program; the touch penetration program records the position and the area of the view in the updated display state according to the width, the height and the upper left corner coordinate of the view in the view updating information, and when a touch point falls in the position and the area of the view, touch data of the touch point are not sent to the signal source equipment; when the view state is moved, obtaining the unique ID, the width, the height and the upper left corner coordinate in the view updating information through a setTouchRegurghzone interface in the touch penetration program; the touch penetration program updates and records the position and the area of the view in the updated display state according to the wide unique ID, the width, the height and the upper left corner coordinate of the view in the view updating information, and when a touch point falls in the position and the area of the view, touch data of the touch point are not sent to the signal source equipment; when the view state is hidden, obtaining the width, the height, the upper left corner coordinate, the layout parameter, the type, the unique ID, the class name and the creation time in the view updating information through a deletetouchgrouhzone interface in the touch penetration program; the touch penetration process is divided into a view deleting position and area instruction formed according to the width, the height, the upper left corner coordinate, the layout parameter, the type, the class name and the creation time of the view in the view updating information; the touch data processing program deletes the view position and the area for recording the unique ID by executing the delete view position and area instruction according to the unique ID; and sending the touch point touch data falling on the view position and area of the unique ID to the signal source device.
In the embodiment of the invention, the problem of touch penetration under the signal source of the all-in-one machine is solved in a unified mode, the android application does not need to process the area for setting the view, hide or move the position and the like, and the touch penetration processing during the view display of all the android applications is supported; the ID used by penetrating through the area to be processed is touched, and the view ID distributed by an android is directly used, so that uniqueness is guaranteed; the touch processing program directly uses it as the ID of the area; the trouble of managing this area ID in the platform interface is eliminated.
Examples
Referring to fig. 2, fig. 2 is a schematic structural composition diagram of a unified processing touch penetration device on an all-in-one machine device according to an embodiment of the present invention.
As shown in fig. 2, a unified processing touch penetration apparatus on a kiosk device, the apparatus comprising:
the information obtaining module 21: the method comprises the steps that a system layer of an android system running on an all-in-one machine is used for obtaining view information of android application in real time, and the view information is updated to a view database;
in the specific implementation process of the invention, the view information comprises the display state, the width, the height, the upper left corner coordinate, the layout parameter, the type, the unique ID, the class name and the creation time of the view; the display state of the view comprises a display view state, a mobile view state and a hidden view state.
Further, the obtaining of view information of the android application in real time based on the system layer of the android system running on the all-in-one machine includes: and calling a related interface based on Windows manager of Frameworks in a system layer of the android system running on the all-in-one machine to obtain view information of the android application.
Further, the obtaining of view information of the android application by invoking a relevant interface based on windows manager of frames in a system layer of the android system running on the all-in-one machine includes: when the view needs to be displayed, an addview method is called by a Windows manager of Frameworks in a system layer of the android system running on the all-in-one machine to create the view of the android application; obtaining view information of the android application based on onPreDraw in the addview method; when the view is moved, calling an updateview method based on Windows manager of Frameworks in a system layer of an android system running on the all-in-one machine to obtain view information of the android application; and when the view is hidden, calling a removeview or settostarte method based on WindowManager of Frameworks in a system layer of the android system running on the all-in-one machine to obtain the view information of the android application.
Further, after the updating to the view database based on the view information, the method further includes: obtaining the view information in the view database through settings in ContentObserver-onChange of a system layer of the android system running on the all-in-one machine; analyzing substrings of the view information to obtain a display state, a width, a height, a coordinate of an upper left corner, a type and a unique ID (identity) in the view; and monitoring whether the view database changes or not according to the display state, the width, the height, the upper left corner coordinate, the type and the unique ID in the view.
Specifically, the specific implementation of obtaining the area of the android view and creating, updating or hiding the position row is as follows: files that need to be modified: frames, base, core, java, android, view, windowManagerGlobal. java; 2. the concrete implementation introduction: when the View is displayed, an addView method in WindowManagerGlobal is called, and the method obtains the width and height information of the View through onPreDraw (because the View cannot be taken when the View is not drawn, and cannot be taken when match _ parent or wrap _ content is transmitted in WindowManager. Description of related parameters of View:
action: a display state of view, 0 denotes addview (display menu), 1 denotes removeview (hidden menu), 2 denotes updateview (update menu), 3 denotes setpstate (set up state), wherein 1 and 3 denote hidden view states, 0 denotes display view states, and 2 denotes move view states; w: represents the width of view; h: represents a view high; x, y: coordinates representing the top left corner of view; type: indicates the type of view, activity/dialog is 1, arlertdialog is 2, poupwindow is 1000 or more, and windows is 2000 or more (including toast); the gradient: a layout parameter representing view, such as level, right | level, top, which determines the view position information (coordinates x, y of the top left corner of the view) together with x, v; id: a unique ID representing view; name: a class name representing a view; time: the current time is used for ensuring that the attribute value of the database is set to be different value every time; in the onPreDraw method, View related information is acquired and updated to a View database.
When the view moves, the interface updateViewLayout is called, and when the Activity of the dialog theme is hidden, the interface setStopState is called, which is similar to the onsop of Activity; when the view disappears, removeView is called, and in the above 4 states, the information of the view at that time is written into the database (action is 1, or 3, x is-1, y is-1, and type is-1).
Obtaining the view information in the view database through settings in ContentObserver-onChange of a system layer of the android system running on the all-in-one machine; analyzing substrings of the view information to obtain a display state, a width, a height, a coordinate of an upper left corner, a type and a unique ID in the view; and monitoring whether the view database changes or not according to the display state, width, height, upper left corner coordinate, type and unique ID in the view.
The information updating module 22: the view updating method comprises the steps of acquiring changed view updating information when the change of the view database is monitored;
in the specific implementation process of the invention, when the change of the view database is monitored, the changed view updating information needs to be obtained; particularly in touch-through platform interfaces, this data change is monitored.
The interface calling module 23: the device is used for obtaining a corresponding updated display state in the view update information and calling a corresponding touch processing interface in a touch penetration program according to the updated display state;
in a specific implementation process of the present invention, the invoking a corresponding touch processing interface in a touch penetration program according to the updated display state includes: when the updated display state is a display view state or a mobile view state, calling a setTouchhreughzone interface in a touch penetration program according to the updated display state; and when the updated display state is the hidden view state, calling a deleetouchhreunghzone interface in the touch penetration program according to the updated display state.
Specifically, the corresponding view information is taken through settings.System.getString in the ContentObserver-onChange, and then the substring is analyzed to obtain the related update information (necessary action, w, h, x, y, id, type) of the view, and the like.
According to the result of the analysis, the specific calling interface is as follows: when action is 0 or 2, the description is to display view, and settouchgroughzone (id, x, y, x + W, y + h) is called; when actiong is 1 or 3, the description is that view is hidden, and deletotuchthrouthzone (int id) is called.
Execute the touch penetration module 24: and the touch processing interface is used for executing the touch penetration in the view updating information based on the corresponding touch processing interface in the touch penetration program.
In a specific implementation process of the present invention, the executing touch penetration in the view update information based on a corresponding touch processing interface in the touch penetration program includes: when the updated display state is a view display state, obtaining the width, height and upper left corner coordinates of the view in the view update information through a setTouchTigroughZone interface in the touch penetration program; the touch penetration program records the position and the area of the view in the updated display state based on the width, the height and the upper left corner coordinate of the view in the view updating information, and when a touch point falls in the position and the area of the view, touch data of the touch point are not sent to signal source equipment; when the updating display state is a mobile view state, obtaining the unique ID, the width, the height and the upper left corner coordinate in the view updating information through a setTouchTigroughZone interface in the touch penetration program; updating and recording the position and the area of the view in the updated display state by the touch penetration program based on the wide unique ID, the width, the height and the upper left corner coordinate of the view in the view updating information, wherein when a touch point falls in the position and the area of the view, the touch data of the touch point is not sent to signal source equipment; when the updating display state is a hidden view state, obtaining the width, the height, the coordinates of the upper left corner, the layout parameters, the type, the unique ID, the class name and the creation time in the view updating information through a deleetouchgrouhpzone interface in the touch penetration program; the touch penetration process is divided by a view deleting position and area instruction formed on the basis of the width, the height, the upper left corner coordinate, the layout parameter, the type, the class name and the creation time of the view in the view updating information; the touch data processing program deletes the view position and the area for recording the unique ID by executing the delete view position and area instruction according to the unique ID; and sending the touch point touch data of the view position and the area of the unique ID to the signal source equipment.
Specifically, the touch penetration processing program may be a touch screen firmware (operating on a touch screen end chip, touch point data including android touch and signal source touch is sent by the touch screen end chip), or a touch data processing program (the signal source touch point data is forwarded to the signal source device through the touch data processing program) operating on an android platform.
Interface of touch penetration handler:
(1) setting an area:
/id: id of view, x1, y 1: coordinates of upper left corner of area, x2, y 2: lower right corner coordinates of region int TouchTiughZone (int id, int x1, int y1, int x2, int y2)
(2) Deleting the area:
/id: hidden view id/, deleTouch hZone (int id)
Processing of the monitored area:
(1) each region includes an ID field (Id of view), the upper left corner coordinate x of the region1、y1Lower right corner coordinate x2、y2(ii) a (2) When the platform interface calls the interface, finding the corresponding area through the ID for processing, and if the received area command is a setting area command and the ID is not available, adding the corresponding ID area item; if the ID exists, updating the area information corresponding to the ID item; and if a deleting instruction is received, clearing the corresponding ID item, and no longer monitoring the ID area.
In the implementation process, different processing modes are selected according to different update display states, wherein the update display states comprise a display view state, a mobile view state and a hidden view state, and when the view state is displayed, the width, the height and the upper left corner coordinate of the view in the view update information are obtained through a setTouchTigroughZone interface in the touch penetration program; the touch penetration program records the position and the area of the view in the updated display state according to the width, the height and the upper left corner coordinate of the view in the view updating information, and when a touch point falls in the position and the area of the view, touch data of the touch point are not sent to the signal source equipment; when the view state is moved, obtaining the unique ID, the width, the height and the upper left corner coordinate in the view updating information through a setTouchRegurghzone interface in the touch penetration program; the touch penetration program updates and records the position and the area of the view in the updated display state according to the wide unique ID, the width, the height and the upper left corner coordinate of the view in the view updating information, and when a touch point falls in the position and the area of the view, touch data of the touch point are not sent to the signal source equipment; when the view state is hidden, obtaining the width, the height, the upper left corner coordinate, the layout parameter, the type, the unique ID, the class name and the creation time in the view updating information through a deletetouchgrouhzone interface in the touch penetration program; the touch penetration process is divided into a view deleting position and area instruction formed according to the width, the height, the upper left corner coordinate, the layout parameter, the type, the class name and the creation time of the view in the view updating information; the touch data processing program deletes the view position and the area for recording the unique ID by executing the delete view position and area instruction according to the unique ID; and sending the touch point touch data falling on the view position and area of the unique ID to the signal source device.
In the embodiment of the invention, the problem of touch penetration under the signal source of the all-in-one machine is solved in a unified mode, the android application does not need to process the area for setting the view, hide or move the position and the like, and the touch penetration processing during the view display of all the android applications is supported; the ID used by penetrating through the area to be processed is touched, and the view ID distributed by an android is directly used, so that uniqueness is guaranteed; the touch processing program directly uses it as the ID of the area; the trouble of managing this area ID in the platform interface is eliminated.
Examples
The computer-readable storage medium provided by the embodiments of the present invention stores thereon a computer program, and when the computer program is executed by a processor, the computer program implements the unified processing touch penetration method according to any one of the embodiments. The computer-readable storage medium includes, but is not limited to, any type of disk including floppy disks, hard disks, optical disks, CD-ROMs, and magneto-optical disks, ROMs (Read-Only memories), RAMs (Random access memories), EPROMs (EraSable Programmable Read-Only memories), EEPROMs (Electrically EraSable Programmable Read-Only memories), flash memories, magnetic cards, or optical cards. That is, a storage device includes any medium that stores or transmits information in a form readable by a device (e.g., a computer, a cellular phone), and may be a read-only memory, a magnetic or optical disk, or the like.
The embodiment of the invention also provides a computer application program which runs on a computer and is used for executing the unified touch penetration processing method of any one of the embodiments.
In addition, fig. 3 is a schematic structural composition diagram of the all-in-one conference machine in the embodiment of the present invention.
The embodiment of the invention also provides all-in-one machine equipment, as shown in fig. 3. The all-in-one conference machine comprises a processor 302, a memory 303, an input unit 304, a display unit 305 and the like. Those skilled in the art will appreciate that the device configuration means shown in fig. 3 do not constitute a limitation of all devices and may include more or less components than those shown, or some components in combination. The memory 303 may be used to store the application 301 and various functional modules, and the processor 302 executes the application 301 stored in the memory 303, thereby performing various functional applications of the device and data processing. The memory may be internal or external memory, or include both internal and external memory. The memory may comprise read-only memory (ROM), Programmable ROM (PROM), Electrically Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), flash memory, or random access memory. The external memory may include a hard disk, a floppy disk, a ZIP disk, a usb-disk, a magnetic tape, etc. The disclosed memory includes, but is not limited to, these types of memory. The disclosed memory is by way of example only and not by way of limitation.
The input unit 304 is used for receiving input of signals and receiving keywords input by a user. The input unit 304 may include a touch panel and other input devices. The touch panel can collect touch operations of a user on or near the touch panel (for example, operations of the user on or near the touch panel by using any suitable object or accessory such as a finger, a stylus and the like) and drive the corresponding connecting device according to a preset program; other input devices may include, but are not limited to, one or more of a physical keyboard, function keys (e.g., play control keys, switch keys, etc.), a trackball, a mouse, a joystick, and the like. The display unit 305 may be used to display information input by a user or information provided to the user and various menus of the terminal device. The display unit 305 may take the form of a liquid crystal display, an organic light emitting diode, or the like. The processor 302 is a control center of the terminal device, connects various parts of the entire device using various interfaces and lines, and performs various functions and processes data by operating or executing software programs and/or modules stored in the memory 302 and calling data stored in the memory.
As an embodiment, the all-in-one machine device includes: one or more processors 302, a memory 303, one or more applications 301, wherein the one or more applications 301 are stored in the memory 303 and configured to be executed by the one or more processors 302, and wherein the one or more applications 301 are configured to perform the unified processing touch penetration method of any of the above embodiments.
In the embodiment of the invention, the problem of touch penetration under the signal source of the all-in-one machine is solved in a unified mode, the android application does not need to process the area for setting the view, hide or move the position and the like, and the touch penetration processing during the view display of all the android applications is supported; the ID used by penetrating through the area to be processed is touched, and the view ID distributed by an android is directly used, so that uniqueness is guaranteed; the touch processing program directly uses it as the ID of the area; the trouble of managing this area ID in the platform interface is eliminated.
In addition, the method, the apparatus, the storage medium, and the all-in-one machine for uniformly processing touch penetration on an all-in-one machine device according to the embodiments of the present invention are described in detail above, and a specific example should be used herein to explain the principle and the implementation manner of the present invention, and the description of the above embodiment is only used to help understand the method and the core idea of the present invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.

Claims (10)

1. A unified touch penetration processing method on all-in-one machine equipment is characterized by comprising the following steps:
obtaining view information of android application in real time based on a system layer of an android system running on an all-in-one machine, and updating the view information to a view database based on the view information;
when the change of the view database is monitored, obtaining the changed view updating information;
acquiring a corresponding updated display state in the view update information, and calling a corresponding touch processing interface in a touch penetration program according to the updated display state;
and executing touch penetration in the view update information based on a corresponding touch processing interface in the touch penetration program.
2. The unified processing touch penetration method according to claim 1, wherein the view information comprises a display status, a width, a height, an upper left corner coordinate, a layout parameter, a type, a unique ID, a class name, a creation time of the view;
the display state of the view comprises a display view state, a mobile view state and a hidden view state.
3. The unified processing touch penetration method according to claim 1, wherein the obtaining of view information of an android application in real time based on a system layer of an android system running on an all-in-one machine comprises:
and calling a related interface based on Windows manager of Frameworks in a system layer of the android system running on the all-in-one machine to obtain view information of the android application.
4. The unified processing touch penetration method according to claim 3, wherein the obtaining view information of an android application by invoking a related interface based on a WindowManager of framework in a system layer of an android system running on the all-in-one machine comprises:
when the view needs to be displayed, an addview method is called by a Windows manager of Frameworks in a system layer of the android system running on the all-in-one machine to create the view of the android application;
obtaining view information of the android application based on onPreDraw in the addview method;
when the view is moved, calling an updateview method based on Windows manager of Frameworks in a system layer of an android system running on the all-in-one machine to obtain view information of the android application;
and when the view is hidden, calling a removeview or settostarte method based on WindowManager of Frameworks in a system layer of the android system running on the all-in-one machine to obtain the view information of the android application.
5. The unified processing touch penetration method according to claim 1, wherein after the updating to the view database based on the view information, further comprising:
obtaining the view information in the view database through settings in ContentObserver-onChange of a system layer of the android system running on the all-in-one machine;
analyzing substrings of the view information to obtain a display state, a width, a height, a coordinate of an upper left corner, a type and a unique ID (identity) in the view;
and monitoring whether the view database changes or not according to the display state, the width, the height, the upper left corner coordinate, the type and the unique ID in the view.
6. The method for unified processing of touch penetration according to claim 1, wherein the invoking of the corresponding touch processing interface in the touch penetration program according to the updated display state comprises:
when the updated display state is a display view state or a mobile view state, calling a setTouchhreughzone interface in a touch penetration program according to the updated display state;
and when the updated display state is the hidden view state, calling a deleetouchhreunghzone interface in the touch penetration program according to the updated display state.
7. The unified processing touch penetration method according to claim 6, wherein the performing touch penetration in the view update information based on the corresponding touch processing interface in the touch penetration program comprises:
when the updated display state is a view display state, obtaining the width, height and upper left corner coordinates of the view in the view update information through a setTouchTigroughZone interface in the touch penetration program;
the touch penetration program records the position and the area of the view in the updated display state based on the width, the height and the upper left corner coordinate of the view in the view updating information, and when a touch point falls in the position and the area of the view, touch data of the touch point are not sent to signal source equipment;
when the updating display state is a mobile view state, obtaining the unique ID, the width, the height and the upper left corner coordinate in the view updating information through a setTouchTigroughZone interface in the touch penetration program;
the touch penetration program updates and records the position and the area of the view in the updated display state based on the wide unique ID, the width, the height and the upper left corner coordinate of the view in the view updating information
When a touch point falls in the view position and the view area, touch data of the touch point are not sent to signal source equipment;
when the updating display state is a hidden view state, obtaining the width, the height, the coordinates of the upper left corner, the layout parameters, the type, the unique ID, the class name and the creation time in the view updating information through a deleetouchgrouhpzone interface in the touch penetration program;
the touch penetration process is divided by a view deleting position and area instruction formed on the basis of the width, the height, the upper left corner coordinate, the layout parameter, the type, the class name and the creation time of the view in the view updating information;
the touch data processing program deletes the view position and the area for recording the unique ID by executing the delete view position and area instruction according to the unique ID; and the number of the first and second groups,
and sending the touch point touch data of the view position and the area of the unique ID to the signal source equipment.
8. A unified processing touch penetration apparatus on a kiosk device, the apparatus comprising:
an information obtaining module: the method comprises the steps that a system layer of an android system running on an all-in-one machine is used for obtaining view information of android application in real time, and the view information is updated to a view database;
an information updating module: the view updating method comprises the steps of acquiring changed view updating information when the change of the view database is monitored;
an interface calling module: the device is used for obtaining a corresponding updated display state in the view update information and calling a corresponding touch processing interface in a touch penetration program according to the updated display state;
executing a touch penetration module: and the touch processing interface is used for executing the touch penetration in the view updating information based on the corresponding touch processing interface in the touch penetration program.
9. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, implements the unified processing touch penetration method according to any one of claims 1 to 7.
10. An all-in-one machine, characterized in that it comprises:
one or more processors;
a memory;
one or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the one or more processors, the one or more applications configured to: performing the unified processing touch penetration method according to any one of claims 1 to 7.
CN201911345736.1A 2019-12-23 2019-12-23 Unified touch penetration processing method and device, storage medium and all-in-one machine equipment Active CN111190674B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201911345736.1A CN111190674B (en) 2019-12-23 2019-12-23 Unified touch penetration processing method and device, storage medium and all-in-one machine equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201911345736.1A CN111190674B (en) 2019-12-23 2019-12-23 Unified touch penetration processing method and device, storage medium and all-in-one machine equipment

Publications (2)

Publication Number Publication Date
CN111190674A true CN111190674A (en) 2020-05-22
CN111190674B CN111190674B (en) 2021-08-10

Family

ID=70709363

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201911345736.1A Active CN111190674B (en) 2019-12-23 2019-12-23 Unified touch penetration processing method and device, storage medium and all-in-one machine equipment

Country Status (1)

Country Link
CN (1) CN111190674B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112306331A (en) * 2020-10-26 2021-02-02 广州朗国电子科技有限公司 Touch penetration processing method and device, storage medium and all-in-one machine

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140109091A1 (en) * 2012-10-12 2014-04-17 Citrix Systems, Inc. Device Virtualization
CN106445278A (en) * 2016-08-31 2017-02-22 冠捷显示科技(厦门)有限公司 Control method of transparent suspension window
CN106610784A (en) * 2016-10-18 2017-05-03 广州视源电子科技股份有限公司 Control method and system for multi-system touch screen
CN109375981A (en) * 2018-10-31 2019-02-22 四川长虹教育科技有限公司 Touch exchange method for intelligent interaction large-size screen monitors
CN109885244A (en) * 2019-02-19 2019-06-14 广州视源电子科技股份有限公司 A kind of touch operation response method, device, storage medium and terminal
CN110347325A (en) * 2019-06-05 2019-10-18 广州朗国电子科技有限公司 The touch-proof data penetration transmission method of meeting all-in-one machine, system and meeting integrated machine equipment

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140109091A1 (en) * 2012-10-12 2014-04-17 Citrix Systems, Inc. Device Virtualization
CN106445278A (en) * 2016-08-31 2017-02-22 冠捷显示科技(厦门)有限公司 Control method of transparent suspension window
CN106610784A (en) * 2016-10-18 2017-05-03 广州视源电子科技股份有限公司 Control method and system for multi-system touch screen
CN109375981A (en) * 2018-10-31 2019-02-22 四川长虹教育科技有限公司 Touch exchange method for intelligent interaction large-size screen monitors
CN109885244A (en) * 2019-02-19 2019-06-14 广州视源电子科技股份有限公司 A kind of touch operation response method, device, storage medium and terminal
CN110347325A (en) * 2019-06-05 2019-10-18 广州朗国电子科技有限公司 The touch-proof data penetration transmission method of meeting all-in-one machine, system and meeting integrated machine equipment

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112306331A (en) * 2020-10-26 2021-02-02 广州朗国电子科技有限公司 Touch penetration processing method and device, storage medium and all-in-one machine
CN112306331B (en) * 2020-10-26 2021-10-22 广州朗国电子科技股份有限公司 Touch penetration processing method and device, storage medium and all-in-one machine

Also Published As

Publication number Publication date
CN111190674B (en) 2021-08-10

Similar Documents

Publication Publication Date Title
KR101790190B1 (en) Application scenario identification method, power consumption management method, apparatus, and terminal device
US9317403B2 (en) Method for creating a label
US10656785B2 (en) Method and user equipment for managing application programs
CN106933468A (en) A kind of user interface switching method and terminal
US9678632B2 (en) Data processing method and apparatus
CN105580024A (en) Screenshot method and apparatus
WO2014002812A1 (en) Terminal device, annotation method, computer system, and computer program
CN111124371A (en) Game-based data processing method, device, equipment and storage medium
EP2068542A1 (en) Method and system for providing a user interface to a call center agent which guides him through the conversation with a caller
CN111190674B (en) Unified touch penetration processing method and device, storage medium and all-in-one machine equipment
KR101865343B1 (en) Server-side framework device for development of web service application, method for executing web service application developmed using the same and computer program for the same
EP2360578A1 (en) A method for detecting user screens in mobile devices working under symbian operating system
CN112462994B (en) Method and device for displaying different colors of multiple flying mouse cursors, storage medium and terminal
US7003761B2 (en) Multi-process display method in debugger system
CN114567659B (en) Cloud mobile phone control method, device, equipment and storage medium
CN110727436A (en) Operation interface script execution method and device, terminal equipment and storage medium
JP4250261B2 (en) Method for automatically creating and deleting shortcut buttons and manufacturing apparatus to which these methods are applied
CN112394871B (en) Method and device for supporting android system multi-point touch by Linux platform
CN112612469A (en) Interface element processing method and device and electronic equipment
CN111221723B (en) Test record generation method and device, storage medium and electronic equipment
CN110794986A (en) Conference tablet control method and device based on infrared touch frame and conference tablet
JP5804898B2 (en) Software development support apparatus and program
CN110874143A (en) Sensor data acquisition method, intelligent terminal, storage medium and electronic device
US20060090167A1 (en) Administering return data from execution of commands by a computer operating system
US10019274B2 (en) Menu bar integration in desktop virtualization environments

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CP03 Change of name, title or address

Address after: Room 238, room 406, No.1, Yichuang street, Huangpu District, Guangzhou, Guangdong 510000

Patentee after: Guangzhou langguo Electronic Technology Co.,Ltd.

Address before: 510000 unit a and B, zone 02, 4th floor, No. 136, Gaopu Road, high tech Development Zone, Tianhe District, Guangzhou City, Guangdong Province

Patentee before: GUANGZHOU LANGO ELECTRONIC SCIENCE & TECHNOLOGY Co.,Ltd.

CP03 Change of name, title or address