CN106325851A - Interactive remote cooperation method of Android application - Google Patents
Interactive remote cooperation method of Android application Download PDFInfo
- Publication number
- CN106325851A CN106325851A CN201610649470.XA CN201610649470A CN106325851A CN 106325851 A CN106325851 A CN 106325851A CN 201610649470 A CN201610649470 A CN 201610649470A CN 106325851 A CN106325851 A CN 106325851A
- Authority
- CN
- China
- Prior art keywords
- interface
- cooperation
- interactive
- android application
- application
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F8/00—Arrangements for software engineering
- G06F8/20—Software design
- G06F8/22—Procedural
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F8/00—Arrangements for software engineering
- G06F8/40—Transformation of program code
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F8/00—Arrangements for software engineering
- G06F8/70—Software maintenance or management
- G06F8/72—Code refactoring
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/54—Interprogram communication
- G06F9/546—Message passing systems or structures, e.g. queues
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Software Systems (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Information Transfer Between Computers (AREA)
- Stored Programmes (AREA)
Abstract
The invention belongs to the technical field of software engineering and in particular relates to an interactive remote cooperation method of an Android application. The interactive remote cooperation method comprises: firstly, carrying out automatic analysis and program conversion on an existing Android application installation package to enable the Android application installation package to have an interactive remote cooperation capability; on the basis, after a requester utilizes the Android application with the interactive remote cooperation capability, selecting one region on any interface as a cooperation range and initiating remote cooperation; after a cooperator receives a cooperation request by utilizing a client, automatically generating a simulation interface with interface content which is the same as that in the application cooperation range of the requester, and carrying out interactive cooperation by the cooperator through the simulation interface; in a cooperation process, returning an interface operation event of the cooperator back to a requester application interface and carrying out event responding processing; meanwhile, sending updated content of the requester application interface to the cooperator, so as to update the content of the simulation interface. The method provided by the invention has relatively low network flow and delay and has higher safety.
Description
Technical field
The invention belongs to technical field of software engineering, be specifically related to Android based on user interface application interactive remote
Cheng Xiezuo and corresponding Android application installation kit (APK file) automatically analyzes and Program transformation.
Background technology
User other users that it is frequently necessary to seek help when using Mobile solution carry out remote collaboration.Such as, user is using
Mobile shopping application helps other people to wish when buying commodity, and other users can remotely fill in the letters such as dispensing address, time and contact person
Breath；User carry out configuring on Mobile solution or during fill message cannot complete independently, need to ask household or friend to assist to fill out
Write.Traditional remote collaboration software does not typically the most support the remote collaboration between mobile device, long-range in minority mobile device
Cooperation technology limits cooperation both sides must use the mobile device of particular vendor.Additionally, existing remote collaboration technology is based on screen
Curtain replicates and shares, and needs higher network traffics network delay simultaneously relatively big, and in cooperating process, cooperation part controls completely
Requesting party's equipment, control authority causes greatly and easily the privacy leakage of requesting party.
The present invention is directed to Android application, by automatically dividing existing Android application installation kit (APK file)
Analysis and Program transformation make it have interactive remote collaboration capabilities.Android operation system is currently three big main flow mobile terminal behaviour
Making one of system, the market share is more than more than 80%.Android application generally uses Java language and writes.Java source code
First it is compiled into Java bytecode, is then translated to the bytecode of dex form.Dex bytecode may operate in Android
Dalvik virtual machine on.Android application interface realizes based on Activity assembly.Activity assembly provide with
Interface that user is mutual the life cycle of administration interface.The present invention obtains by analyzing Android application installation kit (APK file)
Take the information of wherein each Activity assembly, and increase interactive remote collaboration capabilities by amendment dex bytecode.
Summary of the invention
It is an object of the invention to provide a kind of Android application interactive remote collaboration method so that user is using
Other users can be asked during Android application to carry out interactive remote based on application interface by network cooperate, simultaneously can
To specify the cooperation scope on interface flexibly.
The Android application interactive remote collaboration method that the present invention provides, its core concept is by answering Android
Add interactive remote collaboration capabilities with automatically analyzing of installation kit (APK file) with Program transformation, use in Android application
During realize interactive remote by the application interface content of lightweight and event synchronization mechanism and cooperate.
Technical scheme is as follows.First, by existing Android application installation kit (APK file) from
Dynamic analysis makes it have interactive remote collaboration capabilities with Program transformation.On this basis, requesting party uses and has interactive mode far
After the Android application of journey collaboration capabilities, a region can be selected on arbitrary interface and as cooperation scope and initiate remotely
Cooperation, its cooperating process is as shown in Figure 1.After cooperation part uses client to accept cooperation request, this client will automatically generate one
Individual modeling interface as the interface content in the range of requestor application cooperation, cooperation part interacts formula by modeling interface
Cooperation.In cooperating process, the interface operation event of cooperation part will pass back on requestor application interface and carry out at event response
Reason, the requestor application interface content after simultaneously updating will be sent to cooperation part and be used for updating modeling interface content.This gently
The interactive remote collaboration method of magnitude has relatively low network traffics and delay, and requesting party can be to interface cooperation scope simultaneously
Carry out fine-grained control, possess higher safety.
The Android application interactive remote collaboration method that the present invention provides, concretely comprises the following steps:
(1) read Android application installation kit (APK file), analyze dex file therein, obtain the most all Activity
The subclass of class and the audiomonitor subclass relevant to View control, insert relevant to interactive remote collaboration method the most wherein
Realize code, then by storehouse one when class and other dex files after transformation and additional interactive remote cooperating operation
Rise and repack and sign, generate the new Android application with interactive remote collaboration capabilities；
(2) requesting party user uses the Android application with interactive remote collaboration capabilities, and on arbitrary application interface, length is pressed
Screen starts remote collaboration mechanism, then chooses a region on screen as cooperation scope, and from the most online other
User select a co actor send request；
(3) cooperation part uses special remote collaboration Android client, receives after the cooperation of requesting party ask and accept, objective
Family end obtains the interface content in the range of cooperating by remote message communication from requesting party's mobile device, and generates on the client
And show an interactive interface simulated；
(4) cooperation part carries out the operations such as content input, click, remote collaboration client capture circle on the interactive interface of simulation
Face alternative events are also sent to requesting party's equipment；
(5), after the application on requesting party's equipment receives cooperation part event message, this event of resetting on current application interface is also drawn
Send out interface content to update, then extract the interface content after updating and send interface content message to cooperation part equipment；
(6) content on simulation interactive interface is updated after the client on cooperation part equipment receives interface content message；
(7) repeated execution of steps (4) arrives step (6), until requesting party terminates whole cooperating process.
Android application interactive remote cooperation transformation in step (1) is without source code, for Android application peace
Dex file in dress bag (APK file) is analyzed and is automatically inserted into and the interactive remote relevant behavior of cooperation and accordingly
Run-time library, then repack to be formed and possess the application of interactive remote collaboration capabilities.Android application interactive remote
The concrete scheme of collaboration capabilities transformation, as shown in Figure 2:
(1) audiomonitor subclass relevant to the variation of View control content in applying for Android, in its event response method
Insert the byte code instruction of the function calling binding interface content change audiomonitor；
(2) for Android apply in Activity subclass, its onCreate, onResume, onPause,
The middle insertion of onDestroy and dispatchTouchEvent method (without being then automatically added to) is called remote collaboration and is sent out
Rise, cooperation scope selects, co actor selects, bind the byte code instruction of the functions such as interface content change audiomonitor；
(3) by the audiomonitor class revised and Activity class and run-time library (containing above-mentioned called function realize class with
And some auxiliary functions realize class) repack together and sign formation improved Android application.
The real time content at interface when interface content in step (3) and step (6) is by running for Android application
Analyze the structured representation obtained.
Accompanying drawing explanation
Fig. 1 is the Android application interactive remote cooperating process figure of the present invention.
Fig. 2 is the schematic diagram of the Android application renovation technique scheme of the present invention.
Fig. 3 is the JSON message examples of interface content.
Fig. 4 is the JSON message examples of interface event.
Detailed description of the invention
As a example by transformation has the Android shopping class application of interactive remote collaboration capabilities, it is described by one below
Collaborative effect:
(1) requesting party user uses this to apply long cooperation by initiation on interface to ask, and screen prompt user selects cooperation scope；
(2) the red frame display cooperation scope after requesting party user chooses cooperation scope, on screen；
(3) screen prompt requesting party user selects co actor；
(4) client that cooperation part uses automatically generates the application interface of a simulation after receiving and accepting cooperation request；
(5) application interface of cooperation part operation simulation, its operation content shows in real time on the interface of requestor application.
In this embodiment, have between Android application and the cooperation part client of interactive remote collaboration capabilities
Communicated by socket message, the interface content transmitted and interface event message use JSON form be packaged (as
Shown in Fig. 3 and Fig. 4).
Be described below Android application interactive remote collaboration capabilities transformation specific embodiments:
(1) use PKUNZIP 7z to decompress Android application installation kit, obtain its dex file, then use instrument
Dex file is read in internal memory and travels through the most all of class by Dex2Jar；
(2) find audiomonitor subclass relevant to the variation of View control content in dex file, insert in its event response method
Call the byte code instruction of the function of binding interface content change audiomonitor；
(3) find all of Activity subclass in dex file, each of which class is judged whether it defines
OnCreate, onResume, onPause, onDestroy and dispatchTouchEvent method, without the most automatic
Generate these methods and be inserted in Activity subclass.Insert in these methods and call remote collaboration initiation, cooperation scope
Select, co actor selects, bind the byte code instruction of the functions such as interface content change audiomonitor；
(4) the audiomonitor class revised and Activity class are re-write disk by Dex2Jar instrument and formed improved
Dex file, then by run-time library (containing above-mentioned called function realize class and some auxiliary functions realize class) with change
Dex file after making is compressed by 7z compressed software and the improved Android of generation that signs applies.
Claims (2)
1. an Android application interactive remote collaboration method, it is characterised in that concretely comprise the following steps:
(1) reading Android application installation kit, this installation kit is APK file, analyzes dex file therein, obtains and wherein owns
The subclass of Activity class and the audiomonitor subclass relevant to View control, insert and interactive remote collaboration method wherein
Relevant realizes code, when the class after then transforming and other dex files and additional interactive remote cooperating operation
Storehouse is repacked together and signs, and generates the new Android application with interactive remote collaboration capabilities；
(2) requesting party user uses the Android application with interactive remote collaboration capabilities, and on arbitrary application interface, length is pressed
Screen starts remote collaboration mechanism, then chooses a region on screen as cooperation scope, and from the most online other
User select a co actor send request；
(3) cooperation part uses special remote collaboration Android client, receives after the cooperation of requesting party ask and accept, objective
Family end obtains the interface content in the range of cooperating by remote message communication from requesting party's mobile device, and generates on the client
And show an interactive interface simulated；
(4) cooperation part carries out content input, clicking operation, remote collaboration client capture interface on the interactive interface of simulation
Alternative events are also sent to requesting party's equipment；
(5), after the application on requesting party's equipment receives cooperation part event message, this event of resetting on current application interface is also drawn
Send out interface content to update, then extract the interface content after updating and send interface content message to cooperation part equipment；
(6) content on simulation interactive interface is updated after the client on cooperation part equipment receives interface content message；
(7) repeated execution of steps (4) arrives step (6), until requesting party terminates whole cooperating process.
Android application interactive remote collaboration method the most according to claim 1, it is characterised in that in step (1)
The cooperation transformation of Android application interactive remote without source code, the flow process of its transformation is:
(1) audiomonitor subclass relevant to the variation of View control content in applying for Android, in its event response method
Insert the byte code instruction of the function calling binding interface content change audiomonitor；
(2) for Android apply in Activity subclass, its onCreate, onResume, onPause,
Insert in onDestroy and dispatchTouchEvent method and call remote collaboration initiation, cooperation scope selects, co actor
Select, bind the byte code instruction of the functions such as interface content change audiomonitor；
(3) the audiomonitor class revised and Activity class are repacked together with run-time library and signed, after forming transformation
Android application.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610649470.XA CN106325851B (en) | 2016-08-10 | 2016-08-10 | Interactive remote collaboration method for Android application |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610649470.XA CN106325851B (en) | 2016-08-10 | 2016-08-10 | Interactive remote collaboration method for Android application |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106325851A true CN106325851A (en) | 2017-01-11 |
| CN106325851B CN106325851B (en) | 2020-05-26 |
Family
ID=57739804
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610649470.XA Active CN106325851B (en) | 2016-08-10 | 2016-08-10 | Interactive remote collaboration method for Android application |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106325851B (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108429810A (en) * | 2018-03-15 | 2018-08-21 | 广东小天才科技有限公司 | A kind of remote-control method and system based on private tutor's equipment |
| CN109144809A (en) * | 2017-06-28 | 2019-01-04 | 武汉斗鱼网络科技有限公司 | A kind of focal variation monitoring method, storage medium, electronic equipment and system |
| CN112286621A (en) * | 2020-12-30 | 2021-01-29 | 智道网联科技(北京)有限公司 | Remote interface generation method and device, electronic equipment and medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102547793A (en) * | 2012-01-10 | 2012-07-04 | 南京邮电大学 | Mobile sensing network management method based on Android platform |
| US20140059467A1 (en) * | 2012-08-21 | 2014-02-27 | Trane International Inc. | Mobile device with graphical user interface for monitoring a building automation system |
| CN104899009A (en) * | 2014-03-03 | 2015-09-09 | 可牛网络技术（北京）有限公司 | Identification method and device of Android application |
| CN105573842A (en) * | 2015-12-21 | 2016-05-11 | 北京奇虎科技有限公司 | Method and device for achieving process recycling in application |
| CN105704225A (en) * | 2016-03-11 | 2016-06-22 | 浪潮(北京)电子信息产业有限公司 | Method and device for small mobile communication terminal to remotely access super computer |
-
2016
- 2016-08-10 CN CN201610649470.XA patent/CN106325851B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102547793A (en) * | 2012-01-10 | 2012-07-04 | 南京邮电大学 | Mobile sensing network management method based on Android platform |
| US20140059467A1 (en) * | 2012-08-21 | 2014-02-27 | Trane International Inc. | Mobile device with graphical user interface for monitoring a building automation system |
| CN104899009A (en) * | 2014-03-03 | 2015-09-09 | 可牛网络技术（北京）有限公司 | Identification method and device of Android application |
| CN105573842A (en) * | 2015-12-21 | 2016-05-11 | 北京奇虎科技有限公司 | Method and device for achieving process recycling in application |
| CN105704225A (en) * | 2016-03-11 | 2016-06-22 | 浪潮(北京)电子信息产业有限公司 | Method and device for small mobile communication terminal to remotely access super computer |
Non-Patent Citations (1)
| Title |
|---|
| 诸姣 等: ""安卓应用系统的功能与权限相关性研究"", 《计算机应用与软件》 * |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109144809A (en) * | 2017-06-28 | 2019-01-04 | 武汉斗鱼网络科技有限公司 | A kind of focal variation monitoring method, storage medium, electronic equipment and system |
| CN109144809B (en) * | 2017-06-28 | 2022-03-25 | 武汉斗鱼网络科技有限公司 | Focus change monitoring method, storage medium, electronic device and system |
| CN108429810A (en) * | 2018-03-15 | 2018-08-21 | 广东小天才科技有限公司 | A kind of remote-control method and system based on private tutor's equipment |
| CN108429810B (en) * | 2018-03-15 | 2021-06-25 | 广东小天才科技有限公司 | Remote control method and system based on family education equipment |
| CN112286621A (en) * | 2020-12-30 | 2021-01-29 | 智道网联科技(北京)有限公司 | Remote interface generation method and device, electronic equipment and medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106325851B (en) | 2020-05-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111669623B (en) | Video special effect processing method and device and electronic equipment | |
| CN108345531B (en) | Test method, device and system | |
| CN108733334A (en) | Image quality parameter adjusting method, device, terminal and storage medium | |
| CN107393013B (en) | Virtual roaming file generation and display method, device, medium, equipment and system | |
| CN102567198B (en) | System and method for testing application program in physical system environment | |
| CN104158836A (en) | Method for rendering mobile application interface through data | |
| CN109800135B (en) | Information processing method and terminal | |
| KR20150043333A (en) | User interface control framework for stamping out controls using a declarative template | |
| CN109828791B (en) | Animation playing method, terminal and computer readable storage medium | |
| CA2539130A1 (en) | System and method for applying development patterns for component based applications | |
| CN105653438B (en) | The striding course automated testing method and device of Android device | |
| CN113268226A (en) | Page data generation method and device, storage medium and equipment | |
| KR20150137911A (en) | user terminal apparatus, communication system and control method thereof | |
| CN106325851A (en) | Interactive remote cooperation method of Android application | |
| CN107102853A (en) | A kind of method for customizing Mobile operating system compatibility Android applications | |
| KR20130017337A (en) | Hybrid app development platform architecture and test method of the same, and computer-readable recording medium with program for the same | |
| CN109522131A (en) | Resource allocation method, device and equipment | |
| CN108875011A (en) | Page status information acquisition method, device, equipment and the medium of third-party application | |
| CN104239202A (en) | Non-Root testing method and system of interactive intelligent equipment | |
| Melchior | Distributed user interfaces in space and time | |
| Korchi et al. | Classification of existing mobile cross-platform approaches | |
| Bryksin et al. | Ubiq Mobile+ QReal a Technology for Development of Distributed Mobile Services | |
| CN104461905A (en) | Method and system for debugging intelligent card virtual machine, API bank and upper layer application at same time | |
| Lin et al. | Simple run-time infrastructure (SRTI): An accessible distributed computing platform for interdisciplinary simulation | |
| CN103246517A (en) | Method for smart client programs to invoke web services to achieve database transaction persistence |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |