CN112565512A - Method and system for acquiring data through screenshot and recording between Android applications - Google Patents
Method and system for acquiring data through screenshot and recording between Android applications Download PDFInfo
- Publication number
- CN112565512A CN112565512A CN202011464333.1A CN202011464333A CN112565512A CN 112565512 A CN112565512 A CN 112565512A CN 202011464333 A CN202011464333 A CN 202011464333A CN 112565512 A CN112565512 A CN 112565512A
- Authority
- CN
- China
- Prior art keywords
- screenshot
- information
- application
- recording
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/04845—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
- G11B20/00—Signal processing not specific to the method of recording or reproducing; Circuits therefor
- G11B20/10—Digital recording or reproducing
- G11B20/10527—Audio or video recording; Data buffering arrangements
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
- G11B20/00—Signal processing not specific to the method of recording or reproducing; Circuits therefor
- G11B20/10—Digital recording or reproducing
- G11B20/10527—Audio or video recording; Data buffering arrangements
- G11B2020/10537—Audio or video recording
- G11B2020/10546—Audio or video recording specifically adapted for audio data
Abstract
The invention discloses a method for acquiring data between Android applications through screenshot and recording. And developing open screen capture and recording functions of mediaproject and Android by utilizing Android5.0 to acquire data of foreground application. And processing the acquired data by using artificial intelligent algorithms such as image recognition, audio recognition and the like as tools and transmitting the processed data to background application. In the past, background application acquires data of foreground application either by a broadcasting mechanism or file storage, and the use range is greatly limited. Or the application needs to acquire root rights, which is neither secure nor cumbersome. However, with the help of more and more mature and popular artificial intelligence image processing and audio processing algorithms, the invention provides the method for acquiring foreground application data without root authority. The invention also discloses a system for acquiring data between Android applications through screenshot and recording.
Description
Technical Field
The invention relates to an Android development technology, and particularly provides a method for acquiring data between Android applications.
Background
Since the birth of Android, Android attracts a large number of users by virtue of its unique advantages and characteristics. In terms of advantages, the Android platform is its openness in the first place. The obvious openness can enable the mobile phone to have more developers, and with the increasing abundance of users and applications, the mobile phone has more and more functions opened to the developers. Developers can utilize rich interfaces that are open for Android. Various practical and convenient applications are created. In the past, a background program needs to acquire the data of foreground application and needs the background application to acquire root authority, so that the method is time-consuming, labor-consuming and unsafe. With the development and maturity of artificial intelligence, the invention provides a method for acquiring data between new Android applications depending on the artificial intelligence.
Disclosure of Invention
The invention aims to provide a method for acquiring data for foreground and background applications of Android equipment aiming at the situation. According to the method, a new data exchange mode between two applications is realized by utilizing the interface class for obtaining the audio and the video opened by the Android. The foreground application can display images and play audio, and the background application can acquire the audio and image display of the foreground application in a recording and screen capturing mode. And the background application transmits the data to a voice recognition module or a video recognition module after acquiring the data. And the voice recognition module or the video recognition module extracts required data from the data and returns the required data to the background application.
In order to achieve the purpose, the invention provides the following technical scheme:
after obtaining the user authorization, the information acquirer application (background application, information acquirer application) may intercept the content displayed on the Android device by the application two (foreground application, information acquirer) by calling the mediaproject interface. And after the information acquirer application acquires the data, the information needed to be used is extracted through image identification by using artificial intelligence. The information acquirer application can also record in real time through the MediaRecorder and the AudioRecorder, and the recording sound source can be sound emitted by a microphone and a mobile phone. After audio data are obtained, useful information in the audio is extracted through audio identification by using artificial intelligence. Thereby enabling applications to more conveniently obtain a wider variety of information and data in this manner.
A method for acquiring data between Android applications through screenshot and recording comprises the following steps:
step 1: and audio acquisition, wherein the information acquirer application records in real time, and the recording sound source can be the sound emitted by a microphone and a mobile phone.
Step 2: and acquiring the audio state, wherein the information acquiring party acquires whether the audio is playing or not by using an Android Audio manager.
And step 3: and voice recognition, namely converting the recording content into character information or other information through a voice dictation interface.
In step 1 of the invention, recording is carried out in real time by calling MediaRecorder and Audio Recorder methods.
The present invention further comprises:
and 4, step 4: the information acquirer application directly acquires the screenshot of the foreground application by calling a screenshot related interface, or the user removes the screenshot, and then the information acquirer application finds out the screenshot file of the user for use;
and 5: and the information acquirer application reads the screen capture file through a file reading interface provided by the Android, reads information data in the screen capture file through image recognition, and returns the information data to the information acquirer application.
In the invention, the information acquirer application calls the screen capture related interface method to include: after the information acquirer application receives a request of an Android user for acquiring foreground application information, if the foreground application, namely the information is allowed to be screenshot by the acquirer application, and the user agrees to screenshot by the information acquirer application and provides screenshot related authority, the information acquirer application performs screenshot on a foreground interface through a screenshot acquiring interface provided by the Android to acquire screenshot data.
The invention discloses a method for finding a screen capture file of a user by an information acquirer application, which comprises the following steps: and after detecting that the user performs screen capture, the information acquirer application reads the screen capture into the application.
The invention also provides a method for acquiring data between Android applications through screenshot and recording, which comprises the following steps:
and 4, step 4: the information acquirer application directly acquires the screenshot of the foreground application by calling a screenshot related interface, or the user removes the screenshot, and then the information acquirer application finds out the screenshot file of the user for use;
and 5: and the information acquirer application reads the screen capture file through a file reading interface provided by the Android, reads information data in the screen capture file through image recognition, and returns the information data to the information acquirer application.
Based on the method, the invention also provides a system for acquiring data between Android applications through screenshot and recording, which comprises the following modules:
the audio acquisition module is used for recording in real time by the application of the information acquisition party, and the recording sound source is the sound emitted by the microphone and the mobile phone;
the voice state acquisition module is used for acquiring whether audio is playing or not by the information acquirer application through an Android Audio manager.
The voice recognition module is used for converting the recording content into character information or other information through the voice dictation interface;
the image acquisition module is used for directly acquiring the screenshot of the foreground application by calling a screenshot related interface by the information acquirer application or removing the screenshot by a user, and then the information acquirer application finds out the screenshot file of the user for use;
and the image identification module is used for reading the screen capture file by the information acquirer application through a file reading interface provided by the Android, reading the information data in the screen capture file through image identification, and returning the information data to the information acquirer application.
The invention has the beneficial effects that:
one of the biggest advantages of Android over other mobile operating systems is its openness. Developers can utilize rich interfaces that are open for Android. Various practical and convenient applications are created. The invention utilizes the audio and video and image acquisition interfaces such as the MediaRecorder, the AudioRecorder and the mediaproject which are open to Android, and is matched with more and more mature artificial intelligence image processing and audio processing algorithms. A new method of acquiring data between foreground and background applications is provided. By the method, the information which cannot be obtained before can be obtained without root authority.
Android mandates that, using mediaproject, a developer of an information acquirer application sets the information acquirer application to allow screen capture by other applications, and at the same time, the information acquirer application is to be granted permission to capture screen display of other applications. Meanwhile, Android can remind a user when screen capturing operation is executed, so that the method is difficult to be used for illegal operations such as malicious acquisition of user information. This increases security over previous background applications that required root rights to obtain foreground data.
Drawings
Fig. 1 is a schematic diagram of a method for acquiring data between Android applications through screenshot and recording.
Detailed Description
The present invention is further described in detail with reference to the following specific examples and the accompanying drawings. The procedures, conditions, experimental methods and the like for carrying out the present invention are general knowledge and common general knowledge in the art except for the contents specifically mentioned below, and the present invention is not particularly limited.
The invention discloses a method for acquiring data between Android applications through screenshot and recording. And developing open screen capture and recording functions of mediaproject and Android by utilizing Android5.0 to acquire data of foreground application. And processing the acquired data by using artificial intelligent algorithms such as image recognition, audio recognition and the like as tools and transmitting the processed data to background application. In the past, background application acquires data of foreground application either by a broadcasting mechanism or file storage, and the use range is greatly limited. Or the application needs to acquire root rights, which is neither secure nor cumbersome. However, with the help of more and more mature and popular artificial intelligence image processing and audio processing algorithms, the invention provides the method for acquiring foreground application data without root authority.
A method for acquiring data between Android applications through screenshot and recording comprises the following steps: the method comprises all of five modules (1: audio acquisition, 2: voice state acquisition, 3: voice recognition, 4: image acquisition and 5: image recognition), or three modules (1: audio acquisition, 2: voice state acquisition and 3: voice recognition) or two modules (4: image acquisition and 5: image recognition).
The audio acquisition method comprises the following steps: and audio acquisition, wherein an information acquisition application can record in real time by calling methods such as a MediaRecorder and an AudioRecorder, and a recording sound source can be the sound emitted by a microphone and a mobile phone.
The audio state acquisition method comprises the following steps: the information acquirer can acquire whether audio is playing or not by using an Android audiomanager.
The voice recognition method comprises the following steps: and converting the recording content into text information or other information through a voice dictation interface.
The image acquisition method comprises the following steps: the information acquirer application can directly acquire the screenshot of the foreground application by calling a screenshot related interface, or the user can remove the screenshot, and then the information acquirer application finds out the screenshot file of the user for use.
The obtaining party application can call a screen capture related interface method, after the first application (the obtaining party application of the information) receives a request of an Android user for obtaining foreground application information, if the second application (the foreground application and the obtained party application of the information) allows the first application to capture the screen, and the user agrees to capture the screen of the first application and provides screen capture related authority, the first application captures the screen of the foreground interface through the screen capture obtaining interface provided by the Android at the background to obtain screen capture data.
The user performs screen capture operation, and the information acquirer application reads the screen capture into the application after detecting that the user performs screen capture.
The image identification method comprises the following steps: and reading the screen capture file by using an interface for reading the file provided by the Android, recognizing and reading the information data in the screen capture file by using an image, and returning the information data to the application I.
Examples
As shown in fig. 1, the foreground application can display images and play audio, and the background application can obtain the audio and image display of the foreground application in a recording and screen-capturing manner. And the background application transmits the data to a voice recognition module or a video recognition module after acquiring the data. And the voice recognition module or the video recognition module extracts required data from the data and returns the required data to the background application.
As shown in fig. 1, the method for acquiring data between Android applications through screenshot and recording includes the following steps.
Step one, a background application acquires data, calls mediaproject to capture a screen of a mobile phone, and stores the screen capture to a specified path in the mobile phone.
Step two, the background application finds the screenshot file through the designated path, transmits the screenshot file to the image recognition module,
step three, after the image recognition module extracts the required data from the screen capture, the required data is returned to the background application
And step four, the information acquisition party can select real-time recording through the MediaRecorder and the AudioRecorder at the same time, and the recording sound source can be the sound emitted by a microphone and a mobile phone. After audio data are obtained, useful information in the audio is extracted through audio identification by using artificial intelligence. Thereby enabling applications to more conveniently obtain a wider variety of information and data in this manner.
The protection of the present invention is not limited to the above embodiments. Variations and advantages that may occur to those skilled in the art may be incorporated into the invention without departing from the spirit and scope of the inventive concept, and the scope of the appended claims is intended to be protected.
Claims (10)
1. A method for acquiring data between Android applications through screenshot and recording is characterized by comprising the following steps:
step 1: audio acquisition, wherein the information acquisition party applies real-time recording, and the recording sound source is the sound emitted by a microphone and a mobile phone;
step 2: and acquiring the audio state, wherein the information acquiring party acquires whether the audio is playing or not by using an Android Audio manager.
And step 3: and voice recognition, namely converting the recording content into character information or other information through a voice dictation interface.
2. The method for acquiring data between Android applications through screenshot and recording as claimed in claim 1, characterized in that in step 1, real-time recording is performed by calling MediaRecorder and AudioRecorder methods.
3. The method for acquiring data between Android applications through screenshot and recording according to claim 1, further comprising:
and 4, step 4: the information acquirer application directly acquires the screenshot of the foreground application by calling a screenshot related interface, or the user removes the screenshot, and then the information acquirer application finds out the screenshot file of the user for use;
and 5: and the information acquirer application reads the screen capture file through a file reading interface provided by the Android, reads information data in the screen capture file through image recognition, and returns the information data to the information acquirer application.
4. The method for acquiring data between Android applications through screenshot and recording as claimed in claim 3, wherein the information acquirer application calls a screenshot-related interface method to include: after the information acquirer application receives a request of an Android user for acquiring foreground application information, if the foreground application, namely the information is allowed to be screenshot by the acquirer application, and the user agrees to screenshot by the information acquirer application and provides screenshot related authority, the information acquirer application performs screenshot on a foreground interface through a screenshot acquiring interface provided by the Android to acquire screenshot data.
5. The method for acquiring data between Android applications through screenshot and recording as claimed in claim 3, wherein the method for the information acquirer application to find the screenshot file of the user comprises the following steps: and after detecting that the user performs screen capture, the information acquirer application reads the screen capture into the application.
6. A method for acquiring data between Android applications through screenshot and recording is characterized by comprising the following steps:
and 4, step 4: the information acquirer application directly acquires the screenshot of the foreground application by calling a screenshot related interface, or the user removes the screenshot, and then the information acquirer application finds out the screenshot file of the user for use;
and 5: and the information acquirer application reads the screen capture file through a file reading interface provided by the Android, reads information data in the screen capture file through image recognition, and returns the information data to the information acquirer application.
7. The method for acquiring data between Android applications through screenshot and recording according to claim 6, wherein the information acquirer application calls a screenshot-related interface method to include: after the information acquirer application receives a request of an Android user for acquiring foreground application information, if the foreground application, namely the information is allowed to be screenshot by the acquirer application, and the user agrees to screenshot by the information acquirer application and provides screenshot related authority, the information acquirer application performs screenshot on a foreground interface through a screenshot acquiring interface provided by the Android to acquire screenshot data.
8. The method for acquiring data between Android applications through screenshot and recording as claimed in claim 6, wherein the method for the information acquirer application to find out the screenshot file of the user comprises the following steps: and after detecting that the user performs screen capture, the information acquirer application reads the screen capture into the application.
9. A system for acquiring data through screenshot and recording between Android applications is characterized by comprising the following modules:
the audio acquisition module is used for recording in real time by the application of the information acquisition party, and the recording sound source is the sound emitted by the microphone and the mobile phone;
the voice state acquisition module is used for acquiring whether audio is playing or not by the information acquirer application through an Android Audio manager.
The voice recognition module is used for converting the recording content into character information or other information through the voice dictation interface;
the image acquisition module is used for directly acquiring the screenshot of the foreground application by calling a screenshot related interface by the information acquirer application or removing the screenshot by a user, and then the information acquirer application finds out the screenshot file of the user for use;
and the image identification module is used for reading the screen capture file by the information acquirer application through a file reading interface provided by the Android, reading the information data in the screen capture file through image identification, and returning the information data to the information acquirer application.
10. The system for acquiring data between Android applications through screenshot and recording according to claim 9, characterized in that the method according to any one of claims 1-8 is adopted.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011464333.1A CN112565512A (en) | 2020-12-14 | 2020-12-14 | Method and system for acquiring data through screenshot and recording between Android applications |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011464333.1A CN112565512A (en) | 2020-12-14 | 2020-12-14 | Method and system for acquiring data through screenshot and recording between Android applications |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112565512A true CN112565512A (en) | 2021-03-26 |
Family
ID=75064148
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011464333.1A Pending CN112565512A (en) | 2020-12-14 | 2020-12-14 | Method and system for acquiring data through screenshot and recording between Android applications |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112565512A (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103312801A (en) * | 2013-06-05 | 2013-09-18 | 上海西本网络科技有限公司 | Application devices, interaction method and system for data between application devices and server |
| US20130346991A1 (en) * | 2012-06-22 | 2013-12-26 | Fujitsu Limited | Method of controlling information processing apparatus, and information processing apparatus |
| CN105827825A (en) * | 2016-02-29 | 2016-08-03 | 维沃移动通信有限公司 | Audio data processing method and mobile terminal |
| CN106028092A (en) * | 2016-05-25 | 2016-10-12 | 天脉聚源(北京)传媒科技有限公司 | Television screenshot sharing method and device |
| US10715651B2 (en) * | 2014-06-26 | 2020-07-14 | EMC IP Holding Company LLC | Multilayer mobile app interface |
-
2020
- 2020-12-14 CN CN202011464333.1A patent/CN112565512A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130346991A1 (en) * | 2012-06-22 | 2013-12-26 | Fujitsu Limited | Method of controlling information processing apparatus, and information processing apparatus |
| CN103312801A (en) * | 2013-06-05 | 2013-09-18 | 上海西本网络科技有限公司 | Application devices, interaction method and system for data between application devices and server |
| US10715651B2 (en) * | 2014-06-26 | 2020-07-14 | EMC IP Holding Company LLC | Multilayer mobile app interface |
| CN105827825A (en) * | 2016-02-29 | 2016-08-03 | 维沃移动通信有限公司 | Audio data processing method and mobile terminal |
| CN106028092A (en) * | 2016-05-25 | 2016-10-12 | 天脉聚源(北京)传媒科技有限公司 | Television screenshot sharing method and device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10135818B2 (en) | User biological feature authentication method and system | |
| WO2021175019A1 (en) | Guide method for audio and video recording, apparatus, computer device, and storage medium | |
| KR20160148009A (en) | Replay attack detection in automatic speaker verification systems | |
| CN111050201B (en) | Data processing method and device, electronic equipment and storage medium | |
| CN104899490A (en) | Terminal positioning method and user terminal | |
| EP3176719A1 (en) | Methods and devices for acquiring certification document | |
| CN104965589A (en) | Human living body detection method and device based on human brain intelligence and man-machine interaction | |
| CN109065038A (en) | A kind of sound control method and system of crime scene investigation device | |
| CN109857505A (en) | Execution method, apparatus, terminal and the storage medium of operation | |
| CN111901567A (en) | Privacy protection method, device, equipment and computer readable storage medium | |
| CN112151038B (en) | Voice replay attack detection method and device, readable storage medium and electronic equipment | |
| WO2021017277A1 (en) | Image capture method and apparatus, and computer storage medium | |
| CN112989299A (en) | Interactive identity recognition method, system, device and medium | |
| KR100827848B1 (en) | Method and system for recognizing person included in digital data and displaying image by using data acquired during visual telephone conversation | |
| CN117235406A (en) | Information content security management and control method and device based on block chain | |
| CN112565512A (en) | Method and system for acquiring data through screenshot and recording between Android applications | |
| CN111161710A (en) | Simultaneous interpretation method and device, electronic equipment and storage medium | |
| Al Hosani et al. | State of the art in digital forensics for small scale digital devices | |
| CN110245485A (en) | A kind of the verifying system and its verification method of combination advertisement video | |
| CN114554131A (en) | High-security smart screen conference content sharing method, system and medium | |
| CN105701378A (en) | Terminal device control method and device | |
| CN111221803B (en) | Feature library management method and coprocessor | |
| CN114265759A (en) | Tracing method and system after data information leakage and electronic equipment | |
| CN115866290A (en) | Video dotting method, device, equipment and storage medium | |
| CN114546939A (en) | Conference summary generation method and device, electronic equipment and readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20210326 |
|
| WD01 | Invention patent application deemed withdrawn after publication |