CN113419650A - Data moving method and device, storage medium and electronic equipment - Google Patents

Data moving method and device, storage medium and electronic equipment Download PDF

Info

Publication number
CN113419650A
CN113419650A CN202110638968.7A CN202110638968A CN113419650A CN 113419650 A CN113419650 A CN 113419650A CN 202110638968 A CN202110638968 A CN 202110638968A CN 113419650 A CN113419650 A CN 113419650A
Authority
CN
China
Prior art keywords
application
data
terminal
mobile
window
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202110638968.7A
Other languages
Chinese (zh)
Inventor
孙飘宇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Oppo Mobile Telecommunications Corp Ltd
Original Assignee
Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Oppo Mobile Telecommunications Corp Ltd filed Critical Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority to CN202110638968.7A priority Critical patent/CN113419650A/en
Publication of CN113419650A publication Critical patent/CN113419650A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/0486Drag-and-drop
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1454Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/451Execution arrangements for user interfaces

Abstract

The application discloses a data moving method, a data moving device, a storage medium and electronic equipment, wherein the method comprises the following steps: the method comprises the steps of sending an application window of a terminal application displayed by a mobile terminal to display equipment for screen projection display, if mobile operation is detected in the display equipment, obtaining mobile operation information corresponding to the mobile operation, sending the mobile operation information to the mobile terminal through the display equipment, obtaining application data and a target terminal application based on the mobile operation information in the mobile terminal, and adding the application data to a terminal application window of the target terminal application. By the adoption of the method and the device, the mobile terminal is controlled to automatically move the application data by obtaining the mobile operation information of the mobile operation executed in the display equipment, so that the screen is projected to use the mobile operation which accords with the operation logic of the display equipment on the display equipment, the terminal equipment can be controlled to complete data movement, steps required by data movement are reduced, the data movement operation efficiency is improved, and the operation effect of the data screen projection is further improved.

Description

Data moving method and device, storage medium and electronic equipment
Technical Field
The present application relates to the field of computer technologies, and in particular, to a data moving method and apparatus, a storage medium, and an electronic device.
Background
With the continuous development and improvement of computer technology, mobile terminals such as mobile phones and tablet computers can be connected with display devices such as computers and smart televisions, application windows of the mobile terminals in the current screens are projected onto screens of the display devices, and therefore users can operate the application windows conveniently. However, when the current moving operation of the application data such as files, characters, pictures and the like between the application windows is performed on the display device, the application data needs to be cached by long pressing at first, the application window is skipped through a specific button, then the application data is copied in the skipped application window by long pressing, and meanwhile, the process of the data moving operation can be synchronized in the mobile terminal.
Disclosure of Invention
The embodiment of the application provides a data moving method and device, a storage medium and electronic equipment, which can reduce steps required by data moving, improve the efficiency of data moving operation and further improve the operation effect of data screen projection. The technical scheme is as follows:
in a first aspect, an embodiment of the present application provides a data moving method, where the method includes:
based on the connection relation with a display device, sending data of an application window of a terminal application displayed by the mobile terminal to the display device so as to perform screen projection display on the application window on the display device;
receiving mobile operation information sent by the display equipment, and acquiring application data and target terminal application based on the mobile operation information;
and adding the application data to a terminal application window of the target terminal application in the mobile terminal, and displaying the terminal application window added with the application data on the mobile terminal, wherein the terminal application window is an application window displayed in the mobile terminal by the target terminal application.
In a second aspect, an embodiment of the present application provides a data moving method, where the method includes:
receiving data of an application window of a terminal application displayed by a mobile terminal based on the connection relation with the mobile terminal, and performing screen projection display on the application window on a screen;
if the mobile operation is detected, mobile operation information corresponding to the mobile operation is acquired;
sending the mobile operation information to the mobile terminal;
the mobile operation information is used for indicating the mobile terminal to add application data to a terminal application window of a target terminal application, the mobile operation information comprises the association information of the application data and the application data of the target terminal application, and the terminal application window is an application window displayed in the mobile terminal by the target terminal application.
In a third aspect, an embodiment of the present application provides a data moving apparatus, where the apparatus includes:
the screen projection sending module is used for sending data of an application window of the terminal application displayed by the mobile terminal to the display equipment based on the connection relation with the display equipment so as to perform screen projection display on the application window on the display equipment;
the data acquisition module is used for receiving the mobile operation information sent by the display equipment and acquiring application data and target terminal application based on the mobile operation information;
and the data adding module is used for adding the application data to a terminal application window of the target terminal application in the mobile terminal and displaying the terminal application window added with the application data on the mobile terminal, wherein the terminal application window is an application window displayed in the mobile terminal by the target terminal application.
In a fourth aspect, an embodiment of the present application provides an information sending apparatus, including:
the screen projection receiving module is used for receiving data of an application window of the terminal application displayed by the mobile terminal based on the connection relation with the mobile terminal and carrying out screen projection display on the application window on a screen;
the information acquisition module is used for acquiring mobile operation information corresponding to the mobile operation if the mobile operation is detected;
the information sending module is used for sending the mobile operation information to the mobile terminal;
the mobile operation information is used for indicating the mobile terminal to add application data to a terminal application window of a target terminal application, the mobile operation information comprises the association information of the application data and the application data of the target terminal application, and the terminal application window is an application window displayed in the mobile terminal by the target terminal application.
In a fifth aspect, embodiments of the present application provide a computer storage medium storing a plurality of instructions adapted to be loaded by a processor and to perform the above-mentioned method steps.
In a sixth aspect, an embodiment of the present application provides an electronic device, which may include: a processor and a memory; wherein the memory stores a computer program adapted to be loaded by the processor and to perform the above-mentioned method steps.
The beneficial effects brought by the technical scheme provided by some embodiments of the application at least comprise:
in one or more embodiments of the application, data of an application window of a terminal application displayed by a mobile terminal in the mobile terminal is sent to a display device for screen projection display, if a mobile operation is detected in the display device, mobile operation information corresponding to the mobile operation is obtained, the mobile operation information is sent to the mobile terminal from the display device, application data and a target terminal application are obtained in the mobile terminal based on the mobile operation information, and the application data is added to the terminal application window of the target terminal application. The mobile terminal is controlled to automatically move the application data by acquiring the mobile operation information of the mobile operation executed in the display equipment, so that the screen is projected on the display equipment by using the mobile operation which accords with the operation logic of the display equipment, the terminal equipment can be controlled to complete data movement, the steps required by data movement are reduced, the data movement operation efficiency is improved, and the operation effect of the data screen projection is further improved.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is an exemplary schematic diagram of interaction between a display device and a mobile terminal according to an embodiment of the present application;
fig. 2 is a schematic flowchart of a data moving method according to an embodiment of the present application;
fig. 3 is a schematic flowchart of a data moving method according to an embodiment of the present application;
fig. 3a is an exemplary schematic diagram of mobile operation information generation provided in an embodiment of the present application;
fig. 3b is a schematic diagram illustrating an example of selecting text information according to an embodiment of the present application;
fig. 4 is a schematic flowchart of a data moving method according to an embodiment of the present application;
fig. 5 is a schematic flowchart of a data moving method according to an embodiment of the present application;
fig. 6 is a schematic flowchart of a data moving method according to an embodiment of the present application;
fig. 7 is a schematic flowchart of a data moving method according to an embodiment of the present application;
fig. 8 is a schematic structural diagram of a data moving apparatus according to an embodiment of the present application;
fig. 9 is a schematic structural diagram of a data moving apparatus according to an embodiment of the present application;
fig. 10 is a schematic structural diagram of a data adding module according to an embodiment of the present application;
fig. 11 is a schematic structural diagram of a window identifier obtaining module according to an embodiment of the present application;
fig. 12 is a schematic structural diagram of an electronic device provided in an embodiment of the present application;
FIG. 13 is a schematic structural diagram of an operating system and a user agent provided in an embodiment of the present application;
FIG. 14 is an architectural diagram of the android operating system of FIG. 12;
FIG. 15 is an architectural diagram of the IOS operating system of FIG. 12;
fig. 16 is a schematic structural diagram of an information transmitting apparatus according to an embodiment of the present application;
fig. 17 is a schematic structural diagram of an information transmitting apparatus according to an embodiment of the present application;
fig. 18 is a schematic structural diagram of an information acquisition module according to an embodiment of the present application;
fig. 19 is a schematic structural diagram of an electronic device according to an embodiment of the present application;
FIG. 20 is a schematic structural diagram of an operating system and a user agent provided in an embodiment of the present application;
FIG. 21 is an architectural diagram of the android operating system of FIG. 19;
FIG. 22 is an architectural diagram of the IOS operating system of FIG. 19.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
In the description of the present application, it is to be understood that the terms "first," "second," and the like are used for descriptive purposes only and are not to be construed as indicating or implying relative importance. In the description of the present application, it is noted that, unless explicitly stated or limited otherwise, "including" and "having" and any variations thereof, are intended to cover non-exclusive inclusions. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those steps or elements listed, but may alternatively include other steps or elements not listed, or inherent to such process, method, article, or apparatus. The specific meaning of the above terms in the present application can be understood in a specific case by those of ordinary skill in the art. Further, in the description of the present application, "a plurality" means two or more unless otherwise specified. "and/or" describes the association relationship of the associated objects, meaning that there may be three relationships, e.g., a and/or B, which may mean: a exists alone, A and B exist simultaneously, and B exists alone. The character "/" generally indicates that the former and latter associated objects are in an "or" relationship.
The data moving method provided by the embodiment of the application can be realized by relying on a computer program, and can run on a data moving device and an information sending device based on a von neumann system. The computer program may be integrated into the application or may run as a separate tool-like application. The data moving device in the embodiment of the application can be a mobile terminal such as a mobile phone, a personal computer, a tablet computer, a handheld device, a vehicle-mounted device, a wearable device and the like, and can also be a module capable of realizing a data moving method in terminal equipment. The information sending device in the embodiment of the application can be a display device such as a personal computer, a tablet computer, an intelligent television, an intelligent projection device and the like, and also can be a module capable of realizing a data moving method in the display device. The mobile terminal can send the data of the application window of the terminal application displayed by the mobile terminal to the display device for displaying, so that the same-screen display is realized, the display device can control the mobile terminal on the screen of the display device, and for example, a mouse can be used for clicking the application window of the mobile terminal to replace a finger to touch, so that the terminal application on the mobile terminal is controlled. The mobile terminal can not only project the application window being displayed on the current mobile terminal screen to the display device, but also send the data of the application window of the terminal application displayed by other mobile terminals in the mobile terminal to the display device for screen projection display according to the selection of the user on the mobile terminal or the display device, thereby realizing multi-screen display. The terminal application window in the embodiment of the application is an application window displayed in the mobile terminal by the terminal application in the mobile terminal, the device application window is an application window displayed in the display device by the terminal application in the mobile terminal, the terminal application window and the device application window are required to be corresponding and synchronous, the operation of the mobile terminal in the terminal application window can be synchronized into the device application window, and the operation of the display device in the device application window can be synchronized into the terminal application window.
Please refer to fig. 1 together, which provides an example schematic diagram of interaction between a display device and a mobile terminal for the embodiment of the present application, where the mobile terminal sends data of an application window of a terminal application displayed by the mobile terminal to the display device for screen projection display, a user may control the mobile terminal through the display device, for example, the user may click the application window with a mouse in fig. 1 to view or share content in the application window, or may use a mobile operation shown with a mouse in fig. 1, that is, content of a terminal application a in the display device is selected with the mouse and dragged to a display window of a terminal application B on the display device, the display device may obtain mobile operation information of the mobile operation and send the mobile operation information to the mobile terminal, and the mobile terminal may implement data movement according to the mobile operation information.
The data moving method provided by the present application is described in detail below with reference to specific embodiments.
Referring to fig. 2, a flow chart of a data moving method is provided in an embodiment of the present application. As shown in fig. 2, the embodiment of the present application is described from both sides of the mobile terminal and the display device, and the method may include the following steps S101 to S105.
S101, the mobile terminal sends data of an application window of a terminal application displayed by the mobile terminal to a display device based on the connection relation with the display device, so that the application window is projected and displayed on the display device.
Specifically, the mobile terminal and the display device may establish a connection relationship in a wired manner or a wireless manner, the mobile terminal sends the application windows of the terminal applications started on the mobile terminal to the display device for screen projection display through the connection relationship, and the display device may display the application windows on the screen after receiving the application windows. An application window displayed on the mobile terminal by the same terminal application is called a terminal application window, an application window displayed on the display device is called a device application window, the terminal application window and the device application window are required to be corresponding and synchronous, the operation of the mobile terminal in the terminal application window can be synchronized into the device application window, and the operation of the display device in the device application window can be synchronized into the terminal application window. It can be understood that multi-screen display, that is, displaying the device application windows of multiple terminal applications simultaneously, can be implemented in the display device.
S102, if the display equipment detects the moving operation, the display equipment acquires moving operation information corresponding to the moving operation.
Specifically, since the display device may simultaneously display device application windows of a plurality of terminal applications, a user may perform a moving operation between the device application windows, for example, when the user wants to add and share a file or application data to the instant chat software, the user may select and drag the application data of one device application window to another device application window for adding the application data to a terminal application corresponding to another device application window. The application data can be files, pictures or text information and the like.
And if the display equipment detects that the movement operation occurs, the display equipment acquires movement operation information corresponding to the movement operation. The mobile operation information is used for instructing the mobile terminal to add application data to a terminal application window of a target terminal application, the mobile operation information includes associated information of the application data and application data of the target terminal application, the associated information of the application data may instruct the mobile terminal to find the application data, for example, a data identifier, a file name, a storage address, and the like of the application data, and the application data of the target terminal application may instruct the mobile terminal to find the target terminal application, for example, an application name, an application package name, and the like of the target terminal application.
S103, the display equipment sends the mobile operation information to the mobile terminal.
Specifically, the display device sends the mobile operation information to the mobile terminal, so that the mobile terminal finds the application data and the target terminal application, and adds and moves the application data to the target terminal application.
And S104, the mobile terminal acquires application data and target terminal application based on the mobile operation information.
Specifically, the mobile terminal acquires application data to be moved and a target terminal application waiting for adding the movement data based on the movement operation information sent by the display device.
S105, adding the application data to a terminal application window of the target terminal application in the mobile terminal, and displaying the terminal application window added with the application data on the mobile terminal.
Specifically, the mobile terminal adds the application data to a terminal application window of the target terminal application, and similarly, due to the corresponding relationship between the terminal application window and the device application window, the target terminal application also displays that the application data is added to the device application window in the device application window on the display device.
In the embodiment of the application, the data of the application window of the terminal application displayed by the mobile terminal in the mobile terminal is sent to the display device for screen projection display, if the mobile operation is detected in the display device, the mobile operation information corresponding to the mobile operation is obtained, the mobile operation information is sent to the mobile terminal from the display device, the application data and the target terminal application are obtained in the mobile terminal based on the mobile operation information, and the application data are added to the terminal application window of the target terminal application. The mobile terminal is controlled to automatically move the application data by acquiring the mobile operation information of the mobile operation executed in the display equipment, so that the screen is projected on the display equipment by using the mobile operation which accords with the operation logic of the display equipment, the terminal equipment can be controlled to complete data movement, the steps required by data movement are reduced, the data movement operation efficiency is improved, and the operation effect of the data screen projection is further improved.
Referring to fig. 3, a flow chart of a data moving method is provided in the present embodiment. As shown in fig. 3, the method of the embodiment of the present application may include the following steps S201 to S208.
S201, the mobile terminal sends data of an application window of a terminal application displayed by the mobile terminal to the display equipment based on the connection relation with the display equipment so as to perform screen projection display on the application window on the display equipment.
Specifically, the mobile terminal and the display device may establish a connection relationship in a wired manner or a wireless manner, the mobile terminal sends the application windows of the terminal applications started on the mobile terminal to the display device for screen projection display through the connection relationship, and the display device may display the application windows on the screen after receiving the application windows. An application window displayed on the mobile terminal by the same terminal application is called a terminal application window, an application window displayed on the display device is called a device application window, the terminal application window and the device application window are required to be corresponding and synchronous, the operation of the mobile terminal in the terminal application window can be synchronized into the device application window, and the operation of the display device in the device application window can be synchronized into the terminal application window. It can be understood that multi-screen display, that is, displaying the device application windows of multiple terminal applications simultaneously, can be implemented in the display device.
S202, if the display device detects the movement operation, the display device acquires a starting point position and an end point position of the movement operation.
Specifically, since the display device may simultaneously display device application windows of a plurality of terminal applications, a user may perform a moving operation between the device application windows, for example, when the user wants to add or share a file or application data to the instant chat software, the user may implement data moving by using the moving operation, and the user may select and drag the application data of one device application window to another device application window for adding the application data to a terminal application corresponding to another device application window. The application data can be files, pictures or text information and the like. If the display device detects that the movement operation occurs, the display device may acquire a start position and an end position of the movement operation.
S203, the display device acquires the starting point coordinate of the starting point position and the window identifier of the application window where the end point position is located, and generates the moving operation information based on the starting point coordinate and the window identifier.
Specifically, each point on the screen of the display device has a corresponding coordinate, which is used for the display device to confirm the position of the mouse, the display device can obtain a starting point coordinate of a starting point position of the moving operation, and the starting point coordinate can indicate the mobile terminal to find the application data on the position corresponding to the starting point coordinate; the application windows opened on the display device all have corresponding window identifications, the window identifications can be numbers, names and the like of the application windows, the display device can obtain the window identification of the application window where the end point position is located, and the window identification can indicate the terminal device to obtain the target terminal application. The display device may generate movement operation information based on the start point coordinates and the window identification, and may transmit the movement operation information to the mobile terminal to instruct the mobile terminal to find the application data and the target terminal application.
It can be understood that the display device may obtain window identifiers corresponding to the start point coordinate and the end point position according to the start point position and the end point position of the mobile operation, and the same mobile terminal may obtain application data or a window corresponding to both the start point position and the end point position of the mobile operation, so that if the display device detects the mobile operation, the start point coordinate of the start point position and the end point coordinate of the end point position of the mobile operation may be obtained, the mobile operation information is generated directly based on the start point coordinate and the end point coordinate, the mobile terminal finds the application data according to the start point coordinate, and finds the corresponding window identifier according to the end point coordinate, and then finds the corresponding target terminal application.
Referring to fig. 3a together, an exemplary schematic diagram for generating mobile operation information is provided for the embodiment of the present application, when a display device detects a mobile operation, a starting point position and an ending point position of the mobile operation are obtained or obtained, as shown in fig. 3a, the starting point position falls on a compressed packet with a file name of "summer social practice", and as long as a starting point coordinate of the starting point position is obtained, a mobile terminal may find application data corresponding to the starting point coordinate according to the starting point coordinate, that is, the compressed packet with the name of "summer social practice"; the terminal position falls in one application window, the display device can acquire the terminal coordinate of the terminal position or the window identifier of the application window, and the mobile terminal can find out which target terminal application the application window belongs to according to the terminal coordinate or the window identifier.
Optionally, when the application data is a file or a picture, the display device obtains the start point coordinate of the start point position and sends the start point coordinate to the mobile terminal, and the mobile terminal can search the corresponding application data. If the display device detects a moving operation, a selected area corresponding to a starting position of the moving operation may be obtained, text information in the selected area is obtained, then a window identifier of an application window where an end position of the moving operation is located is obtained, and the display device may generate moving operation information based on the text information and the window identifier. The selected area can be an area selected after the user clicks a right mouse button to drag.
Referring to fig. 3b together, an exemplary schematic diagram of selecting text information is provided for the embodiment of the present application, a user may click a right mouse button and drag the right mouse button to select text information that is desired to be moved, to form a selected region as shown in fig. 3b, then perform a moving operation on the selected region and drag the selected region to other application windows, after detecting the moving operation, a display device may obtain the selected region corresponding to a start position of the moving operation, obtain text information in the selected region, generate moving operation information based on the text information and a window identifier corresponding to an end position, and send the moving operation information to a mobile terminal.
And S204, the display equipment sends the mobile operation information to the mobile terminal.
Specifically, the display device sends the mobile operation information to the mobile terminal, so that the mobile terminal finds the application data and the target terminal application, and adds and moves the application data to the target terminal application.
S205, the mobile terminal acquires the starting point coordinate and the window identifier carried in the mobile operation information.
Specifically, after receiving the mobile operation information sent by the display device, the mobile terminal may obtain a start coordinate and a window identifier carried in the mobile operation information.
S206, the mobile terminal acquires the data identifier corresponding to the starting point coordinate, acquires the application data corresponding to the data identifier, acquires the application identifier corresponding to the window identifier, and acquires the target terminal application corresponding to the application identifier.
Specifically, the mobile terminal may obtain a data identifier corresponding to the starting point coordinate, where the data representation may be a data name, a data address, and the like, and may obtain corresponding application data according to the data identifier, for example, search for application data with the same name in the mobile terminal according to the data name, or obtain application data in the data address according to the data address. The mobile terminal may obtain an application identifier corresponding to the window identifier, where the application identifier may be an application name and an application package name, and the mobile terminal may obtain a corresponding target terminal application according to the application identifier.
It can be understood that the terminal data may also be application data obtained by obtaining a start point coordinate and an end point coordinate carried in the mobile erasing information, then obtaining a window identifier of an application window of the device where the end point coordinate is located, and obtaining the start point coordinate.
It can be understood that, when the application data is text information, the terminal device obtains the mobile operation information sent by the display device, and obtains the text information and the window identifier carried in the mobile operation information.
And S207, if the mobile terminal acquires the sharing permission of the application data and the data adding permission of the target terminal application, adding the application data to a terminal application window of the target terminal application in the mobile terminal, and displaying the terminal application window added with the application data on the mobile terminal.
Specifically, not all application data in the mobile terminal can be moved and shared, nor all terminal applications can accept to add application data, so that data movement can be completed only by acquiring the sharing authority of the application data and the data addition authority of the target terminal application at the same time.
S208, the display device adds the display image of the application data to the device application window of the target terminal application based on the moving operation.
Specifically, if the application data can successfully realize data movement, the display device may display an animation that drags the display image of the application data to the device application window applied by the target terminal on the screen, where the display image of the application data is an image effect of the application data displayed in the display terminal, and the animation does not have a real operation meaning, but may allow a user to have a better visual experience. Because the terminal application window and the device application window are corresponding and synchronous, as long as the application data can realize data movement, the application data can appear in the terminal application window, namely after the animation on the display device is played, the application data can also appear in the device application window.
And S209, if the mobile terminal does not acquire the sharing authority or the data adding authority, sending addition failure information to display equipment.
Specifically, if the mobile terminal does not acquire the sharing permission or the data adding permission, the mobile terminal sends addition failure information to the real device.
S210, the display device displays the addition failure information on the screen.
Specifically, after receiving the addition failure information, the display device may display the addition failure information on a screen, and similarly, may output the addition failure information by using a language output, a warning tone, or the like.
In the embodiment of the application, the data of the application window of the terminal application displayed by the mobile terminal in the mobile terminal is sent to the display device for screen projection display, if the mobile operation is detected in the display device, the mobile operation information corresponding to the mobile operation is generated based on the starting point coordinate and the window identifier corresponding to the mobile operation, the mobile operation information is sent to the mobile terminal from the display device, the application data and the target terminal application are obtained based on the mobile operation information in the mobile terminal, the sharing authority and the data adding authority are obtained, and then the application data are added to the terminal application window applied by the target terminal, so that the safety of the application data and the target terminal application is guaranteed. The mobile terminal is controlled to automatically move the application data by acquiring the mobile operation information of the mobile operation executed in the display equipment, so that the screen is projected on the display equipment by using the mobile operation which accords with the operation logic of the display equipment, the terminal equipment can be controlled to complete data movement, the steps required by data movement are reduced, the data movement operation efficiency is improved, and the operation effect of the data screen projection is further improved. Meanwhile, the display image of the application data is displayed on a screen in the display equipment and added into an equipment application window of the target terminal application, so that the visual experience of a user is enriched, and the use effect is further improved.
Referring to fig. 4, a flow chart of a data moving method is provided in the present embodiment. As shown in fig. 4, the embodiment of the present application is described from the mobile terminal side, and the method may include the following steps S301 to S303.
S301, based on the connection relation with a display device, sending the data of the application window of the terminal application displayed by the mobile terminal to the display device, so as to perform screen projection display on the application window on the display device.
Specifically, the mobile terminal and the display device may establish a connection relationship in a wired manner or a wireless manner, the mobile terminal sends the application windows of the terminal applications started on the mobile terminal to the display device for screen projection display through the connection relationship, and the display device may display the application windows on the screen after receiving the application windows. An application window displayed on the mobile terminal by the same terminal application is called a terminal application window, an application window displayed on the display device is called a device application window, the terminal application window and the device application window are required to be corresponding and synchronous, the operation of the mobile terminal in the terminal application window can be synchronized into the device application window, and the operation of the display device in the device application window can be synchronized into the terminal application window. It can be understood that multi-screen display, that is, displaying the device application windows of multiple terminal applications simultaneously, can be implemented in the display device.
S302, receiving the mobile operation information sent by the display device, and acquiring application data and target terminal application based on the mobile operation information.
The mobile terminal receives mobile operation information of a mobile operation executed in a display device, where the mobile operation information is used to instruct the mobile terminal to add application data to a terminal application window of a target terminal application, the mobile operation information includes associated information of the application data and the application data of the target terminal application, the associated information of the application data may instruct the mobile terminal to find the application data, such as a data identifier, a file name, a storage address, and the like of the application data, and the application data of the target terminal application may instruct the mobile terminal to find the target terminal application, such as an application name, an application package name, and the like of the target terminal application. And then the mobile terminal acquires the application data and the target terminal application according to the mobile operation information.
S303, adding the application data to a terminal application window of the target terminal application in the mobile terminal, and displaying the terminal application window added with the application data on the mobile terminal.
Specifically, the mobile terminal adds the application data to a terminal application window of the target terminal application, and similarly, due to the corresponding relationship between the terminal application window and the device application window, the target terminal application also displays that the application data is added to the device application window in the device application window on the display device.
In the embodiment of the application, based on the connection relation with the display device, the data of the application window of the terminal application displayed by the mobile terminal are sent to the display device, so that the display device can display the application window in a screen projection mode, if the display device detects the mobile operation, the mobile operation information corresponding to the mobile operation is obtained, the mobile operation information is sent to the mobile terminal, and the mobile terminal obtains the application data and the target terminal application based on the mobile operation information and adds the application data to the terminal application window of the target terminal application. The mobile terminal is controlled to automatically move the application data by acquiring the mobile operation information of the mobile operation executed in the display equipment, so that the screen is projected on the display equipment by using the mobile operation which accords with the operation logic of the display equipment, the terminal equipment can be controlled to complete data movement, the steps required by data movement are reduced, the data movement operation efficiency is improved, and the operation effect of the data screen projection is further improved.
Referring to fig. 5, a flow chart of a data moving method is provided in the present embodiment. As shown in fig. 5, the method may include the following steps S401 to S405.
S401, based on the connection relation with a display device, sending the data of the application window of the terminal application displayed by the mobile terminal to the display device, so as to perform screen projection display on the application window on the display device.
Specifically, the mobile terminal and the display device may establish a connection relationship in a wired manner or a wireless manner, the mobile terminal sends the application windows of the terminal applications started on the mobile terminal to the display device for screen projection display through the connection relationship, and the display device may display the application windows on the screen after receiving the application windows. An application window displayed on the mobile terminal by the same terminal application is called a terminal application window, an application window displayed on the display device is called a device application window, the terminal application window and the device application window are required to be corresponding and synchronous, the operation of the mobile terminal in the terminal application window can be synchronized into the device application window, and the operation of the display device in the device application window can be synchronized into the terminal application window. It can be understood that multi-screen display, that is, displaying the device application windows of multiple terminal applications simultaneously, can be implemented in the display device.
S402, obtaining the mobile operation information sent by the display equipment, and obtaining the starting point coordinate and the window identifier carried in the mobile operation information.
Specifically, after receiving the mobile operation information sent by the display device, the mobile terminal may obtain a start point coordinate and a window identifier carried in the mobile operation information, where the start point coordinate may indicate that the mobile terminal finds the application data at a position corresponding to the start point coordinate, the window identifier may be a number, a name, and the like of an application window, the display device may obtain a window identifier of an application window where the end point position is located, and the window identifier may indicate that the terminal device obtains the application of the target terminal.
S403, acquiring a data identifier corresponding to the starting point coordinate, acquiring application data corresponding to the data identifier, acquiring an application identifier corresponding to the window identifier, and acquiring a target terminal application corresponding to the application identifier.
Specifically, the mobile terminal may obtain a data identifier corresponding to the starting point coordinate, where the data representation may be a data name, a data address, and the like, and may obtain corresponding application data according to the data identifier, for example, search for application data with the same name in the mobile terminal according to the data name, or obtain application data in the data address according to the data address. The mobile terminal may obtain an application identifier corresponding to the window identifier, where the application identifier may be an application name and an application package name, and the mobile terminal may obtain a corresponding target terminal application according to the application identifier.
Optionally, the mobile terminal may obtain the mobile operation information sent by the display device, obtain a start point coordinate and an end point coordinate carried in the mobile operation information, then obtain a window identifier of an application window of the device where the end point coordinate is located, obtain application data indicated by the start point coordinate, and obtain a target terminal application corresponding to the window identifier.
Optionally, when the application data is a file or a picture, the display device obtains the start point coordinate of the start point position and sends the start point coordinate to the mobile terminal, and the mobile terminal can search the corresponding application data. If the display device detects a moving operation, a selected area corresponding to a starting position of the moving operation may be obtained, text information in the selected area is obtained, then a window identifier of an application window where an end position of the moving operation is located is obtained, and the display device may generate moving operation information based on the text information and the window identifier. The selected area can be an area selected after the user clicks a right mouse button to drag. The mobile terminal can acquire the mobile operation information sent by the display device, acquire character information and window identification carried in the mobile operation information, and then acquire the target terminal application corresponding to the window identification.
S404, if the sharing permission of the application data and the data adding permission of the target terminal application are obtained, adding the application data to a terminal application window of the target terminal application in the mobile terminal, and displaying the terminal application window added with the application data on the mobile terminal.
Specifically, not all application data in the mobile terminal can be moved and shared, nor all terminal applications can accept to add application data, so that data movement can be completed only by acquiring the sharing authority of the application data and the data addition authority of the target terminal application at the same time.
S405, if the sharing authority or the data adding authority is not acquired, adding failure information is sent to the display device.
Specifically, if the mobile terminal does not acquire the sharing permission or the data addition permission, the mobile terminal sends addition failure information to the real device, so as to prompt the user that the data corresponding to the mobile operation fails to be moved.
In the embodiment of the application, based on the connection relation with the display device, the data of the application window of the terminal application displayed by the mobile terminal is sent to the display device for screen projection display, the mobile operation information sent by the display device is obtained, the mobile terminal obtains the application data and the target terminal application based on the mobile operation information, obtains the sharing authority and the data adding authority, and then adds the application data to the terminal application window of the target terminal application, so that the safety of the application data and the target terminal application is guaranteed. The mobile terminal is controlled to automatically move the application data by acquiring the mobile operation information of the mobile operation executed in the display equipment, so that the screen is projected on the display equipment by using the mobile operation which accords with the operation logic of the display equipment, the terminal equipment can be controlled to complete data movement, the steps required by data movement are reduced, the data movement operation efficiency is improved, and the operation effect of the data screen projection is further improved.
Referring to fig. 6, a flow chart of a data moving method is provided in the present embodiment. As shown in fig. 6, the method may include the following steps S501 to S503.
S501, receiving data of an application window of a terminal application displayed by the mobile terminal based on the connection relation with the mobile terminal, and performing screen projection display on the application window on a screen.
Specifically, the mobile terminal and the display device may establish a connection relationship in a wired manner or a wireless manner, the mobile terminal sends the application windows of the terminal applications started on the mobile terminal to the display device for screen projection display through the connection relationship, and the display device may display the application windows on the screen after receiving the application windows. An application window displayed on the mobile terminal by the same terminal application is called a terminal application window, an application window displayed on the display device is called a device application window, the terminal application window and the device application window are required to be corresponding and synchronous, the operation of the mobile terminal in the terminal application window can be synchronized into the device application window, and the operation of the display device in the device application window can be synchronized into the terminal application window. It can be understood that multi-screen display, that is, displaying the device application windows of multiple terminal applications simultaneously, can be implemented in the display device.
And S502, if the moving operation is detected, obtaining moving operation information corresponding to the moving operation.
Specifically, since the display device may simultaneously display device application windows of a plurality of terminal applications, a user may perform a moving operation between the device application windows, for example, when the user wants to add and share a file or application data to the instant chat software, the user may select and drag the application data of one device application window to another device application window for adding the application data to a terminal application corresponding to another device application window. The application data can be files, pictures or text information and the like.
And if the display equipment detects that the movement operation occurs, the display equipment acquires movement operation information corresponding to the movement operation. The mobile operation information is used for instructing the mobile terminal to add application data to a terminal application window of a target terminal application, the mobile operation information includes associated information of the application data and application data of the target terminal application, the associated information of the application data may instruct the mobile terminal to find the application data, for example, a data identifier, a file name, a storage address, and the like of the application data, and the application data of the target terminal application may instruct the mobile terminal to find the target terminal application, for example, an application name, an application package name, and the like of the target terminal application.
S503, sending the mobile operation information to the mobile terminal.
Specifically, the display device sends the mobile operation information to the mobile terminal, so that the mobile terminal finds the application data and the target terminal application, and adds and moves the application data to the target terminal application.
In the embodiment of the application, data of an application window of a terminal application displayed by a mobile terminal in the mobile terminal is received based on a connection relation with the mobile terminal, screen projection display is carried out on a screen, if the mobile operation is detected, mobile operation information corresponding to the mobile operation is obtained, and the mobile operation information is sent to the mobile terminal. The mobile terminal is controlled to automatically move the application data by acquiring the mobile operation information of the mobile operation executed in the display equipment, so that the screen is projected on the display equipment by using the mobile operation which accords with the operation logic of the display equipment, the terminal equipment can be controlled to complete data movement, the steps required by data movement are reduced, the data movement operation efficiency is improved, and the operation effect of the data screen projection is further improved.
Referring to fig. 7, a flow chart of a data moving method is provided in the present embodiment. As shown in fig. 7, the method may include the following steps S601 to S605, which are described in the embodiment of the present application from the display device side.
S601, receiving data of an application window of a terminal application displayed by the mobile terminal based on the connection relation with the mobile terminal, and performing screen projection display on the application window on a screen.
Specifically, the mobile terminal and the display device may establish a connection relationship in a wired manner or a wireless manner, the mobile terminal sends the application windows of the terminal applications started on the mobile terminal to the display device for screen projection display through the connection relationship, and the display device may display the application windows on the screen after receiving the application windows. An application window displayed on the mobile terminal by the same terminal application is called a terminal application window, an application window displayed on the display device is called a device application window, the terminal application window and the device application window are required to be corresponding and synchronous, the operation of the mobile terminal in the terminal application window can be synchronized into the device application window, and the operation of the display device in the device application window can be synchronized into the terminal application window. It can be understood that multi-screen display, that is, displaying the device application windows of multiple terminal applications simultaneously, can be implemented in the display device.
S602, if the moving operation is detected, acquiring a starting point position and an end point position of the moving operation.
Specifically, since the display device may simultaneously display device application windows of a plurality of terminal applications, a user may perform a moving operation between the device application windows, for example, when the user wants to add or share a file or application data to the instant chat software, the user may implement data moving by using the moving operation, and the user may select and drag the application data of one device application window to another device application window for adding the application data to a terminal application corresponding to another device application window. The application data can be files, pictures or text information and the like. If the display device detects that the movement operation occurs, the display device may acquire a start position and an end position of the movement operation.
S603, obtaining the starting point coordinate of the starting point position and the window identifier of the application window where the end point position is located, and generating the moving operation information based on the starting point coordinate and the window identifier.
See S203 specifically, and will not be described herein.
S604, based on the moving operation, adding the display image of the application data to the device application window of the target terminal application.
Specifically, if the application data can successfully realize data movement, the display device may display an animation that drags the display image of the application data to the device application window applied by the target terminal on the screen, where the display image of the application data is an image effect of the application data displayed in the display terminal, and the animation does not have a real operation meaning, but may allow a user to have a better visual experience. Because the terminal application window and the device application window are corresponding and synchronous, as long as the application data can realize data movement, the application data can appear in the terminal application window, namely after the animation on the display device is played, the application data can also appear in the device application window.
S605, if the mobile terminal does not acquire the sharing authority of the application data and the data adding authority applied by the target terminal, receiving the adding failure information sent by the mobile terminal, and displaying the adding failure information on the screen.
Specifically, not all application data in the mobile terminal can be moved and shared, nor all terminal applications can accept to add application data, so that data movement can be completed only by acquiring the sharing authority of the application data and the data addition authority of the target terminal application at the same time. If the mobile terminal does not acquire the sharing authority or the data adding authority, the mobile terminal sends adding failure information to the real device, after the display device receives the adding failure information, the adding failure information can be displayed on a screen, and similarly, the adding failure information can also be output by means of language output, prompt tones and the like.
In the embodiment of the application, data of an application window of a terminal application displayed by a mobile terminal in the mobile terminal is received based on a connection relation with the mobile terminal, screen projection display is performed on a screen, if a mobile operation is detected, mobile operation information corresponding to the mobile operation is generated based on a starting point coordinate and a window identifier corresponding to the mobile operation, the mobile operation information is sent to the mobile terminal, and the mobile terminal acquires sharing authority and data adding authority of the application data and a target terminal application based on the mobile operation information and then adds the application data to the terminal application window of the target terminal application, so that the safety of the application data and the target terminal application is guaranteed. The mobile terminal is controlled to automatically move the application data by acquiring the mobile operation information of the mobile operation executed in the display equipment, so that the screen is projected on the display equipment by using the mobile operation which accords with the operation logic of the display equipment, the terminal equipment can be controlled to complete data movement, the steps required by data movement are reduced, the data movement operation efficiency is improved, and the operation effect of the data screen projection is further improved. Meanwhile, the display image of the application data is added to the device application window of the target terminal application on the screen of the display device, so that the visual experience of a user is enriched, and the use effect is further improved.
The data moving device provided by the embodiment of the present application will be described in detail with reference to fig. 8 to 11. It should be noted that the data moving apparatus in fig. 8-11 is used to execute the method of the embodiment shown in fig. 4 and fig. 5 of the present application. For convenience of explanation, only the parts related to the embodiments of the present application are shown, and details of the technology are not disclosed, please refer to the embodiments shown in fig. 4 to fig. 5 of the present application.
Referring to fig. 8, a schematic structural diagram of a data moving apparatus according to an exemplary embodiment of the present application is shown. The data movement device may be implemented as all or part of a device in software, hardware, or a combination of both. The device 1 comprises a screen projection sending module 11, a data acquisition module 12 and a data adding module 13.
A screen projection sending module 11, configured to send data of an application window of a terminal application displayed by the mobile terminal to a display device based on a connection relationship with the display device, so as to perform screen projection display on the application window on the display device;
a data obtaining module 12, configured to receive mobile operation information sent by the display device, and obtain application data and a target terminal application based on the mobile operation information;
a data adding module 13, configured to add the application data to a terminal application window of the target terminal application in the mobile terminal, and display the terminal application window after the application data is added on the mobile terminal, where the terminal application window is an application window displayed in the mobile terminal by the target terminal application.
In the embodiment of the application, based on the connection relation with the display device, the data of the application window of the terminal application displayed by the mobile terminal are sent to the display device, so that the display device can display the application window in a screen projection mode, if the display device detects the mobile operation, the mobile operation information corresponding to the mobile operation is obtained, the mobile operation information is sent to the mobile terminal, and the mobile terminal obtains the application data and the target terminal application based on the mobile operation information and adds the application data to the terminal application window of the target terminal application. The mobile terminal is controlled to automatically move the application data by acquiring the mobile operation information of the mobile operation executed in the display equipment, so that the screen is projected on the display equipment by using the mobile operation which accords with the operation logic of the display equipment, the terminal equipment can be controlled to complete data movement, the steps required by data movement are reduced, the data movement operation efficiency is improved, and the operation effect of the data screen projection is further improved.
Referring to fig. 9, a schematic structural diagram of a data moving apparatus according to an exemplary embodiment of the present application is shown. The data movement device may be implemented as all or part of a device in software, hardware, or a combination of both. The device 1 comprises a screen projection sending module 11, a data acquisition module 12, a data adding module 13, a coordinate acquisition module 14, a window identifier acquisition module 15 and a text information acquisition module 16.
A screen projection sending module 11, configured to send data of an application window of a terminal application displayed by the mobile terminal to a display device based on a connection relationship with the display device, so as to perform screen projection display on the application window on the display device;
a data obtaining module 12, configured to receive mobile operation information sent by the display device, and obtain application data and a target terminal application based on the mobile operation information;
a data adding module 13, configured to add the application data to a terminal application window of the target terminal application in the mobile terminal, and display the terminal application window to which the application data is added on the mobile terminal, where the terminal application window is an application window displayed in the mobile terminal by the target terminal application;
specifically, please refer to fig. 10 together, which provides a schematic structural diagram of a data adding module according to an embodiment of the present application. As shown in fig. 10, the data adding module 13 may include:
a data adding unit 131, configured to add the application data to a terminal application window of the target terminal application in the mobile terminal if the sharing permission of the application data and the data adding permission of the target terminal application are obtained, and display the terminal application window to which the application data is added on the mobile terminal;
a failure information sending unit 132, configured to send addition failure information to the display device if the sharing permission or the data addition permission is not obtained.
A coordinate obtaining module 14, configured to obtain the mobile operation information sent by the display device, and obtain a start point coordinate and an end point coordinate carried in the mobile operation information;
acquiring a window identifier of an equipment application window where the terminal point coordinate is located;
the indicated application data and the target terminal application corresponding to the window identification are obtained;
a window identifier obtaining module 15, configured to obtain the mobile operation information sent by the display device, and obtain a starting point coordinate and a window identifier carried in the mobile operation information;
acquiring application data indicated by the starting point coordinates, and acquiring a target terminal application corresponding to the window identifier;
the window identification is the number of a device application window where the end position of the mobile operation is located in the display device;
specifically, please refer to fig. 11, which provides a schematic structural diagram of a window identifier obtaining module according to an embodiment of the present application.
As shown in fig. 11, the window identifier obtaining module 15 may include:
a data obtaining unit 151, configured to obtain a data identifier corresponding to the starting point coordinate, and obtain application data corresponding to the data identifier;
an application obtaining unit 152, configured to obtain an application identifier corresponding to the window identifier, and obtain a target terminal application corresponding to the application identifier.
Optionally, the data obtaining unit 151 is specifically configured to obtain a data address corresponding to the starting point coordinate, and obtain application data in the data address.
The text information acquisition module 16 is configured to acquire the mobile operation information sent by the display device, and acquire text information and a window identifier carried in the mobile operation information;
and acquiring the target terminal application corresponding to the window identifier.
In the embodiment of the application, based on the connection relation with the display device, the data of the application window of the terminal application displayed by the mobile terminal is sent to the display device for screen projection display, the mobile operation information sent by the display device is obtained, the mobile terminal obtains the application data and the target terminal application based on the mobile operation information, obtains the sharing authority and the data adding authority, and then adds the application data to the terminal application window of the target terminal application, so that the safety of the application data and the target terminal application is guaranteed. The mobile terminal is controlled to automatically move the application data by acquiring the mobile operation information of the mobile operation executed in the display equipment, so that the screen is projected on the display equipment by using the mobile operation which accords with the operation logic of the display equipment, the terminal equipment can be controlled to complete data movement, the steps required by data movement are reduced, the data movement operation efficiency is improved, and the operation effect of the data screen projection is further improved.
Referring to fig. 12, a block diagram of an electronic device according to an exemplary embodiment of the present application is shown. The electronic device in the present application may comprise one or more of the following components: a processor 110, a memory 120, an input device 130, an output device 140, and a bus 150. The processor 110, memory 120, input device 130, and output device 140 may be connected by a bus 150.
Processor 110 may include one or more processing cores. The processor 110 connects various parts within the overall electronic device using various interfaces and lines, and performs various functions of the electronic device 100 and processes data by executing or executing instructions, programs, code sets, or instruction sets stored in the memory 120 and calling data stored in the memory 120. Alternatively, the processor 110 may be implemented in hardware using at least one of Digital Signal Processing (DSP), field-programmable gate Array (FPGA), and Programmable Logic Array (PLA). The processor 110 may integrate one or more of a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), a modem, and the like. Wherein, the CPU mainly processes an operating system, a user interface, an application program and the like; the GPU is used for rendering and drawing display content; the modem is used to handle wireless communications. It is understood that the modem may not be integrated into the processor 110, but may be implemented by a communication chip.
The Memory 120 may include a Random Access Memory (RAM) or a read-only Memory (ROM). Optionally, the memory 120 includes a non-transitory computer-readable medium. The memory 120 may be used to store instructions, programs, code sets, or instruction sets. The memory 120 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for implementing at least one function (such as a touch function, a sound playing function, an image playing function, etc.), instructions for implementing various method embodiments described below, and the like, and the operating system may be an Android (Android) system, including a system based on Android system depth development, an IOS system developed by apple, including a system based on IOS system depth development, or other systems. The data storage area may also store data created by the electronic device during use, such as phone books, audio and video data, chat log data, and the like.
Referring to fig. 13, the memory 120 may be divided into an operating system space, in which an operating system runs, and a user space, in which native and third-party applications run. In order to ensure that different third-party application programs can achieve a better operation effect, the operating system allocates corresponding system resources for the different third-party application programs. However, the requirements of different application scenarios in the same third-party application program on system resources are different, for example, in a local resource loading scenario, the third-party application program has a higher requirement on the disk reading speed; in the animation rendering scene, the third-party application program has a high requirement on the performance of the GPU. The operating system and the third-party application program are independent from each other, and the operating system cannot sense the current application scene of the third-party application program in time, so that the operating system cannot perform targeted system resource adaptation according to the specific application scene of the third-party application program.
In order to enable the operating system to distinguish a specific application scenario of the third-party application program, data communication between the third-party application program and the operating system needs to be opened, so that the operating system can acquire current scenario information of the third-party application program at any time, and further perform targeted system resource adaptation based on the current scenario.
Taking an operating system as an Android system as an example, programs and data stored in the memory 120 are as shown in fig. 14, and a Linux kernel layer 320, a system runtime library layer 340, an application framework layer 360, and an application layer 380 may be stored in the memory 120, where the Linux kernel layer 320, the system runtime library layer 340, and the application framework layer 360 belong to an operating system space, and the application layer 380 belongs to a user space. The Linux kernel layer 320 provides underlying drivers for various hardware of the electronic device, such as a display driver, an audio driver, a camera driver, a bluetooth driver, a Wi-Fi driver, power management, and the like. The system runtime library layer 340 provides a main feature support for the Android system through some C/C + + libraries. For example, the SQLite library provides support for a database, the OpenGL/ES library provides support for 3D drawing, the Webkit library provides support for a browser kernel, and the like. Also provided in the system runtime library layer 340 is an Android runtime library (Android runtime), which mainly provides some core libraries that can allow developers to write Android applications using the Java language. The application framework layer 360 provides various APIs that may be used in building an application, and developers may build their own applications by using these APIs, such as activity management, window management, view management, notification management, content provider, package management, session management, resource management, and location management. At least one application program runs in the application layer 380, and the application programs may be native application programs carried by the operating system, such as a contact program, a short message program, a clock program, a camera application, and the like; or a third-party application developed by a third-party developer, such as a game application, an instant messaging program, a photo beautification program, a remote diagnosis program, and the like.
Taking an operating system as an IOS system as an example, programs and data stored in the memory 120 are shown in fig. 15, and the IOS system includes: a Core operating system Layer 420(Core OS Layer), a Core Services Layer 440(Core Services Layer), a Media Layer 460(Media Layer), and a touchable Layer 480(Cocoa Touch Layer). The kernel operating system layer 420 includes an operating system kernel, drivers, and underlying program frameworks that provide functionality closer to hardware for use by program frameworks located in the core services layer 440. The core services layer 440 provides system services and/or program frameworks, such as a Foundation framework, an account framework, an advertisement framework, a data storage framework, a network connection framework, a geographic location framework, a motion framework, and so forth, as required by the application. The media layer 460 provides audiovisual related interfaces for applications, such as graphics image related interfaces, audio technology related interfaces, video technology related interfaces, audio video transmission technology wireless playback (AirPlay) interfaces, and the like. Touchable layer 480 provides various common interface-related frameworks for application development, and touchable layer 480 is responsible for user touch interaction operations on the electronic device. Such as a local notification service, a remote push service, an advertising framework, a game tool framework, a messaging User Interface (UI) framework, a User Interface UIKit framework, a map framework, and so forth.
In the framework shown in FIG. 15, the framework associated with most applications includes, but is not limited to: a base framework in the core services layer 440 and a UIKit framework in the touchable layer 480. The base framework provides many basic object classes and data types, provides the most basic system services for all applications, and is UI independent. While the class provided by the UIKit framework is a basic library of UI classes for creating touch-based user interfaces, iOS applications can provide UIs based on the UIKit framework, so it provides an infrastructure for applications for building user interfaces, drawing, processing and user interaction events, responding to gestures, and the like.
The Android system can be referred to as a mode and a principle for realizing data communication between the third-party application program and the operating system in the IOS system, and details are not repeated herein.
The input device 130 is used for receiving input instructions or data, and the input device 130 includes, but is not limited to, a keyboard, a mouse, a camera, a microphone, or a touch device. The output device 140 is used for outputting instructions or data, and the output device 140 includes, but is not limited to, a display device, a speaker, and the like. In one example, the input device 130 and the output device 140 may be combined, and the input device 130 and the output device 140 are touch display screens for receiving touch operations of a user on or near the touch display screens by using any suitable object such as a finger, a touch pen, and the like, and displaying user interfaces of various applications. Touch displays are typically provided on the front panel of an electronic device. The touch display screen may be designed as a full-face screen, a curved screen, or a profiled screen. The touch display screen can also be designed to be a combination of a full-face screen and a curved-face screen, and a combination of a special-shaped screen and a curved-face screen, which is not limited in the embodiment of the present application.
In addition, those skilled in the art will appreciate that the configurations of the electronic devices illustrated in the above-described figures do not constitute limitations on the electronic devices, which may include more or fewer components than illustrated, or some components may be combined, or a different arrangement of components. For example, the electronic device further includes a radio frequency circuit, an input unit, a sensor, an audio circuit, a wireless fidelity (WiFi) module, a power supply, a bluetooth module, and other components, which are not described herein again.
In the embodiment of the present application, the main body of execution of each step may be the electronic device described above. Optionally, the execution subject of each step is an operating system of the electronic device. The operating system may be an android system, an IOS system, or another operating system, which is not limited in this embodiment of the present application.
The electronic device of the embodiment of the application can also be provided with a display device, and the display device can be various devices capable of realizing a display function, for example: a cathode ray tube display (CR), a light-emitting diode display (LED), an electronic ink panel, a Liquid Crystal Display (LCD), a Plasma Display Panel (PDP), and the like. A user may utilize a display device on the electronic device 101 to view information such as displayed text, images, video, and the like. The electronic device may be a smartphone, a tablet computer, a gaming device, an AR (Augmented Reality) device, an automobile, a data storage device, an audio playback device, a video playback device, a notebook, a desktop computing device, a wearable device such as an electronic watch, an electronic glasses, an electronic helmet, an electronic bracelet, an electronic necklace, an electronic garment, or the like.
In the electronic device shown in fig. 12, the processor 110 may be configured to invoke a remote diagnosis application program stored in the memory 120 and specifically perform the following operations:
based on the connection relation with a display device, sending data of an application window of a terminal application displayed by the mobile terminal to the display device so as to perform screen projection display on the application window on the display device;
receiving mobile operation information sent by the display equipment, and acquiring application data and target terminal application based on the mobile operation information;
and adding the application data to a terminal application window of the target terminal application in the mobile terminal, and displaying the terminal application window added with the application data on the mobile terminal, wherein the terminal application window is an application window displayed in the mobile terminal by the target terminal application.
In an embodiment, when the processor 110 receives the mobile operation information sent by the display device and acquires application data and a target terminal application based on the mobile operation information, the following steps are specifically performed:
acquiring mobile operation information sent by the display equipment, and acquiring a starting point coordinate and an end point coordinate carried in the mobile operation information;
acquiring a window identifier of an equipment application window where the terminal point coordinate is located;
acquiring application data indicated by the starting point coordinates, and acquiring a target terminal application corresponding to the window identifier;
the starting point coordinate is a starting point position of the moving operation in the display device, the end point coordinate is an end point position of the moving operation in the display device, and the device application window is an application window displayed in the display device by the target terminal application.
In an embodiment, when the processor 110 receives the mobile operation information sent by the display device and acquires application data and a target terminal application based on the mobile operation information, the following steps are specifically performed:
acquiring mobile operation information sent by the display equipment, and acquiring a starting point coordinate and a window identifier carried in the mobile operation information;
acquiring application data indicated by the starting point coordinates, and acquiring a target terminal application corresponding to the window identifier;
the window identification is the number of the device application window where the end position of the moving operation is located in the display device.
In an embodiment, when the processor 110 executes to acquire the application data indicated by the start coordinate and acquire the target terminal application corresponding to the window identifier, the following steps are specifically executed:
acquiring a data identifier corresponding to the starting point coordinate, and acquiring application data corresponding to the data identifier;
and acquiring an application identifier corresponding to the window identifier, and acquiring a target terminal application corresponding to the application identifier.
In an embodiment, when the processor 110 acquires the data identifier corresponding to the starting point coordinate and acquires the application data corresponding to the data identifier, the following steps are specifically performed:
and acquiring a data address corresponding to the starting point coordinate, and acquiring application data in the data address.
In an embodiment, when the processor 110 receives the mobile operation information sent by the display device and acquires application data and a target terminal application based on the mobile operation information, the following steps are specifically performed:
acquiring mobile operation information sent by the display equipment, and acquiring character information and window identification carried in the mobile operation information;
and acquiring the target terminal application corresponding to the window identifier.
In an embodiment, when the processor 110 adds the application data to a terminal application window of the target terminal application in the mobile terminal and displays the terminal application window added with the application data on the mobile terminal, the following steps are specifically performed:
if the sharing permission of the application data and the data adding permission of the target terminal application are obtained, adding the application data to a terminal application window of the target terminal application in the mobile terminal, and displaying the terminal application window added with the application data on the mobile terminal;
and if the sharing authority or the data adding authority is not acquired, sending adding failure information to the display equipment.
In the embodiment of the application, based on the connection relation with the display device, the data of the application window of the terminal application displayed by the mobile terminal is sent to the display device for screen projection display, the mobile operation information sent by the display device is obtained, the mobile terminal obtains the application data and the target terminal application based on the mobile operation information, obtains the sharing authority and the data adding authority, and then adds the application data to the terminal application window of the target terminal application, so that the safety of the application data and the target terminal application is guaranteed. The mobile terminal is controlled to automatically move the application data by acquiring the mobile operation information of the mobile operation executed in the display equipment, so that the screen is projected on the display equipment by using the mobile operation which accords with the operation logic of the display equipment, the terminal equipment can be controlled to complete data movement, the steps required by data movement are reduced, the data movement operation efficiency is improved, and the operation effect of the data screen projection is further improved.
The information transmitting apparatus according to the embodiment of the present application will be described in detail below with reference to fig. 16 to 18. It should be noted that the information sending apparatus in fig. 16 to 18 is used for executing the method of the embodiment shown in fig. 6 and 7 of the present application. For convenience of explanation, only the parts related to the embodiments of the present application are shown, and details of the technology are not disclosed, please refer to the embodiments shown in fig. 6 to fig. 7 of the present application.
Please refer to fig. 16, which shows a schematic structural diagram of an information transmitting apparatus according to an exemplary embodiment of the present application. The information transmitting apparatus may be implemented as all or a part of an apparatus by software, hardware, or a combination of both. The device 2 comprises a screen projection receiving module 21, an information acquisition module 22 and an information sending module 23.
The screen projection receiving module 21 is configured to receive data of an application window of a terminal application displayed by a mobile terminal based on a connection relationship with the mobile terminal, and perform screen projection display on the application window on a screen;
the information acquisition module 22 is configured to, if a moving operation is detected, acquire moving operation information corresponding to the moving operation;
an information sending module 23, configured to send the mobile operation information to the mobile terminal;
the mobile operation information is used for indicating the mobile terminal to add application data to a terminal application window of a target terminal application, and displaying the terminal application window added with the application data on the mobile terminal, wherein the mobile operation information comprises association information of the application data and the application data of the target terminal application, and the terminal application window is an application window displayed in the mobile terminal by the target terminal application.
In the embodiment of the application, data of an application window of a terminal application displayed by a mobile terminal in the mobile terminal is received based on a connection relation with the mobile terminal, screen projection display is carried out on a screen, if the mobile operation is detected, mobile operation information corresponding to the mobile operation is obtained, and the mobile operation information is sent to the mobile terminal. The mobile terminal is controlled to automatically move the application data by acquiring the mobile operation information of the mobile operation executed in the display equipment, so that the screen is projected on the display equipment by using the mobile operation which accords with the operation logic of the display equipment, the terminal equipment can be controlled to complete data movement, the steps required by data movement are reduced, the data movement operation efficiency is improved, and the operation effect of the data screen projection is further improved.
Please refer to fig. 17, which shows a schematic structural diagram of an information transmitting apparatus according to an exemplary embodiment of the present application. The information transmitting apparatus may be implemented as all or a part of an apparatus by software, hardware, or a combination of both. The device 2 comprises a screen projection receiving module 21, an information acquisition module 22, an information sending module 23, an image adding module 24 and a failure information display module 25.
The screen projection receiving module 21 is configured to receive data of an application window of a terminal application displayed by a mobile terminal based on a connection relationship with the mobile terminal, and perform screen projection display on the application window on a screen;
the information acquisition module 22 is configured to, if a moving operation is detected, acquire moving operation information corresponding to the moving operation;
specifically, please refer to fig. 18, which provides a schematic structural diagram of an information obtaining module according to an embodiment of the present application. As shown in fig. 18, the information obtaining module 22 may include:
a coordinate acquisition unit 221 configured to acquire a start point coordinate of a start point position and an end point coordinate of an end point position of a movement operation if the movement operation is detected;
generating movement operation information based on the start point coordinates and the end point coordinates;
a window identifier acquisition unit 222 configured to acquire a start point position and an end point position of a movement operation if the movement operation is detected;
acquiring a starting point coordinate of the starting point position and a window identifier of an application window where the end point position is located;
generating moving operation information based on the starting point coordinates and the window identification;
a text information obtaining unit 223, configured to, if a moving operation is detected, obtain a selected region corresponding to a starting point position of the moving operation, and obtain text information in the selected region;
acquiring a window identifier of an application window where the end point position of the mobile operation is located;
and generating moving operation information based on the text information and the window identification.
An information sending module 23, configured to send the mobile operation information to the mobile terminal;
the mobile operation information is used for indicating the mobile terminal to add application data into a terminal application window of a target terminal application and displaying the terminal application window added with the application data on the mobile terminal, the mobile operation information comprises the association information of the application data and the application data of the target terminal application, and the terminal application window is an application window displayed in the mobile terminal by the target terminal application;
an image adding module 24, configured to add the display image of the application data to the device application window of the target terminal application based on the moving operation;
the display image of the application data is an image effect displayed by the application data in a display terminal, and the device application window is an application window displayed by the target terminal in the display device;
a failure information display module 25, configured to receive addition failure information sent by the mobile terminal if the mobile terminal does not obtain the sharing permission of the application data and the data addition permission of the target terminal application;
displaying the addition failure information on the screen.
In the embodiment of the application, data of an application window of a terminal application displayed by a mobile terminal in the mobile terminal is received based on a connection relation with the mobile terminal, screen projection display is performed on a screen, if a mobile operation is detected, mobile operation information corresponding to the mobile operation is generated based on a starting point coordinate and a window identifier corresponding to the mobile operation, the mobile operation information is sent to the mobile terminal, and the mobile terminal acquires sharing authority and data adding authority of the application data and a target terminal application based on the mobile operation information and then adds the application data to the terminal application window of the target terminal application, so that the safety of the application data and the target terminal application is guaranteed. The mobile terminal is controlled to automatically move the application data by acquiring the mobile operation information of the mobile operation executed in the display equipment, so that the screen is projected on the display equipment by using the mobile operation which accords with the operation logic of the display equipment, the terminal equipment can be controlled to complete data movement, the steps required by data movement are reduced, the data movement operation efficiency is improved, and the operation effect of the data screen projection is further improved. Meanwhile, the display image of the application data is added to the device application window of the target terminal application on the screen of the display device, so that the visual experience of a user is enriched, and the use effect is further improved.
Referring to fig. 19, a block diagram of an electronic device according to an exemplary embodiment of the present application is shown. The electronic device in the present application may comprise one or more of the following components: a processor 210, a memory 220, an input device 230, an output device 240, and a bus 250. The processor 210, memory 220, input device 230, and output device 240 may be connected by a bus 250.
Processor 210 may include one or more processing cores. The processor 210 connects various parts within the entire electronic device using various interfaces and lines, performs various functions of the electronic device 200 and processes data by executing or executing instructions, programs, code sets, or instruction sets stored in the memory 220 and calling data stored in the memory 220. Alternatively, the processor 210 may be implemented in hardware using at least one of Digital Signal Processing (DSP), field-programmable gate Array (FPGA), and Programmable Logic Array (PLA). The processor 210 may integrate one or more of a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), a modem, and the like. Wherein, the CPU mainly processes an operating system, a user interface, an application program and the like; the GPU is used for rendering and drawing display content; the modem is used to handle wireless communications. It is understood that the modem may not be integrated into the processor 210, but may be implemented by a communication chip.
The Memory 220 may include a Random Access Memory (RAM) or a read-only Memory (ROM). Optionally, the memory 220 includes a non-transitory computer-readable medium. The memory 220 may be used to store instructions, programs, code, sets of codes, or sets of instructions. The memory 220 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for implementing at least one function (such as a touch function, a sound playing function, an image playing function, etc.), instructions for implementing various method embodiments described below, and the like, and the operating system may be an Android (Android) system, including a system based on Android system depth development, an IOS system developed by apple, including a system based on IOS system depth development, or other systems. The data storage area may also store data created by the electronic device during use, such as phone books, audio and video data, chat log data, and the like.
Referring to fig. 20, the memory 220 may be divided into an operating system space, where an operating system is run, and a user space, where native and third-party applications are run. In order to ensure that different third-party application programs can achieve a better operation effect, the operating system allocates corresponding system resources for the different third-party application programs. However, the requirements of different application scenarios in the same third-party application program on system resources are different, for example, in a local resource loading scenario, the third-party application program has a higher requirement on the disk reading speed; in the animation rendering scene, the third-party application program has a high requirement on the performance of the GPU. The operating system and the third-party application program are independent from each other, and the operating system cannot sense the current application scene of the third-party application program in time, so that the operating system cannot perform targeted system resource adaptation according to the specific application scene of the third-party application program.
In order to enable the operating system to distinguish a specific application scenario of the third-party application program, data communication between the third-party application program and the operating system needs to be opened, so that the operating system can acquire current scenario information of the third-party application program at any time, and further perform targeted system resource adaptation based on the current scenario.
Taking an operating system as an Android system as an example, programs and data stored in the memory 220 are as shown in fig. 21, and a Linux kernel layer 520, a system runtime library layer 540, an application framework layer 560 and an application layer 580 may be stored in the memory 220, where the Linux kernel layer 520, the system runtime library layer 540 and the application framework layer 560 belong to an operating system space, and the application layer 580 belongs to a user space. The Linux kernel layer 520 provides underlying drivers for various hardware of the electronic device, such as a display driver, an audio driver, a camera driver, a Bluetooth driver, a Wi-Fi driver, power management, and the like. The system runtime library layer 540 provides main feature support for the Android system through some C/C + + libraries. For example, the SQLite library provides support for a database, the OpenGL/ES library provides support for 3D drawing, the Webkit library provides support for a browser kernel, and the like. Also provided in the system runtime library layer 540 is an Android runtime library (Android runtime), which mainly provides some core libraries that can allow developers to write Android applications using the Java language. The application framework layer 560 provides various APIs that may be used in building applications, and developers may build their own applications by using these APIs, such as activity management, window management, view management, notification management, content provider, package management, session management, resource management, and location management. At least one application program runs in the application layer 580, and the application programs may be native application programs of the operating system, such as a contact program, a short message program, a clock program, a camera application, and the like; or a third-party application developed by a third-party developer, such as a game application, an instant messaging program, a photo beautification program, a remote diagnosis program, and the like.
Taking an operating system as an IOS system as an example, programs and data stored in the memory 220 are as shown in fig. 22, and the IOS system includes: a Core operating system Layer 620(Core OS Layer), a Core Services Layer 640(Core Services Layer), a Media Layer 660(Media Layer), and a touchable Layer 680(Cocoa Touch Layer). The kernel operating system layer 620 includes an operating system kernel, drivers, and underlying program frameworks that provide functionality closer to hardware for use by program frameworks located in the core services layer 640. The core services layer 640 provides system services and/or program frameworks, such as a Foundation framework, an account framework, an advertisement framework, a data storage framework, a network connection framework, a geographic location framework, a motion framework, etc., that are needed by the application. The media layer 660 provides audiovisual interfaces for applications, such as graphics-related interfaces, audio-related interfaces, video-related interfaces, and audio/video transmission technology wireless playback (AirPlay) interfaces. Touchable layer 680 provides various common interface-related frameworks for application development, and touchable layer 680 is responsible for user touch interaction operations on the electronic device. Such as a local notification service, a remote push service, an advertising framework, a game tool framework, a messaging User Interface (UI) framework, a User Interface UIKit framework, a map framework, and so forth.
In the framework shown in FIG. 22, the framework associated with most applications includes, but is not limited to: a base framework in the core services layer 640 and a UIKit framework in the touchable layer 680. The base framework provides many basic object classes and data types, provides the most basic system services for all applications, and is UI independent. While the class provided by the UIKit framework is a basic library of UI classes for creating touch-based user interfaces, iOS applications can provide UIs based on the UIKit framework, so it provides an infrastructure for applications for building user interfaces, drawing, processing and user interaction events, responding to gestures, and the like.
The Android system can be referred to as a mode and a principle for realizing data communication between the third-party application program and the operating system in the IOS system, and details are not repeated herein.
The input device 230 is used to receive input commands or data, and the input device 230 includes, but is not limited to, a keyboard, a mouse, a camera, a microphone, or a touch device. The output device 240 is used for outputting instructions or data, and the output device 240 includes, but is not limited to, a display device, a speaker, and the like. In one example, the input device 230 and the output device 240 may be combined, and the input device 230 and the output device 240 are touch display screens for receiving touch operations of a user on or near the touch display screens by using any suitable object such as a finger, a touch pen, and the like, and displaying user interfaces of various applications. Touch displays are typically provided on the front panel of an electronic device. The touch display screen may be designed as a full-face screen, a curved screen, or a profiled screen. The touch display screen can also be designed to be a combination of a full-face screen and a curved-face screen, and a combination of a special-shaped screen and a curved-face screen, which is not limited in the embodiment of the present application.
In addition, those skilled in the art will appreciate that the configurations of the electronic devices illustrated in the above-described figures do not constitute limitations on the electronic devices, which may include more or fewer components than illustrated, or some components may be combined, or a different arrangement of components. For example, the electronic device further includes a radio frequency circuit, an input unit, a sensor, an audio circuit, a wireless fidelity (WiFi) module, a power supply, a bluetooth module, and other components, which are not described herein again.
In the embodiment of the present application, the main body of execution of each step may be the electronic device described above. Optionally, the execution subject of each step is an operating system of the electronic device. The operating system may be an android system, an IOS system, or another operating system, which is not limited in this embodiment of the present application.
The electronic device of the embodiment of the application can also be provided with a display device, and the display device can be various devices capable of realizing a display function, for example: a cathode ray tube display (CR), a light-emitting diode display (LED), an electronic ink panel, a Liquid Crystal Display (LCD), a Plasma Display Panel (PDP), and the like. A user may utilize a display device on the electronic device 101 to view information such as displayed text, images, video, and the like. The electronic device may be a smartphone, a tablet computer, a gaming device, an AR (Augmented Reality) device, an automobile, a data storage device, an audio playback device, a video playback device, a notebook, a desktop computing device, a wearable device such as an electronic watch, an electronic glasses, an electronic helmet, an electronic bracelet, an electronic necklace, an electronic garment, or the like.
In the electronic device shown in fig. 19, the processor 210 may be configured to invoke a remote diagnosis application stored in the memory 220 and specifically perform the following operations:
receiving data of an application window of a terminal application displayed by a mobile terminal based on the connection relation with the mobile terminal, and performing screen projection display on the application window on a screen;
if the mobile operation is detected, mobile operation information corresponding to the mobile operation is acquired;
sending the mobile operation information to the mobile terminal;
the mobile operation information is used for indicating the mobile terminal to add application data to a terminal application window of a target terminal application, and displaying the terminal application window added with the application data on the mobile terminal, wherein the mobile operation information comprises association information of the application data and the application data of the target terminal application, and the terminal application window is an application window displayed in the mobile terminal by the target terminal application.
In an embodiment, when the processor 210 executes the following operation when detecting the moving operation and acquiring the moving operation information corresponding to the moving operation:
if the moving operation is detected, acquiring a starting point coordinate of a starting point position and an end point coordinate of an end point position of the moving operation;
and generating movement operation information based on the start point coordinates and the end point coordinates.
In an embodiment, when the processor 210 executes the following operation when detecting the moving operation and acquiring the moving operation information corresponding to the moving operation:
if the moving operation is detected, acquiring a starting point position and an end point position of the moving operation;
acquiring a starting point coordinate of the starting point position and a window identifier of an application window where the end point position is located;
and generating moving operation information based on the starting point coordinates and the window identification.
In an embodiment, when the processor 210 executes the following operation when detecting the moving operation and acquiring the moving operation information corresponding to the moving operation:
if the moving operation is detected, acquiring a selected area corresponding to the starting point position of the moving operation, and acquiring character information in the selected area;
acquiring a window identifier of an application window where the end point position of the mobile operation is located;
and generating moving operation information based on the text information and the window identification.
In one embodiment, the processor 210 further performs the following operations after performing the sending of the mobile operation information to the mobile terminal:
adding a display image of the application data to a device application window of the target terminal application based on the moving operation;
the display image of the application data is an image effect displayed by the application data in a display terminal, and the device application window is an application window displayed by the target terminal in the display device.
In one embodiment, the processor 210, when executing the data moving method, further performs the following operations:
if the mobile terminal does not acquire the sharing authority of the application data and the data adding authority of the target terminal application, receiving adding failure information sent by the mobile terminal;
displaying the addition failure information on the screen.
In the embodiment of the application, data of an application window of a terminal application displayed by a mobile terminal in the mobile terminal is received based on a connection relation with the mobile terminal, screen projection display is performed on a screen, if a mobile operation is detected, mobile operation information corresponding to the mobile operation is generated based on a starting point coordinate and a window identifier corresponding to the mobile operation, the mobile operation information is sent to the mobile terminal, and the mobile terminal acquires sharing authority and data adding authority of the application data and a target terminal application based on the mobile operation information and then adds the application data to the terminal application window of the target terminal application, so that the safety of the application data and the target terminal application is guaranteed. The mobile terminal is controlled to automatically move the application data by acquiring the mobile operation information of the mobile operation executed in the display equipment, so that the screen is projected on the display equipment by using the mobile operation which accords with the operation logic of the display equipment, the terminal equipment can be controlled to complete data movement, the steps required by data movement are reduced, the data movement operation efficiency is improved, and the operation effect of the data screen projection is further improved. Meanwhile, the display image of the application data is added to the device application window of the target terminal application on the screen of the display device, so that the visual experience of a user is enriched, and the use effect is further improved.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by a computer program, which can be stored in a computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. The storage medium may be a magnetic disk, an optical disk, a read-only memory or a random access memory.
The above disclosure is only for the purpose of illustrating the preferred embodiments of the present application and is not to be construed as limiting the scope of the present application, so that the present application is not limited thereto, and all equivalent variations and modifications can be made to the present application.

Claims (17)

1. A data moving method is applied to a mobile terminal, and the method comprises the following steps:
based on the connection relation with a display device, sending data of an application window of a terminal application displayed by the mobile terminal to the display device so as to perform screen projection display on the application window on the display device;
receiving mobile operation information sent by the display equipment, and acquiring application data and target terminal application based on the mobile operation information; the movement operation information is obtained based on a movement operation on the display device;
adding the application data to a terminal application window of the target terminal application in the mobile terminal, and displaying the terminal application window added with the application data on the mobile terminal; the terminal application window is an application window displayed in the mobile terminal by the target terminal application.
2. The method according to claim 1, wherein the receiving the mobile operation information sent by the display device, and acquiring application data and a target terminal application based on the mobile operation information comprises:
acquiring mobile operation information sent by the display equipment, and acquiring a starting point coordinate and an end point coordinate carried in the mobile operation information;
acquiring a window identifier of an equipment application window where the terminal point coordinate is located;
acquiring application data indicated by the starting point coordinates, and acquiring a target terminal application corresponding to the window identifier;
the starting point coordinate is a starting point position of the moving operation in the display device, the end point coordinate is an end point position of the moving operation in the display device, and the device application window is an application window displayed in the display device by the target terminal application.
3. The method according to claim 1, wherein the receiving the mobile operation information sent by the display device, and acquiring application data and a target terminal application based on the mobile operation information comprises:
acquiring mobile operation information sent by the display equipment, and acquiring a starting point coordinate and a window identifier carried in the mobile operation information;
acquiring application data indicated by the starting point coordinates, and acquiring a target terminal application corresponding to the window identifier;
the window identification is the number of the device application window where the end position of the moving operation is located in the display device.
4. The method according to claim 2 or 3, wherein the obtaining the application data indicated by the start coordinates and obtaining the target terminal application corresponding to the window identifier comprises:
acquiring a data identifier corresponding to the starting point coordinate, and acquiring application data corresponding to the data identifier;
and acquiring an application identifier corresponding to the window identifier, and acquiring a target terminal application corresponding to the application identifier.
5. The method according to claim 4, wherein the obtaining of the data identifier corresponding to the starting point coordinate and the obtaining of the application data corresponding to the data identifier comprise:
and acquiring a data address corresponding to the starting point coordinate, and acquiring application data in the data address.
6. The method according to claim 1, wherein the receiving the mobile operation information sent by the display device, and acquiring application data and a target terminal application based on the mobile operation information comprises:
acquiring mobile operation information sent by the display equipment, and acquiring character information and window identification carried in the mobile operation information;
and acquiring the target terminal application corresponding to the window identifier.
7. The method according to claim 1, wherein the adding the application data to the terminal application window of the target terminal application in the mobile terminal and displaying the terminal application window after the application data is added on the mobile terminal comprises:
if the sharing permission of the application data and the data adding permission of the target terminal application are obtained, adding the application data to a terminal application window of the target terminal application in the mobile terminal, and displaying the terminal application window added with the application data on the mobile terminal;
and if the sharing authority or the data adding authority is not acquired, sending adding failure information to the display equipment.
8. A data moving method is applied to a display device, and the method comprises the following steps:
receiving data of an application window of a terminal application displayed by a mobile terminal based on the connection relation with the mobile terminal, and performing screen projection display on the application window on a screen;
if the mobile operation is detected, mobile operation information corresponding to the mobile operation is acquired;
sending the mobile operation information to the mobile terminal;
the mobile operation information is used for indicating the mobile terminal to add application data to a terminal application window of a target terminal application, and displaying the terminal application window added with the application data on the mobile terminal, wherein the mobile operation information comprises association information of the application data and the application data of the target terminal application, and the terminal application window is an application window displayed in the mobile terminal by the target terminal application.
9. The method according to claim 8, wherein the obtaining of the movement operation information corresponding to the movement operation if the movement operation is detected comprises:
if the moving operation is detected, acquiring a starting point coordinate of a starting point position and an end point coordinate of an end point position of the moving operation;
and generating movement operation information based on the start point coordinates and the end point coordinates.
10. The method according to claim 8, wherein the obtaining of the movement operation information corresponding to the movement operation if the movement operation is detected comprises:
if the moving operation is detected, acquiring a starting point position and an end point position of the moving operation;
acquiring a starting point coordinate of the starting point position and a window identifier of an application window where the end point position is located;
and generating moving operation information based on the starting point coordinates and the window identification.
11. The method according to claim 8, wherein the obtaining of the movement operation information corresponding to the movement operation if the movement operation is detected comprises:
if the moving operation is detected, acquiring a selected area corresponding to the starting point position of the moving operation, and acquiring character information in the selected area;
acquiring a window identifier of an application window where the end point position of the mobile operation is located;
and generating moving operation information based on the text information and the window identification.
12. The method of claim 8, wherein after sending the mobile operation information to the mobile terminal, further comprising:
adding a display image of the application data to a device application window of the target terminal application based on the moving operation;
the display image of the application data is an image effect displayed by the application data in a display terminal, and the device application window is an application window displayed by the target terminal in the display device.
13. The method of claim 8, further comprising:
if the mobile terminal does not acquire the sharing authority of the application data and the data adding authority of the target terminal application, receiving adding failure information sent by the mobile terminal;
displaying the addition failure information on the screen.
14. A data moving apparatus, the apparatus comprising:
the screen projection sending module is used for sending data of an application window of the terminal application displayed by the mobile terminal to the display equipment based on the connection relation with the display equipment so as to perform screen projection display on the application window on the display equipment;
the data acquisition module is used for receiving the mobile operation information sent by the display equipment and acquiring application data and target terminal application based on the mobile operation information;
the data adding module is used for adding the application data to a terminal application window of the target terminal application in the mobile terminal and displaying the terminal application window added with the application data on the mobile terminal; the terminal application window is an application window displayed in the mobile terminal by the target terminal application.
15. An information transmission apparatus, characterized in that the apparatus comprises
The screen projection receiving module is used for receiving data of an application window of the terminal application displayed by the mobile terminal based on the connection relation with the mobile terminal and carrying out screen projection display on the application window on a screen;
the information acquisition module is used for acquiring mobile operation information corresponding to the mobile operation if the mobile operation is detected;
the information sending module is used for sending the mobile operation information to the mobile terminal;
the mobile operation information is used for indicating the mobile terminal to add application data to a terminal application window of a target terminal application, and displaying the terminal application window added with the application data on the mobile terminal, wherein the mobile operation information comprises association information of the application data and the application data of the target terminal application, and the terminal application window is an application window displayed in the mobile terminal by the target terminal application.
16. A computer storage medium, characterized in that it stores a plurality of instructions adapted to be loaded by a processor and to carry out the method steps according to any one of claims 1 to 13.
17. An electronic device, comprising: a processor and a memory; wherein the memory stores a computer program adapted to be loaded by the processor and to perform the method steps of any of claims 1 to 13.
CN202110638968.7A 2021-06-08 2021-06-08 Data moving method and device, storage medium and electronic equipment Pending CN113419650A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110638968.7A CN113419650A (en) 2021-06-08 2021-06-08 Data moving method and device, storage medium and electronic equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110638968.7A CN113419650A (en) 2021-06-08 2021-06-08 Data moving method and device, storage medium and electronic equipment

Publications (1)

Publication Number Publication Date
CN113419650A true CN113419650A (en) 2021-09-21

Family

ID=77788133

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110638968.7A Pending CN113419650A (en) 2021-06-08 2021-06-08 Data moving method and device, storage medium and electronic equipment

Country Status (1)

Country Link
CN (1) CN113419650A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113949923A (en) * 2021-09-29 2022-01-18 联想(北京)有限公司 Control method and control device

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150331573A1 (en) * 2014-05-15 2015-11-19 Hisense Mobile Communications Technology Co., Ltd. Handheld mobile terminal device and method for controlling windows of same
CN111443863A (en) * 2020-04-07 2020-07-24 Oppo广东移动通信有限公司 Page control method and device, storage medium and terminal
CN111459586A (en) * 2020-03-27 2020-07-28 Oppo广东移动通信有限公司 Remote assistance method, device, storage medium and terminal

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150331573A1 (en) * 2014-05-15 2015-11-19 Hisense Mobile Communications Technology Co., Ltd. Handheld mobile terminal device and method for controlling windows of same
CN111459586A (en) * 2020-03-27 2020-07-28 Oppo广东移动通信有限公司 Remote assistance method, device, storage medium and terminal
CN111443863A (en) * 2020-04-07 2020-07-24 Oppo广东移动通信有限公司 Page control method and device, storage medium and terminal

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113949923A (en) * 2021-09-29 2022-01-18 联想(北京)有限公司 Control method and control device

Similar Documents

Publication Publication Date Title
CN109766053B (en) User interface display method, device, terminal and storage medium
CN108762937B (en) Configuration information sending method, configuration information obtaining method, configuration information sending device, configuration information obtaining device and terminal
US10852912B2 (en) Image creation app in messaging app
CN107728885B (en) Multitask control method and device, mobile terminal and storage medium
WO2021190184A1 (en) Remote assistance method and apparatus, and storage medium and terminal
WO2019233307A1 (en) User interface display method and apparatus, and terminal and storage medium
CN107580039B (en) Transmission progress display method and device and terminal
CN113268212A (en) Screen projection method and device, storage medium and electronic equipment
CN111124668A (en) Memory release method and device, storage medium and terminal
WO2019047187A1 (en) Navigation bar control method and device
CN110178111B (en) Image processing method and device for terminal
CN112218130A (en) Control method and device for interactive video, storage medium and terminal
CN111866372A (en) Self-photographing method, device, storage medium and terminal
CN111913614B (en) Multi-picture display control method and device, storage medium and display
CN111127469A (en) Thumbnail display method, device, storage medium and terminal
CN117555459A (en) Application group processing method and device, storage medium and electronic equipment
CN113419650A (en) Data moving method and device, storage medium and electronic equipment
CN112995562A (en) Camera calling method and device, storage medium and terminal
CN107765858B (en) Method, device, terminal and storage medium for determining face angle
CN111949150B (en) Method and device for controlling peripheral switching, storage medium and electronic equipment
CN113114849A (en) Alarm clock reminding method and device, storage medium and terminal
CN113825022A (en) Play control state detection method and device, storage medium and electronic equipment
CN111859999A (en) Message translation method, device, storage medium and electronic equipment
CN113286349A (en) Personal hotspot connection method, device, terminal and storage medium
CN113950043A (en) Communication method, communication apparatus, storage medium, and terminal

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination