CN111666055A - Data transmission method and device - Google Patents

Abstract

The present application relates to a data transmission method and device. The method includes: when the first terminal device detects a first cross-device transfer operation for the object on the first terminal device, acquiring the data type of the object, wherein the first cross-device transfer operation is used to initiate the transfer of the object to the object. The process of the second terminal device: sending a judgment request carrying the data type to the second terminal device, and receiving a judgment result based on the data type from the second terminal device, and the judgment result indicates whether the object can be transmitted to the second terminal device. Terminal equipment; displays the judgment result. The data transmission methods and devices of the various embodiments of the present application can provide users with intuitive visual feedback according to the data type of the object and the matching degree of the receiving end, avoid erroneous operation and repeated operation, and improve the operation efficiency.

Description

Data transmission method and device

technical field

The present application relates to the field of communication technologies, and in particular, to a data transmission method and device.

Background technique

Data can be transferred between different devices by dragging and dropping. For example, when data is transferred by dragging and dropping between a mobile phone and a computer with the same operating system, you need to use a specific application on the computer to log in with the same account that you log in on the mobile phone. You can drag photos or files from your mobile phone to your computer, but this method depends on the same account, as well as specific functions such as operating system window display and reverse control capabilities, not any two devices can pass through this The operation realizes data transmission.

If a drag and drop operation is unsuccessful, the user will drag and drop repeatedly, which will result in complicated operations and low efficiency.

SUMMARY OF THE INVENTION

In view of this, a data transmission method, device, terminal device, storage medium and computer program product are proposed, which can avoid wrong operation and repeated operation and improve operation efficiency by providing users with intuitive visual feedback.

In a first aspect, an embodiment of the present application provides a data transmission method, the method is applied to a first terminal device, and the first terminal device is connected to a second terminal device, and the method includes:

The first terminal device acquires the data type of the object when detecting a first cross-device transfer operation for the object on the first terminal device, wherein the first cross-device transfer operation is used to initiate a transfer of the object to the second terminal device. process;

sending the data type judgment request carrying the data type to the second terminal device,

receiving a judgment result from the second terminal device based on the data type, the judgment result indicating whether the object can be transmitted to the second terminal device;

The judgment result is displayed.

In combination with the first possible implementation manner of the first aspect, the judgment request carries a data type field and/or an extended data type field, and the data type field and the extended data type field are used to represent the data type of the object. The data transmission method according to the above-mentioned implementation of the present application can expand the content that can be dragged, and the expanded data type field can indicate a custom, or a data type suitable for a specific device or application, or a new data type, so that cross-device transmission is possible. More data types and devices are applicable to the data, which is convenient for users to operate.

With reference to the first aspect or the first possible implementation manner of the first aspect, in a second possible implementation manner, the method further includes, when the judgment result is that it can be transmitted to the second terminal device and the second crossover is detected. During the device transmission operation, the object is sent to the second terminal device, and the second cross-device transmission operation is used to confirm the transmission of the object to the second terminal device.

In combination with the second possible implementation manner of the first aspect, in a third possible implementation manner, sending an object to the second terminal device may be specifically implemented as:

Temporarily store the object locally in the first terminal device;

Send a data transmission request to the second terminal device, and the data transmission request is used to transmit the object;

When receiving the first response signal of accepting the data transmission request returned by the second terminal device, send the object according to the first response signal;

When receiving the second response signal that the second terminal device does not accept the data transmission request, cancel the sending object.

In combination with the third possible implementation manner of the first aspect, in a fourth possible implementation manner, after the object is temporarily stored locally on the first terminal device, the method further includes:

When a call-out instruction for the temporarily stored object is detected, the temporarily stored object is called out, and the data transmission request is sent to the second terminal device.

In combination with the third or fourth possible implementation manner of the first aspect, in the fifth possible implementation manner, according to the first response signal sending object, the specific implementation may be as follows:

When the first response signal is received, the object is sent directly; or, when the first response signal is received, the object is sent with a delay.

According to the data transmission methods of the third, fourth and fifth possible implementations above, selectable operations for the dragged-in object can be displayed, so that the user can adjust the transmission process or processing method according to actual needs , so that the second terminal device can process the object according to actual needs.

In combination with the first aspect or the first, second, third, fourth or fifth possible implementation manners of the first aspect, in the sixth possible implementation manner, the first terminal device and the two The above candidate terminal devices are connected, and the data transmission method of the present application may also include:

When the first terminal device detects the first cross-device transmission operation for the object on the first terminal device, the information of two or more candidate terminal devices is displayed;

The second terminal device corresponding to the first cross-device transmission operation is determined according to the relationship between the stay position of the first cross-device transmission operation and the display positions of the information of the two or more candidate terminal devices.

In combination with the first aspect or the first, second, third, fourth or fifth possible implementation manners of the first aspect, in the seventh possible implementation manner, the first terminal device and the two The above candidate terminal devices are connected, and the data transmission method of the present application may also include:

The second terminal device corresponding to the first cross-device transmission operation is determined according to the positional relationship between the stay position of the first cross-device transmission operation and the edge of the first terminal device.

According to the data transmission method of the sixth or seventh possible implementation, the interaction between multiple terminal devices can be realized, and the types of multiple terminal devices can be different, so that users can share between multiple different devices. more convenient when using data.

With reference to the first aspect or the seventh possible implementation manner of the first aspect, in an eighth possible implementation manner, the method further includes:

Send a display instruction to the second terminal device to instruct the second terminal device to display the first image of the object according to the display instruction and the positional relationship between the second terminal device and the first terminal device, and the first image of the object displayed on the first terminal device. The second image and the first image of the object displayed on the second terminal device can be combined to form a complete image of the object; if it is detected that the area of the second image of the object displayed on the display screen satisfies the sending conditions, the second terminal device will be sent to the second terminal device. send the object. According to the data transmission method of this implementation, the dragging interaction process is displayed concisely and intuitively, and at the same time, it is helpful for the user to judge the dragging timing, avoid repeated operations, and simplify user operations.

With reference to the first aspect or the sixth possible implementation manner of the first aspect, in a ninth possible implementation manner, the method further includes:

sending a display state request to the second terminal device, so that the second terminal device responds to the display state request and returns to the current display interface of the second terminal device, and displays the display interface;

In this implementation manner, in the first aspect, sending the judgment request carrying the data type to the second terminal device may be specifically implemented as:

Sending a judgment request to the second terminal device, the judgment request is the coordinates of the data type and the position where the first cross-device transmission operation stays in the above-mentioned display interface,

In this implementation manner, in the first aspect, receiving the judgment result made by the second terminal device based on the data type may be specifically implemented as:

The judgment result based on the above-mentioned data type and the above-mentioned coordinates is received from the second terminal device.

According to the data transmission method of the ninth possible implementation, the object can be directly dragged to the target position. Compared with the related art, the process of dragging to the target position needs to be further operated at the receiving end, which can simplify the user operation. The judgment result is displayed in real time during the dragging process, which can avoid repeated operations and improve the operation efficiency.

With reference to the second possible implementation manner of the first aspect, in a tenth possible implementation manner, the method further includes:

determining how the object is processed by the second terminal device;

Sending the object to the second terminal device includes:

Send the object and indication information to the second terminal device, where the indication information is used to instruct the second terminal device to process the object in the processing mode.

In a second aspect, an embodiment of the present application provides a data transmission method, the method is applied to a second terminal device, the second terminal device is connected to the first terminal device, and the method includes:

Receive a judgment request sent by the first terminal device, wherein the judgment request carries the data type of the object to be transmitted, and the judgment request is used to request the second terminal device to judge whether the object of the data type can be transmitted to the second terminal equipment;

The judgment result is made according to the data type, and the judgment result is sent to the first terminal device, so that the first terminal device displays the judgment result.

In combination with the first possible implementation manner of the second aspect, the method further includes:

When receiving the display state request sent by the first terminal device, return the current display interface of the second terminal device to the first terminal device, so that the first terminal device can determine the coordinates of the location where the first cross-device transmission operation stays in the display interface , wherein the first cross-device transmission operation is an operation used by the first terminal device to initiate a process of transmitting the object to the second terminal device;

Wherein, the judgment request in the implementation manner of the second aspect carries the coordinates,

In the implementation manner of the second aspect, the judgment result is made according to the data type, including:

The judgment result is made according to the data type and the coordinates. According to the data transmission method of this implementation, the object can be directly dragged to the target position. Compared with the related art, the process of dragging and dropping to the target position needs to be further performed at the receiving end, which can simplify the user operation. The judgment result is displayed in real time during the dragging process, which can avoid repeated operations and improve the operation efficiency.

With reference to the first possible implementation manner of the second aspect, in the second possible implementation manner, the method further includes:

When the object sent by the first terminal device is received, the object is processed according to one or more items of data type, local storage state, application service installed by the second terminal device, and coordinates.

In combination with the second possible implementation manner of the second aspect, in a third possible implementation manner, the object processing, which can be implemented as:

When the local storage state is that it does not have the storage capability, the object is opened according to the application service installed by the second terminal device;

When the local storage state is capable of storage, the object is stored locally.

In combination with the third possible implementation manner of the second aspect, in the fourth possible implementation manner, when the local storage state is capable of storing, the object is stored locally, which may be specifically implemented as:

When the local storage state is capable of storing, and the corresponding position of the above-mentioned coordinates in the above-mentioned display interface does not allow the insertion of the data type, the object is stored locally and the object is opened by selecting an application program according to the above-mentioned data type;

When the local storage state is capable of storing and the corresponding position of the coordinates in the display interface allows the insertion of the data type, the object is stored locally and the object is opened in the display interface according to the coordinates.

According to the data transmission method of the above implementation manner, the receiving end can process the object according to the local information, thereby simplifying the user operation.

With reference to the second aspect or the first, second, third or fourth possible implementation manners of the second aspect, in a fifth possible implementation manner, the method further includes:

When receiving the object sent by the first terminal device, if the second terminal device has storage capability, temporarily storing the object locally;

display processing options;

The object is processed according to a selection operation for the processing option.

With reference to the second aspect, in a sixth possible implementation manner, the method further includes:

When receiving the display instruction sent by the first terminal device, display the first image of the object according to the display instruction and the positional relationship between the second terminal device and the first terminal device,

The second image of the object displayed on the first terminal device and the first image of the object displayed on the second terminal device can be combined to form a complete image of the object. According to the data transmission method of this implementation, the dragging interaction process is displayed concisely and intuitively, and at the same time, it is helpful for the user to judge the dragging timing, avoid repeated operations, and simplify user operations.

In a third aspect, an embodiment of the present application provides a data transmission apparatus, the method is applied to a first terminal device, the first terminal device is connected to a second terminal device, and the apparatus includes:

a first obtaining module, configured to obtain the data type of the object when the first terminal device detects a first cross-device transmission operation for the object on the first terminal device, wherein the first cross-device transmission operation is used to initiate the process of transmitting the object to the second terminal device;

a first sending module, configured to send a judgment request carrying the data type to the second terminal device,

a first receiving module, configured to receive a judgment result made by the second terminal device based on the data type, where the judgment result indicates whether the object can be transmitted to the second terminal device;

The first display module is used to display the judgment result.

With reference to the first possible implementation manner of the third aspect, the judgment request carries a data type field and/or an extended data type field, and the data type field and the extended data type field are used to represent the data type of the object.

With reference to the third aspect or the first possible implementation manner of the third aspect, in a second possible implementation manner, the apparatus further includes:

The second sending module is configured to send the object to the second terminal device when the judgment result is that it can be transmitted to the second terminal device and a second cross-device transmission operation is detected, and the second cross-device transmission operation is used to confirm that the object is sent to the second terminal device. transmitted to the second terminal device.

With reference to the second possible implementation manner of the third aspect, in the third possible implementation manner, the second sending module may include:

a first storage unit, configured to temporarily store the object locally in the first terminal device;

a first sending unit, configured to send a data transmission request to the second terminal device, where the data transmission request is used to transmit the object;

a second sending unit, configured to send an object according to the first response signal when receiving the first response signal of accepting the data transmission request returned by the second terminal device;

The canceling sending unit is configured to cancel the sending object when receiving the second response signal that the second terminal device does not accept the data transmission request.

With reference to the third possible implementation manner of the third aspect, in a fourth possible implementation manner, the first sending unit is further configured to call out the temporary storage when detecting a call-out instruction for the temporarily stored object object, and send the data transmission request to the second terminal device.

With reference to the third possible implementation manner of the third aspect, in a fifth possible implementation manner, the second sending unit is further configured to: when receiving the first response signal, directly send the object, or, in When the first response signal is received, the object is sent with a delay.

With reference to the third aspect or the first, second, third, fourth or fifth possible implementation manners of the third aspect, in the sixth possible implementation manner, the first terminal device and the More than two candidate terminal devices are connected, and the device further includes:

The second display module is used for the first terminal device to display the information of two or more candidate terminal devices when detecting a first cross-device transmission operation for an object local to the first terminal device;

The second determination module is configured to determine the second terminal device corresponding to the first cross-device transmission operation according to the relationship between the stay position of the first cross-device transmission operation and the display positions of the information of two or more candidate terminal devices.

In combination with the third aspect or the first, second, third, fourth or fifth possible implementation manners of the third aspect, in the seventh possible implementation manner, the first terminal device and the two The above candidate terminal equipment is connected, and the apparatus further includes: a third determining module, configured to determine the second cross-device transmission operation corresponding to the first cross-device transmission operation according to the positional relationship between the stay position of the first cross-device transmission operation and the edge of the first terminal equipment Terminal Equipment.

With reference to the third aspect or the seventh possible implementation manner of the third aspect, in the eighth possible implementation manner, the apparatus further includes:

a third sending module, configured to send a display instruction to the second terminal device to instruct the second terminal device to display the first image of the object according to the display instruction and the positional relationship between the second terminal device and the first terminal device,

The second image of the object displayed on the first terminal device and the first image of the object displayed on the second terminal device can be combined to form a complete image of the object;

The fourth sending module is configured to send the object to the second terminal device if it is detected that the area of the second image of the object displayed on the display screen satisfies the sending condition.

With reference to the third aspect or the sixth possible implementation manner of the third aspect, in a ninth possible implementation manner, the apparatus further includes:

a fifth sending module, configured to send a display state request to the second terminal device, so that the second terminal device returns the current display interface of the second terminal device in response to the display state request, and displays the display interface;

The first sending module includes:

The third sending unit is configured to send a judgment request to the second terminal device according to the data type and the coordinates of the position where the first cross-device transmission operation stays in the above-mentioned display interface,

The first receiving module includes:

A receiving unit, configured to receive a judgment result made by the second terminal device based on the data type and the coordinates.

With reference to the second possible implementation manner of the third aspect, in a tenth possible implementation manner, the apparatus further includes:

a third determining module, configured to determine the processing method of the object by the second terminal device;

The second sending module also includes:

a fourth sending unit, configured to send the object and indication information to the second terminal device, where the indication information is used to instruct the second terminal device to process the object in the processing mode.

In a fourth aspect, an embodiment of the present application provides a data transmission apparatus, the method is applied to a second terminal device, the second terminal device is connected to the first terminal device, and the apparatus includes:

The second receiving module is configured to receive a judgment request sent by the first terminal device, wherein the judgment request carries the data type of the object to be transmitted, and the judgment request is used to request the second terminal device to judge the data type of the data type. Whether the object can be transmitted to the second terminal device;

The first judgment module is configured to make a judgment result according to the data type, and send the judgment result to the first terminal device, so that the first terminal device can display the judgment result.

With reference to the first possible implementation manner of the fourth aspect, the apparatus further includes:

The sixth sending module is configured to, when receiving the display state request sent by the first terminal device, return the current display interface of the second terminal device to the first terminal device, so that the first terminal device determines that the first cross-device transmission operation is in Displaying the coordinates of the stay position in the interface, wherein the first cross-device transmission operation is an operation used by the first terminal device to initiate a process of transmitting the object to the second terminal device;

Wherein, the judgment request in the fourth aspect carries the coordinates, and the first judgment module includes:

A first judgment unit, configured to make a judgment result according to the above data type and the above coordinates.

With reference to the first possible implementation manner of the fourth aspect, in a second possible implementation manner, the apparatus further includes:

The first processing module is configured to, when receiving the object sent by the first terminal device, process the object according to one or more of the data type, local storage state, application service installed by the second terminal device, and the above-mentioned coordinates.

With reference to the second possible implementation manner of the fourth aspect, in a third possible implementation manner, the first processing module includes:

a first processing unit, configured to open the object according to the application service installed by the second terminal device when the local storage state is not capable of storage;

The second processing unit is configured to store the object locally when the local storage state is capable of storing.

In combination with the third possible implementation manner of the fourth aspect, in the fourth possible implementation manner, the second processing unit is further configured to locally store the state of having storage capability and the correspondence of the above coordinates in the above display interface. When the location does not allow the data type to be inserted, the object is stored locally and the object is opened by selecting an application according to the above data type; in the local storage state, the storage capability is available, and the corresponding position of the above coordinates in the above display interface allows the data type When inserting, the object is stored locally and opened in the above-mentioned display interface according to the above-mentioned coordinates.

With reference to the fourth aspect or the first, second, third or fourth possible implementation manners of the fourth aspect, in a fifth possible implementation manner, the apparatus further includes:

a storage module, configured to temporarily store the object locally when the object sent by the first terminal device is received, if the second terminal device has a storage capability;

The third display module is used to display processing options;

The second processing module is configured to process the object according to the selection operation for the processing option.

With reference to the fourth aspect, in a sixth possible implementation manner, the apparatus further includes:

a fourth display module, configured to display the first image of the object according to the display instruction and the positional relationship between the second terminal device and the first terminal device when receiving the display instruction sent by the first terminal device,

The second image of the object displayed on the first terminal device and the first image of the object displayed on the second terminal device can be combined to form a complete image of the object.

Combining the first aspect, multiple implementations of the first aspect, the second aspect, multiple implementations of the second aspect, the third aspect, multiple implementations of the third aspect, the fourth aspect, and multiple implementations of the fourth aspect Implementation manner, in a possible implementation manner, the first cross-device transmission operation is a drag operation, and the second cross-device transmission operation is a drag release operation.

In a fifth aspect, embodiments of the present application provide a data transmission apparatus, including: a processor; a memory for storing instructions executable by the processor; wherein the processor is configured to implement the above method when executing the instructions.

In a sixth aspect, embodiments of the present application provide a non-volatile computer-readable storage medium having computer program instructions stored thereon, wherein the computer program instructions implement the above method when executed by a processor.

In a seventh aspect, an embodiment of the present application provides a terminal device, where the terminal device can execute one or more of the data transmission methods in the first aspect or multiple implementation manners of the first aspect.

In combination with the first possible implementation manner of the seventh aspect, the terminal device may also perform one or more of the data transmission methods of the second aspect or multiple implementation manners of the second aspect.

In an eighth aspect, embodiments of the present application provide a computer program product, comprising computer-readable codes, or a non-volatile computer-readable storage medium carrying computer-readable codes, when the computer-readable codes are stored in an electronic When running in the device, the processor in the electronic device executes the above method.

The data transmission method and device of the above-mentioned embodiments can provide users with intuitive visual feedback according to the data type of the object and the matching degree of the receiving end, avoid erroneous operation and repeated operation, and improve operation efficiency.

Other features and aspects of the present application will become apparent from the following detailed description of exemplary embodiments with reference to the accompanying drawings.

Description of drawings

The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate exemplary embodiments, features and aspects of the application and together with the description, serve to explain the principles of the application.

FIG. 1 shows a schematic diagram of an application scenario according to an embodiment of the present application.

FIG. 2 shows a schematic structural diagram of an internal system of a terminal device according to an embodiment of the present application.

3a and 3b respectively show a flowchart of a data transmission method according to an embodiment of the present application.

FIG. 4 shows a schematic diagram of an application scenario of a data transmission method according to an embodiment of the present application.

Fig. 5a and Fig. 5b respectively illustrate an example of a manner of displaying a judgment result according to an embodiment of the present application.

FIG. 6 shows a schematic diagram of fields included in a dragevent event according to an embodiment of the present application.

FIG. 7 shows a schematic diagram of an application scenario according to an embodiment of the present application.

8a and 8b respectively show a flowchart of a data transmission method according to an embodiment of the present application.

FIG. 8c shows an interaction flowchart of an application scenario according to an embodiment of the present application.

FIG. 9a shows a flowchart of a data transmission method according to an embodiment of the present application.

FIG. 9b shows a flowchart of a data transmission method according to an embodiment of the present application.

FIG. 9c shows a flowchart of a data transmission method according to an embodiment of the present application.

FIG. 9d and FIG. 9e respectively show schematic diagrams of a display interface of a terminal device according to an embodiment of the present application.

FIG. 9f shows a schematic diagram of a specific application scenario according to an embodiment of the present application.

FIG. 9g shows a schematic diagram of a display interface of a terminal device according to an embodiment of the present application.

FIG. 10 shows a schematic diagram of an application scenario according to an embodiment of the present application.

FIG. 11a shows a schematic diagram of a display interface of a first terminal device according to an embodiment of the present application.

FIG. 11b shows a schematic diagram of a display interface of a first terminal device according to an embodiment of the present application.

FIG. 11c shows a schematic diagram of a display interface of a first terminal device according to an embodiment of the present application.

FIG. 11d shows a schematic diagram of an application scenario of a display interface of a first terminal device according to an embodiment of the present application.

FIG. 12a shows a flowchart of a data transmission method according to an embodiment of the present application.

FIG. 12b shows a flowchart of a data transmission method according to an embodiment of the present application.

FIG. 13a shows a schematic diagram of an application scenario according to an embodiment of the present application.

FIG. 13b shows a schematic diagram of multi-screen display according to an embodiment of the present application.

FIG. 14a shows a flowchart of a data transmission method according to an embodiment of the present application.

FIG. 14b shows a flowchart of a data transmission method according to an embodiment of the present application.

FIG. 15 shows a schematic diagram of an application scenario according to an embodiment of the present application.

FIG. 16 shows a flowchart of a data transmission method according to an embodiment of the present application.

FIG. 17 shows a block diagram of a data transmission apparatus according to an embodiment of the present application.

FIG. 18 shows a block diagram of a data transmission apparatus according to an embodiment of the present application.

FIG. 19 shows a schematic structural diagram of a terminal device according to an embodiment of the present application.

FIG. 20 shows a block diagram of a software structure of a terminal device according to an embodiment of the present application.

Detailed ways

Various exemplary embodiments, features and aspects of the present application will be described in detail below with reference to the accompanying drawings. The same reference numbers in the figures denote elements that have the same or similar functions. While various aspects of the embodiments are shown in the drawings, the drawings are not necessarily drawn to scale unless otherwise indicated.

The word "exemplary" is used exclusively herein to mean "serving as an example, embodiment, or illustration." Any embodiment described herein as "exemplary" is not necessarily to be construed as preferred or advantageous over other embodiments.

In addition, in order to better illustrate the present application, numerous specific details are given in the following detailed description. It should be understood by those skilled in the art that the present application may be practiced without certain specific details. In some instances, methods, means, components and circuits well known to those skilled in the art have not been described in detail so as not to obscure the subject matter of the present application.

In order to solve the above technical problems, the present application provides a data transmission method. The data transmission method of the embodiment of the present application can realize data transmission across devices, and the transmission method can be applied to terminal devices. The degree of matching of the equipment provides intuitive visual feedback and improves operational efficiency.

In the embodiments of the present application, the party that initiates cross-device transmission of data and sends the data may be referred to as the source (source) end, and the party that receives the data may be referred to as the sink (sink) end. It should be noted that the device that is the source end in one pair of relationships may also be the sink end in another pair of relationships, that is, for one terminal device, it may be the source end of another terminal device. , and possibly the receiver of another terminal device.

The terminal equipment involved in this application (including the above-mentioned source-side equipment and receiving-side equipment) may refer to a device with a wireless connection function. For connection, the terminal device of the present application may also have the function of wired connection for communication. The terminal device of this application may be a touch screen, a non-touch screen, or no screen, and a touch screen can control the terminal device by clicking, sliding, etc. on the display screen with a finger, a stylus pen, etc. , Non-touch screen devices can be connected to input devices such as mouse, keyboard, touch panel, etc., and the terminal device can be controlled through the input device. For example, devices without a screen can be a Bluetooth speaker without a screen.

For example, the terminal device of the present application can be a smartphone, a netbook, a tablet computer, a notebook computer, a wearable electronic device (such as a smart bracelet, a smart watch, etc.), a TV, a virtual reality device, an audio system, an electronic ink, etc. .

FIG. 19 shows a schematic structural diagram of a terminal device according to an embodiment of the present application. Taking the terminal device being a mobile phone as an example, FIG. 19 shows a schematic structural diagram of the mobile phone 200 .

The mobile phone 200 may include a processor 210, an external memory interface 220, an internal memory 221, a USB interface 230, a charging management module 240, a power management module 241, a battery 242, an antenna 1, an antenna 2, a mobile communication module 251, a wireless communication module 252, Audio module 270, speaker 270A, receiver 270B, microphone 270C, headphone jack 270D, sensor module 280, buttons 290, motor 291, indicator 292, camera 293, display screen 294, SIM card interface 295, etc. The sensor module 280 may include a gyroscope sensor 280A, an acceleration sensor 280B, a proximity light sensor 280G, a fingerprint sensor 280H, and a touch sensor 280K (of course, the mobile phone 200 may also include other sensors, such as a temperature sensor, a pressure sensor, a distance sensor, and a magnetic sensor. , ambient light sensor, air pressure sensor, bone conduction sensor, etc., not shown in the figure).

It can be understood that the structures illustrated in the embodiments of the present application do not constitute a specific limitation on the mobile phone 200 . In other embodiments of the present application, the mobile phone 200 may include more or less components than shown, or combine some components, or separate some components, or arrange different components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

The processor 210 may include one or more processing units, for example, the processor 210 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor ( image signal processor, ISP), controller, memory, video codec, digital signal processor (DSP), baseband processor, and/or neural-network processing unit (NPU), etc. . Wherein, different processing units may be independent devices, or may be integrated in one or more processors. The controller may be the nerve center and command center of the mobile phone 200 . The controller can generate an operation control signal according to the instruction operation code and timing signal, and complete the control of fetching and executing instructions.

A memory may also be provided in the processor 210 for storing instructions and data. In some embodiments, the memory in processor 210 is cache memory. The memory may hold instructions or data that have just been used or recycled by the processor 210 . If the processor 210 needs to use the instruction or data again, it can be called directly from the memory. Repeated accesses are avoided, and the waiting time of the processor 210 is reduced, thereby improving the efficiency of the system.

The processor 210 may execute the data transmission method provided by the embodiments of the present application, so as to reduce the operation complexity of the user, improve the intelligence of the terminal device, and improve the user experience. The processor 210 may include different devices. For example, when the CPU and the GPU are integrated, the CPU and the GPU may cooperate to execute the data transmission method provided by the embodiments of the present application. For example, in the data transmission method, some algorithms are executed by the CPU, and another part of the algorithms are executed by the GPU. Execute for faster processing efficiency.

Display screen 294 is used to display images, videos, and the like. Display screen 294 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (active-matrix organic light-emitting diode). , AMOLED), flexible light-emitting diode (flex light-emitting diode, FLED), Miniled, MicroLed, Micro-oLed, quantum dot light-emitting diodes (quantum dot light emitting diodes, QLED) and so on. In some embodiments, cell phone 200 may include 1 or N display screens 294, where N is a positive integer greater than 1. The display screen 294 may be used to display information entered by or provided to the user as well as various graphical user interfaces (GUIs). For example, display 294 may display photos, videos, web pages, or documents, and the like. As another example, display 294 may display a graphical user interface. The GUI includes a status bar, a hideable navigation bar, a time and weather widget, and an application icon, such as a browser icon. The status bar includes operator name (eg China Mobile), mobile network (eg 4G), time and remaining battery. The navigation bar includes a back button icon, a home button icon, and a forward button icon. In addition, it can be understood that, in some embodiments, the status bar may further include a Bluetooth icon, a Wi-Fi icon, an external device icon, and the like. It can also be understood that, in other embodiments, the graphical user interface may further include a Dock bar, and the Dock bar may include commonly used application icons and the like. After the processor 210 detects a touch event of the user's finger (or stylus, etc.) on an application icon, in response to the touch event, the user interface of the application corresponding to the application icon is opened and displayed on the display 294 The user interface of the application.

In this embodiment of the present application, the display screen 294 may be an integrated flexible display screen, or a spliced display screen composed of two rigid screens and a flexible screen located between the two rigid screens.

After the processor 210 runs the data transmission method provided by the embodiment of the present application, the terminal device can establish a connection with other terminal devices through the antenna 1, the antenna 2 or the USB interface, and transmit the data according to the data transmission method provided by the embodiment of the present application. The data and control display 294 displays a corresponding graphical user interface.

Camera 293 (front camera or rear camera, or a camera that can be both a front camera and a rear camera) is used to capture still images or video. Generally, the camera 293 may include a photosensitive element such as a lens group and an image sensor, wherein the lens group includes a plurality of lenses (convex or concave) for collecting the light signal reflected by the object to be photographed, and transmitting the collected light signal to the image sensor . The image sensor generates an original image of the object to be photographed according to the light signal.

Internal memory 221 may be used to store computer executable program code, which includes instructions. The processor 210 executes various functional applications and data processing of the mobile phone 200 by executing the instructions stored in the internal memory 221 . The internal memory 221 may include a storage program area and a storage data area. The storage program area may store operating system, code of application programs (such as camera application, WeChat application, etc.), and the like. The storage data area may store data created during the use of the mobile phone 200 (such as images and videos collected by the camera application) and the like.

The internal memory 221 may also store one or more computer programs 1310 corresponding to the data transmission methods provided in the embodiments of the present application. The one or more computer programs 1304 are stored in the aforementioned memory 221 and configured to be executed by the one or more processors 210, and the one or more computer programs 1310 include instructions that may be used to perform the execution of FIG. 3a , Fig. 3b, Fig. 8a, Fig. 8b, Fig. 9a-Fig. 9c, Fig. 12a, Fig. 12b, Fig. 14a, Fig. 14b or Fig. 16 each step in the corresponding embodiment, this computer program 1310 can comprise the first obtaining module 61, The first sending module 62 , the first receiving module 63 and the first display module 64 . Wherein, the first obtaining module 61 is used for the first terminal device to obtain the data type of the object when detecting the first cross-device transmission operation for the object on the first terminal device; the first sending module 62, for sending a judgment request carrying the data type to the second terminal device, the first receiving module 63, for receiving the judgment result made by the second terminal device based on the data type, the The judgment result indicates whether the object can be transmitted to the second terminal device; the first display module 64 is used to display the judgment result. When the code of the data transmission method stored in the internal memory 221 is executed by the processor 210, the processor 210 can control the display screen to display the judgment result.

In addition, the internal memory 221 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, universal flash storage (UFS), and the like.

Certainly, the code of the data transmission method provided by the embodiment of the present application may also be stored in an external memory. In this case, the processor 210 may execute the code of the transmission method of the data stored in the external memory through the external memory interface 220 .

The function of the sensor module 280 is described below.

The gyro sensor 280A can be used to determine the movement posture of the mobile phone 200 . In some embodiments, the angular velocity of cell phone 200 about three axes (ie, x, y, and z axes) may be determined by gyro sensor 280A. That is, the gyro sensor 280A can be used to detect the current motion state of the mobile phone 200, such as shaking or still.

When the display screen in the embodiment of the present application is a foldable screen, the gyro sensor 280A can be used to detect a folding or unfolding operation acting on the display screen 294 . The gyroscope sensor 280A may report the detected folding operation or unfolding operation to the processor 210 as an event to determine the folding state or unfolding state of the display screen 294 .

The acceleration sensor 280B can detect the magnitude of the acceleration of the mobile phone 200 in various directions (generally three axes). That is, the gyro sensor 280A can be used to detect the current motion state of the mobile phone 200, such as shaking or still. When the display screen in the embodiment of the present application is a foldable screen, the acceleration sensor 280B can be used to detect a folding or unfolding operation acting on the display screen 294 . The acceleration sensor 280B may report the detected folding operation or unfolding operation to the processor 210 as an event to determine the folding state or unfolding state of the display screen 294 .

Proximity light sensor 280G may include, for example, light emitting diodes (LEDs) and light detectors, such as photodiodes. The light emitting diodes may be infrared light emitting diodes. The mobile phone emits infrared light outward through light-emitting diodes. Phones use photodiodes to detect reflected infrared light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the phone. When insufficient reflected light is detected, the phone can determine that there are no objects near the phone. When the display screen in the embodiment of the present application is a foldable screen, the proximity light sensor 280G can be arranged on the first screen of the foldable display screen 294, and the proximity light sensor 280G can detect the first screen according to the optical path difference of the infrared signal. The size of the folding or unfolding angle between the screen and the second screen.

The gyroscope sensor 280A (or the acceleration sensor 280B) may send the detected motion state information (such as angular velocity) to the processor 210 . The processor 210 determines, based on the motion state information, whether the current state is the hand-held state or the tripod state (for example, when the angular velocity is not 0, it means that the mobile phone 200 is in the hand-held state).

The fingerprint sensor 280H is used to collect fingerprints. The mobile phone 200 can use the collected fingerprint characteristics to realize fingerprint unlocking, accessing application locks, taking photos with fingerprints, answering incoming calls with fingerprints, and the like.

Touch sensor 280K, also called "touch panel". The touch sensor 280K may be disposed on the display screen 294, and the touch sensor 280K and the display screen 294 form a touch screen, also called a "touch screen". The touch sensor 280K is used to detect a touch operation on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to touch operations may be provided through display screen 294 . In other embodiments, the touch sensor 280K may also be disposed on the surface of the mobile phone 200 , which is different from the location where the display screen 294 is located.

Exemplarily, the display screen 294 of the mobile phone 200 displays a main interface, and the main interface includes icons of multiple applications (such as a camera application, a WeChat application, etc.). The user clicks the icon of the camera application in the main interface through the touch sensor 280K, which triggers the processor 210 to start the camera application and turn on the camera 293 . Display screen 294 displays an interface of a camera application, such as a viewfinder interface.

The wireless communication function of the mobile phone 200 can be realized by the antenna 1, the antenna 2, the mobile communication module 251, the wireless communication module 252, the modulation and demodulation processor, the baseband processor, and the like.

Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in handset 200 may be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, the antenna 1 can be multiplexed as a diversity antenna of the wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.

The mobile communication module 251 can provide a wireless communication solution including 2G/3G/4G/5G, etc. applied on the mobile phone 200 . The mobile communication module 251 may include at least one filter, switch, power amplifier, low noise amplifier (low noise amplifier, LNA) and the like. The mobile communication module 251 can receive electromagnetic waves from the antenna 1, filter and amplify the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 251 can also amplify the signal modulated by the modulation and demodulation processor, and then turn it into an electromagnetic wave for radiation through the antenna 1 . In some embodiments, at least part of the functional modules of the mobile communication module 251 may be provided in the processor 210 . In some embodiments, at least part of the functional modules of the mobile communication module 251 may be provided in the same device as at least part of the modules of the processor 210 . In this embodiment of the present application, the mobile communication module 251 may also be used for information interaction with other terminal devices.

The modem processor may include a modulator and a demodulator. Wherein, the modulator is used to modulate the low frequency baseband signal to be sent into a medium and high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low frequency baseband signal. Then the demodulator transmits the demodulated low-frequency baseband signal to the baseband processor for processing. The low frequency baseband signal is processed by the baseband processor and passed to the application processor. The application processor outputs sound signals through audio devices (not limited to the speaker 270A, the receiver 270B, etc.), or displays images or videos through the display screen 294 . In some embodiments, the modem processor may be a stand-alone device. In other embodiments, the modulation and demodulation processor may be independent of the processor 210, and may be provided in the same device as the mobile communication module 251 or other functional modules.

The wireless communication module 252 can provide applications on the mobile phone 200 including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellite systems ( global navigation satellite system, GNSS), frequency modulation (frequency modulation, FM), near field communication technology (near field communication, NFC), infrared technology (infrared, IR) and other wireless communication solutions. The wireless communication module 252 may be one or more devices integrating at least one communication processing module. The wireless communication module 252 receives electromagnetic waves via the antenna 2 , frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 210 . The wireless communication module 252 can also receive the signal to be sent from the processor 210 , perform frequency modulation on the signal, amplify the signal, and then convert it into an electromagnetic wave for radiation through the antenna 2 . In this embodiment of the present application, the wireless communication module 252 is configured to transmit data with other terminal devices under the control of the processor 210. For example, when the processor 210 executes the data transmission method provided in the embodiment of the present application, the processor may Control the wireless communication module 252 to send a judgment request to other terminal equipment, and can also receive judgment results made by other terminal equipment based on the above judgment request, the judgment result indicates whether the data to be transmitted can be transmitted to other terminal equipment, and then control the display screen 294 to display Judging the results, providing users with intuitive visual feedback, avoiding wrong operations and repeated operations, and improving operation efficiency

In addition, the mobile phone 200 can implement audio functions through an audio module 270, a speaker 270A, a receiver 270B, a microphone 270C, an earphone interface 270D, and an application processor. Such as music playback, recording, etc. The cell phone 200 can receive key 290 input and generate key signal input related to user settings and function control of the cell phone 200 . The mobile phone 200 can use the motor 291 to generate vibration alerts (eg, vibration alerts for incoming calls). The indicator 292 in the mobile phone 200 may be an indicator light, which may be used to indicate a charging state, a change in power, and may also be used to indicate a message, a missed call, a notification, and the like. The SIM card interface 295 in the mobile phone 200 is used to connect the SIM card. The SIM card can be contacted and separated from the mobile phone 200 by inserting into the SIM card interface 295 or pulling out from the SIM card interface 295 .

It should be understood that, in practical applications, the mobile phone 200 may include more or less components than those shown in FIG. 19 , which are not limited in this embodiment of the present application. The illustrated handset 200 is merely an example, and the handset 200 may have more or fewer components than those shown, two or more components may be combined, or may have different component configurations. The various components shown in the figures may be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and/or application specific integrated circuits.

The software system of the terminal device can adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservice architecture, or a cloud architecture. The embodiments of the present application take an Android system with a layered architecture as an example to exemplarily describe the software structure of a terminal device.

FIG. 20 is a block diagram of a software structure of a terminal device according to an embodiment of the present application.

The layered architecture divides the software into several layers, and each layer has a clear role and division of labor. Layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, which are, from top to bottom, an application layer, an application framework layer, an Android runtime (Android runtime) and system libraries, and a kernel layer.

The application layer can include a series of application packages.

As shown in Figure 20, the application package may include applications such as phone, camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, and short message.

The application framework layer provides an application programming interface (application programming interface, API) and a programming framework for the applications of the application layer. The application framework layer includes some predefined functions.

As shown in Figure 20, the application framework layer may include window managers, content providers, view systems, telephony managers, resource managers, notification managers, and the like.

A window manager is used to manage window programs. The window manager can get the size of the display screen, determine whether there is a status bar, lock the screen, take screenshots, etc. The window manager may also be used to detect whether there is an extension device transmission operation in this embodiment of the present application, such as a drag and drop operation.

Content providers are used to store and retrieve data and make these data accessible to applications. The data may include video, images, audio, calls made and received, browsing history and bookmarks, phone book, etc.

The view system includes visual controls, such as controls for displaying text, controls for displaying pictures, and so on. View systems can be used to build applications. A display interface can consist of one or more views. For example, the display interface including the short message notification icon may include a view for displaying text and a view for displaying pictures.

The telephony manager is used to provide the communication function of the terminal device. For example, the management of call status (including connecting, hanging up, etc.).

The resource manager provides various resources for the application, such as localization strings, icons, pictures, layout files, video files and so on.

The notification manager enables applications to display notification information in the status bar, which can be used to convey notification-type messages, and can disappear automatically after a brief pause without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc. The notification manager can also display notifications in the status bar at the top of the system in the form of graphs or scroll bar text, such as notifications of applications running in the background, and notifications on the screen in the form of dialog windows. For example, text information is prompted in the status bar, a prompt sound is issued, the terminal device vibrates, and the indicator light flashes.

Android Runtime includes core libraries and a virtual machine. The Android runtime is responsible for the scheduling and management of the Android system.

The core library consists of two parts: one is the function functions that the java language needs to call, and the other is the core library of Android.

The application layer and the application framework layer run in virtual machines. The virtual machine executes the java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object lifecycle management, stack management, thread management, safety and exception management, and garbage collection.

A system library can include multiple functional modules. For example: surface manager (surface manager), media library (Media Libraries), 3D graphics processing library (eg: OpenGL ES), 2D graphics engine (eg: SGL) and so on.

The Surface Manager is used to manage the display subsystem and provides a fusion of 2D and 3D layers for multiple applications.

The media library supports playback and recording of a variety of commonly used audio and video formats, as well as still image files. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

2D graphics engine is a drawing engine for 2D drawing.

The kernel layer is the layer between hardware and software. The kernel layer contains at least display drivers, camera drivers, audio drivers, and sensor drivers.

FIG. 1 shows a schematic diagram of an application scenario according to an embodiment of the present application. As shown in Figure 1, a wireless connection can be established and paired between the first terminal device and the second terminal device through Bluetooth, hotspot, WIFI, etc., or a wired connection, such as between a mobile phone and a laptop It is connected through a USB data line, etc., and the specific connection manner is not limited in this application. It can be understood by those skilled in the art that both the first terminal device and the second terminal device may be a source end or a receiving end. In the embodiments of the present application, in order to clearly describe the technical solution, unless otherwise specified , the first terminal device is the source end, and the second terminal device is the receiver end.

FIG. 2 shows a schematic diagram of the internal system structure of a terminal device according to an embodiment of the present application. As shown in FIG. 2 , the system of the terminal device may include an application service layer and an application framework layer (the Framework in FIG. 2 is an example) And a cross-device transmission service system that implements a function of cross-device data transmission. For example, the drag-and-drop service system in FIG. 2 is an example of a cross-device transmission service system.

The application framework layer can refer to the relevant content in Figure 20. In this embodiment, the application framework layer may include inputDispatcher, View system, and WmS (windowManagerService). The inputDispatcher in the Framework layer is responsible for receiving user operations and distributing them to various Window processing; WmS can manage the displayed windows as part of the window manager together with the View system. WmS responds to user operations in the window, such as drag and drop actions, touch screen actions, click operations, etc. WmS responds to user operations to determine Whether the user operation is a cross-device transfer operation (for example, a drag-and-drop operation), the cross-device transfer operation here may refer to an operation used to transfer an object on one terminal device to another terminal device, that is, the terminal device detects the As the operation of the source end, the cross-device transmission operation can be one or a series of preset operations. When WmS compares the user operation with the preset operation and determines that the user operation conforms to the preset operation, it can determine that the user operation is a cross-device operation. transfer operation. If WmS determines that the user operation is a cross-device transfer operation, it can generate a cross-device transfer event and send it to the drag and drop service system. The drag and drop service system can be added at the system runtime layer to implement various forms based on drag and drop The drag service system can monitor the cross-device transmission event of the Framework layer, and send the cross-device transmission event to the drag service system of another connected terminal device.

The application service in the application service layer can register the monitoring of cross-device transmission operations (for example, drag and drop monitoring) in the WmS of the Framework layer. After registering the monitoring of the cross-device transmission operation, if the Framework layer of the terminal device detects that there is a target When a cross-device transmission event (for example, a drag event) of an application service or a drag service system of one terminal receives a cross-device transmission event sent by a drag service system of another terminal, the Framework layer can send the cross-device transmission event to the application Service, the application service can determine whether it can accept the object (data) of the event passed across the device. The cross-device transmission event for an application service may refer to a user dragging an object on one terminal to an application service on another terminal, a location in the application service, etc., and the Framework layer of the terminal device detects that there is a target for the application in the window. The cross-device transmission event of a service may refer to the event that the device serving as the receiving end detects the drag and drop of the object in the local display window after receiving the object sent by the source end, which is used to drag the object into the application service or the application service. Location operation, at this time, the framework layer of the receiving end can send the cross-device transmission event to the application service, and the application service can determine whether it can accept the object (data) of the cross-device transmission event.

In a possible implementation manner, the drag-and-drop service system in FIG. 2 may include a first interface and a second interface. The first interface can be used for communication with the Framework layer, and the second interface can be used for communication with the communication component of the terminal device. The communication component of the terminal device can be a wireless communication component, such as an antenna, etc., or It is a hardware interface for realizing wired communication, which is not limited in this application.

Both the first interface and the second interface can be implemented in the form of software interfaces. For example, both the first interface and the second interface can be implemented by callback functions, and other functions of the drag-and-drop service system can also be implemented in the form of software. For example, you can register a callback function that monitors the cross-device transmission operation in the Framework layer, that is to say, you can register the pointer to call the drag service system (drag service function) in the Framework layer, and the Framework layer is listening to the cross-device transmission operation. , a cross-device transmission event can be generated, thereby triggering the invocation of the drag service system (drag service function). The dragging service system can generate a judgment request according to the cross-device transmission event of the Framework layer, and send it to another terminal device through the second interface and the communication component. After receiving the judgment request, the dragging service system of the other terminal device may send it to its own Framework layer through the first interface.

It should be noted that FIG. 2 only shows the internal structure in the Framework layer of one terminal device, and another terminal device also has the same structure, which is just not shown.

The operating system installed in the terminal device can be Android, ios, windows, mac, Linux and other systems, which are not limited in this application. For different systems, the application program of the drag and drop service can be developed according to the above method to support the drag and drop service. way to transfer data across devices.

It can be known from the above examples that by improving the system of the terminal device or adding a new application service, data can be transmitted between the two terminals. On this basis, the data transmission method of the present application is introduced. FIG. 3 a and FIG. 3 b respectively show a flowchart of the data transmission method according to an embodiment of the present application. The data transmission method shown in FIG. 3a can be applied to the first terminal device in FIG. 1, that is, can be applied to the source end device, and the transmission method can include:

Step S100, the first terminal device acquires the data type of the object when detecting a first cross-device transmission operation for the object on the first terminal device, wherein the first cross-device transmission operation is used to initiate the process of transmitting the object to the second terminal device;

Step S101, sending a judgment request carrying the data type to the second terminal device,

Step S102, receiving a judgment result from the second terminal device based on the data type, where the judgment result indicates whether the object can be transmitted to the second terminal device;

Step S103, displaying the judgment result.

The method shown in FIG. 3b can be applied to the second terminal device in FIG. 1, that is, can be applied to the receiving end device. In this embodiment, the data transmission method can include:

Step S201: Receive a judgment request sent by a first terminal device, wherein the judgment request carries the data type of the object to be transmitted, and the judgment request is used to request the second terminal device to judge whether the object of the data type can be transmission to the second terminal device;

Step S202: Make a judgment result according to the data type, and send the judgment result to the first terminal device, so that the first terminal device displays the judgment result.

In step S100, the first cross-device transfer operation is used to initiate a process of transferring the object to the second terminal device, which may mean that the dragging service system can be invoked through the first cross-device transfer operation. That is to say, the user can trigger the dragstart event through the first cross-device transmission operation on the display screen of the first terminal device. In the dragstart event, the drag data (object) can be specified through setData(), and the dragstart event can be triggered by triggering the dragstart event. The service system initiates the process of transferring the object to the second terminal device.

As shown in FIG. 2 , the Framework layer of the first terminal device can monitor user operations, and an operation capable of evoking the dragging service system can be preset on the first terminal device and the second terminal device as a preset operation, and the first terminal device can The monitored user operation is compared with the preset operation, and when the user operation matches the preset operation, the first terminal device can determine that there is a first cross-device transmission operation for a certain object, which is equivalent to detecting a first cross-device transmission operation for a certain object. The first cross-device transfer operation of the object on the terminal device can evoke the dragging service system.

In a possible implementation manner, the first cross-device transmission operation may refer to a process from initiating an operation to an operation stop, and when the operation stop position is within a preset area of the first terminal device (such as the edge of the display screen, etc.) , indicating that cross-device transfer is to be performed, and the dragging service system can be invoked.

In a possible implementation manner, the first cross-device transmission operation may be a drag operation. For the convenience of description, the drag operation is used as an example for description below, but the present application is not limited to this. For different terminal device types (such as , touch screen device or non-touch screen device) or different objects, the corresponding first cross-device operations may also be different.

For example, for a touch screen device, the preset operation can be the user's finger or palm to long press the object, drag the object to the edge of the screen, or use the stylus to tap the object and immediately slide to the edge of the screen, the sliding direction Not limited, you can go down, up, left, right, or in other directions, or, after selecting a piece of text, long-press the selected text to bring up the multiple controls that can include the "Cross-device transfer" control. When the "device transfer" control is triggered, the drag service system can be invoked, that is, the preset operation can be that the "cross-device transfer" control is triggered, and so on. For non-touch screen devices, the preset operation can be to move the mouse to the object, click the left mouse button with your finger and drag it to the edge of the display screen, or use your finger to control the touch panel to select the object and drag it to the edge of the screen. and many more. It should be noted that the above possible ways in which the first terminal device detects the first cross-device transmission operation are only some examples of the present application, and the present application is not limited thereto.

The objects of this application may be documents, folders, texts, pictures, and may also be audio, video, or links. The first terminal device may identify the data type by the extension of the data. For example, for an object, by identifying the extension of the object, the data type of the object may be acquired. Taking video as an example, if the extension of the object has ".avi", ".mov" and other extensions representing images, the data type of the object can be identified as video; taking audio as an example, if the extension of the object is in With ".wav", ".mp4", ".mp3" and other extensions representing sound, the type of the object can be identified as audio.

In a possible implementation, the drag data specified by setData() in the dragstart event may contain two pieces of information, namely the data type and the data value, that is, the data type of the object and the data corresponding to the object. After a terminal device obtains the data type of the object, it can be added to the setData() of the dragstart event. When the dragstart event is triggered to evoke the drag service system, the drag service system can send the data to the second terminal according to the data type specified in the dragstart event. When judging the request, judge the data type of the object that can be carried in the request.

FIG. 4 shows a schematic diagram of an application scenario of a data transmission method according to an embodiment of the present application. As shown in Figure 4, device 1 and device 2 are paired and connected wirelessly, device 2 and device 3 can be paired and connected wirelessly, or connected by wire, and device 1 and device 3 are connected wirelessly. or wired connection. The cross-device data transmission in this embodiment of the present application may be performed between the device 1 , the device 2 , and the device 3 .

In a possible implementation manner, device 1 and device 2 may be touch-screen terminal devices, such as smart phones, tablet computers, etc., and multiple application programs may be installed on both device 1 and device 2, such as shown in FIG. 4 . It shows that both device 1 and device 2 can have application A and application B installed. Application A can refer to "rich media" applications such as social networking, email, browser, etc., and the content can include text, pictures, documents, links, etc., and application B can Refers to file management applications, such as file manager, gallery, the content mainly includes pictures, video, audio and documents, no separate text content. The device 3 may be a non-touch screen device, such as a laptop computer, and a program A may be installed on the device 3 and a folder may be stored. The program A may refer to applications such as office software and a browser in the Windows/Mac system. FIG. 4 shows some example data types and possible presentation forms of objects. The presentation forms may be located in applications or archive management. The present application is not limited to the types and presentation forms of objects shown in FIG. 4 .

For step S101, as shown in FIG. 2, the first terminal device may send a judgment request to the drag service system of the second terminal device through the awakened drag service system, and the judgment request includes the data type of the object. Therefore, in step S201, the second terminal equipment receives the judgment request sent by the first terminal equipment, and the judgment request carries the data type of the object to be transmitted, and the judgment request is used to request the second terminal equipment to judge that the data type has the above-mentioned data type. whether the object can be transferred to the second terminal device.

For step S202, in a possible implementation manner, the second terminal device may determine whether or not to transmit to the second terminal device according to the data type of the object and the type of the second terminal device, and each type of second terminal device may pre- There are data types that are allowed or not allowed to be transferred. For example, if the object is a text file or folder, and the second terminal device is a Bluetooth speaker, then the judgment result of the second terminal device can be that it cannot be transmitted to the second terminal device; the object is an audio file or a video file with audio, the first The second terminal device is a Bluetooth speaker, then, the judgment result of the second terminal device may be able to be transmitted to the second terminal device.

For step S202, in a possible implementation manner, the second terminal device may further determine whether the data can be transmitted to the second terminal device according to the data type of the object and the application service installed by the second terminal device. The application service installed on the second terminal device may refer to an application program or software program installed on the second terminal device, for example, an APP installed on a smart phone, a software program installed on a laptop computer, and the like.

The above is merely an example to provide two implementation manners of judging whether the data can be transmitted to the second terminal device according to the data type of the object, and the present application is not limited thereto.

After making the judgment result, the second terminal device can send the judgment result to the drag service system of the first terminal device through the drag service system, and the drag service system of the first terminal device can send the judgment result after receiving the judgment result. For the Framework layer, the Framework layer controls the display screen of the first terminal device to display the judgment result.

There may be various manners for displaying the judgment result, and FIG. 5a and FIG. 5b respectively show an example of the manner of displaying the judgment result according to an embodiment of the present application. Fig. 5a shows a schematic diagram of a display interface of a first terminal device in two examples, and Fig. 5b shows a schematic diagram of a display interface of the first terminal device in another two examples. The edge regions of the display screen are illustrated in dashed lines in Figures 5a and 5b.

For example, as shown in Figure 5a, taking the mouse dragging method as an example, a small icon can be displayed near the pointer of the mouse on the display screen. Different colors of the small icon can represent different judgment results. For example, the small icon is green Indicates that it can be transmitted to the second terminal device, and the small icon is red to indicate that it cannot be transmitted to the second terminal device, or, as shown in Figure 5a, different shapes of the small icon can represent different judgment results, and the small icon is a check mark "√" It can indicate that it can be transmitted to the second terminal device, the small icon with a cross "x" can indicate that it cannot be transmitted to the second terminal device, and so on.

As shown in Figure 5b, taking finger operation as an example, prompt information can be displayed near the icon of the object (such as a thumbnail), so as to display the judgment result. For example, the prompt information "XX cannot be received" can be displayed in the upper right corner of the icon of the object. Or "XX acceptable" to indicate different judgment results, where "XX" can indicate the identification information of the second terminal device, and the example of mouse operation can also display the judgment results in this way.

The displayed judgment result may also include the reason for generating the judgment result, such as "device B cannot receive the .avi format file", etc., so that the user can know the reason more intuitively and take corresponding solutions.

It should be noted that the above manners of displaying the judgment results are only some examples of the present application, and the present application is not limited in any way, as long as the judgment results can be displayed to the user intuitively.

Through the data transmission method of the above-mentioned embodiments of the present application, intuitive visual feedback can be provided to the user according to the data type of the object and the matching degree of the receiving end, so as to avoid erroneous operation and repeated operation, and improve the operation efficiency.

In the related art, only text, documents, pictures, and files can be dragged and dropped, and the content that can be dragged is limited. In order to solve this technical problem, the present application adds an extended field to the dragevent event for extending the draggable content. FIG. 6 shows a schematic diagram of fields included in a dragevent event according to an embodiment of the present application. As shown in Figure 6, the fields label and mimeTypes outlined by the dotted line are the fields extended on the clipDescription object, where the label is a String (string) type, and the action action can be extended, such as "open", and mimeTypes is the data of the object Type, the dragged object and the actions on the dragged object can be extended through the above two extended fields.

In Figure 6, the "action" on the left side directly connected to the dragevent event refers to actions such as drag, dragstart, dragenter, dragend, drop, etc., which refers to a series of drag actions; x and y can indicate the position where the drag action stays. Coordinates, clipdata can refer to some attributes of the dragged data, such as the MIME type of the clip object, the ClipData.Item object contains text, web page text, Uri or Intent data; result can be a field that records the returned judgment result. It should be noted that, what is shown in FIG. 6 is only one way of extending fields in the present application, and the present application is not limited to this, and fields can also be extended on other suitable objects or positions on dragevent events.

Therefore, in a possible implementation manner, the judgment request may carry a data type field and/or an extended data type field, and the data type field and the extended data type field are used to indicate the data type of the object. In this way, when the dragging service system of the first terminal device sends the judgment request to the second terminal device, the second terminal device can judge whether the first terminal device is ready to move according to the data type field and/or the extended data type field. to the object of the second terminal device to obtain the judgment result.

The data transmission method according to the above-mentioned embodiments of the present application can expand the content that can be dragged, and the expanded data type field can indicate a custom, or a data type suitable for a specific device or application, or a new data type, so that cross-device transmission is possible. More data types and devices are applicable to the data, which is convenient for users to operate.

For example, in the related art, it is impossible to implement the drag and drop operation of official account articles on some social platforms. According to the embodiment of the present application, the data type "Weblinks" can be added to the extended field of the dragevent event, and the corresponding action can be opening in a browser or opening in an application corresponding to a social platform, etc., which can be represented by different strings. A different action, in one example, for the "Weblinks" data type, may default to opening with a browser if not set (eg, the label field is empty).

FIG. 7 shows a schematic diagram of an application scenario according to an embodiment of the present application. As shown in FIG. 7 , assuming that both the first terminal device and the second terminal device are smart phones, the first terminal device opens the application A with a link The official account article (the link can be an object), the preset operation for this type of object can be a large area touch and then slide to one side, the first terminal device detects the large area touch on the currently displayed page and then moves to one side During the swipe operation, it can be determined to perform cross-device transmission for the official account article with the link opened in application A. For example, as shown in Figure 7, when the user touches the screen with the entire palm or most of the palm and slides to the right to trigger the dragstart event, the first terminal device can send a judgment request to the second terminal device, and the judgment request table contains Extended data type field: The data type is "Weblinks", and the label field is empty. The second terminal device receives the judgment request. The second terminal device is a smart phone and has a browser installed locally. Therefore, the judgment result can be transmitted to the second terminal device, and the second terminal device can send the judgment result to the first terminal. device, the first terminal device displays the judgment result on the display screen. After the user sees the judgment result, if the user releases the drag gesture, that is, the first terminal device detects the drop operation, the above link and the extended data type field can be added. It is sent to the second terminal device, and the second terminal device recognizes that the data type of the object is "Weblinks" and the label field is empty according to the extended data type. Therefore, the object is opened by default, as shown in Figure 7, in the browser Open the link in.

Figures 8a and 8b respectively show a flowchart of a data transmission method according to an embodiment of the present application. The transmission method shown in Figure 8a can be applied to the first terminal device. As shown in Figure 8a, the transmission method of this embodiment Can include:

Step S800, the first terminal device acquires the data type of the object when detecting a first cross-device transmission operation for the object on the first terminal device, wherein the first cross-device transmission operation is used to initiate the process of transmitting the object to the second terminal device;

Step S801, sending a judgment request carrying the data type to the second terminal device,

Step S802, receiving a judgment result from the second terminal device based on the data type, where the judgment result indicates whether the object can be transmitted to the second terminal device;

Step S803, displaying the judgment result;

Step S804, when the judgment result is that it can be transmitted to the second terminal device and a second cross-device transmission operation is detected, the object is sent to the second terminal device, and the second cross-device transmission operation is used for confirmation The object is transmitted to the second terminal device for display.

Wherein, for steps S800-S803, reference may be made to the description of steps S100-S103 in the embodiment section corresponding to FIG. 3a, and details are not repeated here.

For step S804, the second cross-device transfer operation corresponds to the first cross-device transfer operation. For example, if the first cross-device transfer operation is a drag operation, the second cross-device transfer operation may be a drag release operation. Taking a non-touch screen device as an example, if the first cross-device transfer operation is to click and drag the left mouse button with a finger, then the second cross-device transfer operation can be to release the left mouse button, or take a touch screen device as an example. , if the first cross-device transmission operation is that the finger or the touch pen presses and drags the object, then the second cross-device transmission operation may be that the finger or the touch pen leaves the touch screen.

Sending the object to the second terminal device may refer to sending one or more of the data corresponding to the object, the data type, the indication information of the processing method of the object, etc. to the second terminal device, and the second terminal device may send the object according to the processing method. Process the data. Wherein, in a possible implementation manner, as described above, the indication information of the processing manner of the object may also be carried in the dragstart event.

The transmission method shown in FIG. 8b may be applied to the second terminal device. As shown in FIG. 8b, the transmission method of this embodiment may include:

Step S301: Receive a judgment request sent by a first terminal device, wherein the judgment request carries the data type of the object to be moved, and the judgment request is used to request the second terminal device to judge whether the object of the data type can be transmission to the second terminal device;

Step S302, making a judgment result according to the data type, and sending the judgment result to the first terminal device, so that the first terminal device displays the judgment result;

Step S303, when receiving the object sent by the first terminal device, process the object according to one or more of the data type, local storage state, and application services installed by the second terminal device .

Wherein, for steps S301-S302, reference may be made to the description of steps S201-S202 in the embodiment part corresponding to FIG. 3b, and details are not repeated here.

For step S303, taking the local storage state as an example, when the local storage state is not having the storage capability, the second terminal device can open the object according to the application service installed by the second terminal device; when the local storage state is having the storage capability, the first Two end devices can store objects locally.

In a possible implementation manner, the local storage state of the second terminal device is that it does not have the storage capability, and the second terminal device can select the application service installed by the second terminal device to open the object according to the data type of the object, or the second terminal device can open the object. It is also possible to display a selectable option of an application service installed by the second terminal device, and open the object according to the application service selected by the user.

In a possible implementation manner, the local storage state of the second terminal device is capable of storing. In addition to storing the object locally, the second terminal device can also process the object according to the operation specified by the first terminal device, as described above. , when the first terminal device sends the object to the second terminal device, it also sends the indication information of the processing method for the object, so the second terminal device can process the object according to the processing method. If the first terminal device does not specify a processing method for the object, the second terminal device can select the installed application service to open the object according to the data type of the object, or, as described above, open the object according to the application service selected by the user.

It should be noted that the above are only examples of several processing methods for objects shown in this application, and do not limit this application in any way.

FIG. 8c shows an interaction flowchart of an application scenario according to an embodiment of the present application. As shown in Figure 8c, device A is an example of a first terminal device, device B is an example of a second terminal device, device A (Framework layer) detects a drag operation for a local object, and the Framework layer of device A generates a dragstart event , arouse the dragging service system of device A. The dragging service system of device A can generate a judgment request according to the data type of the object specified by the dragstart event. The judgment request can be a request to judge whether to allow dragging in. The dragging service system of device A Send the judgment request to the drag service system of device B, and the drag service system of device B sends the judgment request to the WindowManager on the device B, and then the WindowManager sends it to the WmS, and the WmS can send the judgment request to the corresponding application service ( APP), the application service makes a judgment result in response to the judgment request, and returns the judgment result to device A step by step, and device A can display the judgment result. If the judgment result is that dragging is allowed, the Framework layer of device A detects the drag release operation, and can send the object to the dragging service system of device A, and the dragging service system of device A transmits the object to the dragging service system of device B. After receiving the object, the dragging service system of device B can save the object and send it to the Framework layer and the application service layer through the notifyDragAndDrop message to process the object.

The data transmission method according to the above-mentioned embodiment can simplify the user operation, and through simple dragging and other actions, not only can the display position of the object be changed, copied, transmitted, etc., but also can be directly processed at the receiving end according to the data type of the object For example, in addition to storage, you can also choose to open the application service, open with the currently opened application service, etc., without the user's further operation on the receiving end, which greatly simplifies the user's operation.

FIG. 9a shows a flowchart of a data transmission method according to an embodiment of the present application. Fig. 9a shows a flowchart of an example of a process included in the step "send the object to the second terminal device" in step S804. As shown in Fig. 9a, the step "send the object to the second terminal device" The "object" may include:

Step S8041, temporarily storing the object locally in the first terminal device;

Step S8042, sending a data transmission request to the second terminal device, where the data transmission request is used to transmit the object;

Step S8043, sending the object according to the first response signal when receiving the first response signal returned by the second terminal device for accepting the data transmission request;

Step S8044, when receiving the second response signal returned by the second terminal device not to accept the data transmission request, cancel sending the object.

FIG. 9b shows a flowchart of a data transmission method according to an embodiment of the present application. The transmission method of FIG. 9b may be applied to the second terminal device, and the transmission method of this embodiment may include:

Step S204, displaying processing options when receiving the data transmission request sent by the first terminal device;

Step S205: Determine a response signal in response to the data transmission request according to the selection operation for the processing option, and send the response signal to the first terminal device.

That is to say, when the first terminal device determines that it can be transmitted to the second terminal device and detects the second cross-device transmission operation, it can temporarily store the object locally in the first terminal device and send data to the second terminal device. For the transmission request, the object is processed according to the response signal for the data transmission request returned by the second terminal device.

When the second terminal device receives the data transmission request sent by the first terminal device, it displays processing options, and the processing options may refer to the processing options of the object, for example, it may be a plurality of selectable controls displayed in the form of controls, It can also be the prompt information of different gestures that can be selected.

In one example, the second terminal device displays a plurality of selectable controls in the form of controls, for example, "Cancel", "Delay Send", "Receive" and so on. In another example, the second terminal device displays processing options with different gestures that can be selected. For example, a gesture of swiping left on the display screen indicates canceling sending, a gesture swiping right indicates receiving, upward or A swipe down gesture indicates a delayed send.

In step S205, the response signal in response to the data transmission request may include a first response signal and a second response signal. The first response signal may be a signal indicating acceptance of the data transmission request. For example, if the user selects to receive or delay sending, or if the user swipes to the right, swipes upward, etc., it indicates that the second terminal device allows the data to be sent. The object corresponding to the transmission request. In this case, the second terminal device determines that the response to the data transmission request is the first response signal, and sends the first response signal to the first terminal device. The second response signal may indicate that the data transmission request is not accepted, that is, the second terminal device does not allow the first terminal device to send the object corresponding to the data transmission request. Sliding, etc., the second terminal device may determine, according to the user's selection operation for the processing option, that the response to the data transmission request is the second response signal, and send the second corresponding signal to the first terminal device.

In step S8043, when receiving the first response signal, the first terminal device sends the object according to the first response signal. For example, when receiving the first response signal, the first terminal device may directly send the object or delay sending the object. The delay time for delayed sending may be preset by the first terminal device, or may be specified by the first response signal fed back by the second terminal device. For example, when the second terminal device displays the processing options, The option can also provide the user with the option of delay time selection, or provide an input box for the delay time, and collect the delay time input by the user through the input box, and the second terminal device can generate the first response signal according to the delay time selected or input by the user, and Send the first response signal to the first terminal device, and the first terminal device may delay the sending object according to the delay time carried by the first response signal.

In step S8044, the first terminal device cancels the sending object when receiving the second response signal. After revoking the sending object, the object can be stored (temporarily stored) in the foreground of the first terminal device for a certain period of time. The duration of the storage time can be preset by the first terminal, or it can be adjusted in real time according to the amount of data stored in the foreground, for example , when the amount of saved data exceeds a set threshold, the oldest saved data can be deleted, and so on.

In a possible implementation manner, after canceling the sending object, it may further include:

When a call-out instruction for the temporarily stored object is detected, the temporarily stored object is called out, and the data transmission request is sent to the second terminal device.

This step is only required after most objects are temporarily stored locally on the first terminal device, and after canceling the sending of objects, it is only an example, and the specific scenario is not limited to this.

That is to say, after canceling the sending object, if the user wants to continue sending the object again, the temporarily stored object can be called out through a call-out instruction, and the call-out instruction can be detected when the first terminal device detects the user's call-out operation. Yes, the recall operation can be a preset operation, such as sliding to the middle along one side of the screen. The first terminal device may also resend the data transmission request to the second terminal device, and the subsequent process may refer to the above description.

According to the data transmission method of the above-mentioned embodiment, selectable operations for the dragged object can be displayed on the display screen of the receiving end device, which is convenient for the user to adjust the transmission process or processing method according to actual needs, so that the second terminal The device can process objects according to actual needs.

In a possible implementation manner, the user can also temporarily store multiple objects in the foreground of the first terminal device by using the above-mentioned process, for example, send the first object to the second terminal device, and then send the first object to the second terminal device. The device sends the second object, and both the first object and the second object are temporarily stored in the foreground of the first terminal device. In this case, if the second terminal device continuously receives multiple data transmission requests, the provided processing options are the same as It can be different if only one data transmission request is received. For example, "all receive" and "all delay" can be provided. The second terminal device can also display thumbnails of multiple objects, and display a selected control near the thumbnail of each object. For the user to choose, the user can select the object to be received, and then select "receive" or "delay reception" or "cancel", and so on. The second terminal device may process the object according to the detected selection operation.

FIG. 9c shows a flowchart of a data transmission method according to an embodiment of the present application. The transmission method of FIG. 9c may be applied to the second terminal device, and the transmission method of this embodiment may include:

Step S206, when receiving the object sent by the first terminal device, if the second terminal device has storage capability, temporarily store the object locally;

Step S207, displaying processing options;

Step S208, processing the object according to the selection operation for the processing option.

That is to say, in step S804, after the first terminal device sends the object to the second terminal device, when the second terminal receives the object, it can first determine whether the local storage capability is available, and if the storage capability is available, the object can be temporarily stored Local, for example, temporarily in the foreground. Then, the processing options are displayed, and the displayed processing options and the process of processing the object according to the selection operation for the processing options can be referred to the descriptions of steps S204-S205 above, and will not be repeated.

In a possible implementation manner, after the object is temporarily stored locally, if the second terminal device detects a drag operation for the temporarily stored object, it can determine whether the position where the drag operation stays is a draggable operation The location generates and displays the determination result. For example, the second terminal device can determine whether the location is a draggable location according to the coordinates of the location where the drag operation stays in the current display interface and/or the data type of the object.

In an example, if the current display interface of the second terminal device is a desktop or a folder, and if the dragging operation stays on a blank position or folder on the desktop, it is determined that the position can be dragged. If the drag operation is released, the second terminal device can directly store the object locally, for example, in a system disk or a folder, and can also select an application service to open the object according to the data type of the object, or as described above, according to the user The selected application service opens the object.

In another example, if the drag operation stays on the shortcut icon of the application service, the second terminal device may determine whether it is a draggable position according to the data type of the object and the application service. For example, if the application service can open the object of this data type, it can be judged that it can be dragged into the position. If the drag operation is released, the second terminal device can use the application service to open the object; if the application service cannot open the data type If the drag operation is released, the object can be saved locally, and the application service installed on the second terminal device can be selected to open the object according to the data type of the object, or as described above , which opens the object according to the application service selected by the user.

In another example, if the second terminal device currently opens the application service, the second terminal device can determine whether the position is draggable according to the position where the drag operation stays in the current display interface of the application service and the data type of the object into the location.

In a possible implementation manner, the application services of the first terminal device and the second terminal device may register the drag monitor in the Framework layer in advance, for example, register the drag monitor with the WmS of the Framework layer. In this way, when detecting a drag event or receiving a drag event sent by another terminal device, the Framework layers of the first terminal device and the second terminal device can send the drag event to the corresponding application service, and the application service can send the drag event to the corresponding application service according to the The drag event can determine whether the object can be dragged in.

As shown in FIG. 2, the Framework layer of the second terminal device can generate a DRAG_LOCATION event by capturing the coordinates of the above-mentioned position and the data type of the object, and send the DRAG_LOCATION event to the corresponding application service, and the second terminal device as described above opens The application service can judge whether the position corresponding to the coordinate can be dragged into the object of the above data type according to the coordinate and data type. If it can be dragged in, the judgment result will be displayed in the current display interface of the second terminal device. The display manner of , can refer to the example in Fig. 5a or Fig. 5b.

9d and 9e respectively show schematic diagrams of a display interface of a terminal device according to an embodiment of the present application. As shown in Figure 9d, when the first terminal device detects the second cross-device transmission operation, it can temporarily store the object locally and send a data transmission request to the second terminal device, or it can directly send the object to the second terminal device, The second terminal device can display processing options, the second terminal device (such as a smart phone) displays the desktop or an open folder, and the user can select the processing method in the second terminal device (for example, cancel, delay, etc.) , You can also continue to drag the object. If the second terminal device detects that the object is dragged to a blank position, then the second terminal device can directly store the object locally, for example, in the system disk or a folder. The data type of , selects the application service to open the object, or as described above, according to the application service selected by the user to open the object, the fourth display screen in FIG. 9d shows the scene of opening the object (picture).

As shown in FIG. 9e, the second terminal device displays a scene in which the application service is opened. If the second terminal device captures that the user's drag operation stays at a certain position in the current display interface of the application service, it can The coordinates and the data type of the object determine whether it is a draggable position. As shown in Fig. 9e, if a drag release operation is detected, and the position where the drag operation stayed before the release can be dragged into the object, the second terminal device can open the object at this position, as shown in the fourth example in Fig. 9e As shown in the display screen, the object is opened in the dialog interface of the instant messaging application service.

Fig. 9f shows a schematic diagram of a specific application scenario according to an embodiment of the present application. As shown in Fig. 9f, the second terminal device opens the mail service and creates a new mail according to the user's operation, and the second terminal device receives the first terminal After the data transmission request sent by the device or the object sent by the first terminal device is temporarily stored locally, processing options are displayed on the display interface, including "Cancel", "Drag from XX", the thumbnail of the object, etc. When dragging an object (for example, dragging the thumbnail of the object) on the display interface of the second terminal device, according to the position where the drag operation stays in the newly created email and the data type of the object, whether the object of this data type is allowed to be dragged in is displayed in real time the location.

If the user chooses to cancel the dragging, the object is temporarily stored in the foreground of the second terminal device or temporarily stored in the foreground of the first terminal device. Taking the temporary storage in the foreground of the second terminal device as an example, after the second terminal device detects the operation of canceling the drag and drop, it can still temporarily store the object in the foreground, and the second terminal device can put away the processing options, as shown in Figure 9g. . If the user wants to process the object again, the processing option can be pulled out in a sliding manner, and the second terminal device processes the object according to the selection operation for the processing option. According to the data transmission method of the above embodiment, selectable operations for the dragged object can be displayed on the display screen of the receiving end device, so that the second terminal device can process the object according to actual needs.

In a possible implementation manner, the first terminal device is connected to more than two candidate terminal devices, and the connection here may include wired connection and/or wireless connection, which is not limited in this application. FIG. 10 shows a schematic diagram of an application scenario according to an embodiment of the present application. As shown in FIG. 10, the first terminal device is wirelessly connected to three candidate terminal devices (candidate terminal device 1, candidate terminal device 2, and candidate terminal device 3). In this embodiment, the data transmission method of the present application may further include: determining the second terminal device from two or more candidate terminal devices.

In a possible implementation manner, when the first terminal device detects a first cross-device transmission operation for an object locally on the first terminal device, the first terminal device determines the stop position of the first cross-device transmission operation according to the first cross-device transmission operation. , determining a second terminal device corresponding to the first cross-device transmission operation from the two or more candidate terminal devices.

In a possible implementation manner, terminal devices corresponding to different positions on the display screen of the first terminal device may be preset, and dragging to the corresponding position may indicate that the user wants to drag the object to the terminal device corresponding to the position. Taking FIG. 4 as an example, for device 2, during pairing, it can be set that the left area of the display screen of device 2 corresponds to device 1, and the right area of the display screen corresponds to device 2. The left side area or the right side area is only an example of the present application, and the present application is not limited thereto, for example, it may also be an upper side area or a lower side area. The size of each area can be set according to the actual situation. For example, if only the left area and the right area are set with corresponding terminal devices, the left 1/3 of the display screen can be set as the left area, and the right 1/3 Set to the right area.

In a possible implementation manner, the first terminal device may also display the information of two or more candidate terminal devices on the display screen when detecting the first cross-device transmission operation for an object locally on the first terminal device. The information, for example, can be the identification information of the second terminal device, and the display form can be a way of displaying “icons and/or text” at a fixed position on the display screen, wherein the icons can include icons representing candidate terminal devices, candidate terminals The icon of the device, the icon of the application service installed on the candidate terminal device, etc., the text may be the identification information of the candidate terminal device, the options of the processing method of the object, and the like.

FIG. 11a shows a schematic diagram of a display interface of a first terminal device according to an embodiment of the present application. Fig. 11a shows an example in which the first terminal device displays the information of more than two candidate terminal devices. As shown in Fig. 11a, the first terminal device may also detect the first crossover of an object local to the first terminal device. During the device transfer operation, a drawer that can be dragged (an example of an icon representing a candidate terminal device) is displayed on the right edge of the display screen, and each drawer can correspond to a candidate terminal device, for example, device 1 to device 4. Displays the device ID of the corresponding candidate terminal device. Any edge position of the first terminal device may display a drawer that can be dragged into, and what is shown in FIG. 11a is just an example, which does not limit the present application in any way.

In a possible implementation manner, the first cross-device transmission operation may refer to a process from initiating an operation to stopping the operation, and the first terminal device may display a draggable display on the right edge of the screen when the initiating operation is detected. The drawer that can be dragged into the drawer can also be displayed on the edge of the screen where the first cross-device transmission operation stays when it is detected that the operation stays and the location of the stay is the edge of the screen. The process is not limited.

In a possible implementation manner, determining the second terminal device corresponding to the first cross-device transmission operation from the two or more candidate terminal devices according to the stay position of the first cross-device transmission operation may include: :

A second terminal device corresponding to the first cross-device transmission operation is determined according to the relationship between the stay position of the first cross-device transmission operation and the display positions of the information of the two or more candidate terminal devices.

During the first cross-device transmission operation, a thumbnail image corresponding to the object can be generated, and the thumbnail image can be moved following the movement of a finger or a mouse, as shown in FIG. 11a , following the small icon of the finger. Therefore, the first terminal device can determine, according to the relationship between the staying position of the thumbnail of the object and the display position of the information of the two or more candidate terminal devices when the first cross-device transmission operation is stopped, the first terminal device corresponding to the first cross-device transmission operation. second terminal equipment. The information of the candidate terminal device may be the above-mentioned information such as the drawer and the ID of the device.

When staying according to the first cross-device transmission operation, the relationship between the stay position of the thumbnail of the object and the display position of the information of the two or more candidate terminal devices may be: the stay position of the thumbnail of the object and the position of the two or more candidate terminal devices The display positions of the information of the object do not overlap; or, the stay position of the thumbnail of the object is at least partially coincident with the display position of the information of one of the candidate terminal devices, for example, the stay position of the thumbnail of the object is completely located in one of the candidate terminal devices. The display position of the information partially overlaps with the display position of the information of one candidate terminal device; or, the stay position of the thumbnail of the object overlaps with the display position of the information of two or more candidate terminal devices.

In the case where the stay position of the thumbnail of the object does not coincide with the display position of the information of two or more candidate terminal devices, the first terminal device may determine that the second terminal device is not currently selected, that is, the receiver device is not selected, As shown in Figure 11a.

Fig. 11b shows a schematic diagram of a display interface of a first terminal device according to an embodiment of the present application, and Fig. 11b shows at least part of the stay position of the thumbnail of the object and the display position of the information of one of the candidate terminal devices (device 2). As an example of the overlapping situation, the thumbnail image in FIG. 11b overlaps with the information part of the second candidate terminal device displayed on the right edge, and the first terminal device can determine that the candidate terminal device is the second terminal device.

In the case where the stay position of the thumbnail of the object overlaps with the display position of the information of two or more candidate terminal devices, the first terminal device may overlap the display position of the information with the stay position of the thumbnail of the object to have the most candidate terminals The device is determined to be the second terminal device. It is only an example of the present application that the first terminal device determines that the candidate terminal device with the most overlap is the second terminal device, and the present application is not limited thereto. Alternatively, the first terminal device may also prompt the user to continue moving until the second terminal device can be determined.

FIG. 11c shows a schematic diagram of a display interface of a first terminal device according to an embodiment of the present application. FIG. 11d shows a schematic diagram of an application scenario of a display interface of a first terminal device according to an embodiment of the present application.

In a possible implementation manner, the first terminal device may determine the second terminal device and the processing method of the object by the second terminal device according to the detected triggering instructions for the information of two or more candidate terminal devices. In this implementation manner, sending the object to the second terminal device may include: sending the object and indication information to the second terminal device, where the indication information is used to instruct the second terminal device to use the The handle method handles the object. After receiving the object and the indication information, the second terminal device may process the object according to the processing method.

Fig. 11c shows an example in which the first terminal device displays information of more than two candidate terminal devices, and the first terminal device can determine the second terminal device according to a selection operation, wherein the selection operation can be that the user clicks the candidate terminal through a finger or a stylus The icon of the device, or click the icon of the candidate terminal device with the mouse. After the second terminal device is determined according to the selection operation, the optional processing method of the object by the second terminal can be displayed. As shown in the small window in the middle of Fig. 11c, the upper part of the small window displays the selected object, and can also display the The number of selected objects, that is, multiple objects can be selected, the information of the candidate terminal equipment is displayed in the middle of the small window, the information of the terminal equipment is displayed in the form of device icons and text, and the lower part of the small window also shows The applications (eg, application 1, application 2) installed on the selected candidate terminal device (eg, device 1) and options for the processing methods that can be performed on the object (eg, save, open, copy, etc.). The first terminal device can determine the processing method of the object by the second terminal device according to the selection operation. In this way, when the first terminal device sends the object to the second terminal device, it can also send instruction information to instruct the second terminal device to process the object in the above-mentioned processing method. object.

As shown in FIG. 11c or FIG. 11d , the user selects the second terminal device, the application service installed on the second terminal device, and the processing method (save, open, etc.) of the object processed by the second terminal device in the small window. In this way, the first terminal device can determine the second terminal device and how the object is processed by the second terminal device.

In the case where there is only one candidate terminal device as the second terminal device, the first terminal device can also display the options of the processing method of the object by the second terminal device, and the first terminal device can be selected by selecting the options. Operation and other methods are used to determine the processing method of the object by the second terminal device.

According to the data transmission method in the above embodiments, interaction between multiple terminal devices can be realized, and the types of multiple terminal devices can be different, which makes it more convenient for users to share data between multiple different devices.

For the example of displaying the drawer shown in FIG. 11a and FIG. 11b , it should be noted that if the first terminal device sends an object to the second terminal device: temporarily storing the object locally may be combining the object with the drawer (ie, with the candidate terminal device) Correspondingly, temporarily store, for example, the drawer icon is associated with a cache space, and the first terminal device can store the object corresponding to the drag and release action in the associated cache space after detecting that the user has performed a drag and release action in the drawer. middle.

In a possible implementation manner, after temporarily storing the object, as described above, the first terminal device can also display options for the processing method of the object by the second terminal device for the user to choose. Selecting an option and other methods, determine the processing method of the object by the second terminal device, and then send a data transmission request to the second terminal device, and the data transmission request may also carry the processing method. In this way, the way of processing and selecting objects can be implemented more flexibly.

The first terminal device sends a data transmission request to the second terminal device, and the second terminal device returns a second response signal (the example shown in Figure 9a and Figure 9b ). When the first terminal device receives the second response signal , revoke the sending object, and the drawer can also be closed in a similar way as in Figure 9g, and the object is still temporarily stored in the cache space. If the user wants to send the object again, he can pull out the drawer by sliding and drag the object again to transfer.

In a possible implementation manner, according to the stay position of the first cross-device transmission operation, the second terminal device corresponding to the first cross-device transmission operation is determined from the two or more candidate terminal devices, and the second terminal device corresponding to the first cross-device transmission operation may also be determined. include:

The second terminal device corresponding to the first cross-device transmission operation is determined according to the positional relationship between the stay position of the first cross-device transmission operation and the edge of the first terminal device.

In a possible implementation manner, according to the positional relationship between the first terminal device and the connected candidate terminal device, the corresponding relationship between different edges of the first terminal device and the candidate terminal device may be preset. The positional relationship between the stay position of the first cross-device transmission operation and the edge of the first terminal device determines the second terminal device corresponding to the first cross-device transmission operation.

Or, in another possible implementation manner, a position sensor may be installed in the terminal device of the present application to sense the positional relationship with other terminal devices, and the first terminal device captures the first cross-device transmission operation When staying on the edge of the first terminal device, the sensor can be enabled to sense the candidate terminal device placed on the edge, and the candidate terminal device placed on the edge can be used as the second terminal device.

Fig. 12a shows a flowchart of a data transmission method according to an embodiment of the present application. The method shown in Fig. 12a can be applied to the first terminal device. On the basis of steps S100-S103, the transmission method of this embodiment can also be include:

Step S105: Send a display instruction to the second terminal device to instruct the second terminal device to display the object according to the display instruction and the positional relationship between the second terminal device and the first terminal device the first image of

The second image of the object displayed on the first terminal device and the first image of the object displayed on the second terminal device can be combined to form a complete image of the object.

Fig. 12b shows a flowchart of a data transmission method according to an embodiment of the present application. The method shown in Fig. 12b can be applied to a second terminal device. On the basis of steps S201-S202 shown in Fig. 3b, this embodiment The transmission method can also include:

Step S209, when receiving the display instruction sent by the first terminal device, display the object corresponding to the data according to the display instruction and the positional relationship between the second terminal device and the first terminal device. first image,

The second image of the object displayed on the first terminal device and the first image of the object displayed on the second terminal device can be combined to form a complete image of the object.

Wherein, the above-mentioned first image and second image may refer to a part of the thumbnail image of the object, and the complete image of the object may refer to the complete thumbnail image of the object. That is to say, in this embodiment, a part of the image in the thumbnail image corresponding to the object may be displayed according to the positional relationship between the first terminal device and the second terminal device. For example, the second terminal device is on the right side of the first terminal device. , then after the first terminal device determines the second terminal device, it can send a display instruction to the second terminal device, and the display instruction can carry the second image of the object currently displayed by the first terminal device. In this way, the second terminal device can According to the positional relationship between the second terminal device and the first terminal device, the complete image of the object is displayed on the display screen of the second terminal device and the first image of the second image is removed.

In a possible implementation manner, displaying the first image according to the positional relationship between the second terminal device and the first terminal device may refer to displaying the first image on a side of the display screen of the second terminal device close to the first terminal device. For example, in the above example, the second terminal device is on the right side of the first terminal device, then the first image can be displayed on the left side of the display screen of the second terminal device.

The side of the display screen of the second terminal device close to the first terminal device may be pre-set according to the initial positional relationship between the second terminal device and the first terminal device, or may be a real-time sensing of the positional relationship between the two. For example, the positional relationship between the second terminal device and the first terminal device is preset, for example, the second terminal device is located on the right side of the first terminal device, then when the second terminal device receives the display instruction, even if the second terminal device The actual position of the terminal device is not on the right side of the first terminal device, and the second terminal device may display the first image on the left side. For another example, as described above, both the first terminal device and the second terminal device may be installed with position sensors, the second terminal device can sense the positional relationship with the first terminal device in real time, and the second terminal device receives the display instruction. When it is sensed that the first terminal device is located on the left side of the second terminal device, the first image can be displayed on the left side of the display screen.

If the first terminal device is connected to a second terminal device, or after the second terminal device is determined from two or more candidate terminal devices, the first terminal device may send a display instruction to the second terminal device, and the display instruction may carry the first terminal device. A second image of the object displayed by a terminal device, in this way, the second terminal device can display the complete image of the object on the display screen of the second terminal according to the display instruction and the positional relationship between the second terminal device and the first terminal device and remove the first The first image of the two images.

In a possible implementation manner, "sending the object to the second terminal device" in step S104 may further include: if it is detected that the area of the second image of the object displayed on the display screen is sufficient for sending condition, the object is sent to the second terminal device.

The sending condition may mean that the object can be sent when the relationship between the area of the second image and the area of the complete image satisfies a certain ratio, and if the relationship between the area of the second image and the area of the complete image does not meet a certain ratio, Then, even when the second cross-device transmission operation is detected, the object is not sent to the second terminal device. For example, if the ratio of the area of the second image to the area of the complete image is less than the ratio threshold, when the second cross-device transmission operation is detected, the object is sent to the second terminal device, and the area of the second image is proportional to the area of the complete image. If the ratio is not less than the ratio threshold, when the second cross-device transmission operation is detected, the object is not sent to the second terminal device. The ratio threshold may be preset, for example, may be 50%.

Fig. 13a shows a schematic diagram of an application scenario according to an embodiment of the present application, and Fig. 13b shows a schematic diagram of a multi-screen display according to an embodiment of the present application. As shown in FIG. 13a, the positions of different edges of the first terminal device may correspond to candidate terminal devices, the position of the left edge of the first terminal device corresponds to candidate terminal device 1, and the position of the right edge of the first terminal device corresponds to the candidate terminal device 1. The terminal device 2 corresponds to the terminal device 3, and the position of the upper edge of the first terminal device corresponds to the candidate terminal device 3. In this way, according to the above, the second terminal device corresponding to the first cross-device transmission operation can be determined according to the positional relationship between the stay position of the first cross-device transmission operation and the edge of the first terminal device.

As shown in FIG. 13a, if the stay position of the first cross-device transmission operation is the right edge of the first terminal device, the candidate terminal device 2 may be the second terminal device. At this time, the first terminal device can send a display instruction to the second terminal device, and the display instruction can carry the second image of the object displayed by the first terminal device. In this way, the second terminal device can The positional relationship between the device and the first terminal device The complete image of the object is displayed on the display screen of the second terminal and the first image of the second image is removed. As shown in Figure 13a, the first image is displayed on the left edge of the candidate terminal device 2 . If the first terminal device detects the drag release action, at this time, the area of the second image displayed on the first terminal device is less than half of the complete image, that is, the ratio of the area of the second image to the area of the complete image is less than the ratio threshold, Thus, the first terminal device can send the object to the second terminal device. For the specific process of sending the object to the second terminal device, reference may be made to the part described above for step S804 and the embodiments shown in FIGS. 9 a to 9 c , which will not be repeated in this application.

In the specific application scenario shown in FIG. 13b, the second terminal device currently opens the application service. In the example shown in FIG. 13b, the second terminal device opens the chat window of the instant messaging application. The first terminal device detects that the first cross-device transmission operation stays on the right edge of the display screen of the first terminal device, and can send a display instruction to the second terminal device, and the second terminal device displays the object's information on the left edge of the display screen. second image.

In a possible implementation manner, the display instruction sent by the first terminal device may also carry the data type of the object, and the second terminal device The application service, the local storage state of the second terminal and other information are used to determine whether the receiving object can make the determination result and feed it back to the first terminal device in real time.

When the first terminal device detects the second cross-device transmission operation, if the ratio of the second image of the object displayed by the first terminal device to the complete image is less than the ratio threshold, and the judgment result is that it can be transmitted to the second terminal device, the first terminal device will An end device may send an object to a second end device. After the second terminal device receives the object, if the currently opened application service can open the object, it can directly open the object in the currently opened application service, as shown in Figure 13b, the second terminal device can open the object in the instant messaging application (for example, pictures), according to the user's further operation, you can choose to send the picture or store the picture locally; if the currently opened application service cannot open the object, the second terminal device can select the application service to open the object according to the data type of the object. The second terminal device may also store objects.

According to the data transmission method of the above-mentioned embodiment, the dragging interaction process is displayed concisely and intuitively, and at the same time, it is helpful for the user to judge the dragging timing, avoid repeated operations, and simplify user operations.

FIG. 14a shows a flowchart of a data transmission method according to an embodiment of the present application. The transmission method shown in FIG. 14a can be applied to the first terminal device. In addition to steps S100-S103, the transmission method of this embodiment may further include:

Step S106: Send a display state request to the second terminal device, so that the second terminal device returns to the current display interface of the second terminal device in response to the display state request, and displays the display interface.

FIG. 14b shows a flowchart of a data transmission method according to an embodiment of the present application. The transmission method shown in FIG. 14b can be applied to the second terminal device. In addition to steps S201-S202, the transmission method of this embodiment may further include:

Step S210, when receiving the display state request sent by the first terminal device, return the current display interface of the second terminal device to the first terminal device, so that the first terminal device determines that the first cross-device transmission operation is in the first terminal device. Displays the position coordinates of the stop position in the interface.

The first cross-device transmission operation is an operation used by the first terminal device to initiate a process of transmitting the object to the second terminal device.

The display state request is used to request the second terminal device to return to the current display interface of the second terminal device. When receiving the display state request, the second terminal device can take a screenshot of the current display interface to obtain a screenshot image, and return the screenshot image to the first terminal device. A terminal device, or the screen can also be directly projected onto the display interface of the first terminal device. The present application does not limit the specific way of returning to the current display interface of the second terminal device.

The transmission method of this embodiment may be combined with the examples shown in FIG. 3a and FIG. 3b, and may also be combined with the examples shown in FIG. 11a and FIG. 11b. That is, if the first terminal device is connected to a second terminal device, or after the second terminal device is determined from two or more candidate terminal devices, the first terminal device can send a display state request to the second terminal device.

After receiving the current display interface of the second terminal device returned by the second terminal device, the second terminal device may continue to monitor the first cross-device transmission operation. In a possible implementation, step S101 may include: sending the The second terminal device sends a judgment request, where the judgment request includes the data type and the coordinates in the display interface of the position where the first cross-device transmission operation stays. That is, the judgment request received by the second terminal device may carry the coordinates in the display interface of the position where the first cross-device transmission operation stays, and making the judgment result according to the data type in step S202 may include: The data type and the coordinates make a judgment result.

For example, if the application service is registered with drag monitoring, the second terminal device can send the judgment request sent by the first terminal device to the application service, and the application service can determine whether it can be transmitted to the first terminal device according to the data type and the position of the coordinates. Two terminal equipment. The second terminal device may send the judgment result based on the data type and the coordinates to the first terminal device, and step S102 may include: receiving the judgment result based on the data type and the coordinates from the second terminal device . For the display manner of the judgment result, reference may be made to the above-mentioned embodiments, which will not be repeated.

In a possible implementation manner, the second terminal device may also make a judgment result according to the local storage state. When the local storage state is that the storage capability is available, the judgment result made by the second terminal device is that it can be moved to the second terminal device. In the local storage state, there is no storage capability, and the judgment result can be made according to the above-mentioned data type and location coordinates.

FIG. 15 shows a schematic diagram of an application scenario according to an embodiment of the present application. As shown in FIG. 15 , the transmission method of the present application will be described with reference to FIG. 14 a , FIG. 14 b and FIG. 11 b . As shown in FIG. 11 b , the stay position of the thumbnail image of the object partially overlaps with the display position of the information of one of the candidate terminal devices, The candidate terminal device is selected as the second terminal device. The first terminal device can send a display state request to the second terminal device, and when the second terminal device receives the display state request, it can take a screenshot of the current display interface to obtain a screenshot image, and return the screenshot image to the first terminal device. The terminal device displays the screen shot image of the second terminal device on the display screen.

The first terminal device continues to monitor the first cross-device transmission operation, sends a judgment request to the second terminal device, and judges that the request carries the data type of the object and the screen shot of the display interface of the second terminal device where the first cross-device transmission operation stays. coordinates in the image. For example, in FIG. 15, the thumbnail of the object dragged by the finger on the first terminal device stays in the message input box of the dialog interface of the instant messaging application in the screenshot image of the second terminal device, or the dialog content display box, the first terminal The device can obtain the coordinates of the stay position, carry it in the judgment request, and send it to the second terminal device. The second terminal device receives the judgment request, and the second terminal device can make a judgment result according to the data type and the coordinates. For example, the dragging service system of the second terminal device receives the judgment request and sends the judgment request to the Framework layer. The Framework layer generates a DRAG_LOCATION event and sends the DRAG_LOCATION event to the application service. The application service can judge according to the coordinates and data type. Whether it can be dragged in, and the judgment result is returned step by step (as shown in Figure 8c, the example of returning the judgment result) to the first terminal device, and the judgment result is displayed in the current display interface of the first terminal device. The specific display method can be See the example in Figure 5a or Figure 5b.

If the object in this embodiment is a picture or a piece of text, the dialog box of the instant messaging application allows dragging of pictures, or the input box allows dragging of text, then the judgment result is displayed on the display interface of the first terminal device. The user releases the drag operation. When the first terminal device detects the release of the drag operation, the first terminal device can send the object to the second terminal device, and the second terminal device can directly open the object at the corresponding position. For example, as shown in FIG. 15 , The second terminal device displays the object (eg a picture) in a dialog box.

According to the data transmission method of the above-mentioned embodiment, the object can be directly dragged to the target position. Compared with the related art, the process of dragging and dropping to the target position needs to be further performed at the receiving end, which can simplify the user operation. The judgment result is displayed in real time during the dragging process, which can avoid repeated operations and improve the operation efficiency.

14a and 14b, FIG. 16 shows a flowchart of a data transmission method according to an embodiment of the present application. The method shown in FIG. 16 can be applied to a second terminal device, as shown in FIG. 16 . , the method may further include: step S211, when receiving the object sent by the first terminal device, according to the data type, the local storage state, the application service installed by the second terminal device, the location coordinates one or more of to process the object.

In a possible implementation, step S211 may include:

When the local storage state is that it does not have storage capability, the object is opened according to the application service installed by the second terminal device;

When the local storage state is capable of storage, the object is stored locally.

In a possible implementation manner, when the local storage state is capable of storing, storing the object locally may include:

When the local storage state is capable of storing, and the location of the location coordinates in the display interface does not allow the data type to be inserted, the object is stored locally and an application is selected to open the object according to the data type. ;

When the local storage state is capable of storing, and the location of the location coordinates in the display interface allows the data type to be inserted, the object is stored locally and the object is opened in the display interface according to the location coordinates. object.

The specific process of opening the object according to the application service installed by the second terminal device may refer to the foregoing description. Whether the position of the position coordinates in the display interface allows the above-mentioned data type to be inserted can be determined according to whether there is a drag monitor registered for the data type at the position, and the specific process can refer to the above description.

According to the data transmission method of the above-mentioned embodiment, the object can be directly dragged to the target position. Compared with the related art, the process of dragging and dropping the object to the target position needs to be further operated at the receiving end, which can simplify the user operation. The information is processed on the object, simplifying the user operation.

The present application also provides a data transmission apparatus, and the apparatus is applied to a first terminal device, and the first terminal device is connected to a second terminal device, as shown in the application scenario shown in FIG. 1 . FIG. 17 shows a block diagram of a data transmission apparatus according to an embodiment of the present application. As shown in FIG. 17 , the apparatus includes:

The first obtaining module 61 is configured to obtain the data type of the object when the first terminal device detects a first cross-device transmission operation for an object on the first terminal device, wherein the first The cross-device transfer operation is used to initiate the process of transferring the object to the second terminal device;

a first sending module 62, configured to send a judgment request carrying the data type to the second terminal device,

a first receiving module 63, configured to receive a judgment result made by the second terminal device based on the data type, where the judgment result indicates whether the object can be transmitted to the second terminal device;

The first display module 64 is used for displaying the judgment result.

According to the data transmission device of the above-mentioned embodiments of the present application, intuitive visual feedback can be provided to the user according to the data type of the object and the matching degree of the receiving end, so as to avoid erroneous operation and repeated operation, and improve the operation efficiency.

In a possible implementation manner, the judgment request carries a data type field and/or an extended data type field, and the data type field and the extended data type field are used to indicate the data type of the object.

In a possible implementation, the apparatus further includes:

The second sending module is configured to send the object to the second terminal device when the judgment result is that it can be transmitted to the second terminal device and a second cross-device transmission operation is detected, and the second cross-device transmission The operation is to confirm the transfer of the object to the second terminal device.

In a possible implementation, the second sending module includes:

a first storage unit, configured to temporarily store the object locally in the first terminal device;

a first sending unit, configured to send a data transmission request to the second terminal device, where the data transmission request is used to transmit the object;

The second sending unit is configured to send the object according to the first response signal when receiving the first response signal of accepting the data transmission request returned by the second terminal device.

In a possible implementation manner, the first sending unit is further configured to call out the temporarily stored object when a call-out instruction for the temporarily stored object is detected, and send the temporarily stored object to the second terminal device the data transfer request.

In a possible implementation manner, the second sending unit is further configured to:

When receiving the first response signal, directly sending the object;

Alternatively, sending the object is delayed upon receipt of the first response signal.

In a possible implementation manner, the second sending module further includes:

A cancel sending unit, configured to cancel sending the object when receiving a second response signal returned by the second terminal device that the data transmission request is not accepted.

In a possible implementation manner, the first terminal device is connected to more than two candidate terminal devices,

The device also includes:

a second display module, configured to display the information of the two or more candidate terminal devices when the first terminal device detects a first cross-device transmission operation for an object local to the first terminal device;

The second determining module is configured to determine the first cross-device transfer operation corresponding to the first cross-device transfer operation according to the relationship between the stay position of the first cross-device transfer operation and the display positions of the information of the two or more candidate terminal devices. Two terminal equipment.

In a possible implementation manner, the apparatus further includes a third determining module, configured to determine the first cross-device according to the positional relationship between the stay position of the first cross-device transmission operation and the edge of the first terminal device The second terminal device corresponding to the device transmission operation. In a possible implementation, the apparatus further includes:

a third sending module, configured to send a display instruction to the second terminal device to instruct the second terminal device to instruct the second terminal device according to the display instruction and the positional relationship between the second terminal device and the first terminal device displaying a first image of the object,

The second image of the object displayed on the first terminal device and the first image of the object displayed on the second terminal device can be combined to form a complete image of the object.

In a possible implementation manner, the fourth sending module is configured to send the second terminal device to the second terminal device if it is detected that the area of the second image of the object displayed on the display screen satisfies the sending condition. described object.

In a possible implementation, the apparatus further includes:

a fifth sending module, configured to send a display state request to the second terminal device, so that the second terminal device responds to the display state request to return to the current display interface of the second terminal device, and displays the display interface;

The first sending module includes:

a third sending unit, configured to send a judgment request to the second terminal device, where the judgment request carries the data type and the coordinates in the display interface of the position where the first cross-device transmission operation stays,

The first receiving module includes:

A receiving unit, configured to receive a judgment result made by the second terminal device based on the data type and the coordinates.

In a possible implementation, the apparatus further includes:

a third determining module, configured to determine the processing method of the object by the second terminal device;

The second sending module also includes:

a fourth sending unit, configured to send the object and indication information to the second terminal device, where the indication information is used to instruct the second terminal device to process the object in the processing mode.

In a possible implementation manner, the first cross-device transmission operation is a drag operation.

In a possible implementation manner, the second cross-device transfer operation is a drag-and-release operation.

In a possible implementation manner, the first terminal device is a touch screen device or a non-touch screen device, and the second terminal device is a touch screen device, a non-touch screen device or a non-touch screen device.

The present application further provides a data transmission apparatus, and the apparatus is applied to a second terminal device, characterized in that the second terminal device is connected to the first terminal device, as shown in the application scenario shown in FIG. 1 . FIG. 18 shows a block diagram of a data transmission apparatus according to an embodiment of the present application, as shown in FIG. 18 ,

The device includes:

The second receiving module 71 is configured to receive a judgment request sent by the first terminal device, wherein the judgment request carries the data type of the object to be transmitted, and the judgment request is used to request the second terminal device to judge the data whether the type of object can be transmitted to the second terminal device;

The first judgment module 72 is configured to make a judgment result according to the data type, and send the judgment result to the first terminal device, so that the first terminal device displays the judgment result.

In a possible implementation, the apparatus further includes:

The sixth sending module is configured to return the current display interface of the second terminal device to the first terminal device when receiving the display state request sent by the first terminal device, so that the first terminal device determines the first cross-device transmission The coordinates of the location where the operation stays in the display interface, wherein the first cross-device transmission operation is an operation used by the first terminal device to initiate a process of transmitting the object to the second terminal device.

In a possible implementation manner, the judgment request carries the coordinates,

The first judgment module includes:

A first judgment unit, configured to make a judgment result according to the data type and the coordinates.

In a possible implementation, the apparatus further includes:

The first processing module is configured to, when receiving the object sent by the first terminal device, perform one of the data type, the local storage state, the application service installed by the second terminal device, the coordinates, or Multiple items are processed on the object.

In a possible implementation, the first processing module includes:

a first processing unit, configured to open the object according to the application service installed by the second terminal device when the local storage state is not having storage capability;

The second processing unit is configured to store the object locally when the local storage state is capable of storing.

In a possible implementation manner, the second processing unit is further configured to, when the local storage state is capable of storing and the corresponding position of the coordinates in the display interface does not allow the insertion of the data type, perform a local storing the object and selecting an application to open the object according to the data type;

When the local storage state is capable of storing and the corresponding position of the coordinates in the display interface allows the insertion of the data type, the object is stored locally and the object is opened in the display interface according to the coordinates .

In a possible implementation, the apparatus further includes:

a storage module, configured to temporarily store the object locally when the object sent by the first terminal device is received, if the second terminal device has a storage capability;

The third display module is used to display processing options;

The second processing module is configured to process the object according to the selection operation for the processing option.

In a possible implementation, the apparatus further includes:

a fourth display module, configured to display the data according to the display instruction and the positional relationship between the second terminal device and the first terminal device when receiving the display instruction sent by the first terminal device the first image of the corresponding object,

The second image of the object displayed on the first terminal device and the first image of the object displayed on the second terminal device can be combined to form a complete image of the object.

In a possible implementation manner, the first terminal device is a touch screen device or a non-touch screen device, and the second terminal device is a touch screen device, a non-touch screen device or a non-touch screen device.

An embodiment of the present application provides a terminal device, and the terminal device can execute one or more of the data transmission methods in the above-mentioned multiple implementation manners.

The present application may be a system, method and/or computer program product. The computer program product may include a computer-readable storage medium having computer-readable program instructions loaded thereon for causing a processor to implement various aspects of the present application.

Embodiments of the present application provide a computer program product, including computer-readable codes, or a non-volatile computer-readable storage medium carrying computer-readable codes, when the computer-readable codes are stored in a processor of an electronic device When running in the electronic device, the processor in the electronic device executes the above method.

A computer-readable storage medium may be a tangible device that can hold and store instructions for use by the instruction execution device. The computer-readable storage medium may be, for example, but not limited to, an electrical storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing. More specific examples (non-exhaustive list) of computer readable storage media include: portable computer disks, hard disks, random access memory (RAM), read only memory (ROM), erasable programmable read only memory (EPROM) or flash memory), static random access memory (SRAM), portable compact disk read only memory (CD-ROM), digital versatile disk (DVD), memory sticks, floppy disks, mechanically coded devices, such as printers with instructions stored thereon Hole cards or raised structures in grooves, and any suitable combination of the above. Computer-readable storage media, as used herein, are not to be construed as transient signals per se, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through waveguides or other transmission media (eg, light pulses through fiber optic cables), or through electrical wires transmitted electrical signals.

The computer readable program instructions described herein may be downloaded to various computing/processing devices from a computer readable storage medium, or to an external computer or external storage device over a network such as the Internet, a local area network, a wide area network, and/or a wireless network. The network may include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers, and/or edge servers. A network adapter card or network interface in each computing/processing device receives computer-readable program instructions from a network and forwards the computer-readable program instructions for storage in a computer-readable storage medium in each computing/processing device .

Computer program instructions for carrying out the operations of the present application may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, state setting data, or instructions in one or more programming languages. Source or object code, written in any combination, including object-oriented programming languages, such as Smalltalk, C++, etc., and conventional procedural programming languages, such as the "C" language or similar programming languages. The computer readable program instructions may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer, or entirely on the remote computer or server implement. In the case of a remote computer, the remote computer may be connected to the user's computer through any kind of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (eg, using an Internet service provider through the Internet connect). In some embodiments, custom electronic circuits, such as programmable logic circuits, field programmable gate arrays (FPGAs), or programmable logic arrays (PLAs), can be personalized by utilizing state information of computer readable program instructions. Computer readable program instructions are executed to implement various aspects of the present application.

Aspects of the present application are described herein with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the present application. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer readable program instructions.

These computer readable program instructions may be provided to a processor of a general purpose computer, special purpose computer or other programmable data processing apparatus to produce a machine that causes the instructions when executed by the processor of the computer or other programmable data processing apparatus , resulting in means for implementing the functions/acts specified in one or more blocks of the flowchart and/or block diagrams. These computer readable program instructions can also be stored in a computer readable storage medium, these instructions cause a computer, programmable data processing apparatus and/or other equipment to operate in a specific manner, so that the computer readable medium on which the instructions are stored includes An article of manufacture comprising instructions for implementing various aspects of the functions/acts specified in one or more blocks of the flowchart and/or block diagrams.

Computer readable program instructions can also be loaded onto a computer, other programmable data processing apparatus, or other equipment to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other equipment to produce a computer-implemented process , thereby causing instructions executing on a computer, other programmable data processing apparatus, or other device to implement the functions/acts specified in one or more blocks of the flowcharts and/or block diagrams.

The flowchart and block diagrams in the Figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present application. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of instructions, which comprises one or more functions for implementing the specified logical function(s) executable instructions. In some alternative implementations, the functions noted in the blocks may occur out of the order noted in the figures. For example, two blocks in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It is also noted that each block of the block diagrams and/or flowchart illustrations, and combinations of blocks in the block diagrams and/or flowchart illustrations, can be implemented in dedicated hardware-based systems that perform the specified functions or actions , or can be implemented in a combination of dedicated hardware and computer instructions.

Various embodiments of the present application have been described above, and the foregoing descriptions are exemplary, not exhaustive, and not limiting of the disclosed embodiments. Numerous modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The terminology used herein was chosen to best explain the principles of the embodiments, the practical application or technical improvement over the technology in the marketplace, or to enable others of ordinary skill in the art to understand the embodiments disclosed herein.

Claims (40)

1. A data transmission method is applied to a first terminal device, and is characterized in that the first terminal device is connected with a second terminal device, and the method comprises the following steps:

the method comprises the steps that when a first cross-device transmission operation aiming at an object on a first terminal device is detected by the first terminal device, the data type of the object is obtained, wherein the first cross-device transmission operation is used for initiating a process of transmitting the object to a second terminal device;

sending a judgment request carrying the data type to the second terminal device,

receiving a judgment result made by the second terminal device based on the data type, wherein the judgment result represents whether the object can be transmitted to the second terminal device;

and displaying the judgment result.

2. The method according to claim 1, wherein the determination request carries a data type field and/or an extended data type field, and the data type field and the extended data type field are used for indicating a data type of the object.

3. The method of claim 1, further comprising:

and when the judgment result is that the object can be transmitted to a second terminal device and a second cross-device transmission operation is detected, sending the object to the second terminal device, wherein the second cross-device transmission operation is used for confirming that the object is transmitted to the second terminal device.

4. The method of claim 3, wherein sending the object to the second terminal device comprises:

temporarily storing the object in the local of the first terminal equipment;

sending a data transmission request to the second terminal equipment, wherein the data transmission request is used for transmitting the object;

and when a first response signal which is returned by the second terminal equipment and accepts the data transmission request is received, the object is sent according to the first response signal.

5. The method of claim 4, wherein after the object is temporarily stored locally at the first terminal device, further comprising:

and when a call-out instruction for the temporarily stored object is detected, calling out the temporarily stored object, and sending the data transmission request to the second terminal equipment.

6. The method of claim 4 or 5, wherein transmitting the object according to the first response signal comprises:

upon receiving the first response signal, directly transmitting the object;

or delaying the transmission of the object upon receiving the first response signal.

7. The method according to any of claims 1-6, wherein the first terminal device is connected to more than two candidate terminal devices,

the method further comprises the following steps:

the first terminal device displays information of the more than two candidate terminal devices when detecting a first cross-device transmission operation for an object on the first terminal device;

and determining a second terminal device corresponding to the first cross-device transmission operation according to the relation between the stop position of the first cross-device transmission operation and the display positions of the information of the more than two candidate terminal devices.

8. The method according to any of claims 1-6, wherein the first terminal device is connected to more than two candidate terminal devices,

the method further comprises the following steps:

and determining second terminal equipment corresponding to the first cross-equipment transmission operation according to the position relation between the stop position of the first cross-equipment transmission operation and the edge of the first terminal equipment.

9. The method according to claim 1 or 8, characterized in that the method further comprises:

sending a display instruction to the second terminal device to instruct the second terminal device to display a first image of the object according to the display instruction and a positional relationship between the second terminal device and the first terminal device,

the second image of the object displayed on the first terminal device and the first image of the object displayed on the second terminal device can be spliced into a complete image of the object;

and if the area of the second image of the object displayed on the display screen is detected to meet the sending condition, sending the object to the second terminal equipment.

10. The method of claim 1 or 7, further comprising:

sending a display state request to the second terminal device, so that the second terminal device responds to the display state request, returns to the current display interface of the second terminal device, and displays the display interface;

sending a judgment request carrying the data type to the second terminal device, including:

sending a judgment request to the second terminal device, wherein the judgment request carries the data type and the coordinate of the position where the first cross-device transmission operation stays in the display interface,

receiving a judgment result made by the second terminal device based on the data type, wherein the judgment result comprises the following steps:

and receiving a judgment result made by the second terminal device based on the data type and the coordinate.

11. The method of claim 3, further comprising:

determining a processing mode of the second terminal equipment to the object;

sending the object to the second terminal device, including:

and sending the object and indication information to the second terminal equipment, wherein the indication information is used for indicating the second terminal equipment to process the object in the processing mode.

12. The method of claim 3, wherein the first cross-device transfer operation is a drag operation and the second cross-device transfer operation is a drag release operation.

13. A data transmission method is applied to a second terminal device, and is characterized in that the second terminal device is connected with a first terminal device, and the method comprises the following steps:

receiving a judgment request sent by a first terminal device, wherein the judgment request carries the data type of an object to be transmitted, and the judgment request is used for requesting a second terminal device to judge whether the object of the data type can be transmitted to the second terminal device;

and making a judgment result according to the data type, and sending the judgment result to the first terminal equipment so as to enable the first terminal equipment to display the judgment result.

14. The method of claim 13, further comprising:

when a display state request sent by a first terminal device is received, returning a current display interface of a second terminal device to the first terminal device so that the first terminal device determines coordinates of a position where a first cross-device transmission operation stays in the display interface, wherein the first cross-device transmission operation is an operation used by the first terminal device for initiating a process of transmitting the object to the second terminal device;

wherein the judgment request carries the coordinates,

making a judgment result according to the data type, comprising:

and making a judgment result according to the data type and the coordinate.

15. The method of claim 14, further comprising:

and when the object sent by the first terminal equipment is received, processing the object according to one or more of the data type, the local storage state, the application service installed by the second terminal equipment and the coordinates.

16. The method of claim 15, wherein processing the object according to one or more of the data type, a local storage state, an application service installed by the second terminal device, and the coordinates comprises:

when the local storage state is that the object does not have the storage capacity, opening the object according to the application service installed by the second terminal equipment;

and when the local storage state is the storage capacity, the object is stored locally.

17. The method of claim 16, wherein storing the object locally when the local storage state is storage-capable comprises:

when the local storage state is that the storage capacity is available and the corresponding position of the coordinate in the display interface does not allow the data type to be inserted, locally storing the object and selecting an application program to open the object according to the data type;

and when the local storage state is that the storage capacity is provided and the corresponding position of the coordinate in the display interface allows the data type to be inserted, locally storing the object and opening the object in the display interface according to the coordinate.

18. The method according to any one of claims 13-17, further comprising:

when the object sent by the first terminal equipment is received, if the second terminal equipment has the storage capacity, the object is temporarily stored locally;

displaying the processing options;

and processing the object according to the selection operation aiming at the processing option.

19. The method of claim 13, further comprising:

when a display instruction sent by the first terminal equipment is received, displaying a first image of the object according to the display instruction and the position relation between the second terminal equipment and the first terminal equipment,

the second image of the object displayed on the first terminal device and the first image of the object displayed on the second terminal device can be pieced together into a complete image of the object.

20. A data transmission device, which is applied to a first terminal device, wherein the first terminal device is connected with a second terminal device, the device comprising:

a first obtaining module, configured to, when the first terminal device detects a first cross-device transmission operation for an object on the first terminal device, obtain a data type of the object, where the first cross-device transmission operation is used to initiate a process of transmitting the object to a second terminal device;

a first sending module, configured to send a determination request carrying the data type to the second terminal device,

a first receiving module, configured to receive a determination result made by the second terminal device based on the data type, where the determination result indicates whether the object can be transmitted to the second terminal device;

and the first display module is used for displaying the judgment result.

21. The apparatus of claim 20, wherein the determination request carries a data type field and/or an extended data type field, and wherein the data type field and the extended data type field are used to indicate a data type of the object.

22. The apparatus of claim 20, further comprising:

and a second sending module, configured to send the object to a second terminal device when the determination result is that the object can be transmitted to the second terminal device and a second cross-device transmission operation is detected, where the second cross-device transmission operation is used to confirm that the object is transmitted to the second terminal device.

23. The apparatus of claim 22, wherein the second sending module comprises:

the first storage unit is used for temporarily storing the object in the local of the first terminal equipment;

a first sending unit, configured to send a data transmission request to the second terminal device, where the data transmission request is used to transmit the object;

and the second sending unit is used for sending the object according to the first response signal when receiving the first response signal returned by the second terminal equipment and accepting the data transmission request.

24. The apparatus of claim 23, wherein the first sending unit is further configured to send the first message to a second sending unit

And when a call-out instruction for the temporarily stored object is detected, calling out the temporarily stored object, and sending the data transmission request to the second terminal equipment.

25. The apparatus according to claim 23 or 24, wherein the second sending unit is further configured to:

upon receiving the first response signal, directly transmitting the object;

or delaying the transmission of the object upon receiving the first response signal.

26. The apparatus according to any of claims 20-25, wherein the first terminal device is connected to more than two candidate terminal devices,

the device further comprises:

a second display module, configured to display information of the two or more candidate terminal devices when the first terminal device detects a first cross-device transmission operation for an object local to the first terminal device;

and the second determining module is used for determining the second terminal equipment corresponding to the first cross-equipment transmission operation according to the relation between the stop position of the first cross-equipment transmission operation and the display positions of the information of the more than two candidate terminal equipment.

27. The apparatus according to any of claims 20-25, wherein the first terminal device is connected to more than two candidate terminal devices,

the device further comprises:

and a third determining module, configured to determine, according to a position relationship between a staying position of the first cross-device transmission operation and an edge of the first terminal device, a second terminal device corresponding to the first cross-device transmission operation.

28. The apparatus of claim 20 or 27, further comprising:

a third sending module, configured to send a display instruction to the second terminal device to instruct the second terminal device to display the first image of the object according to the display instruction and a positional relationship between the second terminal device and the first terminal device,

the second image of the object displayed on the first terminal device and the first image of the object displayed on the second terminal device can be spliced into a complete image of the object;

and the fourth sending module is used for sending the object to the second terminal equipment if the area of the second image of the object displayed on the display screen is detected to meet the sending condition.

29. The apparatus of claim 20 or 26, further comprising:

a fifth sending module, configured to send a display status request to the second terminal device, so that the second terminal device returns to a current display interface of the second terminal device in response to the display status request, and displays the display interface;

the first transmitting module includes:

a third sending unit, configured to send a determination request to the second terminal device, where the determination request carries the data type and a coordinate of a location where the first cross-device transmission operation stays in the display interface,

the first receiving module includes:

a receiving unit, configured to receive a determination result made by the second terminal device based on the data type and the coordinate.

30. The apparatus of claim 22, further comprising:

the third determining module is used for determining the processing mode of the second terminal equipment to the object;

the second sending module further comprises:

and a fourth sending unit, configured to send the object and indication information to the second terminal device, where the indication information is used to instruct the second terminal device to process the object in the processing manner.

31. The apparatus of claim 22, wherein the first cross-device transfer operation is a drag operation and the second cross-device transfer operation is a drag release operation.

32. A data transmission device, which is applied to a second terminal device, wherein the second terminal device is connected with a first terminal device, the device comprising:

a second receiving module, configured to receive a determination request sent by a first terminal device, where the determination request carries a data type of an object to be transmitted, and the determination request is used to request the second terminal device to determine whether the object of the data type can be transmitted to the second terminal device;

and the first judgment module is used for making a judgment result according to the data type and sending the judgment result to the first terminal equipment so as to enable the first terminal equipment to display the judgment result.

33. The apparatus of claim 32, further comprising:

a sixth sending module, configured to, when receiving a display state request sent by a first terminal device, return a current display interface of a second terminal device to the first terminal device, so that the first terminal device determines coordinates of a position where a first cross-device transmission operation stays in the display interface, where the first cross-device transmission operation is an operation in which the first terminal device is configured to initiate a process of transmitting the object to the second terminal device;

wherein the judgment request carries the coordinates,

the first judging module comprises:

and the first judgment unit is used for making a judgment result according to the data type and the coordinate.

34. The apparatus of claim 33, further comprising:

and the first processing module is used for processing the object according to one or more of the data type, the local storage state, the application service installed by the second terminal equipment and the coordinates when the object sent by the first terminal equipment is received.

35. The apparatus of claim 34, wherein the first processing module comprises:

the first processing unit is used for opening the object according to the application service installed by the second terminal equipment when the local storage state is that the local storage state does not have the storage capacity;

and the second processing unit is used for locally storing the object when the local storage state is that the storage capacity is available.

36. The apparatus of claim 35, wherein the second processing unit is further configured to

When the local storage state is that the storage capacity is available and the corresponding position of the coordinate in the display interface does not allow the data type to be inserted, locally storing the object and selecting an application program to open the object according to the data type;

and when the local storage state is that the storage capacity is provided and the corresponding position of the coordinate in the display interface allows the data type to be inserted, locally storing the object and opening the object in the display interface according to the coordinate.

37. The apparatus of any one of claims 32-36, further comprising:

the storage module is used for temporarily storing the object in the local area if a second terminal device has storage capacity when receiving the object sent by the first terminal device;

the third display module is used for displaying the processing options;

and the second processing module is used for processing the object according to the selection operation aiming at the processing option.

38. The apparatus of claim 32, further comprising:

a fourth display module, configured to display the first image of the object according to the display instruction and the positional relationship between the second terminal device and the first terminal device when receiving the display instruction sent by the first terminal device,

the second image of the object displayed on the first terminal device and the first image of the object displayed on the second terminal device can be pieced together into a complete image of the object.

39. An apparatus for transmitting data, comprising:

a processor;

a memory for storing processor-executable instructions;

wherein the processor is configured to carry out the instructions when executing the method of any one of claims 1 to 12 or to carry out the method of any one of claims 13 to 19.

40. A non-transitory computer readable storage medium having stored thereon computer program instructions, wherein the computer program instructions, when executed by a processor, implement the method of any one of claims 1-12 or the method of any one of claims 13-19.

Images