CN112398855A

CN112398855A - Method and device for transferring application contents across devices and electronic device

Info

Publication number: CN112398855A
Application number: CN202011282590.3A
Authority: CN
Inventors: 杨俊拯; 毕浩; 何�轩; 谭柯; 钟卫东
Original assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Current assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date: 2020-11-16
Filing date: 2020-11-16
Publication date: 2021-02-23
Anticipated expiration: 2040-11-16
Also published as: CN112398855B; WO2022100304A1

Abstract

The embodiment of the application discloses a method and a device for cross-device transfer of application content and electronic equipment, wherein the method comprises the following steps: acquiring the application type of a target application currently running by a stream source device; determining an application flow strategy aiming at the target application according to the application type; and transferring the content of the target application to the transfer target equipment according to the application transfer strategy. Therefore, in the embodiment of the application, different application circulation strategies are determined according to different application types of the target application, so that different application contents are circulated across devices through different application circulation strategies, the diversity of the application contents flowing across the devices is ensured, and the efficiency and the use experience of the application circulation are improved.

Description

Method and device for transferring application contents across devices and electronic device

Technical Field

The application relates to the technical field of computers, in particular to a method and a device for cross-device application content circulation and electronic equipment.

Background

Currently, a user may have multiple devices simultaneously, and the devices may have multiple forms, such as a mobile phone, a computer, a tablet, a television, a watch, and the like, and different devices may have different operating systems, software and hardware architectures, and the like mounted thereon. For example, a computer may be equipped with a system such as Windows or Mac, and a mobile phone may be equipped with a system such as Android or IOS.

In addition, the application streaming technology is a technology for transmitting content (such as pictures, text, or audio) of an application currently running on one or more devices to another one or more devices to cause the other one or more devices to run the content of the application. Therefore, there still exist some problems to be solved how to make the applications running on different devices or systems perform cross-device application content circulation by using an application circulation technology, so as to implement the application content running on different devices or systems.

Disclosure of Invention

The embodiment of the application content cross-device circulation method and device and electronic equipment aims to determine different application circulation strategies according to different application types of target applications so as to realize different application content cross-device circulation, so that the diversity of the application content cross-device circulation is ensured, and the efficiency and the use experience of the application circulation are improved.

In a first aspect, an embodiment of the present application provides an application content cross-device streaming method, which is applied to a streaming source device, and the method includes:

acquiring the application type of a target application currently operated by the stream source equipment;

determining an application flow strategy aiming at the target application according to the application type;

and transferring the content of the target application to the transfer target equipment according to the application transfer strategy.

As can be seen, in the embodiment of the application, the flow source device determines the application flow strategy for the target application according to the application type by acquiring the application type of the target application currently running by the flow source device; and finally, transferring the content of the target application to the transfer target equipment according to the application transfer strategy. According to the method and the device for transferring the target application, the target application is currently operated on the transfer source device, so that the target application is transferred from the transfer source device to the transfer target device, the application type of the target application is considered to be obtained, different application transfer strategies are determined according to different application types of the target application, different application content transfer strategies are used for realizing different application content transfer across devices, the diversity of the application content transfer across devices is guaranteed, and the application transfer efficiency and the application transfer experience are improved.

In a second aspect, an embodiment of the present application provides an application content cross-device streaming method, which is applied to a first streaming target device, and the method includes:

acquiring an application type of a target application on the first flow-to-target device, wherein the target application is flowed to the first flow-to-target device from a flow source device;

and transferring the content of the target application to second transfer target equipment according to the application transfer strategy.

As can be seen, in the embodiment of the application, the first traffic target device determines the application traffic policy for the target application according to the application type by acquiring the application type of the target application currently running by the first traffic source device; and finally, transferring the content of the target application to second transfer target equipment according to the application transfer strategy. According to the method and the device for transferring the application content, the target application runs on the transfer source device at present, and the target application is transferred to the first transfer target device from the transfer source device, so that the target application is transferred to the second transfer target device from the transfer source device through the first transfer target device, the application type of the target application is obtained, different application transfer strategies are determined according to different application types of the target application, different application content cross-device transfer is achieved through different application transfer strategies, the diversity of the application content cross-device transfer is guaranteed, and the efficiency and the use experience of the application transfer are improved.

In a third aspect, an embodiment of the present application provides an application content cross-device streaming apparatus, which is applied to a streaming source device; the device comprises:

the application information module is used for acquiring the application type of the target application currently operated by the stream source equipment;

the flow strategy module is used for determining an application flow strategy aiming at the target application according to the application type;

and the application circulation module is used for circulating the content of the target application to the circulation target equipment according to the application circulation strategy.

Therefore, in the embodiment of the application, the cross-device application transfer device determines different application transfer strategies according to different application types of the target application to realize the cross-device transfer of different application contents, so that the diversity of the cross-device application transfer of the application contents is ensured, and the efficiency and the use experience of the application transfer are improved.

In a fourth aspect, an embodiment of the present application provides an application content cross-device streaming apparatus, which is applied to a first streaming source device; the device comprises:

an application information module, configured to obtain an application type of a target application on the first traffic destination device, where the target application is streamed from a stream source device to the first traffic destination device;

and the application flow module is used for transferring the content of the target application to the second flow target equipment according to the application flow strategy.

In a fifth aspect, an embodiment of the present application provides an electronic device, which is a stream source device and includes a processor, a memory and a communication interface, where the memory stores one or more programs, and the one or more programs are executed by the processor, and the one or more programs are used to execute the instructions of the steps in the first aspect of the embodiment of the present application.

Therefore, in the embodiment of the application, the electronic device determines different application circulation strategies according to different application types of the target application to realize cross-device circulation of different application contents, so that the diversity of the cross-device circulation of the application contents is ensured, and the efficiency and the use experience of the application circulation are improved.

In a sixth aspect, an embodiment of the present application provides an electronic device, which is a first streaming target device and includes a processor, a memory and a communication interface, where the memory stores one or more programs, and the one or more programs are executed by the processor, and the one or more programs are used to execute the instructions of the steps in the second aspect of the embodiment of the present application.

In a seventh aspect, an embodiment of the present application provides a computer-readable storage medium, where the computer-readable storage medium stores a computer program for electronic data exchange, and the computer program is operable to cause a computer to perform some or all of the steps described in the first aspect or the second aspect of the embodiment of the present application.

In an eighth aspect, the present application provides a computer program product, where the computer program product includes a computer program operable to cause a computer to perform some or all of the steps described in the first or second aspect of the present application. The computer program product may be a software installation package.

Drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below. It is to be expressly understood that the drawings described below are only illustrative of some embodiments of the invention. It is also possible for a person skilled in the art to derive other figures from these figures without inventive effort.

Fig. 1 is a schematic architecture diagram of an application content streaming communication system according to an embodiment of the present application;

fig. 2 is a schematic diagram of a hardware structure of an electronic device according to an embodiment of the present disclosure;

fig. 3 is a schematic diagram of a software structure of an electronic device according to an embodiment of the present application;

fig. 4 is a schematic structural diagram of an electronic device provided in an embodiment of the present application;

fig. 5 is a flowchart illustrating an application content cross-device flow method according to an embodiment of the present application;

FIG. 6 is a schematic structural diagram of an application content cross-device flow provided by an embodiment of the present application;

FIG. 7 is a schematic structural diagram of still another application content cross-device flow provided by an embodiment of the present application;

FIG. 8 is a schematic structural diagram of still another application content cross-device flow provided by an embodiment of the present application;

FIG. 9 is a schematic structural diagram of still another application content cross-device flow provided by an embodiment of the present application;

FIG. 10 is a schematic structural diagram of still another application content cross-device flow provided by an embodiment of the present application;

FIG. 11 is a schematic structural diagram of still another application content cross-device flow provided by an embodiment of the present application;

FIG. 12 is a schematic structural diagram of still another application content cross-device flow provided by an embodiment of the present application;

fig. 13 is a flowchart illustrating an application content cross-device flow method according to an embodiment of the present application;

FIG. 14 is a schematic structural diagram of still another application content cross-device flow provided by an embodiment of the present application;

fig. 15 is a block diagram illustrating functional module components of an apparatus for cross-device streaming of application content according to an embodiment of the present application;

fig. 16 is a block diagram illustrating functional modules of a further apparatus for cross-device streaming of application content according to an embodiment of the present application;

fig. 17 is a schematic structural diagram of another electronic device provided in the embodiment of the present application;

fig. 18 is a schematic structural diagram of another electronic device provided in the embodiment of the present application.

Detailed Description

In order to better understand the technical solutions of the present application, the following description is given for clarity and completeness in conjunction with the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only some embodiments of the present application, but not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the description of the embodiments of the present application without inventive step, are within the scope of the present application.

Before describing the technical solution of the embodiment of the present application, the following description will be made on related concepts, application content transfer communication systems, software and hardware structures of electronic devices, and the like, which may be involved in the present application.

The application streaming technology of the embodiment of the application is to transmit the content (such as pictures, texts or audio) of the application currently running on one or more devices to another or more devices so as to enable the devices to run the content of the application. In addition, the application circulation technique may include an application screen projection technique, an application relay (handoff) technique, an application distribution technique, and the like. The application screen projection technology projects the content of an application running on one device to a display screen or a display medium of another device for display, and is a typical information synchronization mode; the application relay technology is a technology for storing, transferring or sharing the content of an application running on one device to another device; an application distribution technique is a technique in which a backend of an application (e.g., a user interface UI interface) runs on one device (e.g., to handle the exposed business logic functions of the UI interface), and a frontend of the application (e.g., UI interface) runs on another device and requires real-time access to the backend of the application.

It should be noted that, in the embodiment of the present application, a device that initiates streaming of content of its application is referred to as a streaming source device, and a device that receives content of the application is referred to as a streaming target device.

Second, the application circulation technique according to the present application may include a wired method and a wireless method. The wired mode is to establish wired connection between the streaming source device and the streaming target device through a high-definition multimedia interface (HDMI) data line, a Universal Serial Bus (USB) data line, and the like to transmit media data; the wireless mode is to establish wireless connection between the streaming source device and the streaming target device through a Digital Living Network Alliance (DLNA) protocol, a wireless display sharing (Miracast) protocol or an AirPlay (AirPlay) protocol, etc. to transmit media data.

For example, when streaming is applied, the streaming source device may transmit the video stream in the current video player to the streaming target device after compressing the video stream by data encoding; then, the streaming target device decodes the video stream data and displays the video stream on its display screen.

In addition, the embodiment of the present application may collectively refer to the streaming source device and the streaming target device as electronic devices. The electronic device according to the embodiment of the present application may be a handheld device, a vehicle-mounted device, a wearable device, an Augmented Reality (AR) device, a Virtual Reality (VR) device, a projection device, a projector, or other devices connected to a wireless modem, or may be various User Equipments (UEs), terminal devices (terminal devices), cell phones (smart phones), smart screens, smart tvs, smart watches, laptops, smart stereos, cameras, game pads, microphones, Stations (STAs), Access Points (APs), Mobile Stations (MSs), Personal Digital Assistants (PDAs), Personal Computers (PCs), or relay devices.

For example, two electronic devices, a computer and a mobile phone, are taken as examples. When the computer and the mobile phone are connected with each other through a wireless communication technology (such as Bluetooth, wireless fidelity, Zigbee, near field communication and the like) or a data line (such as a USB data line), the mobile phone serves as a circulation source device to transmit the content of the running application of the mobile phone to the computer through an application circulation technology, and the computer serves as a circulation target device; or, the computer is used as a circulation source device to transmit the content of the application running on the mobile phone, and the mobile phone is used as a circulation target device at the moment.

The following technical solution of the embodiment of the present application may be applied to the application content streaming communication system 10 shown in fig. 1. The application content streaming communication system 10 may include at least two electronic devices 110, among other things. Among them, the at least two electronic devices 110 may include an electronic device 110A, an electronic device 110B, an electronic device 110C, an electronic device 110D, an electronic device 110E, and an electronic device 110F. Meanwhile, each of the at least two electronic devices 110 may be communicatively connected to each other through a wireless network or wired data.

It should be noted that the wireless network may include a mobile cellular network (e.g., a fifth generation 5G mobile communication network), a Wireless Local Area Network (WLAN), a Wide Area Network (WAN), Bluetooth (Bluetooth), wireless fidelity (Wi-Fi), Zigbee (Zigbee), Near Field Communication (NFC), Ultra Wide Band (UWB), or the like; the wired data may include HDMI data lines, USB data lines, and the like.

Specifically, each of the at least two electronic devices 110 may be devices under the same user account. For example, when a user logs in to a mobile phone, a desktop computer, a smart screen, a notebook computer, a relay device and a smart watch using the same user account, the at least two electronic devices 110 include the mobile phone, the desktop computer, the smart screen, the notebook computer, the relay device and the smart watch, and the mobile phone, the desktop computer, the smart screen, the notebook computer, the relay device and the smart watch can communicate with each other through a wireless network.

Specifically, each of the at least two electronic devices 110 may be connected to the same WLAN network through a relay device (e.g., a router). For example, when a user accesses a mobile phone, a desktop computer, a smart screen, a notebook computer and a smart watch to a Wi-Fi network provided by a relay device, the at least two electronic devices 110 include the mobile phone, the desktop computer, the smart screen, the notebook computer, the relay device and the smart watch, and the mobile phone, the desktop computer, the smart screen, the notebook computer, the relay device and the smart watch form a WLAN network, so that the devices in the WLAN network can communicate with each other through the relay device.

Specifically, each of the at least two electronic devices 110 may form a Peer-to-Peer (P2P) network through a wireless communication manner (e.g., bluetooth, Zigbee, NFC, UWB, etc.). For example, a user forms a P2P network by scanning NFC tags with devices such as a mobile phone, a notebook computer, and a smart watch, and all devices in the P2P network may communicate with each other.

Further, one or more of the at least two electronic devices 110 may serve as a streaming source device, and the other electronic devices may serve as streaming target devices. At this time, the streaming source device may transmit the content of the application it runs into the streaming target device. In addition, when the streaming target device needs to simultaneously run or display the content of the application transmitted by the multiple screen projection source devices, the streaming target device may simultaneously run by establishing multiple processes or simultaneously display in a split screen manner. For example, electronic device 110A casts a screen to electronic device 110B and electronic device 110C, and electronic device 110D casts a screen to electronic device 110C and electronic device 110F. At this time, the electronic device 11C may simultaneously display the screen projection images from the electronic device 110A and the electronic device 110D in a split screen manner.

Further, the application content streaming communication system 10 may also include other numbers of electronic devices, which are not specifically limited herein.

The following describes the structure of the electronic device in the embodiment of the present application in detail with reference to fig. 2, and it is understood that the structure illustrated in fig. 2 does not specifically limit the electronic device. In other embodiments of the present application, the electronic device may also include more or fewer components than illustrated in FIG. 2, or some components may be combined, some components may be split, or a different arrangement of components. In addition, the components illustrated in fig. 2 may be implemented by hardware, software, or a combination of software and hardware.

Referring to fig. 2, the electronic device may include a processor 210, an antenna 1, an antenna 2, a mobile communication module 220, a wireless communication module 230, an audio module 240, a sensor module 250, a display module 260, a camera module 270, a charging management module 280, an internal memory 2901, an external memory interface 2902, and the like.

In particular, processor 210 may include one or more processing units. For example, the processor 210 may include an Application Processor (AP), a modem processor, a Graphics Processor (GPU), an Image Signal Processor (ISP), a controller, a memory, a video codec, a Digital Signal Processor (DSP), a Field Programmable Gate Array (FPGA), a baseband processor and/or a neural Network Processor (NPU), and the like. The different processing units may be separate devices or may be integrated into one or more processors.

Further, a memory may be disposed within processor 210 for storing instructions and data. In some embodiments, the memory in the processor 210 is a cache memory. The memory may hold instructions or data that have just been used or recycled by processor 210. If the processor 210 needs to reuse the instruction or data, it can be called directly from the memory, thereby avoiding repeated accesses and reducing the latency of the processor 210 to improve system efficiency.

Further, the processor 210 may include one or more interfaces. The interface may include an integrated circuit (I2C) interface, an integrated circuit built-in audio (I2S) interface, a Pulse Code Modulation (PCM) interface, a universal asynchronous receiver/transmitter (UART) interface, a Mobile Industry Processor Interface (MIPI), a general-purpose input/output (GPIO) interface, a Subscriber Identity Module (SIM) interface, and/or a USB interface, etc.

The wireless communication function of the electronic device may be implemented by the antenna 1, the antenna 2, the mobile communication module 220, the wireless communication module 230, the modem processor, the baseband processor, and the like. Wherein the antennas 1 and 2 are used for transmitting and receiving electromagnetic wave signals. Each antenna in an electronic device may be used to cover a single or multiple communication bands. In addition, different antennas can be multiplexed to improve the utilization rate of the antennas. For example, antenna 1 is multiplexed as a diversity antenna for a wireless local area network.

In particular, the mobile communication module 220 may provide a solution including 2G/3G/4G/5G wireless communication applied to the electronic device. The mobile communication module 220 may include at least one filter, a switch, a power amplifier, a Low Noise Amplifier (LNA), and the like.

Further, the mobile communication module 220 may receive the electromagnetic wave from the antenna 1, and perform filtering, amplification, and other processing on the received electromagnetic wave, and then transmit the electromagnetic wave to the modem processor for demodulation. In addition, the mobile communication module 220 may also amplify the signal modulated by the modem processor, and then convert the signal into electromagnetic wave through the antenna 1 to radiate the electromagnetic wave. In this embodiment, the mobile communication module 220 can implement communication connection between the streaming source device and the streaming target device in the technical solution of this application.

Further, at least a part of the functional modules of the mobile communication module 220 may be disposed in the processor 210; alternatively, at least some of the functional modules of the mobile communication module 220 may be disposed in the same device as some of the modules of the processor 210.

Specifically, the wireless communication module 230 may provide a solution for wireless communication applied to the electronic device, including Bluetooth (BT), Wireless Local Area Network (WLAN), wireless fidelity (Wi-Fi) network, Near Field Communication (NFC), infrared technology (IR), and the like.

Further, the wireless communication module 230 may be one or more devices integrating at least one communication processing module. The wireless communication module 230 receives electromagnetic waves via the antenna 2, performs frequency modulation and filtering on electromagnetic wave signals, and transmits the processed signals to the system-on-chip 210. The wireless communication module 230 may also receive a signal to be transmitted from the processor 210, perform frequency modulation and amplification on the signal, and convert the signal into electromagnetic wave radiation by the antenna 2. In this embodiment, the wireless communication module 230 can implement communication connection between the streaming source device and the streaming target device in the technical solution of this application.

It should be noted that the electronic device may implement an audio function through the audio module 240, the speaker 2401, the receiver 2402, the microphone 2403, the earphone interface 2404, the processor 210, and the like. Such as music playing, sound recording, video playing, etc.

Specifically, the audio module 240 may be configured to convert digital audio information into an analog audio signal for output, and may also be configured to convert an analog audio input into a digital audio signal. In addition, the audio module 240 may also be used to encode and decode an audio signal. In one possible example, the audio module 240 may be provided in the processor 210, or some functional modules of the audio module 240 may be provided in the processor 210.

In particular, the speaker 2401 may be used to convert an audio electrical signal into an acoustic signal. The electronic apparatus can listen to music through the speaker 2301 or listen to a handsfree call.

In particular, receiver 2402 may be used to convert an electrical audio signal into an acoustic signal. For example, when the electronic device receives a call or voice message, the electronic device can receive the voice message by placing the receiver 2402 close to the ear of the user.

In particular, microphone 2403 may be used to convert acoustic signals into electrical signals. For example, when making a call or transmitting voice information, the user can input a voice signal to the microphone 2403 by speaking into the mouth near the microphone 2403. In addition, the electronic device may be provided with at least one microphone 2403. In one possible example, the electronic device may be provided with two microphones 2403, which may implement a noise reduction function in addition to collecting sound signals; in a possible example, the electronic device may further include three, four or more microphones 2403 to collect sound signals, reduce noise, identify sound sources, implement a directional recording function, and the like, which is not particularly limited.

In particular, the headset interface 2404 may be used to connect wired headsets. The headset interface 2404 may be a USB interface 2703, or may be a 3.5mm open mobile electronic device platform (OMTP) standard interface, a cellular telecommunications industry association (cellular telecommunications industry association of the USA, CTIA) standard interface, or the like.

Specifically, the sensor module 250 may include a pressure sensor, a gyroscope sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, a bone conduction sensor, an ultra-wideband UWB sensor, a near field communication NFC sensor, a laser sensor, a visible light sensor, and the like.

The electronic device may implement a display function through the GPU, the display module 260, the processor 210, and the like. The GPU may be configured to perform mathematical and geometric calculations and perform graphics rendering, among other things. Additionally, the GPU may be a microprocessor for image processing and connect the display module 260 and the processor 210. Processor 210 may include one or more GPUs that execute program instructions to generate or alter display information.

Specifically, the display module 260 may be a display screen for displaying images, videos, or texts. The display screen 260 may include a display panel, among others. The display panel may be a Liquid Crystal Display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a quantum dot light-emitting diode (QLED), or the like. In one possible example, the electronic device may include one or more display modules 260.

The electronic device may implement a shooting function through the ISP, the camera module 270, the video codec, the GPU, the display module 260, the processor 210, and the like. The ISP may be configured to process data fed back by the camera module 270. For example, when a photo is taken, the shutter is opened first, then light is transmitted to the camera photosensitive element through the lens, so that an optical signal is converted into an electrical signal, and finally the electrical signal is transmitted to the ISP through the camera photosensitive element to be processed so as to be converted into an image visible to naked eyes. In addition, the ISP can also carry out algorithm optimization on the noise, brightness and skin color of the image. The ISP can also optimize parameters such as exposure, color temperature and the like of a shooting scene. In one possible example, the ISP may be provided in the camera module 270.

In particular, the camera module 270 may be a camera for capturing still images or videos, etc. The object generates an optical image through a lens and projects the optical image onto a photosensitive element, and the photosensitive element may be a Charge Coupled Device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The light sensing element converts the optical signal into an electrical signal, which is then transmitted to the ISP to be converted into a digital image signal. And the ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In one possible example, the electronic device may include one or more camera modules 270.

Specifically, the charging management module 280 is configured to receive charging input from a charger. The charger may be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 280 may receive charging input from a wired charger via the USB interface 2803. In some wireless charging embodiments, the charging management module 280 may receive a wireless charging input through a wireless charging coil of the electronic device. While the charging management module 280 charges the battery 2801, power may also be supplied to the electronic device through the power management module 2802.

Note that the power management module 2802 is used to connect the battery 2801, the charge management module 2802, and the processor 210. The power management module 2802 receives input from the battery 2801 and/or the charge management module 280, and provides power to various modules in the electronic device, the processor 210, and the like.

Specifically, the power management module 2802 may also be configured to monitor parameters such as battery capacity, battery cycle count, and battery state of health (leakage, impedance). In one possible example, the power management module 2802 can also be disposed in the processor 210; in one possible example, the power management module 2802 and the charge management module 280 may also be provided in the same device.

It is noted that internal memory 2901 can be utilized to store computer-executable program code, including instructions. The processor 210 executes various functional applications and data processing of the electronic device by executing instructions stored in the internal memory 2901. In one possible example, the internal memory 2901 stores program code that implements the technical aspects of the embodiments of the present application.

Specifically, the internal memory 2901 may include a program storage area and a data storage area. The storage program area may store an operating system, an application program (e.g., a sound playing function, an image playing function, etc.) required for at least one function, and the like. The storage data area may store data (e.g., audio data, a phonebook, etc.) created during use of the electronic device, and the like. In addition, the internal memory 2901 can include high-speed random access memory, and can also include non-volatile memory. Such as at least one magnetic disk storage device, flash memory device, Universal Flash Storage (UFS), etc.

Specifically, the external memory interface 2902 can be used for connecting an external memory card, such as a micro SD card, to extend the memory capability of the electronic device. The external memory card communicates with the processor 210 through the external memory interface 2902, implementing data storage functionality. For example, files such as music, video, and the like are saved in an external memory card.

In the embodiment of the present application, a software system of an electronic device may adopt a layered architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture, or a cloud architecture. In the following, the embodiment of the present application takes an Android system with a layered architecture as an example, and exemplarily illustrates a software structure of an electronic device.

Fig. 3 is a schematic diagram of an architecture of a software and hardware system with an Android system. The internal memory 2901 may store a kernel layer 320, a system runtime layer 340, an application framework layer 360, and an application layer 380. The layers communicate with each other through a software interface, and the kernel layer 320, the system runtime layer 340 and the application framework layer 360 belong to an operating system space.

Specifically, the application layer 380 belongs to a user space, and at least one application program (or simply "application") runs in the application layer 380, and the application program may be a native application program carried by an operating system itself or a third-party application program developed by a third-party developer. For example, the application layer 380 may include applications for cameras, galleries, calendars, conversations, maps, navigation, WLAN, Bluetooth, music, video, and short messages.

In the embodiment of the application, a circulation application can be further installed in the application layer. The user can open the circulation application from a desktop, a setup function, a pull-down menu, or the like. The streaming application can be used as a bridge between streaming source equipment and streaming target equipment during content streaming, and transmits the content of the application needing to be streamed in the streaming source equipment to the streaming target equipment. For example, the streaming application may receive a streaming event reported by the application framework layer 360, so as to interact with a running application (such as a video player) by using the streaming application, and then send content being displayed or played in the application as streaming content to the streaming target device through a wireless communication manner such as Wi-Fi.

In addition, the user may also set up a binding relationship between the NFC or UWB tag and one or more electronic devices using the streaming application. For example, an option for binding NFC or UWB tags is set in streaming applications. When the electronic device detects that the user opens the option, the circulation application may display a list of electronic devices to be bound. After the user selects one or more electronic devices needing to be bound on the list, the electronic devices are close to the NFC label. In this way, after transmission of an NFC signal or the like, the identifier of the electronic device selected by the user in the streaming application may be written into the NFC tag, so as to establish a binding relationship between the NFC tag and one or more electronic devices in the NFC tag.

It should be noted that the application framework layer 360 provides various Application Programming Interfaces (APIs) and programming frameworks that may be used when building the application of the application layer, so that a developer can build a self-or third-party application by using the APIs. For example, a window manager (window manager), a content provider (content providers), a view system (view system), a telephone manager (telephone manager), a resource manager, a notification manager (notification manager), a message manager, an activity manager (activity manager), a package manager (package manager), a location manager (location manager), and an NFC service, etc.

In particular, a window manager may be used to manage the windowing program. The window manager can obtain the size of the display screen and judge whether a status bar, a lock screen, a capture screen and the like exist.

In particular, the content provider may be used to store and retrieve data and make the data accessible to applications. The data may include, among other things, video, images, audio, calls made and answered, browsing history and bookmarks, phone books, and the like. In addition, the content provider may enable an application to access data of another application, such as a contacts database, or to share their own data.

In particular, the view system includes visual controls. For example, controls for displaying text, controls for displaying pictures, and the like. The view system may be used to build applications. The display interface may be composed of one or more views. For example, the display interface including the short message notification icon may include a view for displaying text and a view for displaying pictures.

In particular, a phone manager is used to provide communication functions for the electronic device. For example, management of call status (e.g., on, off, etc.).

In particular, the resource manager may provide various resources for the application. Such as localized strings, icons, pictures, layout files, video files, etc.

Specifically, the notification manager enables the application to display notification information in the status bar, can be used to convey notification-type messages, can disappear automatically after a short dwell, and does not require user interaction. For example, a notification manager is used to notify download completion, message alerts, and the like. The notification manager may also be a notification that appears in the form of a chart or scroll bar text at the top status bar of the system. Additionally, the notification of the application running in the background may also be a notification that appears on the screen in the form of a dialog window. For example, text messages are prompted in the status bar, a prompt tone is sounded, the electronic device vibrates, indicator lights flash, and the like.

Specifically, the message manager may be configured to store data of messages reported by each application program, and process the data reported by each application program.

In particular, the campaign manager may be used to manage application lifecycle and provide common navigation fallback functionality. In one possible example, the message manager may be part of the notification manager.

In the embodiment of the present application, an NFC service (NFCservice) may be run in the application framework layer 360.

For example, after the NFC function is turned on, the mobile phone may start running the NFC service in the application framework layer. When the mobile phone is close to or touches the NFC label, the NFC service can call the NFC drive of the kernel layer to read the binding relation stored in the NFC label, and therefore the transfer target device for transferring the content is obtained. Furthermore, the NFC service may report a streaming event to the content streaming, so as to trigger the streaming application to transmit the content running or played by the mobile phone as streaming content to the streaming target device to start the content streaming process.

It should be noted that the system runtime library layer 340 provides a main feature support for the Android system through some C/C + + libraries. For example, the SQLite library provides support for a database, the OpenGL/ES library provides support for 3D drawing, the Webkit library provides support for a browser kernel, and the like. Also provided in the system Runtime layer 340 is an Android Runtime library (Android Runtime), which mainly provides some core libraries capable of allowing developers to write Android applications using the Java language.

Specifically, the kernel layer 320 may provide underlying drivers for various hardware of the electronic device, such as a display driver, an audio driver, a camera driver, a bluetooth driver, a Wi-Fi driver, a power management, an NFC driver, a UWB driver, an application flow driver, a voice recognition driver, a gesture recognition driver, an image recognition driver, a human recognition driver, a facial motion recognition driver, a human motion recognition driver, and the like.

The application flow framework of the embodiment of the present application is described in detail below. As shown in fig. 4, the application flow framework may include an acquisition information module 410, a source and target determination module 420, a connection management module 430, an application information module 440, a flow policy module 450, and an application flow module 460. The information obtaining module 410 may include a sensor recognition module, a voice recognition module, a gesture recognition module, an image recognition module, a human posture recognition module, a face action recognition module and/or a human action recognition module, etc.; the application flow module 460 may include a distributed application framework, a screen-casting service framework, a relay application framework, a generic application framework, a screen-casting application framework, and the like.

Specifically, the information obtaining module 410 may be configured to obtain Identification (ID) information of one or more electronic devices through sensor recognition, voice recognition, gesture recognition, image recognition, human gesture recognition, face motion recognition, human motion recognition, and the like, and send the ID information of the one or more electronic devices to the source and target determining module 420. The sensor can comprise a UWB sensor, an NFC sensor, a laser sensor and/or a visible light sensor, and the like; the ID information may include an Internet Protocol (IP) address, a Media Access Control (MAC) address, a UWB tag, an NFC tag, and the like. Two electronic devices, a mobile phone and a notebook computer, are exemplified below.

For example, if a mobile phone and a notebook computer are both equipped with UWB sensors and each has a UWB tag (i.e., ID information), when a user moves the mobile phone so that the distance between the mobile phone and the notebook computer is short, the UWB sensor on the mobile phone will acquire the UWB tag of the notebook computer.

For another example, if both the mobile phone and the notebook computer have NFC sensors and have NFC tags (i.e., ID information), when the user touches the mobile phone to the notebook computer by touching or leaning on, the NFC sensor on the mobile phone will acquire the NFC tag of the notebook computer.

For another example, if the mobile phone and the notebook computer both turn on the camera, when the mobile phone and the notebook computer both capture the current gesture motion image of the user, the information obtaining module 410 analyzes the angle of the gesture (for example, the gesture is a front side, but not a deviation angle), the size of the gesture (for example, the gesture occupies the size of the whole screen), and the like in the captured gesture motion image, so as to select a device satisfying the preset condition from the mobile phone and the notebook computer as the stream source device or the stream target device, and obtain the ID information of the stream source device or the ID information of the stream target device. For example, in the respective captured gesture motion images, the real stream source device (stream destination device) captures images with more gestures toward the front, rather than having a shift angle; alternatively, the larger the proportion of gestures in the captured image, the more likely it is that the stream source device (stream destination device) is true. Therefore, the preset condition can be understood as that the gesture in the image is more oriented to the front, or the gesture proportion in the image is larger, and the like.

Specifically, the source and destination determining module 420 may be configured to determine, from the ID information of the one or more electronic devices from the obtaining information module 410, the ID information corresponding to the streaming source device and the ID information corresponding to the streaming destination device. It should be noted that there may be ambiguous flow source devices and flow destination devices (i.e., flow objects) in the ID information sent by the obtaining information module 410 to the source and destination determining module 420, so that application flow cannot be executed. At this point, a determination is required by the source and destination determination module 420. If the result of the flow source device and the flow target device is clear, the result is sent to the flow policy module 440 to execute the application flow policy from the flow source device to the flow target device; if there is no explicit result of the streaming source device and the streaming target device, the connection management module 430 is accessed. In the following, a mobile phone is taken as an example of the streaming source device.

For example, when the mobile phone recognizes a voice input by the user, that is, "transfer the video image of the mobile phone to the computer", the voice recognition module in the mobile phone recognizes the voice, and transmits the recognition result to the source and target determination module. Since the mobile phone may have communication connections with a plurality of devices (e.g., a laptop computer, a desktop computer, etc.), the source and target determination modules in the mobile phone cannot determine the specific target device from the recognition result.

Specifically, the connection management module 430 may be configured to obtain ID information of all devices connected to the streaming source device under the same user account or the same network. The connection management module 430 may access a server or other electronic devices at a remote end or a cloud end to obtain the ID information, may access an internal memory at a local end to obtain the ID information, and may also access an external memory interface to obtain the ID information, which is not limited specifically.

Specifically, the application information module 440 may be configured to identify a currently running application to obtain application information of the application. The application information may include an application name, an application type, and the like. It should be noted that the application information module 440 may obtain the application information of the application currently running on the front end (e.g., UI interface) or the back end by accessing a process or a thread.

In addition, the embodiments of the present application divide the application types into the following four types: screen projection type application, distributed application, relay type application and common type application. The screen-casting application refers to an application which continues to run on the streaming source device, is screen-cast to the streaming target device by the streaming source device, and then starts to run by the streaming target device; the distributed application refers to an application of which the front end and the back end can realize separated operation on different devices; the relay application refers to an application which can realize storage, recovery or sharing operation on different devices through file service on a local terminal; the plain application refers to an application capable of implementing a display operation on different devices through a screen projection technology, and the plain application may include a screen projection application.

Specifically, the flow policy module 450 may be configured to determine an application flow policy from the flow source device to the flow target device according to the application type, and transmit the application flow policy to the application flow module 460. It should be noted that the circulation policy module 450 may access the application information module 440 to know the application type of the currently running application, so as to determine different application circulation policies according to different application types.

In particular, the application flow module 460 may be configured to execute the application content cross-device flow according to the application flow policy. It should be noted that different application types need to adopt different application flow policies, and the different application flow policies correspond to different application frameworks. For example, when performing application flow on a distributed application, a distributed application framework needs to be adopted; when the application circulation is executed on the relay type application, a relay type application framework is needed; when application circulation is executed on the screen-projecting type application, a screen-projecting service framework or a screen-projecting type application framework is required to be adopted; when executing application circulation to the plain application, a screen projection service framework or a plain application framework needs to be adopted.

At present, a cross-device flow scheme for application contents only supports a single software and hardware, and a module or a framework is not provided for integrating multiple software and hardware to realize cooperative operation. Meanwhile, the current scheme only supports screen projection or simple data transmission, cannot support richer circulation of distributed applications or relay applications and the like, and cannot simultaneously support application circulation among different application types. Therefore, through the application flow framework shown in fig. 4, in the embodiment of the application, information acquisition can be performed through different identification modules, the ID information of the flow source device and the ID information of the flow target device are determined from the acquired information to determine the flow object, and different application flow strategies are adopted according to the application type of the currently running application, so that more convenient and faster application content cross-device flow is realized, and the application flow efficiency and the use experience are improved. The following embodiments of the present application will be specifically described with reference to the method examples.

In conjunction with the above description, the execution steps of the application content cross-device streaming method will be described in the following from the perspective of a method example, please refer to fig. 5. Fig. 5 is a flowchart of a cross-device application content streaming method provided in an embodiment of the present application, where the method is applied to a streaming source device, and includes: and S510, acquiring the application type of the target application currently operated by the stream source equipment.

It should be noted that, a target application is currently running on the streaming source device in the embodiment of the present application, and the target application may be an application program or media data, such as a photo, a video, an audio, a game, a gallery, a document, or multimedia, running on an application layer of the streaming source device. In addition, the stream source device may run the target application at the front end, or may run the target application at the back end. When the circulation source device runs the target application at the front end, a display screen of the circulation source device can display the current content of the target application; when the circulation source device runs the target application at the back end, the display screen of the circulation source device may not display the current content of the target application, and the background continues to execute the target application.

In one possible example, before S510, the method may further include the steps of: and acquiring the first information, and judging whether the first information carries the identification information of the circulation target equipment.

Specifically, the first information may satisfy at least one of the following modes: the first information is acquired through sensor recognition, the first information is acquired through voice recognition, the first information is acquired through gesture recognition, the first information is acquired through image recognition, the first information is acquired through human body posture recognition, the first information is acquired through face action recognition, and the first information is acquired through human body action recognition; wherein the sensor may include at least one of: the ultra-wideband UWB sensor, the NFC sensor, the laser sensor and the visible light sensor.

It should be noted that, in order to implement cross-device application content streaming between a streaming source device and a streaming target device, in the embodiment of the present application, a streaming object (that is, a streaming source device and/or a streaming target device) needs to be determined first. Therefore, when the content of the target application currently running by the streaming source device is considered to be streamed, the streaming source device obtains the first information and judges whether the first information carries the identification information of the streaming target device, so that the streaming target device is determined by the streaming source device. At this time, in combination with the application streaming framework in fig. 4, in the embodiment of the present application, the first information may be acquired by the information acquisition module in the streaming source device, and whether the first information carries the identification information of the streaming target device is determined by the source and target determination module in the streaming source device. The following description takes the streaming source device as a mobile phone as an example.

For example, when a mobile phone is equipped with a UWB sensor, a user brings the mobile phone close to a notebook computer and a smart watch, which are also equipped with the UWB sensor, to acquire the UWB tag of the notebook computer and the UWB tag of the smart watch. At this time, the notebook computer and the smart watch may serve as candidate streaming target devices. Then, the display screen of the mobile phone can display an option list containing the notebook computer and the smart watch in a mode of popup, pull-down menu and the like. Finally, the user can select one or more devices from the option list as the circulation target device, so that the mobile phone obtains the ID information (i.e. UWB tag, MAC address or IP address, etc.) of the definite circulation target device.

For another example, when the NFC sensor is installed on a mobile phone, a user touches the mobile phone with a touch (or a touch, etc.) manner to a notebook computer and a smart watch that are also installed with the NFC sensor, so as to obtain the NFC tag of the notebook computer and the NFC tag of the smart watch. At this time, the notebook computer and the smart watch may serve as candidate streaming target devices. Then, the display screen of the mobile phone can display an option list containing the notebook computer and the smart watch in a popup window, a pull-down menu and other modes. Finally, the user can select one or more devices from the option list as the circulation target device, so that the mobile phone obtains the ID information (i.e. NFC tag, MAC address or IP address, etc.) of the explicit circulation target device.

For another example, when a notebook computer is connected to the mobile phone under the current user account, the mobile phone may enable the notebook computer to turn on the camera by issuing an instruction. At this time, if the notebook computer captures a current gesture motion image of the user (such as a gesture release motion, a gesture capture motion, a hand swinging motion, a left-right hand shaking motion, an "OK" gesture motion, and the like), the notebook computer analyzes whether the captured gesture motion image meets a preset gesture condition. If the preset gesture condition is met, the notebook computer serves as the circulation target device, and the notebook computer sends the MAC address or the IP address of the notebook computer to the mobile phone, so that the mobile phone obtains the clear ID information (namely the MAC address or the IP address and the like) of the circulation target device. It should be noted that, when the user really needs to transfer the content of the application running on the mobile phone to the notebook computer, the user can definitely make a gesture motion in the direction facing the camera of the notebook computer. Therefore, when analyzing the gesture action image shot by the notebook computer, the real circulation target device shoots more pictures with gestures towards the front instead of a deviation angle; alternatively, the larger the gesture proportion in the captured screen, the more likely it is that the gesture is a true circulation target device. Therefore, the preset gesture condition may be understood as that the gesture in the screen is oriented more frontally, or the gesture in the screen is larger in proportion, or the like.

As can be seen from the above three examples, the ID information of the streaming target device may be directly carried in the first information acquired by the streaming source device. However, the information acquisition module in the circulation source device may not carry the identification information of the circulation target device in the acquired first information by recognizing voice, image, human body posture, facial motion, human body motion, and the like. The following description takes the streaming source device as a mobile phone as an example.

For example, when a mobile phone recognizes a piece of voice "transfer a local video image to a computer" input by a user, if the mobile phone has a communication connection with a plurality of devices (such as a notebook computer, a desktop computer, etc.), the mobile phone obtains first information by recognizing the voice, but cannot clearly recognize from the first information which computer or computers to which the local video image is transferred, so that the mobile phone cannot determine from the first information a clearly transferred target device.

For another example, when a notebook computer a and a notebook computer B are connected to the mobile phone under the current user account, the mobile phone may enable both the notebook computer a and the notebook computer B to turn on the camera by issuing an instruction. At this time, if the notebook computer a and the notebook computer B both capture the current face action picture of the user (such as smiling action, mouth closing action, etc.), the notebook computer a and the notebook computer B each analyze whether the captured face action picture meets the preset face condition. If neither of the two mobile phones satisfies the preset face condition, neither of the notebook computer a and the notebook computer B sends the respective MAC address or IP address to the mobile phone, so that the mobile phone cannot acquire the specific ID information (i.e., the MAC address or IP address, etc.) of the circulation destination device. It should be noted that, when the user really needs to transfer the content of the application running on the mobile phone to the notebook computer a, the user can definitely perform a facial action in the direction facing the camera of the notebook computer a. At this time, the notebook computer a captures a picture with more faces facing the front, rather than having an offset angle; alternatively, the larger the face proportion in the captured picture is. However, since the user does not face the camera of the notebook computer B, the face of the user in the image captured by the notebook computer B has a large oblique angle. Therefore, the preset face condition may be understood as the face in the screen is oriented more frontally, or the face in the screen is more heavily occupied, or the like.

Next, an example of a case where the first information does not carry the identification information of the streaming target device will be described in the embodiments of the present application.

In one possible example, after determining whether the first information carries the identification information of the streaming target device, the method further includes the following steps: when the first information does not carry identification information of the transfer target device, acquiring identification information of all devices connected with the transfer source device under a current user account of the transfer source device; the identification information of the circulation target device is determined from the identification information of all the devices.

It should be noted that, when the embodiment of the present application considers that the content of the target application currently running in the streaming source device is streamed, if the first information acquired by the streaming source device does not carry the ID information of the streaming target device, in combination with the application streaming framework in fig. 4, the embodiment of the present application may acquire, by using a connection management module in the streaming source device, the ID information of all devices connected to the streaming source device under the current user account of the streaming source device.

It should be further noted that, because the identification information of all devices connected to the streaming source device under the current user account of the streaming source device is stored in the server at the far end or the cloud end, the streaming source device may access the server at the far end or the cloud end to obtain the ID information; or, because the identification information of all devices connected to the flow source device under the current user account of the flow source device is stored in the other remote electronic devices (such as a router or a relay device), the flow source device may access the other remote electronic devices to obtain the ID information; or, since the server or the other electronic device may directly issue the ID information to an internal memory of the streaming source device for caching, so as to improve access efficiency, the streaming source device may directly access the internal memory of the local terminal to obtain the ID information; alternatively, since the ID information may be copied to an external memory, the streaming source device may access an external memory interface to acquire the ID information.

Therefore, the ID information of all the devices under the same user account of the streaming source device is obtained through different access modes to determine the streaming target device, so that the cross-device streaming of the application content is more conveniently realized, and the efficiency, diversity and use experience of the application streaming are improved.

In addition, as for the current user account of the transfer source device, as can be seen from the application content transfer communication system 10 described above, each of the at least two electronic devices 110 may be a device under the same user account. For example, when a user logs in to a device such as a mobile phone, a desktop computer, and a smart watch using the same user account, the at least two electronic devices 110 include the mobile phone, the desktop computer, and the smart watch, and the mobile phone, the desktop computer, and the smart watch may communicate with each other through a wireless network. At this time, the stream source device may be understood as one device of the at least two electronic devices 110.

In one possible example, after determining whether the first information carries the identification information of the streaming target device, the method further includes: when the first information does not carry the identification information of the circulation target equipment, the identification information of all equipment connected with the circulation source equipment in the network where the circulation source equipment is located is obtained; the identification information of the circulation target device is determined from the identification information of all the devices.

It should be noted that, when the content of the target application currently running by the streaming source device is considered to be streamed in the embodiment of the present application, if the first information acquired by the streaming source device does not carry the ID information of the streaming target device. At this time, in combination with the application streaming framework in fig. 4, in the embodiment of the present application, the connection management module in the streaming source device may acquire ID information of all devices connected to the streaming source device in the network where the streaming source device is located.

It should be further noted that, as for the network where the streaming source device is located, as can be seen from the above-described application content streaming communication system 10, each of the at least two electronic devices 110 may be connected to the same WLAN network through a relay device (e.g., a router). Alternatively, each of the at least two electronic devices 110 may form a Peer-to-Peer (P2P) network through a wireless communication manner (e.g., bluetooth, Zigbee, NFC, UWB, etc.). Therefore, the network where the streaming source device is located may be a WLAN network or a P2P network formed by relay devices or wireless communication methods.

In addition, if the network where the flow source device is located is a WLAN network, the flow source device may access the remote relay device to obtain the ID information; or, the relay device at the remote end directly issues the ID information to the internal memory of the flow source device for caching, and the flow source device may directly access the internal memory of the local end to obtain the ID information. If the network where the stream source device is located is a P2P network, the stream source device may access a master electronic device (e.g., a device with high computing power, a device closest to the stream source device, or a master device in the P2P network) in the P2P network to obtain the ID information; or, the main electronic device directly issues the ID information to an internal memory of the stream source device for caching, and the stream source device may directly access the internal memory of the local terminal to obtain the ID information. If the ID information can be copied to the external memory, the stream source device may access the external memory interface to acquire the ID information.

Therefore, the ID information of all the devices connected with the flow source device in the network where the flow source device is located is obtained through the different access modes to determine the flow target device, so that the cross-device flow of the application content is more conveniently realized, and the efficiency, diversity and use experience of the application flow are improved.

The following embodiment of the present application will specifically describe how the streaming source device determines the identification information of the streaming target device from the identification information of all devices.

Specifically, determining the identification information of the circulation target device from the identification information of all devices may include the following steps: if only the identification information of one device exists in the identification information of all the devices except the identification information of the circulation source device, the identification information of the device is used as the identification information of the circulation target device.

It should be noted that, when only one device is provided for all devices connected to the streaming source device under the same user account, or only one device is provided for all devices connected to the streaming source device in the same network, the embodiment of the present application considers that the device can be used as a streaming target device and the ID information of the device is acquired, so that the streaming source device can realize that the content of the currently running target application is streamed to the device.

Specifically, determining the identification information of the circulation target device from the identification information of all devices may include the following steps: if the identification information of at least two devices exists in the identification information of all the devices except the identification information of the streaming source device, acquiring a selection operation instruction aiming at the identification information of at least two devices; and determining the identification information of the circulation target equipment from the identification information of at least two pieces of equipment according to the selection operation instruction.

It should be noted that, when all devices connected to the flow source device under the same user account have at least two (i.e., multiple) devices, or all devices connected to the flow source device in the same network have multiple devices, the embodiment of the present application considers that an option list including the multiple devices is displayed on a display screen of the flow source device in a manner of a popup, a pull-down menu, or the like. The user may then select one or more devices from the list of options as the streaming target device. That is to say, the flow source device may obtain the selection operation instruction for the ID information of the multiple devices, so as to determine the ID of the flow target device according to the selection operation instruction, and implement that the flow source device flows the content of the currently running target application to the flow target device. The following description takes the streaming source device as a mobile phone as an example.

As shown in fig. 6 and 7, for example. In fig. 6, a music player (i.e., a target application) is currently running on the handset. At this time, the user needs to transfer the song "you don't want to remember me" (i.e., the content of the target application) being played on the music player to the notebook computer for playing. At this time, the user starts to prepare for the cross-device application content transfer by clicking the "transfer application" option on the mobile phone. In fig. 7, after clicking the "circulation application" on the mobile phone shown in fig. 6, the user searches for a laptop a and a laptop B from a wide area network (all devices under the same user account are connected through the wide area network) or a local area network (such as a WLAN network or a P2P network). At this time, the MAC address of notebook A (i.e., 00:0C:29:26: BC:07) and the MAC address of notebook B (i.e., 00:0C:29: F3:54:1D) are transmitted to the cellular phone through the above-mentioned network. Then, the mobile phone displays an option list containing the MAC address of the notebook computer A and the MAC address of the notebook computer B in a popup mode. Finally, the user can select the notebook computer a from the option list as the circulation target device.

Therefore, when a plurality of devices exist, the plurality of devices can be selected by the user to determine the transfer target device, so that the use experience of the application content transfer across the devices is improved.

Specifically, determining the identification information of the circulation target device from the identification information of all devices may include the following steps: if the identification information of at least two devices exists in the identification information of all the devices except the identification information of the streaming source device, the identification information with the highest priority in the identification information of at least two devices is used as the identification information of the streaming target device according to a preset priority policy.

It should be noted that, when there are multiple devices in all devices connected to the circulation source device under the same user account, or there are multiple devices in all devices connected to the circulation source device in the same network, the embodiment of the present application determines the identification information of the circulation target device from the identification information of all devices according to the preset priority policy.

Several embodiments of the preset priority policy according to the embodiments of the present application are specifically described below.

Mode 1:

further, the pre-setting of the priority policy may include determining, from the at least two devices, a time when the application flow has historically occurred with the flow source device, and setting a device having a closest time to the time when the application flow has occurred with the flow source device as the highest priority.

Illustratively, taking a mobile phone as a circulation source device as an example, all devices under the same user account with the mobile phone include a notebook computer and a smart watch. The notebook computer and the mobile phone have the latest application circulation at 16:00 at 11/6/2020, and the smart watch and the mobile phone have the latest application circulation at 12:00 at 11/7/2020. Therefore, according to the preset priority strategy, the priority of the smart watch is the highest.

Mode 2:

further, the presetting of the priority policy may include judging, from the at least two devices, the number of times of having historically experienced application flows with the flow source device, and setting, as the highest priority, a device having the highest number of times of having experienced application flows with the flow source device.

Illustratively, taking a mobile phone as a circulation source device as an example, all devices in the same network with the mobile phone include a notebook computer and a smart watch. The number of times of application circulation between the notebook computer and the mobile phone in history is 1, and the number of times of application circulation between the smart watch and the mobile phone in history is 0. Therefore, according to the preset priority strategy, the priority of the notebook computer is the highest.

Mode 3:

further, the preset priority policy may include setting all devices in a P2P network (i.e., a network formed by bluetooth, Zigbee, NFC, UWB, and other wireless communication manners) where the streaming source device is located as the highest priority.

Illustratively, taking a mobile phone as a streaming source device as an example, the mobile phone and a notebook computer form a P2P network in a bluetooth manner, and the mobile phone and a smart watch form a WLAN network by accessing the same router. Therefore, according to the preset priority strategy, the priority of the notebook computer is the highest.

Mode 4:

further, the pre-setting of the priority policy may include setting all devices in the WLAN network (i.e., the network formed by the same relay device or router) in which the streaming source device is located to have the highest priority.

Illustratively, taking a mobile phone as a streaming source device as an example, the mobile phone and a notebook computer form a P2P network in a bluetooth manner, and the mobile phone and a smart watch form a WLAN network by accessing the same router. Therefore, according to the preset priority strategy, the priority of the smart watch is the highest.

Mode 5:

further, the preset priority policy may include setting all devices under the same user account as the streaming source device to have the highest priority.

Illustratively, taking a mobile phone as a circulation source device as an example, the mobile phone and a notebook computer are two devices under the same user account, and the mobile phone and the notebook computer are connected with each other, and the mobile phone and a smart watch form a WLAN network by accessing the same router. Therefore, according to the preset priority strategy, the priority of the notebook computer is the highest.

Mode 6:

further, the preset priority policy may include preferentially selecting all devices in the P2P network where the flow source device is located, and then determining identification information of the flow target device from all the devices according to the selection operation instruction; or, preferentially selecting all devices in the P2P network where the flow source device is located, then judging the time of the application flow which has occurred with the flow source device historically from all the devices, and setting the device which has the closest time to the time of the application flow which has occurred with the flow source device as the highest priority; or, preferentially selecting all devices in the P2P network where the flow source device is located, then judging the times of application flow which has historically occurred with the flow source device from the above all devices, and setting the device with the largest number of times of application flow which has occurred with the flow source device as the highest priority.

It should be noted that, in the embodiment of the present application, the foregoing various implementation manners may be combined to determine the preset priority policy, which is not described in detail herein.

Therefore, in the embodiment of the application, the identification information of the transfer target device can be determined from the identification information of all the devices through different implementation modes, so that the efficiency and the use experience of the application content transfer across the devices are improved.

In combination with the above description, S510 of the embodiment of the present application may include the following steps: and when the first information carries the identification information of the circulation target equipment, acquiring the application type of the target application currently operated by the circulation source equipment.

It should be noted that, when the embodiment of the present application considers that the content of the target application currently running on the streaming source device is streamed, if the first information acquired by the streaming source device carries the ID information of the streaming target device, in combination with the application streaming framework in fig. 4, the embodiment of the present application may identify the target application currently running on the streaming source device through the application information module in the streaming source device to acquire the application information (such as the application name, the application type, and the like) of the target application. In addition, the application information module in the flow source device may access a process or a thread, etc. on the operating system of the flow source device to obtain the application type of the target application.

Specifically, the application type of the target application may include at least one of the following: distributed application, relay application, and normal application.

Further, the distributed application may be used to instruct the front-end of the target application and the back-end of the target application to implement separate execution operations on different devices.

It should be noted that, when the target application is a distributed application, the back end of the target application needs to be run on the streaming source device, and the front end of the target application is streamed to the streaming target device, and the streaming target device runs the front end of the target application without the streaming source device running again.

Further, the baton application may be used to instruct the target application to perform storage, transfer, recovery, or sharing operations on different devices through a file service on the stream source device.

It should be noted that, when the target application is a relay application, the file service (fileServer) on the streaming source device may transfer the content (such as data stream, video stream, audio stream, etc.) of the target application to the streaming target device, and then the streaming target device accesses the file service on the streaming source device to recover the content of the target application. The file service can provide an http access address and provide the http access address to an external application or a third-party cooperative application in a data stream mode. For example, the external application or the third-party cooperative application may access the multimedia data of the home terminal through the http access address.

For example, taking a mobile phone as a streaming source device, a video player in the mobile phone is playing a local video file. When a user needs to relay the local video file played on the video player of the user to a notebook computer, the mobile phone transmits data stream information such as a video name, a video http address, a playing progress and the like of the local video file to the notebook computer through a relay type application framework. However, the notebook computer pops up a notification box after receiving the data stream information, and prompts the user whether to execute the video from the mobile phone or not through the notification box. If the user determines to execute the relay, the notebook computer runs the video player of the local terminal, and the video player accesses the file service on the mobile phone through the http address of the video in the received data stream information to recover the local video file (such as continuously playing the video), and the mobile phone stops playing the local video file.

Further, a generic application may be used to instruct the target application to implement the display operation on a different device through a screen-casting technique.

It should be noted that, when the target application is a normal application, the streaming source device may project the content of the target application onto a display screen or a display medium of the streaming target device for displaying, so as to display a synchronous display of the content.

S520, determining an application flow strategy aiming at the target application according to the application type.

It should be noted that, when the embodiment of the present application considers that the content of the target application currently running in the streaming source device is streamed, if the streaming source device already knows the ID information of the streaming target device, in combination with the application streaming framework in fig. 4, the embodiment of the present application may access the application information module through the streaming policy module in the streaming source device to know the application type of the target application, so as to determine the application streaming policy corresponding to the target application according to the application type of the target application.

The following embodiments of the present application will specifically describe several implementation manners for determining different application flow policies according to different application types of target applications.

Mode 1:

in one possible example, if the application type includes a distributed application, determining an application flow policy for the target application according to the application type may include: determining an application circulation strategy according to the distributed application; wherein the application flow policy is used to perform the following steps: the front end of the target application is paused to run on the streaming source device, and the streaming target device accesses the back end of the target application running on the streaming source device to start running the front end of the target application.

It should be noted that, when the target application is a distributed application, the application flow policy may be: continuously running the back end of the target application on the circulation source equipment, transferring the front end of the target application to the circulation target equipment, and stopping running the front end of the target application per se; the streaming target device accesses the back end of the target application running on the streaming source device to start running the front end of the target application. Two electronic devices, a mobile phone and a notebook computer, are exemplified below.

For example, please refer to fig. 8. The handset is currently running a distributed application X. And the UI interface and the server of the application X are operated. When the mobile phone points to the notebook computer through the UWB, after the mobile phone passes through the distributed application framework, the mobile phone suspends the operation of the UI interface of the application X, and the notebook computer starts to operate the UI interface of the application X by accessing the server side of the application X on the mobile phone.

In addition, in conjunction with the application flow framework in fig. 4, the UBW identification module in the mobile phone shown in fig. 8 acquires the UWB tag of the notebook computer, and sends the UWB tag of the notebook computer to the source and target determination module. Then, the source and target judgment module transmits the UWB tag of the mobile phone and the UWB tag of the notebook computer to the circulation strategy module, and the circulation strategy module accesses the application information module to acquire that the application X currently running by the mobile phone is distributed application. And finally, the flow strategy module initiates an application flow request to a distributed application framework in the application flow module, so that the UI interface of the application on the mobile phone is suspended through the distributed application framework, the UI interface of the application X on the notebook computer is pulled up, the notebook computer is informed to access the server side of the application X on the mobile phone when the UI interface of the application X starts to run, and the cross-device flow process of the application X is completed.

Mode 2:

in one possible example, if the application type includes a baton application, determining an application flow policy for the target application according to the application type may include: determining an application transfer strategy according to the relay application; wherein the application flow policy is used to perform the following steps: and pausing the running of the target application on the streaming source device, and accessing the file service of the streaming source device by the streaming target device to start running the target application.

It should be noted that, when the target application is a relay application, the application flow policy may be: the file service on the streaming source device transfers the content (such as data stream, video stream, audio stream and the like) of the target application to the streaming target device; the streaming target device accesses a file service on the streaming source device to start running the content of the target application. The file service can provide an http access address and provide the http access address to an external application or a third-party cooperative application in a data stream mode. Two electronic devices, a mobile phone and a notebook computer, are exemplified below.

For example, please refer to fig. 9. The mobile phone runs a video player to play a local video file. When a user inputs the voice played on the notebook computer into the mobile phone through the microphone of the mobile phone. The mobile phone analyzes the voice to know that the streaming source device is a notebook computer. Finally, after passing through the relay application framework, the mobile phone suspends playing the local video file on the video player of the local terminal, and the notebook computer starts playing (or continues playing) the local video file (i.e. the notebook computer plays the same video as the mobile phone) on the video player of the local terminal by accessing the file service on the mobile phone.

In addition, in conjunction with the application flow framework in fig. 4, the speech recognition module in the mobile phone shown in fig. 9 recognizes the speech "played on the notebook computer", and transmits the recognition result to the source and target determination modules. Secondly, because the source and target judgment modules cannot specifically acquire the ID information of the notebook computer through the identification result, the source and target judgment modules access the connection management module to query the ID information of all devices connected with the mobile phone in the same user account or the same network. And thirdly, only one notebook computer is connected with the mobile phone, so that the source and target judgment module acquires the ID information of the notebook computer and transmits the ID information of the mobile phone and the ID information of the notebook computer to the circulation strategy module. And then, the circulation strategy module accesses the application information module to acquire that the video player currently operated by the mobile phone is relay application. And finally, the transfer strategy module initiates an application transfer request to the relay application framework in the application transfer module, so that the video playing on the video player of the mobile phone is suspended through the relay application framework, and the notebook computer continues to play the same video on the video player of the local terminal as that on the mobile phone by accessing the file service on the mobile phone.

Mode 3:

in one possible example, if the application type includes a plain application, determining the application flow policy for the target application according to the application type may include the following steps: determining an application circulation strategy according to the common application; wherein the application flow policy is used to perform the following operations: if the application compatible target application and the content supporting the synchronous target application exist on the circulation target equipment, the running of the target application on the circulation source equipment is suspended, and the content of the target application is projected to a display screen or a display medium of the circulation target equipment for displaying; or if the application compatible target application is not available on the streaming target device or the content of the synchronous target application is not supported, continuing to run the target application on the streaming source device, and projecting the content of the target application to a display screen or a display medium of the streaming target device for displaying.

It should be noted that, when the target application is a generic application, the application flow policy may be: the method comprises the steps that a streaming source device projects the content of a target application to a display screen or a display medium of a streaming target device through a screen projection service framework for displaying, and judges whether the streaming target device has the content of an application compatible target application and supporting a synchronous target application; if the applications are compatible and support synchronization, the streaming source device can pause running the target application; if no application is compatible or synchronization is supported, the streamer device may continue running the target application.

In addition, the target application of the embodiment of the present application may be an application program or media data, such as a photo, a video, an audio, a game, a gallery, a document, multimedia, or the like, running on an application layer of the streaming source device. Meanwhile, the stream source device may run the target application at the front end, and may also run the target application at the back end. When the circulation source device runs the target application at the front end, a display screen of the circulation source device can display the content of the target application; when the circulation source device runs the target application at the back end, the display screen of the circulation source device may not display the content of the target application, and the target application is executed by the background. Two electronic devices, a mobile phone and a notebook computer, are exemplified below.

For example, please refer to fig. 10. The handset is currently running a plain application Y. When the mobile phone touches the notebook computer through NFC, after the screen projection service framework is passed, the mobile phone projects the content of the running application Y onto the display screen of the notebook computer for displaying. Since the notebook computer does not have an application compatible with the running of the application Y, the mobile phone needs to continue to run the application Y.

It should be further noted that, in the embodiment of the present application, what is displayed on the display screen of the streaming target device and is being screened by the streaming source device may be referred to as an image, and the image may present all or part of the screen of the content of the target application. Meanwhile, the mirror image may be a picture that is displayed after operations such as resolution adjustment, display size adjustment, pixel adjustment, image quality adjustment, and the like are performed in the screen projection process. The following description will be given by taking the streaming source device as a notebook computer and the streaming target device as a mobile phone.

For example, please refer to fig. 11 and 12. In fig. 11, the user opens a "cat. jpg" photo through the "gallery" application in the laptop, and uses the screen-casting service framework or the normal application framework to screen-cast the contents (i.e., the photo frame) of the "gallery" application in the laptop onto the mobile phone. At this time, the screen projection content displayed on the display screen of the mobile phone is the same as the content of the "gallery" application on the notebook computer (i.e. the mirror image can present the whole picture of the content of the target application). However, in fig. 12, the user may only screen "cat. jpg" with the "gallery" application on the laptop open onto the cell phone by setting the relevant screen-projection option. At this time, the screen-projected content displayed on the display screen of the mobile phone is only a partial screen in the content of the gallery application (i.e. a mirror image may present a partial screen of the content of the target application), for example, a whole body or a part of the whole "cat" is displayed.

In summary, through the descriptions of the above "mode 1", "mode 2", and "mode 3", the embodiment of the present application considers that different application flow policies are determined according to different application types of the target application, so that different application content cross-device flows are implemented according to the different application flow policies, diversity of the application content cross-device flows is ensured, and efficiency and use experience of the application flows are improved.

S530, transferring the content of the target application to the transfer target equipment according to the application transfer strategy.

In the embodiment of the application, the streaming source device acquires the first information and judges whether the first information carries the identification information of the streaming target device; then, when the first information carries identification information of the circulation target device, acquiring an application type of a target application currently operated by the circulation source device, and determining an application circulation strategy aiming at the target application according to the application type; and finally, transferring the content of the target application to the transfer target equipment according to the application transfer strategy. Because the target application is currently operated on the circulation source device in the embodiment of the application, in order to realize the circulation of the target application from the circulation source device to the circulation target device, the circulation source device acquires the first information and judges whether the first information carries the identification information of the circulation target device, so that the circulation source device determines the circulation target device. In addition, in order to realize that the target application is transferred from the transfer source device to the transfer target device, the application type of the target application is obtained, and different application transfer strategies are determined according to different application types of the target application, so that different application content cross-device transfer is realized through different application transfer strategies, the diversity of the application content cross-device transfer is ensured, and the efficiency and the use experience of the application transfer are improved.

Referring to fig. 13, fig. 13 is a schematic flowchart illustrating a further method for cross-device streaming of application content according to an embodiment of the present application, where the method is applied to a first streaming target device, and the method includes:

s1310, obtaining an application type of a target application on a first streaming target device, wherein the target application is streamed from a streaming source device to the first streaming target device.

It should be noted that, the target application runs on the streaming source device in the embodiment of the present application, and the streaming source device streams the target application to the first streaming target device. At this time, the first streaming target device has the target application thereon. The target application may be an application program or media data, such as a photo, a video, an audio, a game, a gallery, a document or multimedia, running on an application layer of the stream source device. In addition, the stream source device may run the target application at the front end, or may run the target application at the back end. When the circulation source device runs the target application at the front end, a display screen of the circulation source device can display the current content of the target application; when the circulation source device runs the target application at the back end, the display screen of the circulation source device may not display the current content of the target application, and the background continues to execute the target application. Similarly, the first streaming target device may run the target application streamed by the streaming source device at the front end, or may run the target application streamed by the streaming source device at the back end.

In one possible example, after S1310, the method may further include the steps of: and acquiring the first information, and judging whether the first information carries the identification information of the second transfer target equipment.

It should be noted that, in the embodiment of the present application, on the basis of the above description of cross-device application streaming of the application content between the streaming source device and the streaming target device, it is necessary to further implement streaming of the target application from the streaming source device to the second streaming target device through the first streaming target device. In addition, in order to determine a streaming object (i.e., a second streaming target device), in the embodiment of the present application, the first information may be obtained by an information obtaining module in the first streaming target device, and whether the first information carries the identification information of the second streaming target device is determined by a source and target determining module in the first streaming target device, so that the first streaming target device determines the second streaming target device. For a specific example, reference may be made to the description of the above embodiments, which is not repeated herein.

It should be further noted that the first information acquired by the first offload target device may directly carry ID information of the second offload target device. However, the information acquisition module in the first streaming target device may not carry the identification information of the second streaming target device in the acquired first information by recognizing voice, image, human body posture, facial motion, human body motion, and the like. For a specific example, reference may be made to the description of the above embodiments, which is not repeated herein.

Next, an example of a case where the first information does not carry the identification information of the second streaming target device will be described in this embodiment of the application.

In one possible example, after determining whether the first information carries the identification information of the second offload target device, the method may further include: when the first information does not carry identification information of the second transfer target device, acquiring identification information of all devices connected with the first transfer target device under a current user account of the first transfer target device; or acquiring identification information of all devices connected with the first flow transfer target device in a network where the first flow transfer target device is located; the identification information of the circulation target device is determined from the identification information of all the devices.

It should be noted that, when the content of the target application is considered to be transferred from the streaming source device to the second streaming target device through the first streaming target device in the embodiment of the present application, if the first information acquired by the first streaming target device does not carry the ID information of the second streaming target device. At this time, with reference to the application transfer framework in fig. 4, in the embodiment of the present application, ID information of all devices connected to the first transfer target device under the current user account of the first transfer target device may be acquired through the connection management module in the first transfer target device; or, the ID information of all devices connected to the first transfer target device in the network where the first transfer target device is located is obtained through the connection management module in the first transfer target device.

It should be further noted that the current user account of the first transfer target device and the current user account of the transfer source device are the same; the network where the first streaming target device is located may be a WLAN network formed by relay devices or wireless communication modes or a P2P network, and the streaming source device is also located in the network where the first streaming target device is located.

In addition, in the embodiment of the present application, ID information of all devices in the same user account or the same network as the first transfer target device may be obtained by specifically referring to different access manners described in the above embodiments to determine the second transfer target device, so that it is ensured that cross-device transfer of application content is more conveniently achieved, and efficiency, diversity, and use experience of application transfer are improved.

The following embodiment of the present application will specifically describe how the first offload target device determines the identification information of the second offload target device from the identification information of all devices.

Specifically, determining the identification information of the second streaming target device from the identification information of all devices may include the following steps: if only the identification information of one device exists in the identification information of all devices except the identification information of the streaming source device and the identification information of the first streaming target device, taking the identification information of the device as the identification information of the second streaming target device; or, if the identification information of at least two devices exists in the identification information of all the devices except the identification information of the stream source device and the identification information of the first stream transfer target device, acquiring a selection operation instruction for the identification information of the at least two devices; determining identification information of a second transfer target device from the identification information of at least two devices according to the selection operation instruction; or, if the identification information of at least two devices exists in the identification information of all the devices except the identification information of the flow source device and the identification information of the first flow transfer target device, taking the identification information with the highest priority in the identification information of the at least two devices as the identification information of the second flow transfer target device according to a preset priority policy.

It should be noted that, when only one device is provided for all devices connected to the first transfer target device under the same user account, or only one device is provided for all devices connected to the first transfer target device in the same network, the device may be used as the second transfer target device, and the ID information of the device is acquired, so that the transfer source device may transfer the content of the currently running target application to the device, and suspend the first transfer target device from running the target application. In addition, when all devices connected to the first transfer target device have at least two (i.e., multiple) devices under the same user account, or all devices connected to the first transfer target device in the same network have multiple devices, an option list including the multiple devices may be displayed on a display screen of the first transfer target device in a pop-up window, a pull-down menu, or the like, and then the user selects one or more devices from the option list as the second transfer target device.

It should be further noted that, for the preset priority policy in the embodiment of the present application, specific reference may be made to the specific description in the foregoing embodiment, and details are not described herein again.

With reference to the foregoing description, S1310 according to the embodiment of the present application may specifically include the following steps of obtaining an application type of a target application on a first streaming target device when the first information carries identification information of a second streaming target device, where the target application is streamed from a streaming source device to the first streaming target device.

It should be noted that, when the embodiment of the present application considers that a target application is transferred from a transfer source device to a second transfer target device through a first transfer target device, if first information acquired by the first transfer target device carries ID information of the second transfer target device, in combination with the application transfer framework in fig. 4, the embodiment of the present application may identify a target application running on the first transfer target device through an application information module in the first transfer target device to acquire application information (such as an application name, an application type, and the like) of the target application. In addition, the application information module in the first offload target device may access a process or thread, etc. on the operating system of the first offload target device to obtain the application type of the target application.

Specifically, the application type of the target application may include at least one of the following: screen projection type application, distributed application, relay type application and common type application; the screen-projection application is used for indicating the target application to continuously run on the streaming source device, pausing the content of the target application by the streaming source device to be displayed on the first streaming target device, and projecting the content of the target application to a display screen or a display medium of the second streaming target device to be displayed; the distributed application is used for indicating that the front end of the target application and the back end of the target application realize separated operation on different devices; the relay application is used for indicating the target application to realize storage, recovery or sharing operation on different equipment through the file service on the stream source equipment; the common application is used for indicating that the target application is applied to different equipment to realize display operation through screen projection technology.

S1320, determining an application circulation strategy aiming at the target application according to the application type.

It should be noted that, when the embodiment of the present application considers that a target application is transferred from a transfer source device to a second transfer target device through a first transfer target device, if the first transfer target device already knows ID information of the second transfer target device, in combination with the application transfer framework in fig. 4, the embodiment of the present application may access an application information module through a transfer policy module in the first transfer target device to know an application type of the target application, so as to determine an application transfer policy corresponding to the target application according to the application type of the target application.

Mode 1:

in one possible example, if the application type includes a screen-projection application, determining an application flow policy for the target application according to the application type may include the following steps: determining an application circulation strategy according to the screen projection type application; wherein the application flow policy is used to perform the following steps: and pausing the running of the target application on the first streaming target device through the screen projection service framework, and projecting the content of the target application to a display screen or a display medium of the second streaming target device for displaying.

It should be noted that, when the target application is a screen-projection application, the application flow policy may be: the first stream transfer target equipment firstly feeds back information to the stream transfer source equipment for storage; and the streaming source device suspends the projection of the content of the target application to the display screen of the first streaming target device for display through the screen projection service framework, and projects the content of the target application to the display screen or the display medium of the second streaming target device for display. Three electronic devices, namely, a mobile phone, a smart watch and a notebook computer, are exemplified below.

For example, please refer to fig. 14. The screen-casting application Z projected by the mobile phone through the screen-casting service framework is being displayed on the display screen of the smart watch. When the smart watch touches the notebook computer through NFC, the mobile phone suspends projection of the content of the application Z onto the display screen of the smart watch through the screen projection service framework, and projects the content of the application Z onto the display screen of the notebook computer for display.

Mode 2:

in one possible example, if the application type includes a distributed application, determining an application flow policy for the target application according to the application type may include: determining an application circulation strategy according to the distributed application; wherein the application flow policy is used to perform the following steps: the front end of the target application is paused to run on the first streaming target device, and the second streaming target device accesses the back end of the target application running on the streaming source device to start running the front end of the target application.

It should be noted that, when the target application is a distributed application, the application flow policy may be: the first stream transfer target equipment firstly feeds back information to the back end of the target application on the stream transfer source equipment for storage; continuing to run the back end of the target application on the stream source equipment, then transferring the front end of the target application to the second stream target equipment, and stopping the first stream target equipment from running the front end of the target application; the second streaming target device accesses the back end of the target application running on the streaming source device to start running the front end of the target application.

Mode 3:

in one possible example, if the application type includes a baton application, determining an application flow policy for the target application according to the application type may include: determining an application transfer strategy according to the relay application; wherein the application flow policy is used to perform the following steps: the target application is paused to run on the first streaming target device and the second streaming target device accesses the file service of the streaming source device to start running the target application.

It should be noted that, when the target application is a relay application, the application flow policy may be: the first stream transfer target equipment firstly transfers the file service feedback information on the stream transfer source equipment for storage; the file service on the streaming source device then streams the content of the target application to a second streaming target device; the second streaming target device accesses a file service on the streaming source device to start running the content of the target application. The file service can provide an http access address and provide the http access address to an external application or a third-party cooperative application in a data stream mode.

Mode 4:

in one possible example, if the application type includes a plain application, determining the application flow policy for the target application according to the application type may include the following steps: determining an application circulation strategy according to the common application; wherein the application flow policy is used to perform the following steps: if the second streaming target device has the application compatible target application and the content supporting the synchronous target application, suspending the target application from running on the first streaming target device, and projecting the content of the target application to a display screen or a display medium of the second streaming target device for displaying; or if the second streaming target device does not have the application-compatible target application or does not support the content of the synchronous target application, continuing to run the target application on the first streaming target device, and projecting the content of the target application to a display screen or a display medium of the second streaming target device for displaying.

It should be noted that, when the target application is a generic application, the application flow policy may be: the first stream transfer target equipment firstly feeds back information to the stream transfer source equipment for storage; the stream source device projects the content of the target application to a display screen or a display medium of a second stream target device through a screen projection service framework for displaying, and judges whether the second stream target device has the content of an application compatible target application and supporting a synchronous target application; if the applications are compatible and support synchronization, the streaming source device can pause running the target application; if no application is compatible or synchronization is supported, the streamer device may continue running the target application.

In summary, through the descriptions of the above "mode 1", "mode 2", "mode 3", and "mode 4", the embodiment of the present application considers determining different application flow policies according to different application types of the target application, so as to implement different application content cross-device flows according to different application flow policies, ensure the diversity of the application content cross-device flows, and improve application flow and efficiency and use experience.

And S1330, transferring the content of the target application to the second target transfer device according to the application transfer strategy.

It should be noted that, because the descriptions of the embodiments have respective emphasis, parts that are not described in detail in the specific embodiment illustrated in fig. 13 may refer to the description of the specific embodiment in fig. 5, and are not described again here.

In the embodiment of the application, the first stream-to-target device acquires the first information and judges whether the first information carries the identification information of the second stream-to-target device; then, when the first information carries identification information of the second traffic target device, acquiring an application type of a target application currently operated by the first traffic source device, and determining an application traffic strategy for the target application according to the application type; and finally, transferring the content of the target application to second transfer target equipment according to the application transfer strategy. In the embodiment of the application, because the target application runs on the streaming source device currently and the target application is streamed from the streaming source device to the first streaming target device, in order to enable the target application to be streamed from the streaming source device to the second streaming target device through the first streaming target device, the first streaming target device acquires the first information and judges whether the first information carries the identification information of the second streaming target device, so that the first streaming target device determines the second streaming target device. In addition, in order to realize that the target application is transferred from the transfer source device to the second transfer target device through the first transfer target device, the application type of the target application is obtained, and different application transfer strategies are determined according to different application types of the target application, so that different application content cross-device transfer is realized through different application transfer strategies, the diversity of the application content cross-device transfer is ensured, and the efficiency and the use experience of the application transfer are improved.

The above description has introduced the solution of the embodiment of the present application mainly from the perspective of the method-side implementation process. It is understood that the electronic device comprises corresponding hardware structures and/or software modules for performing the respective functions in order to realize the above-mentioned functions. Those of skill in the art will readily appreciate that the present application is capable of hardware or a combination of hardware and computer software implementing the various illustrative elements and algorithm steps described in connection with the embodiments provided herein. Whether a function is performed as hardware or computer software drives hardware depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.

In the embodiment of the present application, the electronic device may be divided into the functional modules according to the method example, for example, each functional module may be divided corresponding to each function, or two or more functions may be integrated into one processing unit. Wherein the processing unit may be a processor or controller, such as a CPU, general purpose processor, DSP, ASIC, FPGA, transistor logic, hardware component, or any combination thereof. Or a combination of both implementing computing functionality, e.g., a combination of one or more microprocessors, DSPs, and microprocessors, such that the processing unit may implement or execute the various illustrative logical blocks, modules, and circuits described in connection with the above description. In addition, the processing unit may be configured to perform any one of the steps performed by the electronic device in the above method embodiments, and when performing data transmission such as sending, optionally call a communication unit to complete the corresponding operation, where the communication unit may be a communication interface, a transceiver circuit, and the like.

Furthermore, the integrated module may be implemented in a form of hardware, or may be implemented in a form of software. It should be noted that the division of the units in the embodiment of the present application is illustrative, and is only one division of the logic functions, and there may be another division in actual implementation.

In the case of using the integrated function module, fig. 15 shows a function module composition block diagram of an application content cross-device streaming apparatus. The device 1500 for cross-device streaming of application content is applied to a streaming source device, and specifically includes: an application information module 1510, a flow policy module 1520, and an application flow module 1530. The application information module 1510 is configured to obtain an application type of a target application currently running by the stream source device; the flow policy module 1520 is configured to determine an application flow policy for the target application according to the application type; the application circulation module 1530 is configured to circulate the content of the target application to the circulation target device according to the application circulation policy.

It should be noted that, for specific implementation of each operation performed by the application content cross-device streaming apparatus 1500, reference may be made to the corresponding description of the method embodiment shown in fig. 5, which is not described herein again.

It can be seen that, in the embodiment of the present application, the application content cross-device circulation apparatus determines different application circulation policies according to different application types of the target application to implement different application content cross-device circulation, thereby ensuring diversity of application content cross-device circulation, and improving efficiency and use experience of application circulation.

In one possible example, the application type includes at least one of: distributed application, relay application, normal application; the distributed application is used for indicating that the front end of the target application and the back end of the target application realize separated running operation on different devices; the relay application is used for indicating the target application to realize storage, recovery or sharing operation on different devices through the file service on the stream source device; the common application is used for indicating that the target application is applied to different equipment through a screen projection technology to realize display operation.

In a possible example, if the application type includes the distributed application, in determining the application flow policy for the target application according to the application type, the flow policy module 1620 is specifically configured to: determining the application circulation strategy according to the distributed application; wherein the application flow policy is configured to perform the following steps: pausing the running of the front end of the target application on the streaming source device, and accessing the back end of the target application running on the streaming source device by the streaming target device to start running the front end of the target application.

In a possible example, if the application type includes the relay type application, in determining the application flow policy for the target application according to the application type, the flow policy module 1620 is specifically configured to: determining the application circulation strategy according to the relay type application; wherein the application flow policy is configured to perform the following steps: suspending the target application from running on the streaming source device, and accessing, by the streaming target device, a file service of the streaming source device to start running the target application.

In a possible example, if the application type includes the generic application, in determining the application flow policy for the target application according to the application type, the flow policy module 1620 is specifically configured to: determining the application circulation strategy according to the common application; wherein the application flow policy is configured to perform the following steps: if the target application is compatible with the application and the content of the target application is supported to be synchronized on the circulation target equipment, the target application is paused to run on the circulation source equipment, and the content of the target application is projected to a display screen or a display medium of the circulation target equipment to be displayed; or if no application is compatible with the target application or the content of the target application is not supported to be synchronized on the circulation target equipment, continuing to operate the target application on the circulation source equipment, and projecting the content of the target application to a display screen or a display medium of the circulation target equipment for displaying.

In one possible example, the application cross-device flow apparatus 1500 further includes an obtaining information module and a determining information module; wherein, the information acquisition module: for obtaining first information; and the judging information module is used for judging whether the first information carries the identification information of the circulation target equipment.

In one possible example, the application cross-device flow apparatus 1500 further comprises a connection management module; the connection management module is configured to acquire, when the first information does not carry identification information of the streaming target device, identification information of all devices connected to the streaming source device under a current user account of the streaming source device; or acquiring identification information of all devices connected with the flow source device in a network where the flow source device is located; and the judgment information module is also used for determining the identification information of the circulation target equipment from the identification information of all the equipment.

In one possible example, in determining the identification information of the circulation destination device from the identification information of all the devices, the determination information module is specifically configured to: if the identification information of only one device exists in the identification information of all the devices except the identification information of the circulation source device, taking the identification information of the device as the identification information of the circulation target device; or, if the identification information of at least two devices exists in the identification information of all the devices except the identification information of the stream source device, acquiring a selection operation instruction for the identification information of the at least two devices; determining the identification information of the circulation target equipment from the identification information of the at least two pieces of equipment according to the selection operation instruction; or, if the identification information of at least two devices exists in the identification information of all the devices except the identification information of the flow source device, taking the identification information with the highest priority in the identification information of the at least two devices as the identification information of the flow target device according to a preset priority policy.

In one possible example, the obtain information module may include at least one of: the system comprises a sensor recognition module, a voice recognition module, a gesture recognition module, an image recognition module, a human body posture recognition module, a face action recognition module and a human body action recognition module; wherein the sensor comprises at least one of: the ultra-wideband UWB sensor, the NFC sensor, the laser sensor and the visible light sensor.

In the case of using the integrated function module, fig. 16 shows a block diagram of the function module composition of an application content cross-device streaming apparatus. The application content cross-device transferring apparatus 1600 is applied to a first transfer target device, and specifically includes: an application information module 1610, a flow policy module 1620, and an application flow module 1630. The application information module 1610 is configured to, when the first information carries identification information of the second streaming target device, acquire an application type of a target application on the first streaming target device, where the target application is streamed from the streaming source device to the first streaming target device; the flow policy module 1620 is configured to determine an application flow policy for the target application according to the application type; the application streaming module 1630 is configured to stream the content of the target application to the second streaming target device according to the application streaming policy.

It should be noted that, for specific implementation of each operation performed by the application content cross device streaming apparatus 1600, reference may be made to the corresponding description of the method embodiments shown in fig. 13 and fig. 15, and details are not described here again.

A schematic structural diagram of another electronic device 1700 provided in this embodiment of the application is described below, as shown in fig. 17. Wherein the electronic device 1700 is a streaming source device and the electronic device 1700 comprises a processor 1710, a memory 1720, a communication interface 1730, and at least one communication bus connecting the processor 1710, the memory 1720, and the communication interface 1730.

The processor 1710 may be one or more central processing units CPU. In the case where the processor 1710 is one CPU, the CPU may be a single-core CPU or a multi-core CPU. Memory 1720 includes, but is not limited to, Random Access Memory (RAM), Read-Only Memory (ROM), Erasable Programmable Read-Only Memory (EPROM), or portable Read-Only Memory (CD-ROM), and Memory 1720 is used for associated instructions and data. Communication interface 1730 is used to receive and transmit data.

The processor 1710 in the electronic device 1700 is configured to read one or more programs 1721 stored in the memory 1720 for performing the following steps: acquiring the application type of a target application currently running by a stream source device; determining an application flow strategy aiming at the target application according to the application type; and transferring the content of the target application to the transfer target equipment according to the application transfer strategy.

It should be noted that, for specific implementation of each operation performed by the electronic device 1700, reference may be made to the corresponding description of the method embodiment shown in fig. 5, and details are not described here again.

It can be seen that, in the embodiment of the application, the electronic device determines different application flow strategies according to different application types of the target application to realize cross-device flow of different application contents, so that diversity of the cross-device flow of the application contents is ensured, and efficiency and use experience of the application flow are improved.

A schematic structural diagram of another electronic device 1800 provided in the embodiment of the present application is described below, as shown in fig. 18. The electronic device 1800 is a first streaming target device, and the electronic device 1800 includes a processor 1810, a memory 1820, a communication interface 1830, and at least one communication bus connecting the processor 1810, the memory 1820, and the communication interface 1830.

The processor 1810 may be one or more central processing units CPU. In the case where the processor 1810 is one CPU, the CPU may be a single-core CPU or a multi-core CPU. Memory 1820 includes, but is not limited to, RAM, ROM, EPROM, or CD-ROM, and memory 1820 is used for associated instructions and data. Communication interface 1830 is used to receive and transmit data.

The processor 1810 in the electronic device 1800 is configured to read one or more programs 1821 stored in the memory 1820 for performing the following steps: acquiring an application type of a target application on first flow-to-target equipment, wherein the target application is transferred to the first flow-to-target equipment from flow source equipment; determining an application flow strategy aiming at the target application according to the application type; and transferring the content of the target application to the second transfer target equipment according to the application transfer strategy.

It should be noted that, for specific implementation of each operation performed by the electronic device 1800, reference may be made to the corresponding description of the method embodiment shown in fig. 13, and details are not described here again.

Embodiments of the present application also provide a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program for electronic data exchange, the computer program being operable to cause a computer to perform part or all of the steps of any of the methods as set forth in the above method embodiments.

Embodiments of the present application also provide a computer program product, where the computer program product includes a computer program operable to cause a computer to perform part or all of the steps of any one of the methods as described in the above method embodiments. The computer program product may be a software installation package.

For simplicity of description, each of the above method embodiments is described as a series of combinations of operations. Those skilled in the art should appreciate that the present application is not limited by the order of acts described, as some steps in the embodiments of the present application may occur in other orders or concurrently. Moreover, those skilled in the art should also appreciate that the embodiments described in the specification are preferred embodiments and that acts and modules referred to are not necessarily required to implement the embodiments of the application.

In the foregoing embodiments, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.

In the several embodiments provided in the present application, it should be understood by those skilled in the art that the described apparatus can be implemented in other ways. It will be appreciated that the above described apparatus embodiments are merely illustrative. For example, the division of the modules is only one logical function division, and actually, there may be another division manner. That is, multiple modules or components may be combined or integrated into another software, and some features may be omitted or not implemented. In addition, the shown or discussed mutual coupling, direct coupling or communication connection and the like can be an indirect coupling or communication connection through some interfaces, devices, modules or units, and can also be an electric or other form.

The above modules or units, if implemented in the form of software functions and sold or used as independent products, may be stored in a computer-readable storage medium. It will be appreciated that the solution of the present application (which form a part of or all or part of the prior art) may be embodied in the form of a computer software product. The computer software product is stored in a memory and includes several instructions for causing a computer device (personal computer, server, network device, etc.) to perform all or part of the steps of the embodiments of the present application. The computer-readable storage medium may be stored in various memories such as a usb disk, a ROM, a RAM, a removable hard disk, a magnetic disk, or an optical disk.

While the embodiments of the present application have been described in detail, it should be understood by those skilled in the art that the embodiments of the present application are only used for assisting understanding of the core concept of the technical solutions of the present application, and therefore, the embodiments of the present application may be changed in terms of the specific implementation and the application scope. The contents described in the present specification should not be construed as limiting the scope of the present application. In addition, any modification, equivalent replacement, improvement and the like made on the basis of the technical solutions of the embodiments of the present application should be included in the protection scope of the embodiments of the present application.

Claims

1. The method for transferring the application content across the devices is characterized by being applied to a transfer source device; the method comprises the following steps:

2. The method of claim 1, wherein the application type comprises at least one of: distributed application, relay application, normal application;

the distributed application is used for indicating that the front end of the target application and the back end of the target application realize separated running operation on different devices; the relay application is used for indicating the target application to realize storage, recovery or sharing operation on different devices through the file service on the stream source device; the common application is used for indicating that the target application is applied to different equipment through a screen projection technology to realize display operation.

3. The method of claim 2, wherein if the application type comprises the distributed application, determining an application flow policy for the target application according to the application type comprises:

determining the application circulation strategy according to the distributed application;

wherein the application flow policy is configured to perform the following steps: pausing the running of the front end of the target application on the streaming source device, and accessing the back end of the target application running on the streaming source device by the streaming target device to start running the front end of the target application.

4. The method according to claim 2, wherein if the application type includes the baton-type application, determining an application flow policy for the target application according to the application type includes:

determining the application circulation strategy according to the relay type application;

wherein the application flow policy is configured to perform the following steps: suspending the target application from running on the streaming source device, and accessing, by the streaming target device, a file service of the streaming source device to start running the target application.

5. The method of claim 2, wherein if the application type comprises the generic application, determining an application flow policy for the target application according to the application type comprises:

determining the application circulation strategy according to the common application;

wherein the application flow policy is configured to perform the following steps: if the target application is compatible with the application and the content of the target application is supported to be synchronized on the circulation target equipment, the target application is paused to run on the circulation source equipment, and the content of the target application is projected to a display screen or a display medium of the circulation target equipment to be displayed; alternatively, the first and second electrodes may be,

if the application is not compatible with the target application or the content of the target application is not supported to be synchronized on the circulation target equipment, continuing to operate the target application on the circulation source equipment, and projecting the content of the target application to a display screen or a display medium of the circulation target equipment for displaying.

6. The method according to any one of claims 1-5, wherein before the obtaining the application type of the target application currently running by the stream source device, the method further comprises:

acquiring first information, and judging whether the first information carries identification information of a circulation target device;

the obtaining of the application type of the target application currently running by the stream source device includes:

and when the first information carries the identification information of the circulation target equipment, acquiring the application type of the target application currently operated by the circulation source equipment.

7. The method according to claim 6, wherein after the determining whether the first information carries the identification information of the streaming target device, the method further comprises:

when the first information does not carry the identification information of the transfer target device, acquiring the identification information of all devices connected with the transfer source device under the current user account of the transfer source device; or acquiring identification information of all devices connected with the flow source device in a network where the flow source device is located;

and determining the identification information of the circulation target equipment from the identification information of all the equipment.

8. The method according to claim 7, wherein the determining the identification information of the circulation target device from the identification information of all the devices comprises:

if the identification information of only one device exists in the identification information of all the devices except the identification information of the circulation source device, taking the identification information of the device as the identification information of the circulation target device; alternatively, the first and second electrodes may be,

if the identification information of at least two devices exists in the identification information of all the devices except the identification information of the stream source device, acquiring a selection operation instruction aiming at the identification information of the at least two devices; determining the identification information of the circulation target equipment from the identification information of the at least two pieces of equipment according to the selection operation instruction; alternatively, the first and second electrodes may be,

if the identification information of at least two devices exists in the identification information of all the devices except the identification information of the streaming source device, taking the identification information with the highest priority in the identification information of the at least two devices as the identification information of the streaming target device according to a preset priority policy.

9. The method of claim 6, wherein the first information satisfies at least one of the following: the first information is acquired through sensor recognition, the first information is acquired through voice recognition, the first information is acquired through gesture recognition, the first information is acquired through image recognition, the first information is acquired through human posture recognition, the first information is acquired through face motion recognition, and the first information is acquired through human motion recognition;

wherein the sensor comprises at least one of: the ultra-wideband UWB sensor, the NFC sensor, the laser sensor and the visible light sensor.

10. The method is characterized in that the method is applied to a first streaming target device; the method comprises the following steps:

11. The method of claim 9, wherein the application type comprises at least one of: screen projection type application, distributed application, relay type application and common type application;

the screen-projection application is used for indicating the target application to continuously run on the streaming source device, pausing the display of the content of the target application on the first streaming target device by the streaming source device, and projecting the content of the target application to a display screen or a display medium of the second streaming target device for displaying; the distributed application is used for indicating that the front end of the target application and the back end of the target application realize separate running operation on different devices; the relay application is used for indicating the target application to realize storage, recovery or sharing operation on different devices through the file service on the stream source device; the common application is used for indicating that the target application is applied to different equipment through a screen projection technology to realize display operation.

12. The method of claim 11, wherein if the application type comprises the screen-projection application, determining an application flow policy for the target application according to the application type comprises:

determining the application circulation strategy according to the screen-projection type application;

wherein the application flow policy is configured to perform the following steps: pausing display of the content of the target application on the first streaming target device and projecting the content of the target application onto a display screen or a display medium of the second streaming target device for display.

13. The method of claim 11, wherein if the application type comprises the distributed application, determining an application flow policy for the target application according to the application type comprises:

wherein the application flow policy is used to perform the following operations: pausing the running of the front end of the target application on the first streaming target device, and accessing, by the second streaming target device, the back end of the target application running on the streaming source device to start running the front end of the target application.

14. The method of claim 11, wherein if the application type comprises the baton application, determining an application flow policy for the target application according to the application type comprises:

wherein the application flow policy is used to perform the following operations: suspending the target application from running on the first streaming target device, and accessing, by the second streaming target device, a file service of the streaming source device to start running the target application.

15. The method of claim 11, wherein if the application type comprises the generic application, determining an application flow policy for the target application according to the application type comprises:

wherein the application flow policy is used to perform the following operations: if the second streaming target device has the content which is compatible with the target application and supports the synchronization of the target application, suspending the running of the target application on the first streaming target device, and projecting the content of the target application to a display screen or a display medium of the second streaming target device for displaying; alternatively, the first and second electrodes may be,

if the second streaming target device does not have application compatibility with the target application or does not support content of the target application, continuing to run the target application on the first streaming target device, and projecting the content of the target application to a display screen or a display medium of the second streaming target device for displaying.

16. The method of any of claims 10-15, wherein prior to said obtaining an application type of a target application on the first offload target device, the method further comprises:

acquiring first information, and judging whether the first information carries identification information of a second transfer target device;

the obtaining of the application type of the target application on the first streaming target device includes:

and when the first information carries the identification information of the second streaming target device, acquiring the application type of the target application on the streaming source device.

17. The method according to claim 16, wherein after the determining whether the first information carries identification information of a second offload target device, the method further comprises:

when the first information does not carry the identification information of the second transfer target device, acquiring the identification information of all devices connected with the first transfer target device under the current account of the first transfer target device; or acquiring identification information of all devices connected with the first transfer target device in a network where the first transfer target device is located;

and determining the identification information of the second stream transfer target device from the identification information of all the devices.

18. The method of claim 17, wherein the determining the identification information of the second streaming target device from the identification information of all the devices comprises:

if only the identification information of one device exists in the identification information of all the devices except the identification information of the streaming source device and the identification information of the first streaming target device, taking the identification information of the device as the identification information of the second streaming target device; alternatively, the first and second electrodes may be,

if the identification information of at least two devices exists in the identification information of all the devices except the identification information of the stream source device and the identification information of the first stream transfer target device, acquiring a selection operation instruction aiming at the identification information of the at least two devices; determining the identification information of the second streaming target device from the identification information of the at least two devices according to the selection operation instruction; alternatively, the first and second electrodes may be,

if the identification information of at least two devices exists in the identification information of all the devices except the identification information of the stream source device and the identification information of the first stream transfer target device, taking the identification information with the highest priority in the identification information of the at least two devices as the identification information of the second stream transfer target device according to a preset priority policy.

19. The method of claim 16, wherein the first information satisfies at least one of the following: the first information is acquired through sensor recognition, the first information is acquired through voice recognition, the first information is acquired through gesture recognition, the first information is acquired through image recognition, the first information is acquired through human posture recognition, the first information is acquired through face motion recognition, and the first information is acquired through human motion recognition;

20. An application content cross-device circulation device is characterized in that the device is applied to a circulation source device; the device comprises:

21. The device for transferring the application content across the devices is characterized by being applied to a first transfer target device; the device comprises:

22. An electronic device, characterized in that the electronic device is a streaming source device, comprising a processor, a memory and a communication interface, the memory storing one or more programs, and the one or more programs being executed by the processor, the one or more programs comprising instructions for performing the steps in the method according to any of claims 1-9.

23. An electronic device, wherein the electronic device is a first streaming target device, comprising a processor, a memory, and a communication interface, wherein the memory stores one or more programs, and wherein the one or more programs are executed by the processor, wherein the one or more programs comprise instructions for performing the steps of the method of any of claims 10-19.

24. A computer-readable storage medium, characterized in that the computer-readable storage medium stores a computer program for electronic data exchange, wherein the computer program is operable to cause a computer to perform the method according to any of claims 1-9 or 10-19.