CN114785848A

CN114785848A - Collaborative interaction and collaboration method, device and system between electronic devices

Info

Publication number: CN114785848A
Application number: CN202210204631.XA
Authority: CN
Inventors: 张垒垒; 朴云; 张克; 王磊; 吴仲深
Original assignee: Alibaba China Co Ltd
Current assignee: Alibaba China Co Ltd
Priority date: 2022-03-02
Filing date: 2022-03-02
Publication date: 2022-07-22

Abstract

The application discloses a collaborative interaction method, a collaborative interaction device and a collaborative interaction system among electronic equipment, wherein the collaborative interaction method comprises the following steps: responding to a cooperation request of the current electronic equipment for the service application, and determining target electronic equipment to be cooperated of the service application in the cooperation request; performing streaming processing on the service application positioned in the target electronic equipment in the received cooperative request, and transmitting generated streaming data of the service application to the current electronic equipment; or, performing streaming processing on the service application located in the current electronic device in the received collaboration request, and transmitting generated streaming data of the service application to the target electronic device; outputting the service application to the current electronic equipment according to the acquired streaming data transmitted to the current electronic equipment; or outputting the streaming data transmitted to the target electronic equipment in the target electronic equipment according to the acquired streaming data; resource waste is avoided, and resource utilization is insufficient.

Description

Collaborative interaction between electronic devices and collaborative method, device and system

Technical Field

The present application relates to computer application technologies, and in particular, to a method and an apparatus for collaborative interaction between electronic devices. The application also relates to a cooperation system and a cooperation method between the electronic devices, a determination method of the electronic devices to be cooperated, a computer storage medium and the electronic devices.

Background

With the popularization of electronic devices such as PCs, smart phones, smart speakers and the like, various types and characteristics of terminal devices play respective roles in work and life of people, but due to factors such as brands, technologies, businesses and the like among a plurality of electronic device terminals, the terminals and application software are often independently installed, deployed and used, and cooperation among the devices is lacked, so that resource waste at a device end is caused.

Disclosure of Invention

The application provides a collaborative interaction method between electronic devices, which aims to solve the problem of resource waste caused by the existing multi-terminal collaboration problem in the prior art.

The application provides a collaborative interaction method between electronic devices, which comprises the following steps:

responding to a cooperation request of current electronic equipment for service application, and determining target electronic equipment to be cooperated of the service application in the cooperation request;

performing streaming processing on the service application located in the target electronic device in the received cooperation request, and transmitting generated streaming data of the service application to the current electronic device; or, performing streaming processing on the service application located in the current electronic device in the received cooperation request, and transmitting the generated streaming data of the service application to the target electronic device;

outputting the service application to the current electronic equipment according to the acquired streaming data transmitted to the current electronic equipment; or outputting the streaming data transmitted to the target electronic equipment at the target electronic equipment according to the acquired streaming data.

In some embodiments, the determining, in response to a cooperation request of a current electronic device for a service application, a target electronic device to be coordinated for the service application in the cooperation request includes:

responding to the operation of the service application in the service application list, and acquiring the cooperation request;

determining information of the target electronic equipment according to the installation condition of the service application in the cooperation request;

routing the collaboration request to the target electronic device.

In some embodiments, the determining, according to the installation condition of the service application in the cooperation request, information of the target electronic device includes:

receiving candidate electronic equipment determined according to the electronic equipment provided with the service application;

in the candidate electronic device, determining the target electronic device according to at least one parameter of the type of the service application, the running state of the candidate electronic device and the type of the candidate electronic device.

In some embodiments, the streaming processing is performed on the service application located in the target electronic device in the received collaboration request, and the generated streaming data of the service application is transmitted to the current electronic device; or, performing streaming processing on the service application located in the current electronic device in the received cooperation request, and transmitting the generated streaming data of the service application to the target electronic device, further including:

and according to the streaming processing, performing data broadcasting on the type and/or the operation state of the target electronic equipment.

In some embodiments, further comprising:

sending an operation request of the service application based on the current electronic equipment output;

responding to the operation request, and transmitting the generated operation streaming data of the service application matched with the operation request;

and outputting the service application information corresponding to the acquired operation streaming data at the current electronic equipment.

The present application further provides a collaboration system between electronic devices, including: a collaborative decision end, a collaborative server end and a collaborative client end;

the cooperation decision terminal is used for responding to a cooperation request of the current electronic equipment for service application, and determining target electronic equipment to be cooperated of the service application in the cooperation request;

the collaboration service end is configured to perform streaming processing on the service application located in the target electronic device in the received collaboration request, and transmit generated streaming data of the service application to the current electronic device; or, performing streaming processing on the service application located in the current electronic device in the received cooperation request, and transmitting generated streaming data of the service application to the target electronic device;

the collaboration client is used for outputting the service application to the current electronic equipment according to the acquired streaming data transmitted to the current electronic equipment; or outputting the streaming data transmitted to the target electronic equipment at the target electronic equipment according to the acquired streaming data.

In some embodiments, the deployment manner of the collaborative server, the collaborative client, and the collaborative decision-making terminal includes at least one of the following:

when the electronic equipment in the local area network is common computer terminal equipment, deploying the collaboration service terminal and the collaboration client in the common computer terminal equipment;

when the electronic equipment in the local area network is the terminal equipment of the Internet of things, deploying the collaborative client in the terminal equipment of the Internet of things;

when the electronic device in the local area network is a GPU type computer terminal device, a speed type network electronic device or a computing type computer terminal device, the collaboration service end or the collaboration service end and the collaboration client are deployed in the GPU type computer terminal device, the speed type network electronic device or the computing type computer terminal device.

The present application further provides a collaboration method between electronic devices, including:

responding to a cooperative request of current electronic equipment to service application, performing streaming processing on the service application of target electronic equipment, and generating streaming data of the service application; or, performing streaming processing on the service application on the current electronic device to generate streaming data of the service application;

transmitting the streaming data generated by the target electronic device to the current electronic device; or, transmitting the streaming data generated by the current electronic device to the target electronic device.

In some embodiments, further comprising:

responding to an operation request of the service application coordinated to the current electronic equipment, and transmitting operation streaming data of the service application matched with the operation request in the target electronic equipment to the current electronic equipment; or responding to an operation request of the service application coordinated to the target electronic equipment, and transmitting operation streaming data of the service application matched with the operation request in the current electronic equipment to the target electronic equipment.

receiving streaming data of a service application;

and outputting the service application to the current electronic equipment or the target electronic equipment according to the streaming data.

In some embodiments, further comprising:

sending an operation request based on the service application;

and outputting the service application information corresponding to the acquired operation streaming data in the current electronic equipment or the target electronic equipment.

In some embodiments, further comprising:

detecting electronic equipment information capable of providing service application cooperation;

and sending the electronic equipment information.

The application further provides a method for determining to-be-coordinated electronic equipment, which includes:

acquiring electronic equipment information capable of executing service application cooperation;

and in response to the acquired service application request on the current electronic equipment, determining target electronic equipment to be coordinated in the electronic equipment information.

The application also provides a computer storage medium for storing the data generated by the network platform and a program for processing the data generated by the network platform;

when the program is read and executed by a processor, the program executes the cooperative interaction method between the electronic devices; or, a cooperation method between the electronic devices as described above is performed; or, a cooperation method between the electronic devices as described above is performed; alternatively, the determination method of the electronic device to be coordinated as described above is executed.

The present application further provides an electronic device, including:

a processor;

a memory for storing a program for processing network platform generated data, the program, when read and executed by the processor, performing the method of collaborative interaction between electronic devices as described above; or, a cooperation method between the electronic devices as described above is performed; or, a cooperation method between the electronic devices as described above is performed; alternatively, the determination method of the electronic device to be coordinated as described above is executed.

Compared with the prior art, the method has the following advantages:

according to the collaborative interaction method between the electronic devices, the collaboration of the service application can be achieved among the electronic devices in the local area network, so that the problems that the service application of other electronic devices in the local area network cannot be used under the condition that the service application is not installed on the electronic devices, and therefore resources are wasted and the resources are not sufficiently utilized can be solved; on the other hand, the problem that the cooperation is limited due to the limitation of service application, that is, the further cooperation processing of the interactive operation cannot be realized based on the cooperation state, the cooperation of a plurality of terminals and the like can be solved. The cooperative interaction method between the electronic devices can not only perform cooperative fluidization processing according to the type or application scene of the service application, but also perform operation based on the cooperative service application, and output corresponding service application content after fluidization processing on the operation.

Drawings

FIG. 1 is a flowchart of an embodiment of a method for collaborative interaction between electronic devices according to the present application;

fig. 2 is a first timing diagram of an embodiment of a method for collaborative interaction between electronic devices according to the present application;

fig. 3 is a second timing chart in an embodiment of a method for collaborative interaction between electronic devices according to the present application

FIG. 4 is a schematic structural diagram of an embodiment of a cooperative interaction apparatus between electronic devices according to the present application;

FIG. 5 is a schematic structural diagram of an embodiment of a collaboration system between electronic devices provided in the present application;

FIG. 6 is a flowchart of an embodiment of a collaboration method between electronic devices provided herein;

FIG. 7 is a schematic structural diagram of an embodiment of a collaboration apparatus between electronic devices provided in the present application;

FIG. 8 is a flowchart of an embodiment of a collaboration method between electronic devices provided herein;

FIG. 9 is a schematic structural diagram of an embodiment of a collaboration apparatus between electronic devices provided in the present application;

fig. 10 is a flowchart of an embodiment of a method for determining an electronic device to be coordinated according to the present application;

fig. 11 is a schematic structural diagram of an embodiment of a determining apparatus of an electronic device to be coordinated provided in the present application;

fig. 12 is a schematic structural diagram of an embodiment of an electronic device provided in the present application.

Detailed Description

In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present application. This application is capable of implementation in many different ways than those herein set forth and of similar import by those skilled in the art without departing from the spirit and scope of this application, and thus this application is not limited to the specific implementations disclosed below.

The terminology used in the present application is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. The description used in this application and in the appended claims is for example: "a," "an," "first," and "second," etc., are not necessarily limited to a quantity or order, but rather are used to distinguish one type of information from another.

As can be seen from the foregoing background, the technical idea of the collaborative interaction method between electronic devices provided by the present application comes from a resource waste problem caused by a collaborative problem between multiple terminals. The problem is caused by at least two situations, one is resource waste caused by the fact that cooperation between multiple terminals cannot be achieved, and the other is that cooperation between the multiple terminals is limited by the form of service application or data, the type of terminal equipment and the like. In any case, the method and the device can solve the problem of resource waste caused by the cooperation problem.

In view of the foregoing, the present application provides a collaboration interaction method between electronic devices from multiple collaboration interaction angles, provides a collaboration method between electronic devices from different collaboration angles, and provides a collaboration system and corresponding apparatus between electronic devices, which will be described below in turn for the respective solutions provided in the present application.

Before describing an embodiment of a method for collaborative interaction between electronic devices provided by the present application, a structure of the present application is briefly described. The purpose of the scheme can be to deploy a streaming client and/or a streaming server on the electronic device to realize the coordination of service application. The service application may be any service application software, and the type and form of the service application are not limited in this embodiment.

One is as follows: the current electronic device A in the local area network determines the service application 1 which needs to be coordinated according to the service application list in the streaming client, and sends a coordination request according to the trigger operation of the determined service application 1 to be coordinated. The cooperative decision-making terminal may be deployed in the electronic device or may be deployed in the local area network alone, and the cooperative decision-making terminal determines, through the cooperative request, that the target electronic device B may cooperate with the service application in the local area network (that is, the current electronic device a may also output and display the service application 1 when the target electronic device B starts the service application 1), and sends the cooperative request to the target electronic device B. And the target electronic equipment B in the local area network carries out streaming processing on the service application 1 through a streaming service end, the data after the streaming processing is sent to the current electronic equipment A, and a streaming client in the current electronic equipment A outputs the service application 1 according to the streaming data.

The other is that the current electronic device a in the local area network determines the service application 1 that needs to be coordinated according to the service application list in the streaming client, and sends the coordination request according to the trigger operation of the determined service application 1 to be coordinated. The cooperative decision-making terminal may be deployed in the electronic device or may be deployed in the local area network alone, and the cooperative decision-making terminal determines, through the cooperative request, that the target electronic device B may cooperate with the service application in the local area network (that is, the current electronic device a may also output and display the service application 1 when the target electronic device B starts the service application 1), and sends the cooperative request to the target electronic device B. The current electronic device A in the local area network can perform streaming processing on the service application 1 through a streaming server, and send the data after the streaming processing to the target electronic device B, and a streaming client in the target electronic device B outputs the service application 1 according to the streaming data.

The foregoing is merely a summary and thus a basic architectural understanding of the present teachings, and will be presented in greater detail hereinafter. The following description is made from a multi-angle of collaborative interaction.

As shown in fig. 1 to fig. 3, fig. 1 is a flowchart of an embodiment of a method for collaborative interaction between electronic devices provided by the present application, fig. 2 is a first timing diagram of an embodiment of a method for collaborative interaction between electronic devices provided by the present application, and fig. 3 is a second timing diagram of an embodiment of a method for collaborative interaction between electronic devices provided by the present application; the embodiment of the cooperative interaction method comprises the following steps:

step S101: responding to a cooperation request of a current electronic device for a service application, and determining a target electronic device to be cooperated of the service application in the cooperation request.

The purpose of step S101 is to determine the target electronic devices to be coordinated.

The service application in step S101 may be any application service software; the current electronic device and the target electronic device may be electronic devices located in a local area network, for example: terminal equipment such as a common computer, a low-power-consumption computer, a GPU computer, Internet of things equipment and the like; the networking mode of the local area network is not limited, and the local area network can be a local area network formed by a star topology network networking mode or a local area network formed by a wireless grid network. The cooperative request may be understood as a request to locally open a service application on another electronic device.

In this embodiment, the target electronic device to be coordinated may be understood as a device that can start the service application, for example: the current electronic device that sends the cooperation request may also be other electronic devices in the local area network, and if the current electronic device is a general computer, the target electronic device may be at least one of a GPU computer and an internet of things device.

In this embodiment, the specific implementation process of step S101 may include:

step S101-1: responding to the operation of the service application in the service application list, and acquiring the cooperation request; in this embodiment, the service application list may be stored in the streaming client, and information of the service application in the electronic device in the local area network is stored in the service application list. The operation performed by the user on the service application in the service application list may be an operation that requests to be locally started, that is, a cooperative operation, and then a cooperative request is generated, thereby obtaining the cooperative request.

Step S101-2: determining the target electronic equipment according to the installation condition of the service application or the type of the service application in the cooperation request;

the step S101-2 is to determine which electronic devices in the local area network have the service application installed therein, so as to determine which target electronic device is according to the installation situation; or determining which electronic devices in the local area network are suitable for streaming processing according to the type of the service application, and determining the electronic devices as target electronic devices. In this embodiment, the information of the service application carried in the collaboration request is searched, an electronic device installed with the service application in a local area network is queried, and the electronic device installed with the service application is determined as a target electronic device; or, querying an electronic device in the local area network that matches the type of the service application, or if the type of the service application can be output at the electronic device, the electronic device is a target electronic device, for example: if the cooperation request is cooperation with the audio playing application service, the smart sound box or the audio playing device may be determined as the target electronic device. Wherein the type of service application may also be understood as an application scenario of the service application.

Therefore, in this embodiment, the service application may be an application service installed in the current electronic device or an application service that is not installed in the current electronic device. Whether the electronic device is installed or not is to trigger the cooperation request through the service application list, and of course, the service application installed locally to the current electronic device may be to trigger the cooperation request for the local service application.

In this embodiment, the specific implementation process of step S101-2 may include:

step S101-21: receiving candidate electronic equipment determined according to the electronic equipment provided with the service application;

step S101-22: in the candidate electronic device, determining the target electronic device according to at least one parameter of the type of the service application, the running state of the candidate electronic device and the type of the candidate electronic device.

In this embodiment, when there are multiple electronic devices installed with the service application, a target electronic device capable of performing streaming processing on the service application may be determined according to at least one parameter of the type of the service application, the operating state of the candidate electronic device, and the type of the candidate electronic device. For example: when the service application is game software, the candidate electronic device can be a heavy computer and a GPU type computer, and then, for the type of the service application, the game type application software is more suitable for an electronic device with high performance of a video card, and therefore, the GPU type computer in the candidate electronic device can be determined as a target electronic device; another example is: when the service application is office-type application software, then the heavy-duty computer may be determined as the target electronic device, and of course, the GPU-type computer may also be determined as the target electronic device. In the process of determining the target electronic device, the operating state of the candidate electronic device may also be referred to, and if the candidate electronic device has a service application being streamed, other candidate electronic devices may be selected to ensure normal and rapid processing of streaming of the service application. Of course, it is also possible to consider only the types of candidate electronic devices, for example: for a computer terminal device with higher performance, it can perform streaming processing on a plurality of application software, and for a GPU type computer terminal, it can also perform streaming processing on a plurality of games, so that the determination of the target electronic device can refer to any one or a combination of parameters.

Step S101-3: routing the collaboration request to the target electronic device;

in this embodiment, the step S101-3 may send the information of the service application carried in the cooperation request and the information of the current electronic device requesting cooperation to the target electronic device.

It is understood that the obtained collaboration request may be obtained collaboration requests issued by a plurality of current electronic devices, and the collaboration requests may be the same or different, that is: the service applications requesting collaboration in the collaboration request may be the same or different. The same cooperation request is routed to the same target electronic device, and different cooperation requests are respectively routed to corresponding different target electronic devices. For example: the cooperation requests sent by the current electronic device a and the current electronic device B are both cooperation for the service application 1, and if it can be determined that the target electronic device is the electronic device C according to the cooperation requests, the cooperation requests of the current electronic device a and the current electronic device B are both sent to the target electronic device C. Another example is: the cooperation requests sent by the current electronic device a and the current electronic device B are respectively for cooperation of the service application 1 and the service application 2, that is, the current electronic device a sends the cooperation request 1 carrying information of the service application 1, and the current electronic device B sends the cooperation request 2 carrying information of the service application 2; if the determined target electronic devices are C and D, the cooperation request 1 is routed to the target electronic device C, and the cooperation request 2 is routed to the target electronic device D.

Step S102: performing streaming processing on the service application located in the target electronic device in the received cooperation request, and transmitting generated streaming data of the service application to the current electronic device; or, performing streaming processing on the service application located in the current electronic device in the received cooperation request, and transmitting the generated streaming data of the service application to the target electronic device;

the purpose of step S102 is to perform streaming processing on the service application to generate streaming data.

Since the service application may include an application located in the current electronic device or an application located in the target electronic device according to different types, the streaming processing procedure of step S102 may include streaming processing of the service application in the target electronic device (as shown in fig. 2), or streaming processing of the service application in the current electronic device (as shown in fig. 3). For example: if the cooperation request of the current electronic device a is to request the service application 1 (game or video type application) of the target electronic device B, the target electronic device B performs streaming processing on the service application 1, generates streaming data, and transmits the streaming data to the current electronic device a. Another example is: if the cooperation request of the current electronic device a is to request the service application 2 (for example, an application of a type such as AI conversation or music playing) on the current electronic device a, the current electronic device a performs streaming processing on the service application 2, generates streaming data, and transmits the streaming data to the target electronic device B.

In order to save streaming resources, when the streaming processing is performed on the streaming processing for the cooperative requests sent by different current electronic devices, where the cooperative request may be for the same service application, the generated streaming data of the service application is transmitted to the electronic device that sends the cooperative request, and then the streaming data may be transmitted to different current electronic devices, so as to avoid performing multiple times of streaming processing on the same service application. For example: the method comprises the steps that a current electronic device A and a current electronic device B send a cooperation request for a service application 1, the determined target electronic device B carries out streaming processing on the service application according to the cooperation request, and generated streaming data are transmitted to the current electronic device A and the current electronic device B. Another example is: the method comprises the steps that a current electronic device A sends a cooperation request 1 for a service application 1, a current electronic device B sends a cooperation request 2 for a service application 2, a determined target electronic device C conducts streaming processing on the service application 1 according to the cooperation request 1, and generated streaming data are transmitted to the current electronic device A. And the determined target electronic equipment D carries out streaming processing on the service application 2 according to the cooperation request 2, and transmits the generated streaming data to the current electronic equipment B.

In this embodiment, the method may further include: and broadcasting the type and/or the operation state of the target electronic equipment for the streaming processing so as to be capable of referring to the operation state and/or the type of the target electronic equipment when a new cooperative request is subsequently streamed, thereby avoiding that a large number of cooperative requests are sent aiming at the same target electronic equipment to cause delay of the streaming processing.

Step S103: according to the obtained streaming data transmitted to the current electronic equipment, the service application is output by the current electronic equipment; or outputting the streaming data transmitted to the target electronic equipment at the target electronic equipment according to the acquired streaming data;

the step S103 may be a process of outputting based on the streaming data acquired in the step S102. Specifically, when the obtained streaming data is data transmitted to the current electronic device, the service application corresponding to the streaming data is displayed on the current electronic device, so that even if the service application is not installed in the current electronic device, the service application can be obtained from a target electronic device in a local area network and locally displayed in an output manner. And when the obtained streaming data is the data transmitted to the target electronic equipment, displaying the service application corresponding to the streaming data on the target electronic equipment, so that the service application installed in the current electronic equipment can be output through the target electronic equipment in a local area network.

To implement the interaction operation between the user and the service application collaborated on the current electronic device, based on the above, the embodiment may further include:

sending an operation request of the service application output by the current electronic equipment or the target electronic equipment; the operation request may be a trigger operation or a voice operation for the service application, for example: and performing click operation on a game application software interface displayed on the current electronic equipment, wherein the click operation can be click operation generated through an input device or click operation generated through triggering of a touch screen. Another example is: may be a voice operation implemented for a voice input operation. In this embodiment, there is no limitation on the operation form of the operation request.

Responding to the operation request, and transmitting the generated operation streaming data of the service application matched with the operation request; for example: when the operation request is to enter the next page of the service application, streaming processing may be performed on the related content of the next page of the service application, and the operation streaming data of the streaming processing may be output. Or, when the operation request is the collected audio information, the voice information may be streamed in the current electronic device, and transmitted to the target electronic device, so as to implement control over the target electronic device, for example: intelligence AI audio amplifier.

Outputting service application information corresponding to the obtained operation streaming data at the current electronic equipment or the target electronic equipment; and displaying only interface information of the service application corresponding to the operation streaming data on the current electronic equipment. Of course, if the service application is an audio application, the target electronic device may play audio information or perform corresponding control on the target electronic device according to a voice operation of the current electronic device.

The above is a description of an embodiment of a collaborative interaction method between electronic devices provided by the present application, and the embodiment of the collaborative interaction method enables collaboration of service applications among a plurality of electronic devices in a local area network, so that on one hand, the problem that the service applications of other electronic devices in the local area network cannot be used under the condition that the service applications are not installed in the electronic devices can be solved, thereby causing resource waste and insufficient resource utilization; on the other hand, the problem that the cooperation is limited due to the limitation of service application, that is, the further cooperation processing of interactive operation cannot be realized based on the cooperation state, and the cooperation of a plurality of terminals cannot be realized, and the like. According to the embodiment of the cooperative interaction method between the electronic devices, cooperative streaming processing can be performed according to the type or application scene of the service application, and the operation can be performed based on the cooperative service application, so that the corresponding service application content is output after the operation is subjected to the streaming processing.

The above is a specific description of an embodiment of a method for collaborative interaction between electronic devices provided by the present application, which corresponds to the aforementioned embodiment of the method for collaborative interaction between electronic devices provided by the present application, and the present application also discloses an embodiment of a device for collaborative interaction between electronic devices, please refer to fig. 3, since the device embodiment is basically similar to the method embodiment, the description is simpler, and related points can be referred to partial description of the method embodiment. The device embodiments described below are merely illustrative.

As shown in fig. 4, fig. 4 is a schematic structural diagram of an embodiment of a cooperative interaction apparatus between electronic devices provided in the present application, where the apparatus embodiment includes:

a determining unit 401, configured to determine, in response to a cooperation request of a current electronic device for a service application, a target electronic device to be coordinated of the service application in the cooperation request.

In this embodiment, the determining unit 401 may include: the method comprises the steps of obtaining a subunit, determining the subunit and routing the subunit;

the acquiring subunit is configured to acquire the coordination request in response to an operation on the service application in a service application list;

the determining subunit is configured to determine, according to an installation condition of the service application in the collaboration request, information of the target electronic device;

the routing subunit is configured to route the cooperation request to the target electronic device.

Wherein the determining the sub-unit may include: a receiving subunit and a target determining subunit; the receiving subunit is configured to receive the candidate electronic device determined according to the electronic device installed with the service application; the target determining subunit is configured to, in the candidate electronic device, determine the target electronic device according to at least one parameter of the type of the service application, the operating state of the candidate electronic device, and the type of the candidate electronic device.

For specific contents of the determining unit 401, reference may be made to the contents of step S101, which is only a schematic description here and will not be described in detail.

A generating unit 402, configured to perform streaming processing on the service application located in the target electronic device in the received collaboration request, and transmit generated streaming data of the service application to the current electronic device; or, performing streaming processing on the service application located in the current electronic device in the received cooperation request, and transmitting the generated streaming data of the service application to the target electronic device;

the generating unit 402 may further include, in this embodiment: and the broadcasting subunit is used for carrying out data broadcasting on the type and/or the running state of the target electronic equipment according to the streaming processing.

For specific content of the generating unit 402, reference may be made to the description of step S102, and details are not repeated here.

An output unit 403, configured to output, according to the obtained streaming data transmitted to the current electronic device, the service application to the current electronic device; or outputting the streaming data transmitted to the target electronic equipment at the target electronic equipment according to the acquired streaming data.

Based on the above, the present embodiment may further include: a transmitting unit, a transmission unit and an operation output unit; the sending unit is used for sending an operation request of the service application output by the current electronic equipment; the transmission unit is used for responding to the operation request and transmitting the generated operation streaming data of the service application matched with the operation request; and the operation output unit is used for outputting the service application information corresponding to the acquired operation streaming data in the current electronic equipment.

For specific content of the output unit 403, reference may be made to the description of step S103, and details are not repeated here.

Based on the foregoing, the present application further provides a collaboration system between electronic devices, as shown in fig. 5, where fig. 5 is a schematic structural diagram of an embodiment of a collaboration system between electronic devices provided in the present application, and the embodiment of the system may include: a collaborative decision terminal 501, a collaborative server terminal 502 and a collaborative client terminal 503;

the cooperation decision terminal 501 is configured to determine, in response to a cooperation request of a current electronic device for a service application, a target electronic device to be coordinated of the service application in the cooperation request.

The collaboration service end 502 is configured to perform streaming processing on the service application located in the target electronic device in the received collaboration request, and transmit generated streaming data of the service application to the current electronic device; or, performing streaming processing on the service application located in the current electronic device in the received cooperation request, and transmitting the generated streaming data of the service application to the target electronic device.

The cooperative client 503 is configured to output the service application to the current electronic device according to the obtained streaming data transmitted to the current electronic device; or outputting the streaming data transmitted to the target electronic equipment at the target electronic equipment according to the acquired streaming data.

In this embodiment, the cooperative decision-making end, the cooperative client, and the cooperative server may be deployed in an electronic device in a local area network, and the specific deployment manner may include the following manner:

when the electronic equipment in the local area network is ordinary computer terminal equipment, deploying the collaboration service end (stream server) and the collaboration client (stream client) in the ordinary computer terminal equipment; the ordinary computer can be understood as a computer which can generally meet the requirements of office study.

When the electronic equipment in the local area network is the terminal equipment of the Internet of things, deploying the cooperative client (stream client) in the terminal equipment of the Internet of things;

when the electronic device in the local area network is a GPU type computer terminal device, or a speed type network electronic device, or a computing type computer terminal (also referred to as a CPU type computer) device, or a low power consumption computer terminal device, the collaboration service end, or the collaboration service end (stream server) and the collaboration client (stream client) are deployed in the GPU type computer terminal device, or the speed type network electronic device, or the computing type computer terminal device, or the low power consumption computer terminal device.

The cooperative decision-making terminal may be separately deployed in any electronic device in the local area network, or may be separately deployed in the local area network.

In this embodiment, the deployment of the cooperative server (stream server), the cooperative client (stream client), and the cooperative decision node is not limited by the above example, and the specific deployment manner may be determined according to parameters such as performance, function, and type of the electronic device in the local area network. Or the determination may be made according to the user's requirement for the cooperative service application in the local area network. For example:

when the current electronic device is a common computer, a user can check a service application list through a collaborative client deployed in the common computer, when the user determines a required service application according to the service application list, the user sends a collaborative request, a collaborative decision-making end determines that the service application is located in a heavy-duty computer (a CPU-type computer) according to the collaborative request of the common computer, the collaborative request can be routed to the CPU-type computer, the collaborative server is deployed in the CPU-type computer to perform streaming processing on the service application (the CPU-type computer can locally start the service application or run at the background), the generated streaming data is sent to the common computer, and the collaborative client in the common computer can perform output display locally in the common computer according to the streaming data; the cooperative client in the ordinary computer can also receive the operation behavior of the user on the service application, generate an operation request and send the operation request to the cooperative server in the CPU type computer, the cooperative server performs streaming processing, generates operation streaming data from information corresponding to the operation request and transmits the operation streaming data to the cooperative client in the ordinary computer, and similarly, the cooperative client in the ordinary computer performs output display according to the operation streaming data.

When the current electronic device is a common computer, the user can view the service application list through the collaborative client deployed in the common computer, when the user determines the needed service application according to the service application list, the cooperation request is sent, the cooperation decision terminal determines that the service application (such as machine learning, large games and the like) is positioned in the GPU type computer according to the cooperation request of the common computer, or when the GPU type computer is determined to be used according to the cooperative request, the cooperative decision end routes the cooperative request to the GPU type computer, a cooperative service end is deployed in the GPU type computer to perform streaming processing on the service application (the GPU type computer can locally start the service application or run in the background), the generated streaming data is sent to the ordinary computer, the collaboration client in the ordinary computer can output and display the data locally in the ordinary computer according to the streaming data; the cooperative client in the general computer may also receive an operation behavior of a user on the service application, generate an operation request, send the operation request to the cooperative server in the GPU type computer, perform streaming processing on the cooperative server, generate operation streaming data from information corresponding to the operation request, and transmit the operation streaming data to the cooperative client in the general computer, and similarly, the cooperative client in the general computer performs output display according to the operation streaming data.

When the current electronic device is a common computer, the service application list can be checked through a collaboration client deployed in the common computer, and a collaboration request is sent when a user determines a required service application according to the service application list. When the service application is a background application with low performance requirement, such as a timer, and other background application software (which may be application software installed in a general computer), the cooperation decision end determines the low-power-consumption computing device according to a cooperation request of the general computer, and then routes the cooperation request to the low-power-consumption computing device, and the cooperation service end deployed in the general computer performs streaming processing on the service application and transmits the streaming processing to the low-power-consumption computing device to perform corresponding function execution, such as timing or timing, at this time, the general computer sleeps, and the energy consumption of the device is reduced.

When the current electronic equipment is a common computer, a user can check a service application list through a collaborative client deployed in the common computer, and sends a collaborative request when the user determines a required service application according to the service application list, wherein, the service application is similar to the high-definition video online playing application service, a large data volume network transmission application (speed type network electronic device) needs to be used, the cooperative decision end routes the cooperative request to the high-speed network electronic device, the cooperative service end is deployed in the high-speed network electronic device to perform the streaming processing on the service application (the speed type network electronic device can start the service application locally or run at the background), and the generated streaming data is sent to the ordinary computer, the collaboration client in the ordinary computer can output and display the data locally in the ordinary computer according to the streaming data; the cooperative client in the general computer may also receive an operation behavior (for example, fast forward operation, double speed operation, brightness adjustment, and the like) of a user on a service application, generate an operation request and send the operation request to the cooperative server in the high-speed network electronic device, where the cooperative server performs streaming processing, generates operation streaming data from information corresponding to the operation request and transmits the operation streaming data to the cooperative client in the general computer, and similarly, the cooperative client in the general computer performs output display according to the operation streaming data.

In addition, in many enterprise scenes, production PCs are not connected with the Internet, at the moment, some software needing the Internet is deployed in one network device, the function of limiting partial software networking can be realized safely and reliably, and meanwhile, the safety of other devices cannot be influenced due to the existence of physical environment isolation.

When the current electronic device is a common computer, the service application list can be checked through a collaboration client deployed in the common computer, and a collaboration request is sent when a user determines a required service application according to the service application list. When the service application or the interactive scene is music playing, AI conversation and the like, the cooperative decision end can determine that the target electronic device is an LOT device (for example, an internet of things device such as an intelligent sound box and an AI device) according to a cooperative request of the ordinary computer, the cooperative request can be routed to the LOT device, the cooperative service end deployed in the ordinary computer carries out streaming processing on the service application and transmits the service application to the LOT device to carry out execution of a corresponding function, and a high-quality playing effect is achieved. Meanwhile, the voice data of the common computer can be streamed into the sound box, so that the common computer can locally control the intelligent sound boxes of other rooms, and the AI capability of the intelligent sound boxes can be better utilized.

The above is merely an example description of deployment manners for the collaborative server, the collaborative client, and the collaborative decision-making terminal, and the deployment manners are not limited to the above examples, for example: the collaborative server, the collaborative client and the collaborative decision-making terminal can be deployed on the same service device; or the cooperative service end and the cooperative client are deployed on the same service device, and the cooperative decision end is separately deployed on a certain electronic device in the local area network; or the collaborative server, the collaborative client and the collaborative decision-making terminal are respectively and independently deployed. In other words, the service application to be streamed can be streamed, the streaming data can be transmitted to the target electronic device, and the target electronic device can output the streaming data or the streaming data in the current electronic device.

The above is a description of an embodiment of a collaboration system between electronic devices provided in the present application, and the contents of the embodiment of the system may be combined with the contents of the embodiment of the collaboration interaction method described above, and details of the same or corresponding contents are not described here again.

Based on the above, the present application further provides a collaboration method between electronic devices, as shown in fig. 6, fig. 6 is a flowchart of an embodiment of the collaboration method between electronic devices provided by the present application; the embodiment of the collaboration method is mainly described in terms of collaboration services, and specifically may include:

step S601: responding to a cooperative request of current electronic equipment to service application, performing streaming processing on the service application of target electronic equipment, and generating streaming data of the service application; or, performing streaming processing on the service application on the current electronic device to generate streaming data of the service application;

step S602: transmitting the streaming data generated by the target electronic device to the current electronic device; or, transmitting the streaming data generated by the current electronic device to the target electronic device.

To implement the interactive operation of the collaborative service application, the method may further include:

in response to an operation request of the service application transmitted to the current electronic equipment, transmitting operation streaming data of the service application matched with the operation request in the target electronic equipment to the current electronic equipment; or responding to an operation request of the service application transmitted to the target electronic equipment, and transmitting operation streaming data of the service application matched with the operation request in the current electronic equipment to the target electronic equipment.

In order to improve the cooperative aging and avoid the occurrence of cooperative delay, the embodiment may further include:

and according to the streaming processing, performing data broadcasting on the type and/or the running state of the target electronic equipment or the current electronic equipment.

The above contents of step S601 and step S602 may refer to the above step S102 and the related description of the collaboration server 502, and a detailed description thereof is not repeated here.

Based on the foregoing application, a coordination apparatus between electronic devices is further provided, as shown in fig. 7, an embodiment of the coordination apparatus includes:

a generating unit 701, configured to perform streaming processing on a service application of a target electronic device in response to a cooperation request of a current electronic device for the service application, and generate streaming data of the service application; or, performing streaming processing on the service application on the current electronic device to generate streaming data of the service application;

a transmitting unit 702, configured to transmit the streaming data generated by the target electronic device to the current electronic device; or, transmitting the streaming data generated by the current electronic device to the target electronic device.

Embodiments may further include, with respect to the apparatus: an operation data transmission unit, configured to transmit, in response to an operation request for the service application coordinated to the current electronic device, operation streaming data of the service application in the target electronic device that matches the operation request to the current electronic device; or responding to an operation request of the service application coordinated to the target electronic equipment, and transmitting operation streaming data of the service application matched with the operation request in the current electronic equipment to the target electronic equipment.

Embodiments may further include, with respect to the apparatus: and the broadcasting unit is used for carrying out data broadcasting on the type and/or the running state of the target electronic equipment or the current electronic equipment according to the streaming processing.

Based on the foregoing, the present application further provides a collaboration method between electronic devices, as shown in fig. 8, fig. 8 is a flowchart of an embodiment of the collaboration method between electronic devices provided in the present application, where the embodiment of the collaboration method is mainly described in terms of a collaboration client, and specifically may include:

step S801: receiving streaming data of a service application;

step S802: and outputting the service application to the current electronic equipment or the target electronic equipment according to the streaming data.

To improve interoperability of collaboration, the present embodiment may further include:

sending an operation request based on the service application;

The present embodiment may further include:

and sending the electronic equipment information. Specifically, the electronic device information may be sent to the service decision terminal, and the service decision terminal searches the electronic device information through the service application information carried in the cooperation request to determine candidate electronic devices, and then determines the target electronic device in the candidate electronic devices.

Likewise, specific contents of the above steps S801 to S802 may refer to the specific description of the step S103 in the above embodiment of the collaborative interaction method and the description of the collaborative client in the embodiment of the collaborative system, and are not detailed here.

Based on the foregoing embodiment of the cooperation method between electronic devices provided in the present application and provided in fig. 8, correspondingly, the present application further provides an embodiment of a cooperation apparatus between electronic devices, as shown in fig. 9, fig. 9 is a schematic structural diagram of an embodiment of a cooperation apparatus between electronic devices provided in the present application, where the embodiment of the cooperation apparatus includes:

a receiving unit 901, configured to receive streaming data of a service application;

an output unit 902, configured to output, according to the streaming data, the service application to the current electronic device or the target electronic device.

Further comprising: the device comprises a sending unit and an operation streaming data output unit, wherein the sending unit is used for sending an operation request based on the service application; and the operation streaming data output unit is used for outputting the service application information corresponding to the acquired operation streaming data in the current electronic equipment or the target electronic equipment.

Further comprising: the system comprises a detection unit and an information sending unit, wherein the detection unit is used for detecting the information of the electronic equipment capable of providing service application cooperation; the information sending unit is used for sending the electronic equipment information.

For details of the embodiment of the coordination apparatus, reference may be made to the description of the corresponding coordination method embodiment (fig. 8) above, and details are not described here.

Based on the above, the present application further provides a method for determining an electronic device to be coordinated, as shown in fig. 9, fig. 10 is a flowchart of an embodiment of the method for determining an electronic device to be coordinated provided by the present application, where the embodiment of the method for determining an electronic device to be coordinated is mainly described in terms of a coordination decision end, and specifically may include:

step S1001: acquiring electronic equipment information capable of executing service application cooperation;

step S1002: responding to the acquired service application request on the current electronic equipment, and determining target electronic equipment to be coordinated in the electronic equipment information; the service application request may be routed to the target electronic device.

For the contents of the steps S1001 to S1002, reference may be specifically made to the description about the step S101 in the above-mentioned collaborative interaction method embodiment and the description about the collaborative decision end 501 in the collaborative system embodiment, and details are not described here.

Correspondingly, the present application further provides an embodiment of a determining apparatus for an electronic device to be coordinated, as shown in fig. 11, the embodiment of the determining apparatus includes:

an acquisition unit 1101 configured to acquire electronic device information capable of performing service application cooperation;

a determining unit 1102, configured to determine, in response to the obtained service application request on the current electronic device, a target electronic device to be coordinated in the electronic device information. The service application request may be routed to the target electronic device.

For a specific description of the embodiment of the determining apparatus of the electronic device to be coordinated, reference may also be made to the description of step S101 in the above collaborative interaction method, the description of the collaborative decision-making terminal 501 in the collaborative system embodiment, and the descriptions of steps S1001 to S1002 in the above embodiment of the determining method, which are not repeated herein.

Based on the above, the present application further provides a computer storage medium for storing data generated by a network platform and a program for processing the data generated by the network platform;

the program, when read and executed by a processor, performs the steps as a method of collaborative interaction between the electronic devices; or, the steps of the cooperation method between the electronic devices are executed; or, the steps of performing a method of coordination as between the electronic devices; or, the steps of the determination method of the electronic device to be coordinated as described are executed.

Based on the above, the present application further provides an electronic device, as shown in fig. 12, fig. 12 is a schematic structural diagram of an embodiment of the electronic device provided in the present application, where the embodiment may include:

a processor 1201;

a memory 1202 for storing a program for processing network platform generated data, which when read and executed by a processor performs the steps of the method as a collaborative interaction between the electronic devices; or, the steps of the cooperation method between the electronic devices are executed; or, the steps of performing a method of coordination as between the electronic devices; or, the steps of the determination method of the electronic device to be coordinated as described are executed.

In a typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.

The memory may include forms of volatile memory in a computer readable medium, Random Access Memory (RAM) and/or non-volatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM). Memory is an example of a computer-readable medium.

1. Computer-readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), Digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information that can be accessed by a computing device. As defined herein, computer readable media does not include non-transitory computer readable media (transient media), such as modulated data signals and carrier waves.

2. As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and so forth) having computer-usable program code embodied therein.

Although the present application has been described with reference to the preferred embodiments, it is not intended to limit the present application, and those skilled in the art can make variations and modifications without departing from the spirit and scope of the present application, therefore, the scope of the present application should be determined by the claims that follow.

Claims

1. A collaborative interaction method between electronic devices, comprising:

according to the obtained streaming data transmitted to the current electronic equipment, the service application is output by the current electronic equipment; or outputting the streaming data transmitted to the target electronic equipment at the target electronic equipment according to the acquired streaming data.

2. The method for collaborative interaction between electronic devices according to claim 1, wherein the determining, in response to a collaboration request by a current electronic device for a service application, a target electronic device to be collaborated for the service application in the collaboration request comprises:

routing the collaboration request to the target electronic device.

3. The method according to claim 2, wherein the determining information about the target electronic device according to the installation condition of the service application in the collaboration request comprises:

4. The method according to claim 1, wherein the streaming processing is performed on the service application located in the target electronic device in the received collaboration request, and the generated streaming data of the service application is transmitted to the current electronic device; or, performing streaming processing on the service application located in the current electronic device in the received cooperation request, and transmitting the generated streaming data of the service application to the target electronic device, further including:

5. The method for collaborative interaction between electronic devices according to claim 1, further comprising:

6. A collaboration system between electronic devices, comprising: a collaborative decision end, a collaborative server end and a collaborative client end;

the cooperation decision terminal is used for responding to a cooperation request of the current electronic equipment for service application and determining target electronic equipment to be cooperated of the service application in the cooperation request;

the cooperative client is used for outputting the service application to the current electronic equipment according to the acquired streaming data transmitted to the current electronic equipment; or outputting the streaming data transmitted to the target electronic equipment at the target electronic equipment according to the acquired streaming data.

7. The collaboration system between electronic devices as claimed in claim 6, wherein the deployment manner of the collaboration service end, the collaboration client end, and the collaboration decision end includes at least one of:

when the electronic equipment in the local area network is terminal equipment of the Internet of things, deploying the collaborative client in the terminal equipment of the Internet of things;

when the electronic device in the local area network is a GPU type computer terminal device, a speed type network electronic device or a computer type computer terminal device, the collaboration service end or the collaboration service end and the collaboration client end are deployed in the GPU type computer terminal device, the speed type network electronic device or the computer type computer terminal device.

8. A collaboration method between electronic devices, comprising:

9. The collaboration method between electronic devices as recited in claim 8, further comprising:

10. A collaboration method between electronic devices, comprising:

receiving streaming data of a service application;

11. The collaboration method between electronic devices as recited in claim 10, further comprising:

sending an operation request based on the service application;

12. The collaboration method between electronic devices as recited in claim 10, further comprising:

and sending the electronic equipment information.

13. A method for determining an electronic device to be coordinated, comprising:

14. A computer storage medium for storing network platform generated data and a program for processing the network platform generated data;

the program, when read and executed by a processor, performs the method of collaborative interaction between electronic devices according to any one of claims 1 through 5; or, performing a cooperation method between the electronic devices according to claim 8 or 9; or, performing the cooperation method between the electronic devices of claims 10 to 12; or, the determination method of the electronic device to be coordinated according to claim 13 is performed.

15. An electronic device, comprising:

a processor;

a memory for storing a program for processing data generated by the network platform, the program, when read and executed by the processor, performing the method of collaborative interaction between electronic devices according to any one of claims 1 to 5; or, performing a collaboration method between electronic devices as claimed in claim 8 or 9; or, performing a cooperation method between the electronic devices of claims 10 to 12; or, the determination method of the electronic device to be coordinated according to claim 13 is performed.