CN114844871A - Cloud application access method and device - Google Patents

Cloud application access method and device Download PDF

Info

Publication number
CN114844871A
CN114844871A CN202210307781.3A CN202210307781A CN114844871A CN 114844871 A CN114844871 A CN 114844871A CN 202210307781 A CN202210307781 A CN 202210307781A CN 114844871 A CN114844871 A CN 114844871A
Authority
CN
China
Prior art keywords
application
streaming
user
media data
cloud
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202210307781.3A
Other languages
Chinese (zh)
Other versions
CN114844871B (en
Inventor
朴云
吴仲深
张垒垒
王磊
张献涛
任晋奎
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Alibaba China Co Ltd
Original Assignee
Alibaba China Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Alibaba China Co Ltd filed Critical Alibaba China Co Ltd
Priority to CN202210307781.3A priority Critical patent/CN114844871B/en
Publication of CN114844871A publication Critical patent/CN114844871A/en
Application granted granted Critical
Publication of CN114844871B publication Critical patent/CN114844871B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60Network streaming of media packets
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/02Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
    • H04L67/025Protocols based on web technology, e.g. hypertext transfer protocol [HTTP] for remote control or remote monitoring of applications
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/1097Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L69/00Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
    • H04L69/22Parsing or analysis of headers

Abstract

One or more embodiments of the present specification provide a method and an apparatus for accessing a cloud application. The method comprises the following steps: responding to an operation of a user on a target cloud application in the at least partial cloud applications, and sending operation data of the user on the target cloud application to the cloud server through the streaming transmission channel so as to trigger the cloud server to run the target cloud application on the basis of the operation data; receiving streaming media data which are transmitted by the server and generated in the process of running the target cloud application through the streaming transmission channel; and outputting and displaying the received streaming media data to the user to finish remote access to the target cloud application.

Description

Cloud application access method and device
Technical Field
One or more embodiments of the present disclosure relate to the field of communications technologies, and in particular, to a method and an apparatus for accessing a cloud application.
Background
The cloud application is an application interaction mode with end cloud coordination, the cloud end is responsible for logic processing, rendering, synthesis and picture transmission of the application, and the end side is responsible for decoding and rendering of the application and input processing of a user. The user installs the application program on the local equipment, and the program runs on the server in the cloud, so the storage space of the local equipment is greatly optimized, and the operating system of the local equipment is not limited, so the method is widely used.
Disclosure of Invention
In view of the above, one or more embodiments of the present disclosure provide a counting method and apparatus to solve the problems in the related art.
To achieve the above object, one or more embodiments of the present disclosure provide the following technical solutions:
according to a first aspect of one or more embodiments of the present specification, an access method of a cloud application is provided, where the access method is applied to an intelligent on-demand device, and an operating system carried by the intelligent on-demand device includes a local application; the cloud server is provided with a plurality of cloud applications; the local application is an application corresponding to at least part of cloud applications deployed on the cloud server; a streaming transmission channel established based on a supported streaming transmission protocol is maintained between the local application and the cloud server; the method comprises the following steps:
responding to an operation of a user on a target cloud application in the at least partial cloud applications, and sending operation data of the user on the target cloud application to the cloud server through the streaming transmission channel so as to trigger the cloud server to run the target cloud application on the basis of the operation data;
receiving streaming media data which are transmitted by the server and generated in the process of running the target cloud application through the streaming transmission channel;
and outputting and displaying the received streaming media data to the user to finish remote access to the target cloud application.
According to a second aspect of one or more embodiments of the present specification, an access method for a cloud application is provided, which is applied to a cloud server; the cloud server is provided with a plurality of cloud applications; the operating system carried by the intelligent on-demand equipment comprises local application; a streaming transmission channel established based on a supported streaming transmission protocol is maintained between the cloud server and the local application; the method comprises the following steps:
receiving operation data of a user for the target cloud application through a streaming transmission channel, and running the target cloud application based on the operation data;
and sending streaming media data generated in the process of running the target cloud application to the intelligent on-demand equipment through the streaming transmission channel, so that the intelligent on-demand equipment outputs and displays the received streaming media data to the user.
According to a third aspect of one or more embodiments of the present specification, there is provided an access system for a cloud application, including:
the intelligent on-demand equipment responds to the operation of a user for a target cloud application in the at least part of cloud applications, and sends the operation data of the user for the target cloud application to the cloud server through the streaming transmission channel;
the cloud server receives operation data of a user for the target cloud application through a streaming transmission channel, and runs the target cloud application based on the operation data;
the cloud server sends streaming media data generated in the process of running the target cloud application to the intelligent on-demand equipment through the streaming transmission channel, so that the intelligent on-demand equipment outputs and displays the received streaming media data to the user;
and the intelligent on-demand equipment outputs and displays the received streaming media data to the user so as to finish remote access to the target cloud application.
According to a fourth aspect of one or more embodiments of the present specification, there is provided an intelligent jukebox device, comprising:
a processor;
a memory for storing processor-executable instructions;
wherein the processor implements the method of the first aspect by executing the executable instructions.
The beneficial effect of this application: according to the streaming media data transmission method and device, the streaming transmission channel is established between the local application of the intelligent on-demand equipment and the cloud server, the streaming media data are transmitted through the streaming transmission channel, the streaming media data sensitive to time delay are directly opened at the intelligent on-demand equipment, and the use experience of a user is guaranteed. Through the technical scheme that the intelligent on-demand equipment accesses the cloud application, the mature application ecology of the existing operating system can be quickly multiplexed onto the intelligent on-demand equipment, the use scenes of users of the intelligent on-demand equipment are enriched, and better use experience is provided for the users.
Drawings
Fig. 1 is an architecture diagram of an access system of a cloud application according to an exemplary embodiment.
Fig. 2 is a flowchart of an access method of a cloud application according to an exemplary embodiment.
Fig. 3 is a flowchart of an access method of another cloud application according to an exemplary embodiment.
Fig. 4 is a flowchart illustrating an access method of a cloud application according to an exemplary embodiment.
FIG. 5 is a schematic block diagram of an intelligent jukebox device provided by an exemplary embodiment.
Fig. 6 is a block diagram of an access device of a cloud application according to an exemplary embodiment.
Fig. 7 is a schematic system structure diagram of a cloud application according to an exemplary embodiment.
Detailed Description
Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with one or more embodiments of the present specification. Rather, they are merely examples of apparatus and methods consistent with certain aspects of one or more embodiments of the specification, as detailed in the claims which follow.
It should be noted that: in other embodiments, the steps of the corresponding methods are not necessarily performed in the order shown and described herein. In some other embodiments, the method may include more or fewer steps than those described herein. Moreover, a single step described in this specification may be broken down into multiple steps in other embodiments; multiple steps described in this specification may be combined into a single step in other embodiments.
Smart televisions are currently on the market for viewing online videos, movies, and the like. Although most of smart televisions are provided with simple operating systems and can be provided with some software, the application ecology is still limited for the smart televisions, and the external openness degree of each smart television manufacturer is different, so that the application manufacturers need to customize and develop the smart televisions with specific models, and the smart televisions are long in development period, high in system adaptation difficulty and not universal.
The cloud application is an application interaction mode with end cloud coordination, the cloud end is responsible for logic processing, rendering, synthesis and picture transmission of the application, and the end side is responsible for decoding and rendering of the application and input processing of a user. In practical application, a user can break through the limitations of time, place, terminal and application, and can access the server in the cloud to access the cloud application at any time and any place.
In practical application, the cloud application can be accessed on the smart television, the application ecology of the existing mature operating system can be quickly reused, the research and development period and workload of an application manufacturer are reduced, and the interaction scene of a user on the smart television is enriched.
In view of this, the present specification provides a technical solution for accessing a cloud application through an intelligent on-demand device, transmitting streaming media data based on a streaming transmission channel, and outputting and displaying the streaming media data to a user.
Fig. 1 is an architecture diagram of an access system of a cloud application according to an exemplary embodiment. As shown in FIG. 1, the system may include a server 102, a connection channel 104, and a smart jukebox device 106.
The server 102 may be a physical server including independent hosts, or the server may be a virtual server, a cloud server, etc., carried by a cluster of hosts. The connection 104 may include at least one type of connection channel constructed of wired or wireless connections. The smart on-demand device 106 may include a smart television or the like having on-demand functionality.
In an embodiment, the server is used as a cloud server, the intelligent video-on-demand equipment is used as an intelligent television, and a user can access an application program running in the cloud server through the intelligent television. The smart television transmits the collected operation data to the cloud server through the connecting channel, then accesses an application program running at the cloud end based on the access scheme of the cloud application of the specification, the application program at the cloud end transmits the generated streaming media data to the smart television through the connecting channel, and the smart television outputs and displays the received streaming media data to the user so as to complete remote access of the target cloud application.
The access scheme of the cloud application of the present specification is described in detail below with reference to the accompanying drawings.
Fig. 2 is a flowchart of an access method of a cloud application according to an exemplary embodiment. As shown in fig. 2, the method is applied to a smart on-demand device, and an operating system installed on the smart on-demand device includes a local application. The local application may be one of operating systems independently running on the smart on-demand device, and is a service program corresponding to at least part of cloud applications (one or multiple cloud applications) deployed on the cloud service end. In practical application, an operation environment can be established for the local application in the operating system of the intelligent on-demand equipment, and then the local application is operated in the operation environment; for example, in one example, an application container may be created as a running environment for the local application in the operating system of the smart jukebox based on container technology, and the local application may be installed in the application container. The local application and the cloud server can maintain a streaming transmission channel established based on the supported streaming transmission protocol, and the cloud application can send streaming media data to the local application through the streaming transmission channel.
In an embodiment, the cloud service end may further deploy a streaming service program corresponding to at least part of the cloud application, where the streaming service program may include a service program supporting a streaming transport protocol, and the streaming service program may acquire streaming media data generated during the operation of the cloud application and transmit the streaming media data to the client program through a streaming transport channel. Correspondingly, in this case, the local application may include a client program corresponding to the streaming service program and configured to remotely access the at least part of the cloud application. For example, in one example, the client program may be a streaming client program corresponding to the streaming service program. The client program can also have an operation mapping function, and the operation mapping function is used for performing operation mapping on the operation of the user aiming at the target cloud application in the part of cloud applications.
The access method of the cloud application may include the following steps:
step 202, responding to an operation of a user for a target cloud application in the at least part of cloud applications, sending operation data of the user for the target cloud application to the cloud server through the streaming transmission channel, so as to trigger the cloud server to run the target cloud application based on the operation data;
the user may specifically be a user who uses an intelligent on-demand device and has an access requirement on the cloud application; the target cloud application may be specifically an on-demand application or a download application, which is not limited in the present invention; the operation of the user for the target cloud application may specifically be an operation input by the user through an input device such as a mouse, a keyboard, a touch screen, or the like; or the operation of the user for the touch large screen input of the intelligent on-demand equipment; the remote control device may be a remote control device, and the remote control device may be a remote control device. The operation data may specifically be data that can be recognized by the cloud server after the operation is initiated by the user and converted by the local application.
In one embodiment, the operation of the user on the target cloud application may include a starting operation on the target cloud application; accordingly, the operation data may specifically be a start instruction corresponding to the start operation. The local application can convert the starting operation of the user for the target cloud application into a starting instruction and send the starting instruction to the streaming service program deployed by the cloud service end through the streaming transmission channel. The streaming service program may start the target cloud application based on the start instruction. It should be noted that the cloud server has an operating environment corresponding to the target cloud application, and the streaming service program may directly start the target cloud application in the operating environment corresponding to the target cloud application.
For example, the user may start a client program of a local application, such as starting a certain video playing program, through the intelligent on-demand device; the client program sends a starting instruction to a cloud server through a streaming transmission channel; the cloud service end starts a video playing program corresponding to the cloud service end based on the starting instruction.
The operation of the user for the target cloud application can also comprise an interactive operation for the target cloud application after the target cloud application is started; correspondingly, the operation data may specifically be interaction data corresponding to the interaction operation. The above interaction operation may be specifically referred to as operations such as selecting, canceling, dragging, sliding, and the like of the local application program, which is not limited in the present invention. The local application can convert the interactive operation of the user for the target cloud application after the target cloud application is started into corresponding interactive data, and the interactive data is sent to the streaming service program deployed at the cloud service end through the streaming transmission channel. The streaming service program can execute the interactive action corresponding to the interactive data based on the interactive data.
For example, after the user starts a client program of the local application through the intelligent on-demand device, for example, after starting a certain video playing program; the user can select the video in the video playing program and can browse the interface of the video playing program in a sliding mode; the client program sends interactive data corresponding to the interactive operation to a cloud server through a streaming transmission channel; and the video playing program corresponding to the cloud server side can execute the interactive action corresponding to the interactive data based on the interactive data.
In an embodiment, the local application has a function of operation mapping, and may perform operation mapping on an operation of the user for the target cloud application. The operation of the user for the target cloud application can be specifically input by the user through input equipment such as a mouse, a keyboard and a touch screen; or the operation of the user for the touch large screen input of the intelligent on-demand equipment; the method can also be an operation initiated by the user aiming at the external equipment corresponding to the intelligent on-demand equipment. Therefore, when the user interacts, the local application can perform operation mapping on the operation input by the user.
In one example, when a user initiates an operation through an external device corresponding to the smart on-demand device, the external device corresponding to the smart on-demand device may be a remote controller. The local application can map keys of the remote controller, specifically, the remote controller has up, down, left and right direction keys, the local application can map the direction keys into a moving end of a mouse pointer, and the short-time moving step length is small and the local application can accurately move; fast moving on long time; when the direction key is double-clicked, the direction key can be mapped into the direction key of the original keyboard; the remote controller can also be provided with a confirmation key, a return key and a menu key; the confirmation key can be mapped to an enter key of the original keyboard, the return key can be mapped to an ESC key of the original keyboard, and the menu key can be mapped to a popup menu of a right mouse button.
In another example, the user may further connect to the smart on-demand device through an electronic device, where the electronic device may be a mobile phone, a tablet computer, or the like, which is not limited in this disclosure. The native application may map the operation for the electronic device to an interactive operation for a target cloud application. For example, a sliding operation of a finger of a user on the electronic device may be mapped to a movement of a mouse pointer, and an operation of a key input by the user on the electronic device may be mapped to a key of a keyboard or the like.
Step 204, receiving streaming media data which is transmitted by the server and generated in the process of running the target cloud application through the streaming transmission channel;
the streaming media data may specifically include video stream data, sound stream data, text stream data, and the like. In the running process of the target application, streaming media data corresponding to a media file for video playing can be generated, streaming media data related to application interface change of the target cloud application can also be generated, and the local application can receive the streaming media data through a streaming transmission channel.
In an embodiment, the streaming media data may include real-time streaming media data that is output and presented to a user in real time; the real-time streaming media data can be specifically applied to video streaming data sent in real time in an on-demand type. The local application can receive real-time streaming media data which are transmitted by the server side in real time and are generated in the process of running the target cloud application through a streaming transmission channel. The local application can analyze the real-time streaming media data in real time and display the real-time streaming media data to the user through the local player
For example, when the target cloud application is an on-demand application, the real-time streaming media data may be a media file requested by a user. When a user accesses the on-demand application through the intelligent on-demand equipment, the on-demand application can transmit the media files requested by the user to the local application at the intelligent television end in real time in the form of video stream data, and the media files are analyzed by the local application and displayed to the user through the local player.
It should be noted that the real-time streaming media data may further include streaming media data related to application interface changes of the target cloud application; the target cloud application can transmit the application interface to the local application through the streaming transmission channel, a user can perform interactive operation through the local application to request, switch, cancel and the like the target cloud application, and the target cloud application can transmit the changed application interface to the local application in real time.
For example, the streaming media data related to the change of the application interface of the target cloud application may be an application interface of the target cloud application, a menu bar of the target cloud application, a placed advertisement built in the target cloud application, or the like.
The streaming media data can also comprise non-real-time streaming media data which do not need to be output and displayed to a user in real time; the non-real-time streaming media data does not need to be output and displayed to the user in real time, so that the non-real-time streaming media data can be stored in a specific position and read by the user for displaying. The non-real-time streaming media data may be stored in a preset storage space by the cloud server, for example, the preset storage space may be a cloud disk shared by the local application and the cloud server. The local application can receive, by the streaming transmission channel, a storage address of the non-real-time streaming media data in the storage space, which is transmitted by the server and generated in the process of running the target cloud application; and when a user needs, reading the non-real-time streaming media data from the storage space based on the storage address.
For example, when the target cloud application is a download-type application, the non-real-time streaming media data may be a media file to be downloaded. When a user accesses the downloading application through the intelligent on-demand equipment, the downloading application can store the media file to be downloaded to a cloud disk of the cloud server and transmit a storage address to the local application; the local application can read the streaming media data in real time through the storage address, or can read the streaming media data in non-real time, and the streaming media data is analyzed by the local application and displayed to the user through the local player.
It should be noted that, during the running process, the cloud application may only send real-time streaming media data, may also only send non-real-time streaming media data, or may send real-time streaming media data and non-real-time streaming media data simultaneously, which is not limited in the present invention. That is, the cloud server may store the streaming media data in a preset storage space, and may also transmit the streaming media data to the local application in real time.
Step 206, outputting and displaying the received streaming media data to the user to complete remote access to the target cloud application;
the local application in the operating system loaded by the intelligent on-demand device may receive streaming media data, where the streaming media data may include real-time streaming media data transmitted by a target cloud application, and may also be streaming media data read by the local application from a cloud storage space loaded by a server. The local application can analyze the streaming media data and output and display the analyzed streaming media data through a local player of the local application.
It should be noted that the real-time streaming media data transmitted by the target cloud application may include streaming media data related to application interface change of the target cloud application, and/or streaming media data corresponding to a media file to be played in real time carried in an application interface of the cloud application; the local player can analyze the two kinds of streaming media data respectively and output and display the two kinds of streaming media data after being synthesized in the local player.
In an embodiment, through a redirection technology, the received streaming media data is output and displayed through a native player of a native application. The redirection technology is that the cloud server directly sends streaming media data before video decoding to the intelligent on-demand equipment through the streaming transmission channel, and the intelligent on-demand equipment decodes the streaming media data through a local player of the local application to realize high-definition and high-performance playing of the video file. The problem that the performance of the server is consumed when the video is played at the cloud server side is solved, and meanwhile the problem that the video playing is not smooth due to overlarge network flow is solved. Through the technical scheme that the cloud application is accessed through the intelligent on-demand equipment, the mature application ecology of the existing operating system can be quickly reused on the intelligent on-demand equipment, the use scenes of users of the intelligent on-demand equipment are enriched, and better use experience is provided for the users. According to the characteristics of playing the video file by the intelligent on-demand equipment, the streaming media data sensitive to time delay are directly opened at the intelligent on-demand equipment end through the streaming transmission channel, and the use experience of a user is guaranteed.
Fig. 3 is a flowchart of an access method of another cloud application according to an exemplary embodiment. As shown in fig. 3, the method is applied to a cloud server; the cloud server is provided with a plurality of cloud applications; the operating system carried by the intelligent on-demand equipment comprises local application; a streaming transmission channel established based on a supported streaming transmission protocol is maintained between the cloud server and the local application;
the access method of the cloud application may include the following steps:
step 302, receiving operation data of a user for the target cloud application through the streaming transmission channel, and running the target cloud application based on the operation data;
step 304, sending streaming media data generated in the process of running the target cloud application to the intelligent on-demand device through the streaming transmission channel, so that the intelligent on-demand device outputs and displays the received streaming media data to the user.
In this specification, the specific implementation manner of steps 302-304 is similar to that of steps 202-206, and is not described herein again.
The process of the access method through the cloud application is further explained by a specific embodiment in conjunction with fig. 4 below.
Fig. 4 is a flowchart illustrating an access method of a cloud application according to an exemplary embodiment. As shown in fig. 4, the smart on-demand device may start a local application (402), access a corresponding target cloud application through the local application, and input a user operation (404) after the local application is started, where the user operation may include a start operation for the target cloud application, and may also include an interaction operation for the target cloud application after the cloud application is started. The local application sends operation data (406) to the cloud server through the streaming transmission channel, and the target cloud application executes corresponding application logic (408) according to the received operation data, wherein the application logic comprises logic for starting the target cloud application and an application interface aiming at the target cloud application. When the user requests the real-time streaming media data, the target cloud application can transmit the real-time streaming media data to the local application through the streaming transmission channel (410), and the local application can receive the real-time streaming media data, analyze the real-time streaming media data and display the real-time streaming media data (412). When the user requests the non-real-time streaming media data, the target cloud application can store the non-real-time streaming media data to a cloud storage space of the cloud server (414), and the local application can read the non-real-time streaming media data from the cloud storage space when needed (416) and display the non-real-time streaming media data after parsing the non-real-time streaming media data (412).
FIG. 5 is a schematic block diagram of an intelligent jukebox device provided by an exemplary embodiment. Referring to fig. 5, at the hardware level, the apparatus includes a processor 502, an internal bus 504, a network interface 506, a memory 508 and a non-volatile memory 510, but may also include hardware required for other services. One or more embodiments of the present description may be implemented in software, such as by processor 502 reading corresponding computer programs from non-volatile storage 510 into memory 508 and then running. Of course, besides software implementation, the one or more embodiments in this specification do not exclude other implementations, such as logic devices or combinations of software and hardware, and so on, that is, the execution subject of the following processing flow is not limited to each logic unit, and may also be hardware or logic devices.
Referring to fig. 6, fig. 6 is a block diagram of an access device of a cloud application according to an exemplary embodiment.
A data sending unit 602, configured to send, in response to an operation of a user on a target cloud application in the at least part of cloud applications, operation data of the user on the target cloud application to the cloud server through the streaming transmission channel, so as to trigger the cloud server to run the target cloud application based on the operation data;
a data receiving unit 604, configured to receive, through the streaming transmission channel, streaming media data that is transmitted by the server and generated in the process of running the target cloud application;
a data presentation unit 606, configured to output and present the received streaming media data to the user, so as to complete remote access to the target cloud application.
Optionally, a streaming service program corresponding to the at least part of the cloud application is deployed on the cloud server; the local application comprises a client program corresponding to the streaming service program and used for remotely accessing the at least part of the cloud application; the streaming transport channel is a streaming transport channel created based on a supported streaming transport protocol maintained between the native application and the streaming service.
Optionally, the operation comprises a start operation; correspondingly, the operation data comprises a starting instruction corresponding to the starting operation;
a data sending unit 602, specifically configured to send, through the streaming transmission channel, a start instruction of the user for the target cloud application to the streaming service program deployed on the cloud service end, so that the streaming service program starts the target cloud application based on the start instruction.
Optionally, the operation includes an interactive operation for the target cloud application after the target cloud application is started; correspondingly, the operation data comprises interaction data corresponding to the interaction operation;
a data sending unit 602, specifically configured to send, through the streaming transmission channel, the interaction data of the user for the target cloud application to the streaming service program deployed on the cloud server, so that the streaming service program runs the target cloud application on the cloud server and executes an interaction action corresponding to the interaction data.
Optionally, the streaming media data includes real-time streaming media data that needs to be output and displayed to a user in real time;
the data receiving unit 604 is specifically configured to receive, through the streaming transmission channel, real-time streaming media data that is transmitted by the server in real time and is generated in the process of running the target cloud application.
Optionally, the streaming media data includes non-real-time streaming media data that does not need to be output to the user in real time; the non-real-time streaming media data generated by the cloud server in the process of running the target cloud application are stored to a preset storage space by the cloud server;
a data receiving unit 604, specifically configured to receive, through the streaming transmission channel, a storage address of the non-real-time streaming media data in the storage space, where the non-real-time streaming media data is generated during the process of running the target cloud application and is transmitted by the server, and read the non-real-time streaming media data from the storage space based on the storage address.
Optionally, the preset storage space includes a cloud disk shared by the local application and the cloud server.
Optionally, the streaming media data includes streaming media data related to an application interface change of the target cloud application; and/or streaming media data corresponding to a media file to be played carried in an application interface of the target cloud application;
the data display unit 606 is specifically configured to output and display the received streaming media data related to the application interface change of the target cloud application to a user through a preset interface; and/or the presence of a gas in the gas,
and playing the received streaming media data corresponding to the media file to be played carried in the application interface of the target cloud application to a user through a local player carried by the local application.
Optionally, the real-time streaming media data includes streaming media data related to an application interface change of the target cloud application; and/or streaming media data corresponding to a media file to be played in real time carried in an application interface of the target cloud application; the non-real-time streaming media data comprise streaming media data corresponding to a media file which is carried in an application interface of the target cloud application and does not need to be played in real time.
Optionally, the sending, in response to an operation of a user on a target cloud application in the at least part of cloud applications, operation data of the user on the target cloud application to the cloud server through the streaming transmission channel includes:
a data sending unit 602, configured to perform operation mapping on an operation performed by a user for a target cloud application in the at least part of cloud applications, so as to convert the operation into a user operation supported by the target cloud application, and send operation data corresponding to the converted user operation to the cloud server through the streaming transmission channel.
Optionally, the operation includes an operation initiated by the user through an external device corresponding to the intelligent on-demand device.
Optionally, the intelligent on-demand device includes an intelligent television; the external equipment comprises a remote controller corresponding to the intelligent television.
Fig. 7 is a schematic diagram of a system structure shown in this specification according to an exemplary embodiment, where the system includes a smart on-demand device 702, a cloud server 704, and several cloud applications 706 deployed and hosted by the cloud server;
the intelligent on-demand equipment responds to the operation of a user for a target cloud application in the at least part of cloud applications, and sends the operation data of the user for the target cloud application to the cloud server through the streaming transmission channel;
the cloud server receives operation data of a user for the target cloud application through a streaming transmission channel, and runs the target cloud application based on the operation data;
the cloud server sends streaming media data generated in the process of running the target cloud application to the intelligent on-demand equipment through the streaming transmission channel, so that the intelligent on-demand equipment outputs and displays the received streaming media data to the user;
and the intelligent on-demand equipment outputs and displays the received streaming media data to the user so as to finish remote access to the target cloud application.
The systems, devices, modules or units illustrated in the above embodiments may be implemented by a computer chip or an entity, or by a product with certain functions. A typical implementation device is a computer, which may be in the form of a personal computer, laptop, cellular telephone, camera phone, smart phone, personal digital assistant, media player, navigation device, email messaging device, game console, tablet computer, wearable device, or a combination of any of these devices.
In a typical configuration, a computer includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.
The memory may include forms of volatile memory in a computer readable medium, Random Access Memory (RAM) and/or non-volatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM). Memory is an example of a computer-readable medium.
Computer-readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), Digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic disk storage, quantum memory, graphene-based storage media or other magnetic storage devices, or any other non-transmission medium that can be used to store information that can be accessed by a computing device. As defined herein, a computer readable medium does not include a transitory computer readable medium such as a modulated data signal and a carrier wave.
It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
The foregoing description has been directed to specific embodiments of this disclosure. Other embodiments are within the scope of the following claims. In some cases, the actions or steps recited in the claims may be performed in a different order than in the embodiments and still achieve desirable results. In addition, the processes depicted in the accompanying figures do not necessarily require the particular order shown, or sequential order, to achieve desirable results. In some embodiments, multitasking and parallel processing may also be possible or may be advantageous.
The terminology used in the description of the one or more embodiments is for the purpose of describing the particular embodiments only and is not intended to be limiting of the description of the one or more embodiments. As used in one or more embodiments of the present specification and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "and/or" as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items.
It should be understood that although the terms first, second, third, etc. may be used in one or more embodiments of the present description to describe various information, such information should not be limited to these terms. These terms are only used to distinguish one type of information from another. For example, first information may also be referred to as second information, and similarly, second information may also be referred to as first information, without departing from the scope of one or more embodiments herein. The word "if" as used herein may be interpreted as "at … …" or "when … …" or "in response to a determination", depending on the context.
The above description is only for the purpose of illustrating the preferred embodiments of the one or more embodiments of the present disclosure, and is not intended to limit the scope of the one or more embodiments of the present disclosure, and any modifications, equivalent substitutions, improvements, etc. made within the spirit and principle of the one or more embodiments of the present disclosure should be included in the scope of the one or more embodiments of the present disclosure.

Claims (14)

1. An access method of cloud application is applied to intelligent on-demand equipment; the operating system carried by the intelligent on-demand equipment comprises a local application; the cloud server is provided with a plurality of cloud applications; the local application is an application corresponding to at least part of cloud applications deployed on the cloud server; a streaming transmission channel established based on a supported streaming transmission protocol is maintained between the local application and the cloud server; characterized in that the method comprises:
responding to an operation of a user on a target cloud application in the at least partial cloud applications, and sending operation data of the user on the target cloud application to the cloud server through the streaming transmission channel so as to trigger the cloud server to run the target cloud application on the basis of the operation data;
receiving streaming media data which are transmitted by the server and generated in the process of running the target cloud application through the streaming transmission channel;
and outputting and displaying the received streaming media data to the user to finish remote access to the target cloud application.
2. The method according to claim 1, wherein a streaming service corresponding to the at least part of the cloud application is deployed on the cloud server; the local application comprises a client program corresponding to the streaming service program and used for remotely accessing the at least part of the cloud application; the streaming transport channel is a streaming transport channel created based on a supported streaming transport protocol maintained between the native application and the streaming service.
3. The method of claim 2, wherein the operation comprises a start operation; correspondingly, the operation data comprises a starting instruction corresponding to the starting operation;
the sending, by the streaming transmission channel, the operation data of the user for the target cloud application to the cloud server to trigger the cloud server to run the target cloud application based on the operation data includes:
sending a starting instruction of the user for the target cloud application to the streaming service program deployed on the cloud service terminal through the streaming transmission channel, so that the streaming service program starts the target cloud application based on the starting instruction.
4. The method of claim 2, wherein the operation comprises an interactive operation for the target cloud application after the target cloud application is launched; correspondingly, the operation data comprises interaction data corresponding to the interaction operation;
the sending, by the streaming transmission channel, the operation data of the user for the target cloud application to the cloud server to trigger the cloud server to run the target cloud application based on the operation data includes:
sending the interactive data of the user aiming at the target cloud application to the streaming service program deployed on the cloud service end through the streaming transmission channel, so that the streaming service program runs the target cloud application on the cloud service end and executes the interactive action corresponding to the interactive data.
5. The method of claim 1, wherein the streaming media data comprises real-time streaming media data that needs to be output to a user in real time;
receiving streaming media data, which is transmitted by the server and generated in the process of running the target cloud application, through the streaming transmission channel, and including:
and receiving real-time streaming media data which are transmitted by the server side in real time and are generated in the process of running the target cloud application through the streaming transmission channel.
6. The method of claim 1, wherein the streaming media data comprises non-real-time streaming media data that does not require real-time output presentation to a user; the non-real-time streaming media data generated by the cloud server in the process of running the target cloud application are stored to a preset storage space by the cloud server;
receiving streaming media data, which is transmitted by the server and generated in the process of running the target cloud application, through the streaming transmission channel, and including:
receiving, by the streaming transmission channel, a storage address of the non-real-time streaming media data in the storage space, which is generated in the process of running the target cloud application and transmitted by the server, and reading the non-real-time streaming media data from the storage space based on the storage address.
7. The method of claim 6, wherein the predetermined storage space comprises a cloud disk shared by the native application and the cloud server.
8. The method of claim 5 or 6, wherein the streaming media data comprises streaming media data related to an application interface change of the target cloud application; and/or streaming media data corresponding to a media file to be played carried in an application interface of the target cloud application;
outputting and displaying the received streaming media data to the user, wherein the outputting and displaying comprises the following steps:
outputting and displaying the received streaming media data related to the change of the application interface of the target cloud application to a user through a preset interface; and/or the presence of a gas in the gas,
and playing the received streaming media data corresponding to the media file to be played carried in the application interface of the target cloud application to a user through a local player carried by the local application.
9. The method of claim 5 or 6, wherein the real-time streaming media data comprises streaming media data related to an application interface change of the target cloud application; and/or streaming media data corresponding to a media file to be played in real time carried in an application interface of the target cloud application; the non-real-time streaming media data comprise streaming media data corresponding to a media file which is carried in an application interface of the target cloud application and does not need to be played in real time.
10. The method according to claim 1, wherein the sending, in response to an operation of a user on a target cloud application of the at least partial cloud application, operation data of the user on the target cloud application to the cloud server through the streaming transmission channel comprises:
responding to the operation of a user for a target cloud application in the at least part of cloud applications, performing operation mapping on the operation to convert the operation into a user operation supported by the target cloud application, and sending operation data corresponding to the converted user operation to the cloud server through the streaming transmission channel.
11. The method of claim 1, wherein the outputting and presenting the received streaming media data to the user comprises:
and outputting and displaying the received streaming media data to the user through a redirection technology.
12. An access method of cloud application is applied to a cloud server; the cloud server is provided with a plurality of cloud applications; the operating system carried by the intelligent on-demand equipment comprises local application; a streaming transmission channel established based on a supported streaming transmission protocol is maintained between the cloud server and the local application; characterized in that the method comprises:
receiving operation data of a user for a target cloud application through the streaming transmission channel, and running the target cloud application based on the operation data;
and sending streaming media data generated in the process of running the target cloud application to the intelligent on-demand equipment through the streaming transmission channel, so that the intelligent on-demand equipment outputs and displays the received streaming media data to the user.
13. An access system for a cloud application, the system comprising: the system comprises intelligent on-demand equipment, a cloud server and a plurality of deployed cloud applications carried by the cloud server;
the intelligent on-demand equipment responds to the operation of a user for a target cloud application in the at least part of cloud applications, and sends the operation data of the user for the target cloud application to the cloud server through the streaming transmission channel;
the cloud server receives operation data of a user for the target cloud application through a streaming transmission channel, and runs the target cloud application based on the operation data;
the cloud server sends streaming media data generated in the process of running the target cloud application to the intelligent on-demand equipment through the streaming transmission channel, so that the intelligent on-demand equipment outputs and displays the received streaming media data to the user;
and the intelligent on-demand equipment outputs and displays the received streaming media data to the user so as to finish remote access to the target cloud application.
14. An intelligent on-demand device, comprising:
a processor;
a memory for storing processor-executable instructions;
wherein the processor implements the method of any one of claims 1-12 by executing the executable instructions.
CN202210307781.3A 2022-03-25 2022-03-25 Cloud application access method and device Active CN114844871B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210307781.3A CN114844871B (en) 2022-03-25 2022-03-25 Cloud application access method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210307781.3A CN114844871B (en) 2022-03-25 2022-03-25 Cloud application access method and device

Publications (2)

Publication Number Publication Date
CN114844871A true CN114844871A (en) 2022-08-02
CN114844871B CN114844871B (en) 2024-03-26

Family

ID=82563343

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210307781.3A Active CN114844871B (en) 2022-03-25 2022-03-25 Cloud application access method and device

Country Status (1)

Country Link
CN (1) CN114844871B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2024061307A1 (en) * 2022-09-23 2024-03-28 杭州阿里云飞天信息技术有限公司 Interaction, processing and control methods for application service in cloud desktop

Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140173036A1 (en) * 2012-12-13 2014-06-19 Motorola Mobility Llc System and Methods for Preventing Interruptions due to Battery Drain During Streaming Media Sessions Between Devices
US20160191627A1 (en) * 2012-11-28 2016-06-30 Nvidia Corporation Method and apparatus for execution of applications in a cloud system
CN111176669A (en) * 2019-12-30 2020-05-19 北京视博云科技有限公司 Cloud application installation starting method, cloud streaming server and storage server
CN111327910A (en) * 2020-01-21 2020-06-23 广州虎牙科技有限公司 Operation control method, device and equipment of application program and storage medium
CN111372115A (en) * 2020-03-03 2020-07-03 北京奇艺世纪科技有限公司 Application program access method and device and communication system
CN112817781A (en) * 2021-02-08 2021-05-18 北京字节跳动网络技术有限公司 Application program interaction method, device, equipment and medium
CN112929716A (en) * 2021-02-10 2021-06-08 江苏视博云信息技术有限公司 Method, device and system for live broadcast interaction of cloud application
CN113382026A (en) * 2021-08-16 2021-09-10 腾讯科技(深圳)有限公司 Data processing method, device, related equipment and storage medium
CN113556568A (en) * 2021-07-21 2021-10-26 北京奇艺世纪科技有限公司 Cloud application program operation method, system, device and storage medium
CN113893524A (en) * 2021-08-04 2022-01-07 广州简悦信息科技有限公司 Cloud application processing system, method, device and equipment
CN114095557A (en) * 2022-01-21 2022-02-25 腾讯科技(深圳)有限公司 Data processing method, device, equipment and medium

Patent Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160191627A1 (en) * 2012-11-28 2016-06-30 Nvidia Corporation Method and apparatus for execution of applications in a cloud system
US20140173036A1 (en) * 2012-12-13 2014-06-19 Motorola Mobility Llc System and Methods for Preventing Interruptions due to Battery Drain During Streaming Media Sessions Between Devices
CN111176669A (en) * 2019-12-30 2020-05-19 北京视博云科技有限公司 Cloud application installation starting method, cloud streaming server and storage server
CN111327910A (en) * 2020-01-21 2020-06-23 广州虎牙科技有限公司 Operation control method, device and equipment of application program and storage medium
CN111372115A (en) * 2020-03-03 2020-07-03 北京奇艺世纪科技有限公司 Application program access method and device and communication system
CN112817781A (en) * 2021-02-08 2021-05-18 北京字节跳动网络技术有限公司 Application program interaction method, device, equipment and medium
CN112929716A (en) * 2021-02-10 2021-06-08 江苏视博云信息技术有限公司 Method, device and system for live broadcast interaction of cloud application
CN113556568A (en) * 2021-07-21 2021-10-26 北京奇艺世纪科技有限公司 Cloud application program operation method, system, device and storage medium
CN113893524A (en) * 2021-08-04 2022-01-07 广州简悦信息科技有限公司 Cloud application processing system, method, device and equipment
CN113382026A (en) * 2021-08-16 2021-09-10 腾讯科技(深圳)有限公司 Data processing method, device, related equipment and storage medium
CN114095557A (en) * 2022-01-21 2022-02-25 腾讯科技(深圳)有限公司 Data processing method, device, equipment and medium

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2024061307A1 (en) * 2022-09-23 2024-03-28 杭州阿里云飞天信息技术有限公司 Interaction, processing and control methods for application service in cloud desktop

Also Published As

Publication number Publication date
CN114844871B (en) 2024-03-26

Similar Documents

Publication Publication Date Title
US11112942B2 (en) Providing content via multiple display devices
US11403124B2 (en) Remotely emulating computing devices
US20200105307A1 (en) Video recording method and apparatus for mobile terminal
WO2022083427A1 (en) Landscape interaction method and apparatus, electronic device, and storage medium
KR102488975B1 (en) Content viewing device and Method for displaying content viewing options thereon
US20160042045A1 (en) Resolving conflicts within saved state data
US20160134924A1 (en) System and method for collecting data
US20150082239A1 (en) Remote Virtualization of Mobile Apps with Transformed Ad Target Preview
KR20160021235A (en) Method and systems for pre-rendering and pre-fetching content
JP2014510320A (en) Context user interface
US20120159338A1 (en) Media navigation via portable networked device
CA2843152C (en) Remotely preconfiguring a computing device
CN113168337A (en) Techniques for managing generation and rendering of user interfaces on client devices
JP2023511730A (en) Video interaction method, apparatus, electronic device, storage medium, computer program product and computer program
TWI521365B (en) Methods for handling urls to trigger functionalities
CN114844871B (en) Cloud application access method and device
CN113556568B (en) Cloud application running method, system, device and storage medium
KR102612580B1 (en) Media providing server, method of switching to other centent through a trigger area and computer program
US20170034301A1 (en) Caching streaming media to user devices
CN114785758A (en) Application access method and device of cross-operating system
CN115733997A (en) Method, device, medium and program product for presenting live associated video
KR20220025475A (en) Method and apparatus for recommending a product associated with a product corresponding to a broadcast video
CN116931773A (en) Information processing method and device and electronic equipment
CN117348725A (en) Method and device for processing multimedia data based on virtual reality equipment
JP2015046673A (en) Information processing terminal and information processing system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant