CN112671970B - Control method and control device for mobile equipment and cloud mobile phone, electronic equipment, mobile equipment, cloud server and medium - Google Patents
Control method and control device for mobile equipment and cloud mobile phone, electronic equipment, mobile equipment, cloud server and medium Download PDFInfo
- Publication number
- CN112671970B CN112671970B CN202011561127.2A CN202011561127A CN112671970B CN 112671970 B CN112671970 B CN 112671970B CN 202011561127 A CN202011561127 A CN 202011561127A CN 112671970 B CN112671970 B CN 112671970B
- Authority
- CN
- China
- Prior art keywords
- application program
- audio
- target
- video data
- mobile phone
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Abstract
The application discloses a control method and device of mobile equipment, the mobile equipment, television equipment and media, and relates to the technical field of artificial intelligence such as cloud computing and big data processing. The specific implementation scheme is as follows: running a target application program on the mobile equipment, wherein the target application program and a first application program and a second application program are application programs with the same type and keep synchronous running, the first application program runs on the cloud mobile phone, and the second application program runs on the television equipment; receiving audio and video data input by a user in response to an interaction request message aiming at a target application program; and audio and video data are synchronously transmitted to the first application program and the second application program, so that the interaction mode of the mobile equipment, the cloud mobile phone and the television equipment can be effectively expanded, the remote control scene of the mobile equipment is effectively expanded, the personalized remote control requirement is met, and the interaction experience degree of a user is improved.
Description
Technical Field
The application relates to the technical field of computers, in particular to the technical field of artificial intelligence such as cloud computing and big data processing, and particularly relates to a control method and device of mobile equipment, the mobile equipment, television equipment and a medium.
Background
Artificial intelligence is the subject of research that makes computers simulate some human mental processes and intelligent behaviors (such as learning, reasoning, thinking, planning, etc.), both at the hardware level and at the software level. Artificial intelligence hardware technologies generally include technologies such as sensors, dedicated artificial intelligence chips, cloud computing, distributed storage, big data processing, and the like; the artificial intelligence software technology mainly comprises a computer vision technology, a voice recognition technology, a natural language processing technology, machine learning/deep learning, a big data processing technology, a knowledge map technology and the like.
With the coming of the fifth generation mobile communication technology (5th generation mobile networks, 5G), the cloud running of applications tends to be great, and a cloud mobile phone is a brand-new service based on cloud computing and virtualization, has the capability of running applications at the cloud quickly, efficiently and stably, and can run without time limit.
Disclosure of Invention
A control method and apparatus for a mobile device, an electronic device, a mobile device, a cloud server, a television device, a storage medium, and a computer program product are provided.
According to a first aspect, there is provided a control method of a mobile device, comprising: running a target application program on the mobile equipment, wherein the target application program and a first application program and a second application program are application programs with the same type and keep synchronous running, the first application program runs on a cloud mobile phone, and the second application program runs on television equipment; receiving audio and video data input by a user in response to an interaction request message aiming at the target application program; and synchronously transmitting the audio and video data to the first application program and the second application program.
According to a second aspect, there is provided a control method of a cloud handset, including: the method comprises the steps that a first application program is operated on the cloud mobile phone, wherein the first application program, a target application program and a second application program are application programs with the same type and keep synchronous operation, the target application program is operated on the mobile equipment, and the second application program is operated on the television equipment; and receiving audio and video data sent by the mobile equipment, wherein the audio and video data are received when the target application program responds to the interaction request message.
According to a third aspect, there is provided a control method of a television apparatus, comprising: running a second application program on the television equipment, wherein the second application program, a target application program and a first application program are application programs with the same type and keep synchronous running, the target application program runs on the mobile equipment, and the first application program runs on the cloud mobile phone; and receiving audio and video data sent by the mobile equipment, wherein the audio and video data are received when the target application program responds to the interaction request message.
According to a fourth aspect, there is provided a control apparatus of a mobile device, comprising: the mobile device comprises a first running module, a second running module and a third running module, wherein the first running module is used for running a target application program on the mobile device, the target application program and the first application program and the second application program are application programs with the same type and keep synchronous running, the first application program runs on the cloud mobile phone, and the second application program runs on the television device; the first receiving module is used for responding to the interaction request message aiming at the target application program and receiving audio and video data input by a user; and the first transmission module is used for synchronously transmitting the audio and video data to the first application program and the second application program.
According to a fifth aspect, there is provided a control apparatus of a cloud handset, comprising: the second running module is used for running a first application program on the cloud mobile phone, wherein the first application program, a target application program and a second application program are application programs with the same type and keep synchronous running, the target application program runs on the mobile equipment, and the second application program runs on the television equipment; and the third receiving module is used for receiving the audio and video data sent by the mobile equipment, wherein the audio and video data are received when the target application program responds to the interaction request message.
According to a sixth aspect, there is provided a control apparatus of a television device, comprising: the third running module is used for running a second application program on the television equipment, the second application program, a target application program and the first application program are the same in type and are kept to run synchronously, the target application program runs on the mobile equipment, and the first application program runs on the cloud mobile phone; and the fourth receiving module is used for receiving the audio and video data sent by the mobile equipment, wherein the audio and video data are received when the target application program responds to the interaction request message.
According to a seventh aspect, there is provided an electronic device comprising: at least one processor; and a memory communicatively coupled to the at least one processor; the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor, so that the at least one processor can execute the control method of the mobile device, the control method of the cloud mobile phone, or the control method of the television device.
According to an eighth aspect, there is provided a non-transitory computer-readable storage medium storing computer instructions for causing a computer to execute the method for controlling a mobile device disclosed in the embodiments of the present application, or execute the method for controlling a cloud phone of the embodiments of the present application, or execute the method for controlling a television device of the embodiments of the present application.
According to a ninth aspect, a computer program product is provided, which includes a computer program, and when the computer program is executed by a processor, the computer program implements the control method of the mobile device disclosed in the embodiment of the present application, or executes the control method of the cloud mobile phone of the embodiment of the present application, or executes the control method of the television device of the embodiment of the present application.
According to a tenth aspect, a mobile device is proposed, comprising: at least one processor; and a memory communicatively coupled to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to execute the control method of the mobile device disclosed in the embodiment of the application.
According to an eleventh aspect, there is provided a cloud server comprising: at least one processor; and a memory communicatively coupled to the at least one processor; the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor, so that the at least one processor can execute the control method of the cloud mobile phone disclosed in the embodiment of the application.
According to a twelfth aspect, there is provided a television apparatus comprising: at least one processor; and a memory communicatively coupled to the at least one processor; the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to execute the control method of the television device disclosed in the embodiment of the application.
It should be understood that the statements in this section do not necessarily identify key or critical features of the embodiments of the present application, nor do they limit the scope of the present application. Other features of the present application will become apparent from the following description.
Drawings
The drawings are included to provide a better understanding of the present solution and are not intended to limit the present application. Wherein:
FIG. 1 is a schematic diagram according to a first embodiment of the present application;
FIG. 2 is a schematic diagram according to a second embodiment of the present application;
FIG. 3 is a schematic illustration according to a third embodiment of the present application;
FIG. 4 is a schematic illustration of a fourth embodiment according to the present application;
FIG. 5 is a schematic illustration according to a fifth embodiment of the present application;
FIG. 6 is a schematic illustration according to a sixth embodiment of the present application;
FIG. 7 is a schematic illustration according to a seventh embodiment of the present application;
FIG. 8 is a schematic illustration according to an eighth embodiment of the present application;
FIG. 9 is a schematic illustration of a ninth embodiment according to the present application;
fig. 10 is a block diagram of an electronic device for implementing a control method of a mobile device according to an embodiment of the present application.
Detailed Description
The following description of the exemplary embodiments of the present application, taken in conjunction with the accompanying drawings, includes various details of the embodiments of the application for the understanding of the same, which are to be considered exemplary only. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the present application. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.
Fig. 1 is a schematic diagram according to a first embodiment of the present application.
It should be noted that an execution subject of the control method of the mobile device in this embodiment is a control apparatus of the mobile device, the apparatus may be implemented in a software and/or hardware manner, the apparatus may be configured in an electronic device, and the electronic device may include, but is not limited to, a terminal, a server, and the like.
The embodiment of the application relates to the technical field of artificial intelligence such as cloud computing and big data processing.
Wherein, Artificial Intelligence (Artificial Intelligence), english is abbreviated as AI. The method is a new technical science for researching and developing theories, methods, technologies and application systems for simulating, extending and expanding human intelligence.
Cloud computing (cloud computing) refers to a technology architecture that accesses a flexibly extensible shared physical or virtual resource pool through a network, where resources may include servers, operating systems, networks, software, applications, storage devices, and the like, and may be deployed and managed in an on-demand, self-service manner. Through the cloud computing technology, high-efficiency and strong data processing capacity can be provided for technical application and model training of artificial intelligence, block chains and the like.
The big data processing refers to a process of analyzing and processing large-scale data in an artificial intelligence mode, and the big data can be summarized into 5V, and has large data Volume (Volume), high speed (Velocity), multiple types (Velocity), Value (Value) and authenticity (Veracity).
As shown in fig. 1, the control method of the mobile device includes:
s101: and running a target application program on the mobile equipment, wherein the target application program and the first application program and the second application program are application programs with the same type and keep synchronous running, the first application program runs on the cloud mobile phone, and the second application program runs on the television equipment.
The control device of the execution main body mobile device of this embodiment may be specifically configured on the mobile device, and the mobile device may be, for example, a physical mobile phone, or an intelligent handle having a remote control function, a display function, a voice broadcast function, and an audio/video data acquisition function, which is not limited thereto.
The cloud mobile phone interface can be loaded on a mobile device, a target application program is run on the mobile device, and the content (such as an application program screen, a function control and the like) of the target application program is displayed on the cloud mobile phone interface, wherein the target application program is an application program of the same type as the first application program and the second application program, and the target application program and the first application program and the second application program are synchronously run.
The type of the target application may be, for example, a game type application, an education type application, a human-computer interaction type application, etc., without limitation.
The application program that runs on the cloud mobile phone and is the same as the target application program in type and keeps running synchronously may be referred to as a first application program, and the application program that runs on the television device and is the same as the target application program in type and keeps running synchronously may be referred to as a second application program, which is not limited to this.
The television device, such as a television or a set-top box, is not limited in this regard.
That is to say, in the embodiment of the application, sharing of applications on a mobile device, a cloud mobile phone, and a television device is supported, and when sharing, a target application, a first application, and a second application are kept running synchronously (synchronously displaying a function interface, audio and video data, and the like).
S102: and receiving audio and video data input by a user in response to the interaction request message aiming at the target application program.
The above-mentioned running of the target application program on the mobile device may monitor whether the interaction request message is received in real time based on the target application program, where the interaction request message may be used to trigger the target application program to respond to an interaction instruction of a user, and in this embodiment of the present application, when the interaction request message is monitored and received, an audio/video acquisition component (such as a camera and a microphone) carried by the mobile device may be started in real time to receive audio/video data input by the user, and then a subsequent step is triggered.
S103: and synchronously transmitting the audio and video data to the first application program and the second application program.
When the interaction request message is monitored and received, the audio and video acquisition component (such as a camera and a microphone) carried by the user can be started in real time to receive audio and video data input by the user, and then the audio and video data can be synchronously transmitted to the first application program and the second application program.
For example, if the target application is a human-computer interaction application, it is assumed that the audio/video data is an inquiry voice, and accordingly, the interaction response data may be an answer voice for the inquiry voice, and according to the actual function category of the target application and the specific form of the audio/video data, the interaction response data may be any other possible multimedia form, which is not limited herein.
Optionally, in some embodiments, the audio and video data is synchronously transmitted to the first application program and the second application program, and the protocol conversion may be performed on the audio and video data by using a real-time audio and video service RTC protocol to obtain target audio and video data; and synchronously transmitting the target audio and video data to the first application program and the second application program.
For example, communication connection among the mobile device, the cloud mobile phone and the television device can be established in advance, so that based on a data transmission link on the communication connection, a real-time audio/video service (RTC) protocol is adopted to perform protocol conversion on audio/video data to obtain target audio/video data, and the target audio/video data are synchronously transmitted to the cloud mobile phone and the television device respectively through the RTC protocol.
The real-time audio and video service RTC can rely on strong streaming media processing and transmission capability of the cloud server, so that protocol conversion is carried out on audio and video data by adopting a real-time audio and video service RTC protocol to obtain target audio and video data, and the target audio and video data are respectively and synchronously transmitted to the cloud mobile phone and the television equipment through the RTC protocol, so that the timeliness of the whole audio and video data transmission can be greatly improved, and the data synchronization performance among the mobile equipment, the cloud mobile phone and the television equipment is guaranteed.
In the embodiment, the target application program is operated on the mobile device, wherein the target application program, the first application program and the second application program are application programs of the same type and are kept to be operated synchronously, the first application program is operated on the cloud mobile phone, the second application program is operated on the television device, and the audio and video data input by a user are received in response to an interaction request message aiming at the target application program and are synchronously transmitted to the first application program and the second application program, so that the interaction mode of the mobile device, the cloud mobile phone and the television device can be effectively expanded, the remote control scene of the mobile device is effectively expanded, the personalized remote control requirement is met, and the interaction experience of the user is improved.
Fig. 2 is a schematic diagram according to a second embodiment of the present application.
As shown in fig. 2, the control method of the mobile device includes:
s201: and controlling the mobile equipment to respectively establish communication connection with the cloud mobile phone and the television equipment.
The control device of the execution main body mobile device of this embodiment may be specifically configured on the mobile device, and the mobile device may be, for example, a physical mobile phone, or an intelligent handle having a remote control function, a display function, a voice broadcast function, and an audio/video data acquisition function, which is not limited thereto.
In some application scenarios, the cloud mobile phone and the television device agree in advance to share one application program, and then it is determined that the mobile device needs to be accessed to assist in extending the functions of the television device, the cloud mobile phone may provide an identification code of the application program, and the mobile device may be controlled to scan the identification code to trigger loading of a cloud mobile phone interface on the mobile device, and run the application program on the mobile device, that is, control the mobile device to establish communication connections with the cloud mobile phone, respectively.
In other application scenarios, when the mobile device is controlled to scan the identification code to trigger loading of the cloud mobile phone interface on the mobile device, the mobile device may also be controlled to establish a communication connection with the television device, and at this time, since the cloud mobile phone and the television device agree in advance to share one application program, at this time, the mobile device, the cloud mobile phone, and the television device may be controlled to establish a mutual communication connection therebetween to assist in extending the functions of the television device, for example, the application program shared by the cloud mobile phone on the television device is controlled correspondingly by the mobile device (for example, the application program is controlled in a voice manner, or controlled in an image manner, or controlled in a touch manner, or the like).
S202: and sending a request message to the cloud mobile phone, wherein the request message is used for acquiring the target content operated by the first application program from the cloud mobile phone.
S203: and receiving target content sent by the cloud mobile phone.
The target content can be a data stream captured by calling a preset interface when the cloud mobile phone receives the request message, and then the cloud mobile phone can synchronously issue the data stream to the mobile device and the television device by adopting a real-time audio and video service (RTC) protocol so as to ensure the consistency of the function synchronization of the application program.
S204: and starting the target application program on the mobile equipment, and controlling the target application program to run the target content.
The cloud mobile phone interface is triggered to be loaded on the mobile device, and when the application program is run on the mobile device, a request message can be sent to the cloud mobile phone, where the request message is used to obtain target content (the target content may be content currently run by the first application program, such as an application program picture, a function control, and the like) run by the first application program from the cloud mobile phone, and display the target content on the cloud mobile phone interface, so as to ensure synchronous display of the target application program and the function interface of the first application program.
S205: and receiving audio and video data input by a user in response to the interaction request message aiming at the target application program.
S206: and synchronously transmitting the audio and video data to the first application program and the second application program.
For details of the descriptions of S205 and S206, reference may be made to the above embodiments, which are not described herein again.
S207: and receiving interactive response data sent by the cloud mobile phone, wherein the interactive response data are generated by a first application program running on the cloud mobile phone in response to the audio and video data.
The Process of synchronously transmitting the audio and video data to the first application program and the second application program may be that the audio and video data are synchronously transmitted to the cloud mobile phone, the cloud mobile phone synchronizes the audio and video data to the first application program based on a built-in IPC (Inter-Process Communication) mechanism, so as to trigger the first application program running on the cloud mobile phone to respond to the audio and video data and generate interactive response data, and then the cloud mobile phone may issue the interactive response data to the mobile device and the television device.
S208: and displaying the interactive response data by adopting the target application program.
After the interactive response data sent by the cloud mobile phone are received, the interactive response data can be directly displayed by the target application program, so that man-machine interaction between a user and the target application program is facilitated, the next round of interactive response operation is triggered in time, and when the functions of the television equipment are extended by the aid of the mobile equipment, the interaction efficiency among the mobile equipment, the cloud mobile phone and the television equipment is guaranteed.
The mobile device in the embodiment of the application can be used as an extension of functions of the television device, so that the mode that the television device controls the application program in the cloud mobile phone is effectively enriched (touch screen input, voice input and camera picture input can be simultaneously supported), the online application that the cloud mobile phone is used in a seamless connection mode is realized, the mobile device can also synchronously support sharing and display the content of the application program on the cloud mobile phone, and the use experience of a user is effectively improved.
In the embodiment, the target application program is operated on the mobile device, wherein the target application program, the first application program and the second application program are application programs of the same type and are kept to be operated synchronously, the first application program is operated on the cloud mobile phone, the second application program is operated on the television device, and the audio and video data input by a user are received in response to an interaction request message aiming at the target application program and are synchronously transmitted to the first application program and the second application program, so that the interaction mode of the mobile device, the cloud mobile phone and the television device can be effectively expanded, the remote control scene of the mobile device is effectively expanded, the personalized remote control requirement is met, and the interaction experience of the user is improved. The mobile device is controlled to respectively establish communication connection with the cloud mobile phone and the television device, and request messages are sent to the cloud mobile phone and used for acquiring target content operated by the first application program from the cloud mobile phone, receiving the target content sent by the cloud mobile phone, starting the target application program on the mobile device, controlling the target application program to operate the target content, so that synchronous display of function interfaces of the target application program and the first application program can be effectively guaranteed, and synchronous consistency of functions of the application programs is guaranteed. After the interactive response data sent by the cloud mobile phone are received, the interactive response data can be directly displayed by the target application program, so that man-machine interaction between a user and the target application program is facilitated, the next round of interactive response operation is timely triggered, and the interactive efficiency among the mobile device, the cloud mobile phone and the television device is guaranteed when the functions of the television device are extended by the aid of the mobile device.
Fig. 3 is a schematic diagram according to a third embodiment of the present application.
As shown in fig. 3, the control method of the cloud mobile phone includes:
s301: the method comprises the steps that a first application program is operated on the cloud mobile phone, wherein the first application program, a target application program and a second application program are application programs with the same type and are kept to be operated synchronously, the target application program is operated on the mobile device, and the second application program is operated on the television device.
The execution subject in this embodiment may be a cloud phone.
It should be noted that, this embodiment is corresponding to the embodiment shown in fig. 1 or fig. 2, and if the execution process at the cloud mobile phone side is the same as or corresponds to the features in the embodiment in the present embodiment, reference may be made to the embodiment in detail, and details are not repeated here.
Optionally, in some embodiments, after the first application is run on the cloud mobile phone, the cloud mobile phone may be further controlled to respectively establish communication connections with the mobile device and the television device;
transmitting the target content operated by the first application program to the television equipment; and responding to a request message sent by the mobile equipment, and sending the target content operated by the first application program to the mobile equipment, so that synchronous display of the functional interfaces of the target application program and the first application program can be effectively ensured, and the consistency of the function synchronization of the application programs can be ensured.
For example, the cloud mobile phone and the television device agree to share one application program in advance, and then the cloud mobile phone can be triggered and controlled to establish communication connection with the television device, and subsequently when it is determined that the mobile device needs to be accessed to assist in extending functions of the television device, the cloud mobile phone can provide an identification code of the application program, the mobile device can be controlled to scan the identification code to trigger loading of a cloud mobile phone interface on the mobile device, the application program is operated on the mobile device, that is, the cloud mobile phone is controlled to establish communication connection with the mobile device, and then target content operated by the first application program is sent to the mobile device in response to a request message sent by the mobile device.
S302: and receiving audio and video data sent by the mobile equipment, wherein the audio and video data are received when the target application program responds to the interaction request message.
For example, a real-time audio/video service RTC protocol conversion module may be configured on the cloud mobile phone side, and after receiving the audio/video data sent by the mobile device, since the audio/video data may be transmitted by the mobile device using a real-time audio/video service RTC protocol, the protocol conversion may be performed on the received audio/video data, so as to convert the audio/video data into audio/video data in a data format suitable for internal transmission in the cloud mobile phone.
Optionally, in some embodiments, after receiving the audio and video data sent by the mobile device, interactive response data is also sent to the mobile device and the television device, where the interactive response data is generated by a first application running on the cloud mobile phone in response to the audio and video data, so as to trigger a next round of interactive response operation in time, so that when the functions of the television device are extended by using the mobile device, the interactive efficiency among the mobile device, the cloud mobile phone, and the television device is ensured.
That is to say, when the mobile device synchronously transmits the audio and video data to the first application program, the first application program running on the cloud mobile phone can synchronously respond according to the audio and video data, so as to generate corresponding interactive response data, and then the interactive response data is sent to the mobile device, so that the target application program on the mobile device is triggered to interact with the user based on the interactive response data.
When the interactive response data are respectively sent to the mobile device and the television device, protocol conversion can be firstly carried out on the interactive response data by adopting a real-time audio and video service (RTC) protocol to obtain target interactive response data, and then the target interactive response data are transmitted to the television device by adopting the real-time audio and video service (RTC) protocol.
In the embodiment, the first application program is operated on the cloud mobile phone, wherein the first application program, the target application program and the second application program are application programs of the same type and are kept to operate synchronously, the target application program is operated on the mobile device, the second application program is operated on the television device and receives audio and video data sent by the mobile device, and the audio and video data are received when the target application program responds to the interaction request message, so that the interaction modes of the mobile device, the cloud mobile phone and the television device can be effectively expanded, the remote control scene of the mobile device is effectively expanded, the personalized remote control requirement is met, and the interaction experience of a user is improved.
Fig. 4 is a schematic diagram according to a fourth embodiment of the present application.
As shown in fig. 4, the control method of the television apparatus includes:
s401: and running a second application program on the television equipment, wherein the second application program, the target application program and the first application program are application programs with the same type and keep synchronous running, the target application program runs on the mobile equipment, and the first application program runs on the cloud mobile phone.
The execution subject in this embodiment may be a television apparatus.
It should be noted that, in this embodiment, the execution flow at the television apparatus side corresponds to the embodiment shown in fig. 1, or fig. 2, or fig. 3, and the same or corresponding features in this embodiment may be specifically referred to the above embodiment, and are not described again here.
S402: and receiving audio and video data sent by the mobile equipment, wherein the audio and video data are received when the target application program responds to the interaction request message.
Optionally, in some embodiments, after receiving the audio and video data sent by the mobile device, interactive response data sent by the cloud mobile phone may also be received, where the interactive response data is generated by a first application program running on the cloud mobile phone in response to the audio and video data; and displaying the interactive response data by adopting the second application program, so that the next round of interactive response operation is triggered in time, and the interactive efficiency among the mobile equipment, the cloud mobile phone and the television equipment is guaranteed when the functions of the television equipment are extended by adopting the mobile equipment as an assistant.
In the embodiment, the second application program is operated on the television equipment, the second application program, the target application program and the first application program are application programs with the same type and keep synchronous operation, the target application program is operated on the mobile equipment, the first application program is operated on the cloud mobile phone and receives audio and video data sent by the mobile equipment, and the audio and video data are received when the target application program responds to the interaction request message, so that the interaction mode of the mobile equipment, the cloud mobile phone and the television equipment can be effectively expanded, the remote control scene of the mobile equipment is effectively expanded, the personalized remote control requirement is met, and the interaction experience of a user is improved.
Fig. 5 is a schematic diagram according to a fifth embodiment of the present application.
As shown in fig. 5, the control device 50 of the mobile device includes:
a first running module 501, configured to run a target application on a mobile device, where the target application is an application of the same type as a first application and a second application, and keeps running synchronously, the first application runs on a cloud phone, and the second application runs on a television device;
a first receiving module 502, configured to receive, in response to an interaction request message for a target application, audio and video data input by a user; and
the first transmission module 503 is configured to transmit the audio/video data to the first application program and the second application program synchronously.
In some embodiments of the present application, as shown in fig. 6, fig. 6 is a schematic diagram of a control apparatus 60 of the mobile device according to a sixth embodiment of the present application, including: the first operation module 601, the first receiving module 602, and the first transmitting module 603 further include:
the first control module 604 is configured to control the mobile device to establish communication connections with the cloud mobile phone and the television device respectively before the target application is run on the mobile device;
a first sending module 605, configured to send a request message to the cloud mobile phone, where the request message is used to obtain target content operated by the first application from the cloud mobile phone;
a second receiving module 606, configured to receive target content sent by the cloud mobile phone;
the first operation module 601 is specifically configured to:
and starting the target application program on the mobile equipment, and controlling the target application program to run the target content.
In some embodiments of the present application, the first transmission module 603 is specifically configured to:
performing protocol conversion on the audio and video data by adopting a real-time audio and video service (RTC) protocol to obtain target audio and video data;
and synchronously transmitting the target audio and video data to the first application program and the second application program.
In some embodiments of the present application, the second receiving module 606 is further configured to:
after the audio and video data are synchronously transmitted to the first application program and the second application program, interactive response data sent by the cloud mobile phone are received, wherein the interactive response data are generated by the first application program running on the cloud mobile phone in response to the audio and video data, and the interactive response data are displayed by adopting a target application program.
It is understood that the control device 60 of the mobile device in fig. 6 of this embodiment and the control device 50 of the mobile device in the above embodiment, the first operation module 601 and the first operation module 501 in the above embodiment, the first receiving module 602 and the first receiving module 502 in the above embodiment, and the first transmitting module 603 and the first transmitting module 503 in the above embodiment may have the same functions and structures.
It should be noted that the explanation of the control method of the mobile device described above is also applicable to the control apparatus of the mobile device of the present embodiment, and is not repeated herein.
In the embodiment, the target application program is operated on the mobile device, wherein the target application program, the first application program and the second application program are application programs of the same type and are kept to be operated synchronously, the first application program is operated on the cloud mobile phone, the second application program is operated on the television device, and the audio and video data input by a user are received in response to an interaction request message aiming at the target application program and are synchronously transmitted to the first application program and the second application program, so that the interaction mode of the mobile device, the cloud mobile phone and the television device can be effectively expanded, the remote control scene of the mobile device is effectively expanded, the personalized remote control requirement is met, and the interaction experience of the user is improved.
Fig. 7 is a schematic diagram of a seventh embodiment according to the present application.
As shown in fig. 7, the control device 70 of the cloud handset includes:
a second running module 701, configured to run a first application on the cloud mobile phone, where the first application, a target application and a second application are the same type of application and keep running synchronously, the target application runs on the mobile device, and the second application runs on the television device;
the third receiving module 702 is configured to receive audio and video data sent by the mobile device, where the audio and video data is received when the target application responds to the interaction request message.
In some embodiments of the present application, as shown in fig. 8, the control device 80 of the cloud mobile phone includes: the second operation module 801 and the third receiving module 802 further include:
the second control module 803 is configured to control the cloud mobile phone to establish communication connections with the mobile device and the television device respectively;
a second sending module 804, configured to send the target content operated by the first application to the television apparatus, and send the target content operated by the first application to the mobile apparatus in response to the request message sent by the mobile apparatus.
In some embodiments of the present application, the second sending module 804 is further configured to:
and respectively sending interactive response data to the mobile equipment and the television equipment, wherein the interactive response data are generated by a first application program running on the cloud mobile phone in response to the audio and video data.
It is understood that the control device 80 of the cloud mobile phone in fig. 8 of this embodiment may have the same functions and structures as the control device 70 of the cloud mobile phone in the foregoing embodiment, the second operation module 801, the second operation module 701 in the foregoing embodiment, and the third receiving module 802, as the third receiving module 702 in the foregoing embodiment.
It should be noted that the explanation of the control method of the cloud mobile phone is also applicable to the control device of the cloud mobile phone in this embodiment, and is not repeated herein.
In the embodiment, the first application program is operated on the cloud mobile phone, the first application program, the target application program and the second application program are application programs of the same type and are kept to operate synchronously, the target application program is operated on the mobile device, the second application program is operated on the television device and receives audio and video data sent by the mobile device, and the audio and video data are received when the target application program responds to the interaction request message, so that the interaction mode of the mobile device, the cloud mobile phone and the television device can be effectively expanded, the remote control scene of the mobile device is effectively expanded, the personalized remote control requirement is met, and the interaction experience degree of a user is improved.
Fig. 9 is a schematic diagram of a ninth embodiment according to the present application.
As shown in fig. 9, the control device 90 of the television apparatus includes:
a third running module 901, configured to run a second application on the television device, where the second application is an application of the same type as the target application and the first application, and keeps running synchronously, the target application runs on the mobile device, and the first application runs on the cloud mobile phone;
the fourth receiving module 902 is configured to receive audio and video data sent by the mobile device, where the audio and video data is received when the target application responds to the interaction request message.
In some embodiments of the present application, the fourth receiving module 902 is further configured to:
receiving interactive response data sent by the cloud mobile phone, wherein the interactive response data are generated by a first application program running on the cloud mobile phone in response to the audio and video data; the interactive response data is displayed using the second application.
It should be noted that the explanation of the control method of the television apparatus described above is also applicable to the control device of the television apparatus of the present embodiment, and details thereof are not repeated here.
In the embodiment, the second application program is operated on the television equipment, the second application program, the target application program and the first application program are application programs with the same type and keep synchronous operation, the target application program is operated on the mobile equipment, the first application program is operated on the cloud mobile phone and receives audio and video data sent by the mobile equipment, and the audio and video data are received when the target application program responds to the interaction request message, so that the interaction mode of the mobile equipment, the cloud mobile phone and the television equipment can be effectively expanded, the remote control scene of the mobile equipment is effectively expanded, the personalized remote control requirement is met, and the interaction experience of a user is improved.
There is also provided, in accordance with an embodiment of the present application, an electronic device, a readable storage medium, and a computer program product.
Fig. 10 is a block diagram of an electronic device for implementing a control method of a mobile device according to an embodiment of the present application. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be examples only, and are not meant to limit implementations of the present application that are described and/or claimed herein.
As shown in fig. 10, the apparatus 1000 includes a computing unit 1001 that can perform various appropriate actions and processes according to a computer program stored in a Read Only Memory (ROM)1002 or a computer program loaded from a storage unit 1008 into a Random Access Memory (RAM) 1003. In the RAM 1003, various programs and data necessary for the operation of the device 1000 can also be stored. The calculation unit 1001, ROM 1002, and RAM 1003 are connected to each other by a bus 1004. An input/output (I/O) interface 1005 is also connected to bus 1004.
A number of components in device 1000 are connected to I/O interface 1005, including: an input unit 1006 such as a keyboard, a mouse, and the like; an output unit 1007 such as various types of displays, speakers, and the like; a storage unit 1008 such as a magnetic disk, an optical disk, or the like; and a communication unit 1009 such as a network card, a modem, a wireless communication transceiver, or the like. The communication unit 1009 allows the device 1000 to exchange information/data with other devices through a computer network such as the internet and/or various telecommunication networks.
For example, in some embodiments, the control method of the mobile device, or the control method of the cloud handset, or the control method of the television device may be implemented as a computer software program tangibly embodied in a machine-readable medium, such as the storage unit 1008. In some embodiments, part or all of the computer program may be loaded and/or installed onto device 1000 via ROM 1002 and/or communications unit 1009. When the computer program is loaded into the RAM 1003 and executed by the computing unit 1001, one or more steps of the control method of the mobile device, or the control method of the cloud handset, or the control method of the television device described above may be executed. Alternatively, in other embodiments, the computing unit 1001 may be configured in any other suitable way (e.g. by means of firmware) to perform a control method of a mobile device, or a control method of a cloud handset, or a control method of a television device.
Various implementations of the systems and techniques described here above may be implemented in digital electronic circuitry, integrated circuitry, Field Programmable Gate Arrays (FPGAs), Application Specific Integrated Circuits (ASICs), Application Specific Standard Products (ASSPs), system on a chip (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs that are executable and/or interpretable on a programmable system including at least one programmable processor, which may be special or general purpose, receiving data and instructions from, and transmitting data and instructions to, a storage system, at least one input device, and at least one output device.
Program code for implementing the control method of the mobile device, or the control method of the cloud handset, or the control method of the television device of the present application may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general purpose computer, special purpose computer, or other programmable data processing apparatus, such that the program codes, when executed by the processor or controller, cause the functions/operations specified in the flowchart and/or block diagram to be performed. The program code may execute entirely on the machine, partly on the machine, as a stand-alone software package partly on the machine and partly on a remote machine or entirely on the remote machine or server.
In the context of this application, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and a pointing device (e.g., a mouse or a trackball) by which a user can provide input to the computer. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic, speech, or tactile input.
The systems and techniques described here can be implemented in a computing system that includes a back-end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such back-end, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), Wide Area Networks (WANs), the internet, and blockchain networks.
The computer system may include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. The Server can be a cloud Server, also called a cloud computing Server or a cloud host, and is a host product in a cloud computing service system, so as to solve the defects of high management difficulty and weak service expansibility in the traditional physical host and VPS service ("Virtual Private Server", or simply "VPS"). The server may also be a server of a distributed system, or a server incorporating a blockchain.
The embodiment of the present application further discloses a mobile device, including: at least one processor; and a memory communicatively coupled to the at least one processor; the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to execute the control method of the mobile device.
The embodiment of the present application further discloses a cloud server, including: at least one processor; and a memory communicatively coupled to the at least one processor; the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor, so that the at least one processor can execute the control method of the cloud mobile phone.
The embodiment of the present application further discloses a television device, including: at least one processor; and a memory communicatively coupled to the at least one processor; the storage stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to execute the control method of the television device.
It should be understood that various forms of the flows shown above may be used, with steps reordered, added, or deleted. For example, the steps described in the present disclosure may be executed in parallel, sequentially, or in different orders, and are not limited herein as long as the desired results of the technical solutions disclosed in the present disclosure can be achieved.
The above-described embodiments should not be construed as limiting the scope of the present application. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions may be made in accordance with design requirements and other factors. Any modification, equivalent replacement, and improvement made within the spirit and principle of the present application shall be included in the protection scope of the present application.
Claims (8)
1. A control method of a mobile device, comprising:
running a target application program on the mobile device, wherein the target application program and a first application program and a second application program are application programs with the same type and keep synchronous running, the first application program runs on a cloud mobile phone, the second application program runs on a television device, and the target application program, the first application program and the second application program are shared application programs;
receiving audio and video data input by a user in response to an interaction request message aiming at the target application program; and
synchronously transmitting the audio and video data to the first application program and the second application program;
wherein the synchronously transmitting the audio and video data to the first application program and the second application program comprises:
performing protocol conversion on the audio and video data by adopting a real-time audio and video service (RTC) protocol to obtain target audio and video data;
synchronously transmitting the target audio and video data to the first application program and the second application program;
after the audio and video data is synchronously transmitted to the first application program and the second application program, the method further comprises the following steps:
receiving interactive response data sent by the cloud mobile phone, wherein the interactive response data are generated by a first application program running on the cloud mobile phone in response to the audio and video data;
displaying the interactive response data with the target application program;
before the target application program is run on the mobile device, the method further comprises the following steps:
controlling the mobile equipment to respectively establish communication connection with the cloud mobile phone and the television equipment;
sending a request message to the cloud mobile phone, wherein the request message is used for acquiring target content operated by the first application program from the cloud mobile phone;
receiving the target content sent by the cloud mobile phone;
wherein the running of the target application on the mobile device comprises:
and starting the target application program on the mobile equipment, and controlling the target application program to run the target content.
2. A control method of a cloud mobile phone comprises the following steps:
the method comprises the steps that a first application program is operated on a cloud mobile phone, wherein the first application program, a target application program and a second application program are application programs with the same type and keep synchronous operation, the target application program is operated on mobile equipment, the second application program is operated on television equipment, and the target application program, the first application program and the second application program are shared application programs;
receiving audio and video data sent by the mobile equipment, wherein the audio and video data are received when the target application program responds to the interaction request message;
wherein, the receiving of the audio and video data sent by the mobile device includes:
the mobile equipment performs protocol conversion on the audio and video data by adopting a real-time audio and video service (RTC) protocol to obtain target audio and video data;
the mobile device synchronously transmits the target audio and video data to the first application program and the second application program;
after the receiving of the audio and video data sent by the mobile device, the method further includes:
respectively sending interactive response data to the mobile equipment and the television equipment, wherein the interactive response data are generated by a first application program running on the cloud mobile phone in response to the audio and video data;
after the first application program is run on the cloud mobile phone, the method further comprises the following steps:
controlling the cloud mobile phone to respectively establish communication connection with the mobile device and the television device;
sending the target content operated by the first application program to the television equipment; and
and responding to the request message sent by the mobile equipment, and sending the target content operated by the first application program to the mobile equipment.
3. A control apparatus of a mobile device, comprising:
the mobile device comprises a first running module, a second running module and a third running module, wherein the first running module is used for running a target application program on the mobile device, the target application program and the first application program and the second application program are application programs with the same type and keep synchronous running, the first application program is run on a cloud mobile phone, the second application program is run on the television device, and the target application program, the first application program and the second application program are shared application programs;
the first receiving module is used for responding to the interaction request message aiming at the target application program and receiving audio and video data input by a user; and
the first transmission module is used for synchronously transmitting the audio and video data to the first application program and the second application program;
the first control module is used for controlling the mobile equipment to respectively establish communication connection with the cloud mobile phone and the television equipment before a target application program runs on the mobile equipment;
a first sending module, configured to send a request message to the cloud mobile phone, where the request message is used to obtain, from the cloud mobile phone, target content operated by the first application;
the second receiving module is used for receiving the target content sent by the cloud mobile phone;
the first operation module is specifically configured to:
starting the target application program on the mobile equipment and controlling the target application program to run the target content;
wherein, the first transmission module is specifically configured to:
performing protocol conversion on the audio and video data by adopting a real-time audio and video service (RTC) protocol to obtain target audio and video data;
synchronously transmitting the target audio and video data to the first application program and the second application program;
the second receiving module is further configured to:
after the audio and video data are synchronously transmitted to the first application program and the second application program, interactive response data sent by the cloud mobile phone are received, wherein the interactive response data are generated by the first application program running on the cloud mobile phone in response to the audio and video data, and the interactive response data are displayed by the target application program.
4. A control device of a cloud mobile phone comprises:
the second running module is used for running a first application program on the cloud mobile phone, wherein the first application program, a target application program and a second application program are application programs with the same type and keep synchronous running, the target application program runs on the mobile equipment, the second application program runs on the television equipment, and the target application program, the first application program and the second application program are shared application programs;
the third receiving module is used for receiving the audio and video data sent by the mobile equipment, wherein the audio and video data are received when the target application program responds to the interaction request message;
the second control module is used for controlling the cloud mobile phone to respectively establish communication connection with the mobile equipment and the television equipment;
a second sending module, configured to send the target content operated by the first application to the television device, and send the target content operated by the first application to the mobile device in response to the request message sent by the mobile device
Wherein the second sending module is further configured to:
respectively sending interactive response data to the mobile equipment and the television equipment, wherein the interactive response data are generated by a first application program running on the cloud mobile phone in response to the audio and video data;
the receiving of the audio and video data sent by the mobile device includes:
the mobile equipment performs protocol conversion on the audio and video data by adopting a real-time audio and video service (RTC) protocol to obtain target audio and video data;
and the mobile equipment synchronously transmits the target audio and video data to the first application program and the second application program.
5. An electronic device, comprising:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein the content of the first and second substances,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of claim 1 or to perform the method of claim 2.
6. A non-transitory computer readable storage medium storing computer instructions for causing a computer to perform the method of claim 1 or perform the method of claim 2.
7. A mobile device, comprising:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein the content of the first and second substances,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of claim 1.
8. A cloud server, comprising:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein the content of the first and second substances,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of claim 2.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011561127.2A CN112671970B (en) | 2020-12-25 | 2020-12-25 | Control method and control device for mobile equipment and cloud mobile phone, electronic equipment, mobile equipment, cloud server and medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011561127.2A CN112671970B (en) | 2020-12-25 | 2020-12-25 | Control method and control device for mobile equipment and cloud mobile phone, electronic equipment, mobile equipment, cloud server and medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112671970A CN112671970A (en) | 2021-04-16 |
| CN112671970B true CN112671970B (en) | 2022-05-10 |
Family
ID=75408928
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011561127.2A Active CN112671970B (en) | 2020-12-25 | 2020-12-25 | Control method and control device for mobile equipment and cloud mobile phone, electronic equipment, mobile equipment, cloud server and medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112671970B (en) |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111857457A (en) * | 2020-06-22 | 2020-10-30 | 北京百度网讯科技有限公司 | Cloud mobile phone control method and device, electronic equipment and readable storage medium |
-
2020
- 2020-12-25 CN CN202011561127.2A patent/CN112671970B/en active Active
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111857457A (en) * | 2020-06-22 | 2020-10-30 | 北京百度网讯科技有限公司 | Cloud mobile phone control method and device, electronic equipment and readable storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112671970A (en) | 2021-04-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112769897B (en) | Synchronization method and device of edge calculation message, electronic equipment and storage medium | |
| US20230215076A1 (en) | Image frame display method, apparatus, device, storage medium, and program product | |
| CN113453073B (en) | Image rendering method and device, electronic equipment and storage medium | |
| CN113778593B (en) | Cloud desktop control method and device, electronic equipment, storage medium and program product | |
| CN106572131A (en) | Media data sharing method and system in Internet of things | |
| CN113961289A (en) | Data processing method, device, equipment and storage medium | |
| CN112671970B (en) | Control method and control device for mobile equipment and cloud mobile phone, electronic equipment, mobile equipment, cloud server and medium | |
| CN112382294A (en) | Voice recognition method and device, electronic equipment and storage medium | |
| CN116931858A (en) | Multi-screen projection method and device and vehicle | |
| CN114422572B (en) | Cloud mobile phone control method and device, electronic equipment and storage medium | |
| CN113641439B (en) | Text recognition and display method, device, electronic equipment and medium | |
| CN113617020B (en) | Game control method, game control device, storage medium, server and terminal | |
| CN112702660B (en) | Multimedia data transmission method and device, automatic driving vehicle and cloud server | |
| CN113836455A (en) | Special effect rendering method, device, equipment, storage medium and computer program product | |
| CN113891441A (en) | Network connection method and device and electronic equipment | |
| CN113760431B (en) | Application control method and device, electronic equipment and readable storage medium | |
| CN114979471B (en) | Interface display method, device, electronic equipment and computer readable storage medium | |
| CN114443192B (en) | Multi-window virtual application method and device based on cloud desktop | |
| JP7346638B2 (en) | Image data modification method, modification device, electronic equipment, storage medium, computer program and self-driving vehicle | |
| CN114967928A (en) | Screen sharing method and device, electronic equipment and medium | |
| CN116931767A (en) | Screen linkage method and device, electronic equipment and storage medium | |
| CN116028009A (en) | Man-machine interaction method, device, equipment and storage medium in projection display | |
| CN114217837A (en) | Software updating method, device, equipment and medium for cloud mobile phone | |
| CN113961207A (en) | Application control method, device, electronic equipment and medium | |
| CN116155962A (en) | Control method and device of aromatherapy equipment and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |