CN117294925A

CN117294925A - Method, device, equipment and storage medium for displaying cloud mobile phone video

Info

Publication number: CN117294925A
Application number: CN202311064962.9A
Authority: CN
Inventors: 何云鹏; 田栩枫; 卢彦超
Original assignee: Shenzhen Huawei Cloud Computing Technology Co ltd
Current assignee: Shenzhen Huawei Cloud Computing Technology Co ltd
Priority date: 2023-08-22
Filing date: 2023-08-22
Publication date: 2023-12-26

Abstract

The embodiment of the disclosure provides a method, a device, equipment and a storage medium for displaying video of a cloud mobile phone, and belongs to the technical field of cloud computing. In the method, when a certain function is triggered to display video data acquired by a camera in the process of using the cloud mobile phone, a local video processing program of user equipment can be used for replacing a cloud mobile phone client to acquire and display the locally acquired video data, at the moment, an interface of the cloud mobile phone client is not required to be displayed, and the video data acquired by the corresponding camera is not required to be sent to a cloud mobile phone server, so that the video data interacted between the user equipment and the cloud mobile phone server can be greatly reduced, and network resource occupation is reduced.

Description

Method, device, equipment and storage medium for displaying cloud mobile phone video

Technical Field

The disclosure relates to the technical field of cloud computing, and in particular relates to a method, a device, equipment and a storage medium for displaying video of a cloud mobile phone.

Background

With the development of cloud computing, the use of cloud mobile phones is becoming more and more widespread, and most of the application programs used on the cloud mobile phones and the application programs used on the common mobile phones are the same. Functions in some applications may involve displaying video data captured by a camera, e.g., camera functions, code scanning functions, etc., which may be used to capture video data by a user device camera.

In the use process of the functions, the camera of the user equipment collects video data and sends the video data to the cloud mobile phone server, and the cloud mobile phone server generates interface images of the application program, such as camera interface images, code scanning interface images and the like, based on the video data, and then sends the interface images to the user equipment for display.

A great deal of video data are interacted between the user equipment and the cloud mobile phone server, and a great deal of network resources are occupied.

Disclosure of Invention

In order to solve the related technical problems, the present disclosure provides a method, an apparatus, a device and a storage medium for displaying video of a cloud mobile phone. The technical proposal is as follows:

in a first aspect, a method for displaying video of a cloud mobile phone is provided, and the method is applied to a target device, wherein the target device operates with a cloud mobile phone client, and the method includes: in the process of operating the cloud mobile phone client, when a user wants to use the video related function, the target application program can be operated and opened in the cloud mobile phone client, and at the moment, the cloud mobile phone server is triggered to send a video stream pulling request to the target equipment, and the target equipment receives the video stream pulling request sent by the cloud mobile phone server. The target device acquires and displays locally acquired video data through a local target video processing program.

The video related function is a function related to displaying video data collected by a camera, such as a camera function, a code scanning function, and the like.

When the video data acquired by the camera is triggered to be displayed by a certain function in the process of using the cloud mobile phone, the video processing program local to the user equipment can be used for replacing the video data acquired and displayed by the cloud mobile phone client, at the moment, the interface of the cloud mobile phone client is not required to be displayed, and the video data acquired by the corresponding camera is not required to be transmitted to the cloud mobile phone server, so that the video data interacted between the user equipment and the cloud mobile phone server can be greatly reduced, and the network resource occupation is reduced.

In one possible implementation manner, after the target device starts the target video processing program, the interface of the cloud mobile phone client may be switched to the background, and the interface of the target video processing program is displayed in the foreground in a full screen manner.

In this way, the user is facilitated to view the captured video image more clearly.

In one possible implementation, the video stream pull request carries the target function identifier. The target device can determine a target video processing program corresponding to the target function identifier based on the corresponding relation between the function identifier and the video processing program, and the cloud mobile phone client can acquire the function identifier carried in the video stream pulling request, search the target video processing program corresponding to the function identifier in the corresponding relation table, and then start the target video processing program. In the corresponding relation, any video processing program and the corresponding function identifier belong to the function which has the same type of interface, and the interface of the video processing program can be designed by referring to the interface of the corresponding function. The function identifiers are used for marking different types of functions, each function can be allocated with a different function identifier, and the same kind of function in different application programs can have the same identifier.

In this way, the target video processing program is arranged in the target device to replace the corresponding function of the target application program, so that the normal operation of the user is not influenced under the condition that the user does not feel, the normal operation mode of the cloud mobile phone is replaced by the local processing operation mode of the target device, the interactive video data between the user device and the cloud mobile phone server can be effectively reduced, and the time loss caused by the interactive video data can be reduced.

In one possible implementation, the function identifier in the correspondence relationship includes a function identifier of a camera function and/or a function identifier of a code scanning function.

In this way, the cloud mobile phone client can determine the corresponding target video processing program according to the target function identifier, the interface of the target video processing program is identical or basically identical to the interface of the target application program, and the general working mode of the cloud mobile phone can be replaced by the working mode of the local processing of the target device under the condition that the user does not feel.

In one possible implementation manner, when a user determines to start video shooting, a video shooting function can be selected on a target device, then a shooting control can be clicked on the target device to trigger a video shooting instruction in a target video processing program, the target video processing program can respond to the video shooting instruction to perform video shooting processing, the user can click the shooting control again to end video shooting, and a cloud mobile phone client sends a recorded video file to a cloud mobile phone server;

Or when the user determines to start to take pictures, a picture taking function can be selected on the target equipment, then a shooting control can be clicked on the target equipment to trigger a picture taking instruction in a target video processing program, the target video processing program can respond to the picture taking instruction to take pictures, and the cloud mobile phone client side sends the taken picture files to the cloud mobile phone server;

or when the camera identifies the complete and clear graphic code, the graphic code identification instruction in the target video processing program can be triggered, the target video processing program can perform graphic code identification processing based on video data, and after the target data carried by the graphic code is identified, the cloud mobile phone client sends the identified target data to the cloud mobile phone server.

In this way, the cloud mobile phone client can process video data by utilizing the target video processing program, so that the interactive video data between the user equipment and the cloud mobile phone server is reduced.

In one possible implementation, the cached video data may be deleted in the target device. After the recorded video data is sent to the cloud mobile phone server, deleting the recorded video data in the target equipment; or after the shot picture data are sent to the cloud mobile phone server, deleting the shot picture data in the target equipment.

Therefore, after the video data is successfully sent to the cloud mobile phone server, the video data cached in the target equipment is deleted, so that the occupation of resources can be effectively reduced.

In one possible implementation, the target video processing program may be exited. After the user has used the video related function, the user may click on the "return" control, or a gesture operation of "return". At this time, the cloud mobile phone client can close the target video processing program, send a video display end notification to the cloud mobile phone server, and switch the interface of the cloud mobile phone client to foreground full screen display.

Thus, after the user operates to exit the target video processing program, the user can return to the interface before the cloud mobile phone enters the target application program, and the whole video display and related processing process is performed. In the process, the normal operation of the user can be replaced by the working mode of the target equipment local processing under the condition that the user does not feel (i.e. the normal operation of the user is not influenced), the video data interacted between the user equipment and the cloud mobile phone server can be effectively reduced, and the time loss caused by the video data interaction can be reduced.

In a second aspect, a method for displaying video of a cloud mobile phone is provided, and the method is applied to a cloud mobile phone server, wherein the cloud mobile phone server serves a cloud mobile phone client operated by a target device, and the method comprises the following steps: when the cloud mobile phone runs the target application program and the user wants to use the video related function, the target application program can send a camera video acquisition instruction to the system program in the cloud mobile phone server. And sending a video stream pulling request to the target device, wherein the video stream pulling request is used for indicating the target device to acquire and display the acquired video data through the target video processing program.

Under the condition that the interface of the cloud mobile phone client is switched to the background, the cloud mobile phone server can continuously send the interface image of the cloud mobile phone to the target equipment, and can also stop sending the interface image of the cloud mobile phone to the target equipment.

In one possible implementation, video data sent by a target device may be stored. Receiving and storing a recorded video file or a shot picture file sent by target equipment; or receiving target data which is sent by the target equipment and is identified in the graphic code, and performing network access processing based on the target data. After receiving the video data, the cloud mobile phone server can store the video data in a folder corresponding to the target application program.

In this way, the cloud mobile phone server can only receive and store video data sent by the target device, and video data interacted between the user device and the cloud mobile phone server is reduced.

In one possible implementation, a scenario in which multiple devices use a cloud handset at the same time may be implemented. And receiving and storing recorded video files or shot picture files transmitted by a plurality of devices, wherein the plurality of devices comprise target devices.

Therefore, the cloud mobile phone server can send the interface images of the cloud mobile phone to the plurality of devices through one distribution device, the plurality of devices can simultaneously display the interface images of the cloud mobile phone, and the cloud mobile phone server does not need to send a plurality of interface images to the plurality of devices respectively, so that the bandwidth requirement on the cloud mobile phone server can be reduced.

In one possible implementation, the exit target video processing program may be operated. And when the target video processing program is closed, the cloud mobile phone server receives a video display ending notification sent by the target equipment. When the cloud mobile phone server processes in the first mode, when the interface of the cloud mobile phone client is switched back to the front desk, the state of transmitting the cloud mobile phone interface image can be unchanged after the cloud mobile phone server receives the video display ending notification, namely the interface image of the cloud mobile phone is kept to be continuously transmitted. When the cloud mobile phone server processes in the second mode, the cloud mobile phone server can restart to send the interface image of the cloud mobile phone to the target equipment. After receiving the video display end notification, the cloud mobile phone server can exit the current interface of the target application program, wherein the current interface can be a main interface of the target application program or an interface of related functions of the target application program. Thus, after exiting the target video processing program, the user may continue to use other functions of the target application program.

Subsequently, the user can click an album control in the target equipment, the cloud mobile phone client sends the operation information to the cloud mobile phone server, and after the cloud mobile phone server receives the operation information, the album interface of the cloud mobile phone can be opened to display the stored video data.

Therefore, the normal operation of the user is not influenced under the condition that the user does not feel, the normal operation mode of the cloud mobile phone is replaced by the operation mode of the local processing of the target equipment, the video data interacted between the user equipment and the cloud mobile phone server can be effectively reduced, and the time loss caused by the video data interaction can be reduced.

In one possible implementation, the video stream pull request may carry a target function identifier.

The function identifiers are used for marking and distinguishing different types of functions, different function identifiers can be allocated for each function, a plurality of video processing programs can be developed in advance by a technician, the video processing programs respectively correspond to the different types of functions, each video processing program is used for processing one type of function, and a corresponding relation table of the function identifiers and the video processing programs can be stored in the cloud mobile phone client. And acquiring a target function identifier corresponding to the current execution function of the target application program, and adding the target function identifier into the video stream pulling request.

Therefore, the function identification can replace the general working mode of the cloud mobile phone by the working mode of the local processing of the target equipment under the condition that the user does not feel (namely, the normal operation of the user is not influenced), the video data interacted between the user equipment and the cloud mobile phone server can be effectively reduced, and the time loss caused by the video data interaction can be reduced.

In a third aspect, an apparatus for video display of a cloud mobile phone is provided, where the apparatus is applied to a target device, and is configured to implement a method provided by the first aspect and a possible implementation manner of the first aspect.

In a fourth aspect, a device for displaying video of a cloud mobile phone is provided, and the device is applied to a cloud mobile phone server and is used for implementing the method provided by the second aspect and possible implementation manners thereof.

In a fifth aspect, a computer device is provided that includes a memory for storing computer instructions and a processor. The processor executes the computer instructions stored in the memory to cause the computer device to perform the method provided by the first aspect, the second aspect and possible implementations thereof.

In a sixth aspect, a computer readable storage medium is provided, the computer readable storage medium storing computer program code which, when executed by a computer device, performs the method provided by the first aspect, the second aspect and possible implementations thereof.

In a seventh aspect, a computer program product is provided, the computer program product comprising computer program code which, when executed by a computer device, performs the method provided by the first aspect, the second aspect and possible implementations thereof.

Drawings

Fig. 1 is a schematic structural diagram of a cloud mobile phone system according to an embodiment of the present disclosure;

fig. 2 is a schematic structural diagram of a user equipment according to an embodiment of the present disclosure;

fig. 3 is a schematic structural diagram of a cloud mobile phone server according to an embodiment of the present disclosure;

fig. 4 is a flowchart of a method for displaying video of a cloud mobile phone according to an embodiment of the present disclosure;

fig. 5 is a schematic structural diagram of a cloud mobile phone system according to an embodiment of the present disclosure;

fig. 6 is a schematic diagram of a video capturing process according to an embodiment of the present disclosure;

fig. 7 is a schematic diagram of a process flow of picture taking according to an embodiment of the disclosure;

FIG. 8 is a schematic diagram of a process flow of graphic code recognition according to an embodiment of the present disclosure;

FIG. 9 is a schematic diagram of a process flow for exiting video related functions provided by an embodiment of the present disclosure;

fig. 10 is a schematic structural diagram of a video display device of a cloud mobile phone according to an embodiment of the disclosure;

fig. 11 is a schematic structural diagram of a cloud mobile phone video display device according to an embodiment of the present disclosure.

Detailed Description

The embodiment of the disclosure provides a method for displaying video of a cloud mobile phone, which can be executed by a cloud mobile phone system. The cloud mobile phone system can be composed of a cloud mobile phone server and user equipment, and a system architecture diagram can be shown in fig. 1.

The cloud mobile phone server is used for completing main processing work in the use process of the cloud mobile phone and continuously sending interface images of the cloud mobile phone to the user equipment for display. The cloud mobile phone server can be used for running a system program and an application program of the cloud mobile phone and also can be used for running a management program of the cloud mobile phone, and the management program can be a component of the system program.

The user equipment is used for displaying the interface image sent by the cloud mobile phone server, and is used for collecting operation information (such as touch control information, space gesture information, physical key operation information and the like) of a user, sensor information (such as a light intensity sensor and a microphone) and the like and sending the operation information to the cloud mobile phone server. The user equipment can be operated with a cloud mobile phone client, the cloud mobile phone client is generally an application program in the user equipment, and related data receiving, sending and interface image display work are all responsible for the cloud mobile phone client.

The working process of the cloud mobile phone can be as follows:

the cloud handset server runs system programs and application programs (similar to the way a normal handset runs these programs). In operation, interface images are continually generated (e.g., at a frame rate of 30 frames/second) and sent to the user device. In the user equipment, the cloud mobile phone client can display the received interface image as if displaying a network video stream. From the user's point of view, the network video stream he sees is indistinguishable from a normal cell phone interface. At this time, the user may perform various operations on the user device, such as clicking, sliding, long pressing, and the like. And the cloud mobile phone client sends the corresponding operation information to the cloud mobile phone server for processing. The cloud mobile phone server processes the operation information in a similar way to that of a common mobile phone. In addition, the cloud mobile phone server can acquire sensor information from the user equipment based on requirements of a system program or an application program.

As shown in fig. 2, the user equipment may include a processor 210, a memory 220, a communication part 230, a display part 240, and the like.

The processor 210 may be a central processing unit (central processing unit, CPU) or a system on chip (SoC), etc., and the processor 210 may be configured to execute various instructions or data information related to the method, for example, to process touch operations, to process video stream pull requests, etc.

The memory 220 may include various volatile memories or nonvolatile memories, such as Solid State Disk (SSD), dynamic random access memory (dynamic random access memory, DRAM) memory, and the like. The memory 220 may be used to store pre-stored data, intermediate data, and result data in the content type conversion and display process, for example, temporarily stored video data, and the like.

The communication component 230 may be a wired network connector, a wireless fidelity (wireless fidelity, wiFi) module, a bluetooth module, a cellular network communication module, or the like. The communication unit 230 may be used for data transmission with other devices, which may be servers, other user devices, etc. For example, the user equipment may receive a video stream pulling request sent by the cloud mobile phone server, and may also send video data to the cloud mobile phone server for storage.

The display unit 240 may be a separate screen, or a screen, a projector, etc. integrated with the body of the user equipment, and the screen may be a touch screen, or may be a non-touch screen (may be remotely displayed), and the display unit 240 is used to display a system interface, an application interface, etc., for example, an interface of a target video processing program, etc.

In addition to the processor, memory, communication means and display means, the user device may also comprise audio acquisition means, audio output means etc. The audio capturing component may be a microphone for capturing the voice of the user. The audio output component may be a speaker, earphone, etc. for playing audio.

As shown in fig. 3, the cloud handset server may include a processor 310, a memory 320, and a communication component 330, among others.

The processor 310 may be a CPU, soC, or the like, and the processor 310 may be configured to execute various instructions, data information, or the like, related to the method, for example, to process camera video acquisition instructions, or the like.

The memory 320 may include various volatile memory or non-volatile memory, such as SSD, DRAM memory, and the like. The memory 320 may be used to store pre-stored data, intermediate data, and result data in the content type conversion and display process, for example, stored video data, etc.

The communication part 330 may be a wired network connector, a WiFi module, a bluetooth module, a cellular network communication module, etc. The communication unit 330 may also be used for data transmission with other devices, which may be other servers, user devices, etc. For example, the cloud mobile phone server may receive video data sent by the user equipment, and may also send a video stream pull request to the user equipment.

Based on the above application scenario, the embodiment of the present disclosure provides a method for displaying video of a cloud mobile phone, and the following details the corresponding process flow, as shown in fig. 4, may include the following steps:

401, when the cloud mobile phone runs the target application program, the cloud mobile phone server acquires a camera video acquisition instruction triggered by the target application program.

The target application program has a target function, and the target function is a function related to displaying video data collected by the camera, such as a camera function, a code scanning function and the like. In the embodiment of the present disclosure, the main content is described by taking the camera function as an example, and other cases are similar and will not be described again.

When a user wants to shoot an image in the process of using the cloud mobile phone, the user can operate on the user equipment to trigger the cloud mobile phone server to start a target application program and start a target function. When the target function is started, in the cloud mobile phone server, the target application program can send a camera video acquisition instruction to the system program. The instruction is used for instructing the system program to start the camera and acquiring video data acquired by the camera to feed back the video data to the target application program.

402, the cloud mobile phone server sends a video stream pulling request to the target device.

Wherein the target device may be a user device.

The management program can intercept the camera video acquisition instruction and acquire a function identifier corresponding to the current execution function of the target application program (the function identifier can be carried in the camera video acquisition instruction in the form of instruction parameters, or the function identifier can be a result obtained by identifying the current execution function of the target application program by the management program). The hypervisor may then generate a video stream pull request based on the cloud handset protocol, add a function identification to the video stream pull request, and send the video stream pull request to the target device. The function identifiers are used for marking and distinguishing different types of functions, different function identifiers can be allocated to each function, and the same type of functions in different application programs can have the same identifier. For example, camera functions may be set in the camera application, the instant messaging application, and the content sharing application, and accordingly, the function identifiers of the camera functions in the different applications may be the same. For another example, the code scanning function may be set in the instant messaging application, the payment application, and the shopping application, and accordingly, the function identifiers of the code scanning functions in the different applications may be the same.

A technician may develop several video processing programs in advance, each corresponding to a different type of function, as shown in fig. 5, each for performing processing of one type of function, for example, one video processing program for camera function processing and another video processing program for code scanning function processing. The interface of the video processing program can be designed with reference to the interface of the corresponding function, so that the video processing program can have a similar interface with the corresponding function in each application program. Furthermore, a table of correspondence between function identifiers and video processing programs may be stored in the cloud mobile phone client.

After receiving the video stream pulling request, the target device can transmit the video stream pulling request to the cloud mobile phone client for processing. The cloud mobile phone client can acquire the function identifier carried in the video stream pulling request, searches the target video processing program corresponding to the function identifier in the corresponding relation table, and further starts the target video processing program. In addition, after the target video processing program is started, the target device can switch the interface of the cloud mobile phone client to the background, and the interface of the target video processing program is displayed in the foreground in a full screen mode.

For example, when a user starts a camera application in a cloud mobile phone, a function identifier carried in a camera video acquisition instruction sent by a cloud mobile phone server is a camera function, a corresponding target video processing program started at a cloud mobile phone client may be a video processing program with the camera function, and an interface of the video processing program is identical or basically identical to an interface of the camera application in the cloud mobile phone.

Based on a general working mechanism of the cloud mobile phone, in the using process of the cloud mobile phone, the cloud mobile phone server always sends an interface image of the cloud mobile phone to the target equipment. After sending the video stream pulling request to the target device, the cloud mobile phone server can continuously send the interface image of the cloud mobile phone to the target device, or can stop sending the interface image of the cloud mobile phone to the target device. If the cloud mobile phone client is switched to the background, the interface is not required to be displayed, so that no interface image is available, normal display of the target equipment is not affected, and the target equipment currently displays a target video processing program.

403, the target device obtains and displays the locally acquired video data through a local target video processing program.

The target video processing program may send a camera video acquisition instruction to the system program of the target device (note that this system program is running in the target device and is not the same system program as the system program in the cloud handset server, nor is the corresponding camera video acquisition instruction the instruction mentioned in step 401). The system program controls the camera of the target device to start, and sends video data shot by the camera to the target video processing program. The target video processing program may display the video data.

For example, the target video processing program corresponds to a camera function, and then the target video processing program currently displays a camera interface in which video data collected by the camera in real time, i.e., a viewfinder image, is displayed. For another example, the target video processing program currently displays a code scanning interface, and video data acquired by the camera in real time, namely a two-dimensional code image, is displayed in the code scanning interface.

The target video processing program continuously displays the video data collected by the camera. Before the user does not further operate or the target video processing program does not process the video data to obtain a processing result, the target device does not need to send the collected video data to the cloud mobile phone server.

In the embodiment of the disclosure, further video processing can be performed based on the video data collected by the target device. The general working mode of the cloud mobile phone can be replaced by the working mode of the local processing of the target equipment (the general working mode is that all the processing is handed over to the cloud) under the condition that the user does not feel (namely, the normal operation of the user is not influenced), and the following various possible conditions are respectively introduced:

case one: the target video processing program is a program having a camera function, and can perform video capturing processing, as shown in fig. 6.

601, the target video processing program performs video shooting processing in response to a video shooting instruction in the target video processing program.

After the target video processing program is started and the interface of the target video processing program is displayed in the foreground, a view-finding frame can be included in the interface of the target video processing program, video data collected by a camera can be displayed in the view-finding frame, and some operation controls such as shooting controls can be further included in the interface. When a user observes a camera on target equipment to view, video data at the moment does not need to be sent to a cloud mobile phone server, when the user determines to start video shooting, a video shooting function can be selected on the target equipment, then a shooting control can be clicked on the target equipment, a video shooting instruction in a target video processing program is triggered, and the target video processing program can respond to the video shooting instruction to carry out video shooting processing.

602, after the video shooting process is finished, the cloud mobile phone client sends the recorded video file to the cloud mobile phone server.

The user can click the shooting control again to finish video shooting, the shot video data can be cached in the target device in the form of a video file, and the cloud mobile phone client can send the video file to the cloud mobile phone server. After sending the video stream pulling request, the cloud mobile phone server can start monitoring through a cloud mobile phone protocol, prepare to receive the video file sent by the cloud mobile phone client at any time, and when the cloud mobile phone server monitors that the cloud mobile phone client uploads the video file, the cloud mobile phone server can trigger the processing of the following steps.

603, the cloud mobile phone server stores the received video file.

After receiving the video file, the cloud mobile phone server can store the video file in a folder corresponding to the target application program. After the storage is successful, the cloud mobile phone server can send a notice of the successful storage to the cloud mobile phone client, and at the moment, the cloud mobile phone client can delete the cached video file; if the storage is not successful, the cloud mobile phone server can send a notification of the storage failure to the cloud mobile phone client, at this time, the cloud mobile phone client can resend the video file until receiving the notification of the storage success, and then delete the cached video file.

Or, the cloud mobile phone client may not delete the cached video file at present, and may select a subsequent time to delete the video file, for example, when exiting the target video processing program, or when exiting the cloud mobile phone client, or when reaching a certain data aging period (for example, 1 week), or when the target device is turned off or restarted. Therefore, if the user operates to play the video file, the target video processing program can directly play the video file cached by the target device without playing the video file through a cloud, so that the network resource occupation can be reduced.

And a second case: the target video processing program is a program having a camera function, and can perform a picture taking process, as shown in fig. 7.

701, in response to a picture taking instruction in a target video processing program, the target video processing program performs picture taking processing.

After the target video processing program is started and the interface of the target video processing program is displayed in the foreground, a view-finding frame can be included in the interface of the target video processing program, video data collected by a camera can be displayed in the view-finding frame, and some operation controls such as shooting controls can be further included in the interface. When a user observes a camera on target equipment to view a view, video data at the moment does not need to be sent to a cloud mobile phone server, when the user determines to start image shooting, an image shooting function can be selected on the target equipment, then a shooting control can be clicked on the target equipment, an image shooting instruction in a target video processing program is triggered, and the target video processing program can respond to the image shooting instruction to carry out image shooting processing.

702, after the picture shooting process is finished, the cloud mobile phone client sends a shot picture file to the cloud mobile phone server.

After clicking the shooting control, the user can complete one-time image shooting processing, a view finding frame is continuously displayed in an interface of the target device, shot video data can be cached in the target device in the form of an image file, and the cloud mobile phone client can send the image file to the cloud mobile phone server. After sending the video stream pulling request, the cloud mobile phone server can start monitoring through a cloud mobile phone protocol, prepare to receive the picture file sent by the cloud mobile phone client at any time, and when the cloud mobile phone server monitors that the cloud mobile phone client uploads the picture file, the cloud mobile phone server can trigger the following steps.

703, the cloud mobile phone server stores the received picture file.

After receiving the picture file, the cloud mobile phone server can store the picture file in a folder corresponding to the target application program. After the storage is successful, the cloud mobile phone server can send a notice of the successful storage to the cloud mobile phone client, and at the moment, the cloud mobile phone client can delete the cached picture file; if the storage is not successful, the cloud mobile phone server can send a notification of the storage failure to the cloud mobile phone client, at this time, the cloud mobile phone client can resend the picture file until receiving the notification of the storage success, and then delete the cached picture file.

And a third case: the target video processing program is a program having a code scanning function, and can perform a graphic code recognition process, as shown in fig. 8.

801, the target video processing program performs a graphic code recognition process based on the video data.

After the target video processing program is started and its interface is displayed in the foreground, a viewfinder may be included in the interface of the target video processing program, in which video data collected by the camera may be displayed. When a user observes a camera on target equipment to view, video data at the moment does not need to be sent to a cloud mobile phone server, and when the camera recognizes a complete and clear graphic code, a graphic code recognition instruction in a target video processing program can be triggered, and the target video processing program can perform graphic code recognition processing based on the video data.

And 802, after identifying the target data carried by the graphic code, sending the identified target data to the cloud mobile phone server.

After the identification processing of the graphic code is completed, a view finding frame can be continuously displayed in the interface, video data collected by a camera can be displayed in the view finding frame, at this time, target data carried by the identified graphic code can be cached in target equipment, and the cloud mobile phone client can send the target data to the cloud mobile phone server. After sending the video stream pulling request, the cloud mobile phone server can start monitoring through a cloud mobile phone protocol, prepare to receive target data sent by the cloud mobile phone client at any time, and when the cloud mobile phone server monitors that the cloud mobile phone client uploads the target data, the cloud mobile phone server can trigger the following steps.

803, the target application performs network access processing based on the target data.

After receiving the target data, the cloud mobile phone server can store the target data in a folder corresponding to the target application program. After the storage is successful, the cloud mobile phone server can send a notice of the successful storage to the cloud mobile phone client, and at the moment, the cloud mobile phone client can delete the cached target data; if the storage is not successful, the cloud mobile phone server can send a notice of storage failure to the cloud mobile phone client, at this time, the cloud mobile phone client can resend the target data until receiving the notice of storage success, and then delete the cached target data.

Alternatively, the graphic code recognition processing may be performed by the cloud mobile phone server, in which case, the target application may send the video data to the cloud mobile phone server, and after receiving the video data, the cloud mobile phone server may perform the graphic code recognition processing and store the recognized target data to the target application.

In the embodiment of the present disclosure, after the user uses the video related function, the user may operate to exit, and the corresponding process flow is shown in fig. 9, and may include the following steps:

and 901, closing the target video processing program in response to an exit instruction of the target video processing program, and switching the interface of the cloud mobile phone client to the foreground.

After the user has used the video related function, the user may click on the "return" control, or a gesture operation of "return". At this time, the cloud mobile phone client can close the target video processing program, and switch the interface of the cloud mobile phone client to the foreground full screen display.

902, the cloud mobile phone client sends a video display ending notification to the cloud mobile phone server.

When the target video processing program is closed, the cloud mobile phone client can send a video display ending notification to the cloud mobile phone server through a cloud mobile phone protocol.

The foregoing describes that, in the case that the interface of the cloud mobile phone client is switched to the background, when the cloud mobile phone server sends the interface image of the cloud mobile phone, there are two ways: mode one: the interface image of the cloud mobile phone can be continuously sent to the target equipment; mode two: the sending of the interface image of the cloud handset to the target device may be stopped.

When the cloud mobile phone server processes in the first mode, when the interface of the cloud mobile phone client is switched back to the front desk, the state of transmitting the cloud mobile phone interface image can be unchanged after the cloud mobile phone server receives the video display ending notification, namely the interface image of the cloud mobile phone is kept to be continuously transmitted. When the cloud mobile phone server processes in the second mode, the cloud mobile phone server can restart to send the interface image of the cloud mobile phone to the target equipment.

903, the cloud mobile phone server exits the current interface of the target application.

After receiving the video display end notification, the cloud mobile phone server can exit the current interface of the target application program, wherein the current interface can be the main interface of the target application program or a functional interface of the target application program. If the current interface is a functional interface of the target application program, the functional interface can be exited, and the previous interface of the functional interface in the target application program is returned; if the current interface is the main interface of the target application program, the target application program can be exited and the system program interface (such as a desktop) can be returned.

In addition to the exit processing manners of the above steps 901-903, other exit processing manners may be adopted, and the corresponding flow may be: the user can click on the return control, at this time, the cloud mobile phone client can send a video display ending notification to the cloud mobile phone server through the cloud mobile phone protocol, the cloud mobile phone server can exit the current interface of the target application program after receiving the notification and send an exit notification to the cloud mobile phone client, and after receiving the notification, the cloud mobile phone client can close the target video processing program and switch the interface of the cloud mobile phone client to the front desk.

In the embodiment of the disclosure, a scene that a plurality of devices use a cloud mobile phone simultaneously can be realized, and the cloud mobile phone can receive and store video files and picture files sent by the plurality of devices, wherein the plurality of devices comprise target devices.

When a plurality of devices log in the same cloud mobile phone, only one device can be set to have operation authority, and the device is assumed to be a target device, namely, the target device has the authority of watching and operating the cloud mobile phone, and other devices have the authority of watching the cloud mobile phone and have no authority of operating the cloud mobile phone. On the other hand, under the function of the camera, a plurality of devices can record video data and send the video data to the cloud mobile phone server.

When a user operates target equipment to run a target application program, the cloud mobile phone server can acquire a camera video acquisition instruction triggered by the target application program, and send video stream pulling requests to a plurality of equipment, wherein the video stream pulling requests can also carry target function identifiers.

Each device, after receiving the video stream pull request, may perform the following processing:

the cloud mobile phone client searches the video processing program corresponding to the function identifier in the corresponding relation table, and then the cloud mobile phone client can start the video processing program, and the video processing program is utilized to acquire and display locally acquired video data.

For each device, the target video processing program may perform video capture processing in response to video capture instructions in the target video processing program on the device. After the video shooting process is finished, the video data can be cached in a plurality of cloud mobile phone clients in the form of video files, the cloud mobile phone clients can send the video files to a cloud mobile phone server, and the cloud mobile phone server can receive the video files and store the video files to a target application program after monitoring the video files.

The cloud mobile phone server can receive and store video data, and when the storage is successful, the cloud mobile phone server can send a notice of the successful storage to a plurality of cloud mobile phone clients, and at the moment, the cloud mobile phone clients receiving the notice of the successful storage can delete the cached video data; when the storage fails, the cloud mobile phone server can send a notification of the storage failure to the cloud mobile phone client corresponding to the video data which fails to be stored, and the cloud mobile phone client receiving the notification of the storage failure can resend the video data until receiving the notification of the successful storage, and then delete the cached video data.

The image shooting instruction and the graphic code identification process are similar to those of the video shooting instruction, and are not repeated here.

When the user uses the video related function of the target device, the user can operate to exit, and the user can click the 'return' control or the gesture operation of 'return', at this time, the cloud mobile phone client can close the target video processing program and switch the interface of the cloud mobile phone client to the foreground. The cloud mobile phone client on the target device can send a video display ending notification to the cloud mobile phone server through a cloud mobile phone protocol. When the cloud mobile phone server receives the video display ending notification sent by the target device, the cloud mobile phone server can send the video display ending notification to other devices and exit the current interface of the target application program. When the other device receives the video display end notification, the video processing program is turned off. The user can click an album control in the target equipment, the cloud mobile phone client sends the operation information to the cloud mobile phone server, the cloud mobile phone server can open an album interface of the cloud mobile phone after receiving the operation information, and the stored video data are displayed, wherein the video data can comprise all video data sent to the cloud mobile phone server by a plurality of equipment.

Alternatively, the target device may obtain the usage of the video processing program of the other device, for example, when a certain device x ends recording video, the top message field of the target device may display "device x ends recording". If the user is operating to log out on the target device, there are other devices recording the video, a popup prompt may be popped up, "device y is still recording, determining to log out? The user of the target device can select 'exit', at this time, the device in recording stops recording, the video data recorded before exiting is cached, and the video data is sent to the cloud mobile phone server, or the user of the target device can select 'cancel', the exiting is canceled, and other devices which do not end recording can continue recording.

Based on the same technical concept, the embodiment of the present disclosure provides a device for displaying video of a cloud mobile phone, where the device is applied to a target device in the cloud mobile phone system, as shown in fig. 10, and the device includes:

the receiving module 1010 is configured to receive a video stream pull request sent by the cloud mobile phone server in a process of running the cloud mobile phone client. The processing functions of step 402 described above, as well as other implicit steps, may be implemented in particular.

And the display module 1020 is used for acquiring and displaying the locally acquired video data through a target video processing program locally of the target equipment. The processing functions of step 403 described above, as well as other implicit steps, may be implemented in particular.

In one possible implementation, the display module 1020 is further configured to: and switching the interface of the cloud mobile phone client to the background, and displaying the interface of the target video processing program on the foreground in a full screen mode. The processing functions of step 402 described above, as well as other implicit steps, may be implemented in particular.

In one possible implementation, the video stream pull request carries the target function identifier. The apparatus further includes a determination module 1030 for: and determining a target video processing program corresponding to the target function identifier based on the corresponding relation between the function identifier and the video processing program, wherein in the corresponding relation, any video processing program and the function to which the corresponding function identifier belongs have the same type of interface. The processing functions of step 402 described above, as well as other implicit steps, may be implemented in particular.

In one possible implementation, the apparatus further includes a video processing module 1040 to: responding to a video shooting instruction in a target video processing program, performing video shooting processing, and after the video shooting processing is finished, sending a recorded video file to a cloud mobile phone server; or, responding to a picture shooting instruction in the target video processing program, carrying out picture shooting processing, and after the picture shooting processing is finished, sending a shot picture file to the cloud mobile phone server; or based on the video data, carrying out graphic code identification processing, and after identifying the target data carried by the graphic code, sending the identified target data to the cloud mobile phone server. The processing functions of the above steps 601, 602, 701, 702, 801, 802, as well as other implicit steps, may be implemented in particular.

In one possible implementation, the apparatus further includes a deletion module 1050 configured to: after the recorded video data is sent to the cloud mobile phone server, deleting the recorded video data in the target equipment; or after the shot picture data are sent to the cloud mobile phone server, deleting the shot picture data in the target equipment. The processing functions of step 803 described above, as well as other implicit steps, may be implemented in particular.

In one possible implementation, the apparatus further includes an exit module 1060 for: closing the target video processing program in response to an exit instruction of the target video processing program; and switching the interface of the cloud mobile phone client to the foreground. The processing functions of step 901 described above, as well as other implicit steps, may be implemented in particular.

In one possible implementation, the exit module 1060 is further configured to: and sending a video display ending notification to the cloud mobile phone server. The processing functions of step 902 described above, as well as other implicit steps, may be implemented in particular.

The receiving module 1010, the display module 1020, the determining module 1030, the video processing module 1040, the deleting module 1050, and the exiting module 1060 may be implemented by a processor, or may be implemented by a processor in combination with a memory, a communication unit, and a display unit.

The embodiment of the disclosure also provides a device for displaying video of a cloud mobile phone, which is applied to the cloud mobile phone server in the cloud mobile phone system, as shown in fig. 11, and includes:

the acquiring module 1110 is configured to acquire a camera video acquisition instruction triggered by a target application program when the cloud mobile phone runs the target application program. The processing functions of step 401 described above, as well as other implicit steps, may be implemented in particular.

The sending module 1120 is configured to send a video stream pulling request to the target device, where the video stream pulling request is used to instruct the target device to acquire and display the acquired video data through the target video processing program. The processing functions of step 402 described above, as well as other implicit steps, may be implemented in particular.

In one possible implementation, the apparatus further includes a storage module 1130 configured to: receiving and storing a recorded video file or a shot picture file sent by target equipment; or receiving target data which is sent by the target equipment and is identified in the graphic code, and performing network access processing based on the target data. The processing functions of the above steps 603, 703, 803, as well as other implicit steps, may be implemented in particular.

In one possible implementation, the storage module 1130 is further configured to: and receiving and storing recorded video files or shot picture files transmitted by a plurality of devices, wherein the plurality of devices comprise target devices.

In one possible implementation, the apparatus further includes an exit module 1140 for: receiving a video display ending notification sent by target equipment; and exiting the current interface of the target application program. The processing functions of step 903 described above, as well as other implicit steps, may be implemented in particular.

In one possible implementation, the apparatus further includes an adding module 1150 configured to: acquiring a target function identifier corresponding to a current execution function of a target application program; the target function identification is added to the video stream pull request. The processing functions of step 402 described above, as well as other implicit steps, may be implemented in particular.

The acquisition module 1110, the sending module 1120, the storage module 1130, the exit module 1140, and the adding module 1150 may be implemented by a processor, or implemented by a processor in combination with a memory and a communication unit.

In the device for displaying the video of the cloud mobile phone provided in the above embodiment, only the division of the above functional modules is used for illustration, and in practical application, the above functional allocation may be completed by different functional modules according to needs, that is, the internal structure of the user equipment is divided into different functional modules, so as to complete all or part of the functions described above. In addition, the device for displaying the video of the cloud mobile phone provided in the above embodiment belongs to the same concept as the method embodiment for displaying the video of the cloud mobile phone, and detailed implementation processes of the device are shown in the method embodiment, and are not repeated here.

Embodiments of the present disclosure also provide a computer-readable storage medium. The computer readable storage medium may be any available medium that can be stored by a computing device or a data storage device such as a data center containing one or more available media. The usable medium may be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., digital video disk (digital video disk, DVD)), or a semiconductor medium (e.g., solid state disk), etc. The computer-readable storage medium includes instructions that direct a computing device to perform a method of business processing or direct a computing device to perform a method of business processing.

Finally, it should be noted that: the above embodiments are merely for illustrating the technical solution of the present disclosure, and are not limiting thereof; although the present disclosure has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some technical features thereof can be replaced by equivalents; these modifications or substitutions do not depart from the essence of the corresponding technical solutions from the protection scope of the technical solutions of the embodiments of the present disclosure.

Claims

1. A method for cloud mobile video display, wherein the method is applied to a target device, the target device operates with a cloud mobile client, the method comprising:

in the process of operating the cloud mobile phone client, receiving a video stream pulling request sent by a cloud mobile phone server;

and acquiring and displaying the locally acquired video data through a target video processing program locally of the target equipment.

2. The method of claim 1, wherein after receiving the video stream pull request sent by the cloud handset server, the method further comprises:

switching the interface of the cloud mobile phone client to a background;

and displaying the interface of the target video processing program on a foreground full screen.

3. The method according to claim 1 or 2, wherein the video stream pull request carries a target function identifier;

before the locally acquired video data is acquired and displayed by the target video processing program of the target device, the method further comprises:

and determining a target video processing program corresponding to the target function identifier based on a corresponding relation between the function identifier and the video processing program, wherein in the corresponding relation, any video processing program and the function to which the corresponding function identifier belongs have the same type of interface.

4. A method according to claim 3, characterized in that the function identification in the correspondence comprises a function identification of a camera function and/or a function identification of a code scanning function.

5. The method of any of claims 1-4, wherein after capturing and displaying locally acquired video data by a target video processing program local to the target device, the method further comprises:

responding to a video shooting instruction in the target video processing program, performing video shooting processing, and after the video shooting processing is finished, sending a recorded video file to the cloud mobile phone server; or,

responding to a picture shooting instruction in the target video processing program, carrying out picture shooting processing, and after the picture shooting processing is finished, sending a shot picture file to the cloud mobile phone server; or,

and carrying out graphic code identification processing based on the video data, and after identifying target data carried by the graphic code, sending the identified target data to the cloud mobile phone server.

6. The method of claim 5, wherein after sending the recorded video data to the cloud handset server, the method further comprises: deleting the recorded video data in the target device; or,

After the shot picture data is sent to the cloud mobile phone server, the method further comprises the following steps: and deleting the shot picture data in the target equipment.

7. The method of any of claims 1-6, wherein after capturing and displaying locally acquired video data by a target video processing program local to the target device, the method further comprises:

closing the target video processing program in response to an exit instruction of the target video processing program;

and switching the interface of the cloud mobile phone client to a foreground.

8. The method of claim 7, wherein after said shutting down said target video processing program, said method further comprises:

and sending a video display ending notification to the cloud mobile phone server.

9. The method for displaying the video of the cloud mobile phone is characterized by being applied to a cloud mobile phone server, wherein the cloud mobile phone server serves a cloud mobile phone client operated by target equipment, and the method comprises the following steps:

when a cloud mobile phone runs a target application program, acquiring a camera video acquisition instruction triggered by the target application program;

and sending a video stream pulling request to the target equipment, wherein the video stream pulling request is used for indicating the target equipment to acquire and display the acquired video data through a target video processing program.

10. The method of claim 9, wherein after sending a video stream pull request to the target device, the method further comprises:

receiving and storing a recorded video file or a shot picture file sent by the target equipment; or,

and receiving target data which is sent by the target equipment and is identified in the graphic code, and performing network access processing based on the target data.

11. The method according to claim 9, wherein the method further comprises:

and receiving and storing recorded video files or shot picture files transmitted by a plurality of devices, wherein the plurality of devices comprise the target device.

12. The method of any of claims 9-11, wherein after sending a video stream pull request to the target device, the method further comprises:

receiving a video display ending notification sent by the target equipment;

and exiting the current interface of the target application program.

13. The method according to any one of claims 9-12, wherein the method further comprises:

acquiring a target function identifier corresponding to a current execution function of the target application program;

And adding the target function identification to the video stream pulling request.

14. An apparatus for cloud mobile video display, wherein the apparatus is applied to a target device, and the target device operates with a cloud mobile client, and the apparatus comprises:

the receiving module is used for receiving a video stream pulling request sent by the cloud mobile phone server in the process of operating the cloud mobile phone client;

and the display module is used for acquiring and displaying the locally acquired video data through the target video processing program of the target equipment.

15. The apparatus of claim 14, wherein the display module is further configured to:

switching the interface of the cloud mobile phone client to a background;

16. The apparatus according to claim 14 or 15, wherein the video stream pull request carries a target function identifier;

the apparatus further comprises a determination module for:

17. The apparatus of claim 16, wherein the function identifiers in the correspondence comprise function identifiers of camera functions and/or function identifiers of code scanning functions.

18. The apparatus according to any one of claims 14-17, further comprising a video processing module for:

19. The apparatus of claim 18, further comprising a deletion module configured to:

after the recorded video data is sent to the cloud mobile phone server, deleting the recorded video data in the target equipment; or,

And deleting the shot picture data in the target equipment after the shot picture data are sent to the cloud mobile phone server.

20. The apparatus of any one of claims 14-19, further comprising an exit module to:

and switching the interface of the cloud mobile phone client to a foreground.

21. The apparatus of claim 20, wherein the exit module is further configured to:

22. A device for cloud mobile video display, the device being applied to a cloud mobile server serving a cloud mobile client operated by a target device, the device comprising:

the acquisition module is used for acquiring a camera video acquisition instruction triggered by a target application program when the cloud mobile phone runs the target application program;

the sending module is used for sending a video stream pulling request to the target equipment, wherein the video stream pulling request is used for indicating the target equipment to acquire and display the acquired video data through a target video processing program.

23. The apparatus of claim 22, further comprising a storage module for:

24. The apparatus of claim 22, wherein the memory module is further configured to:

25. The apparatus of any one of claims 22-24, further comprising an exit module configured to:

receiving a video display ending notification sent by the target equipment;

and exiting the current interface of the target application program.

26. The apparatus according to any one of claims 22-25, further comprising an adding module for:

27. A computer device comprising a memory and a processor, the memory for storing computer instructions;

the processor executes the computer instructions stored in the memory to cause the computer device to perform the method of any one of the preceding claims 1-13.

28. A computer readable storage medium, characterized in that the computer readable storage medium stores computer program code which, when executed by a computer device, performs the method of any of the preceding claims 1-13.