WO2023078142A1 - Image acquisition method and apparatus, device, storage medium, and program product - Google Patents

Image acquisition method and apparatus, device, storage medium, and program product Download PDF

Info

Publication number
WO2023078142A1
WO2023078142A1 PCT/CN2022/127760 CN2022127760W WO2023078142A1 WO 2023078142 A1 WO2023078142 A1 WO 2023078142A1 CN 2022127760 W CN2022127760 W CN 2022127760W WO 2023078142 A1 WO2023078142 A1 WO 2023078142A1
Authority
WO
WIPO (PCT)
Prior art keywords
camera
client
brightness
image acquisition
cloud application
Prior art date
Application number
PCT/CN2022/127760
Other languages
French (fr)
Chinese (zh)
Inventor
周立群
陈娇
Original Assignee
北京百度网讯科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 北京百度网讯科技有限公司 filed Critical 北京百度网讯科技有限公司
Publication of WO2023078142A1 publication Critical patent/WO2023078142A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/72409User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/72427User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality for supporting games or graphical animations
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/7243User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages
    • H04M1/72439User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages for image or video messaging
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72448User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions
    • H04M1/72463User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions to restrict the functionality of the device
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D30/00Reducing energy consumption in communication networks
    • Y02D30/70Reducing energy consumption in communication networks in wireless communication networks

Definitions

  • the present disclosure relates to the technical field of cloud computing, for example, to an image acquisition method, device, equipment, storage medium and program product.
  • the cloud mobile phone is a mobile phone running on the cloud.
  • the cloud mobile phone client installed in the local mobile phone can project the screen of the cloud mobile phone to the local mobile phone, so that the user can control the cloud mobile phone to perform operations such as data calculation and image rendering and encoding through the touch screen of the local mobile phone. It is only used as a display terminal to display the content in the cloud phone to the user.
  • the disclosure provides an image acquisition method, device, equipment, storage medium and program product.
  • the present disclosure provides an image acquisition method, including:
  • the client In response to the image acquisition request, acquire the window brightness of the target cloud application, and send a camera opening request and the window brightness of the target cloud application to the client, to instruct the client to use the window brightness of the target cloud application
  • the brightness controls the screen brightness of the client, turns on the camera according to the camera opening request, and uses the camera to collect images based on the controlled screen brightness of the client.
  • the present disclosure provides an image acquisition method, including:
  • the camera opening request and the window brightness of the target cloud application are determined in response to the image acquisition request initiated by the target cloud application;
  • the present disclosure provides an image acquisition device, including:
  • the image acquisition request acquisition module is configured to acquire the image acquisition request initiated by the target cloud application
  • the camera opening request sending module is configured to respond to the image acquisition request, obtain the window brightness of the target cloud application, and send the camera opening request and the window brightness of the target cloud application to the client to instruct the client Control the screen brightness of the client according to the window brightness of the target cloud application, turn on the camera according to the camera opening request, and use the camera to collect images based on the controlled screen brightness of the client.
  • the present disclosure provides an image acquisition device, including:
  • the camera opening request acquisition module is configured to obtain the camera opening request and the window brightness of the target cloud application; the camera opening request and the window brightness of the target cloud application are determined in response to the image acquisition request initiated by the target cloud application;
  • the image acquisition module is configured to control the screen brightness of the client according to the window brightness of the target cloud application, turn on the camera according to the camera opening request, and use the camera to perform image acquisition based on the controlled screen brightness of the client.
  • the present disclosure provides an electronic device, including:
  • the memory stores instructions executable by at least one processor, and the instructions are executed by at least one processor, so that the at least one processor can execute the image acquisition method of any embodiment of the present disclosure.
  • the present disclosure provides a non-transitory computer-readable storage medium storing computer instructions, wherein the computer instructions are used to cause a computer to execute the image acquisition method of any embodiment of the present disclosure.
  • the present disclosure provides a computer program product, including a computer program.
  • the computer program is executed by a processor, the image acquisition method of any embodiment of the present disclosure is implemented.
  • the embodiment of the present disclosure can realize the acquisition of the client's local image data on the cloud mobile phone.
  • FIG. 1 is a schematic diagram of an image acquisition method provided according to an embodiment of the present disclosure
  • Fig. 2 is a schematic diagram of an image acquisition method provided according to an embodiment of the present disclosure
  • Fig. 3 is a schematic diagram of an image acquisition method provided according to an embodiment of the present disclosure.
  • Fig. 4 is a schematic diagram of an image acquisition method provided according to an embodiment of the present disclosure.
  • Fig. 5 is a scene diagram of an image acquisition method provided according to an embodiment of the present disclosure.
  • Fig. 6 is a schematic diagram of an image acquisition device provided according to an embodiment of the present disclosure.
  • Fig. 7 is a schematic diagram of an image acquisition device provided according to an embodiment of the present disclosure.
  • FIG. 8 is a block diagram of an electronic device implementing an image acquisition method of an embodiment of the present disclosure.
  • Fig. 1 is a flow chart of an image acquisition method according to an embodiment of the present disclosure. This embodiment may be applicable to a situation where a cloud application acquires local image data by calling a camera of a client device.
  • the method in this embodiment can be executed by an image acquisition device, which can be implemented in the form of software and/or hardware, and configured in an electronic device with data computing capabilities.
  • the electronic device can be a client device or a server device, and the client End devices such as mobile phones, tablet computers, vehicle terminals and desktop computers.
  • the target cloud application is an application running on the cloud phone that needs to obtain image data of the client.
  • the target cloud application is an instant messaging application or an online game application running on the cloud phone that needs face recognition.
  • the target cloud application in order to obtain the face image of the client user and perform face recognition when the user logs in or registers, the target cloud application needs to send an image acquisition request to the cloud mobile phone to instruct the cloud mobile phone to obtain the image of the client user Data, the cloud mobile phone first obtains the image acquisition request initiated by the target cloud application, and obtains the image data collected by the client in response to the image acquisition request.
  • the cloud mobile phone acquires the image acquisition request initiated by the target cloud application, it acquires the window brightness of the target cloud application.
  • the cloud mobile phone sends a camera opening request and the window brightness of the target cloud application to the client.
  • the cloud mobile phone acquires the window brightness of the cloud application so that the client can adjust the screen brightness before image collection, so as to improve the quality of the image collected by the camera.
  • the camera opening request is used to instruct the client to turn on the camera, and use the camera to collect image data based on the controlled screen brightness of the client, so as to obtain the image data of the client on the cloud mobile terminal and improve the acquired image data by adjusting the screen brightness.
  • the quality of the image data is used to instruct the client to turn on the camera, and use the camera to collect image data based on the controlled screen brightness of the client, so as to obtain the image data of the client on the cloud mobile terminal and improve the acquired image data by adjusting the screen brightness.
  • the cloud mobile phone acquires the facial video acquisition request initiated by the game application A, it acquires the brightness of the window corresponding to the game application A.
  • the cloud mobile phone sends the camera opening request and the window brightness of the target cloud application to the client to control the client to adjust the current screen brightness according to the window brightness of the target cloud application, so that the screen brightness of the client is consistent with the window brightness of the target cloud application, and
  • the screen brightness is adjusted, turn on the camera to collect face video, realize face recognition in the cloud, and adjust the screen brightness to make the face video acquired by the cloud mobile phone clearer, thereby improving the accuracy of face recognition.
  • the technical solution of the embodiment of the present disclosure obtains the image acquisition request initiated by the target cloud application, and then responds to the image acquisition request to obtain the window brightness of the target cloud application, and sends the camera opening request and the window brightness of the target cloud application to the client to obtain Instruct the client to control the client's screen brightness according to the window brightness of the target cloud application, and turn on the camera according to the camera opening request, and use the camera to collect images based on the controlled client's screen brightness, realizing the acquisition of the client's local image data on the cloud mobile phone Effect.
  • Fig. 2 is a schematic diagram of an image acquisition method in an embodiment of the present disclosure.
  • it is provided to obtain the window brightness of the target cloud application in response to an image acquisition request, and send a camera opening request and The steps of the window brightness of the target cloud application, and the steps after sending the camera opening request and the window brightness of the target cloud application to the client.
  • An image acquisition method provided by an embodiment of the present disclosure will be described below with reference to FIG. 2, and the method includes the following steps:
  • S220 through the operating system of the cloud mobile phone, in response to the image acquisition request, start the camera driver of the cloud mobile phone, obtain the window brightness of the target cloud application, and send the window brightness of the target cloud application to the remote interactive service.
  • the camera driver is turned on in response to the image acquisition request to acquire the image data fed back by the client.
  • the operating system of the cloud mobile phone also needs to obtain the window brightness of the target cloud application, and send the window brightness to the remote interactive service in the cloud mobile phone.
  • the remote interactive service can send the window brightness to the client, so that the client Adjust the brightness of the screen based on the brightness of the window to improve the clarity of the collected image data.
  • the operating system of the cloud phone obtains the face video acquisition request initiated by the game application A
  • the camera driver of the cloud phone is turned on, and in order to improve the quality of the acquired face video, the operating system of the cloud phone acquires the target The window brightness of the cloud application, and send the window brightness to the remote-play in the cloud phone.
  • the remote interactive service monitors that the camera driver of the cloud mobile phone is started, send a camera start request and the window brightness of the target cloud application to the client through the control service, so as to instruct the client to use the target cloud application
  • the screen brightness of the client is controlled by the brightness of the window, the camera is turned on according to the camera opening request, and image acquisition is performed using the camera based on the controlled screen brightness of the client.
  • the remote interactive service in the cloud mobile phone will monitor the camera status of the cloud mobile phone.
  • the remote interactive service detects that the camera driver of the cloud mobile phone starts, it indicates that the target cloud application running on the cloud mobile phone needs to obtain the client Collected image data, at this time, the remote interactive service will send the camera opening request and the window brightness of the target cloud application to the control service to instruct the control service to send the camera opening request and the window brightness of the target cloud application to the client, thereby instructing the client Control the screen brightness of the client according to the window brightness of the target cloud application, and turn on the camera for image data collection after the screen brightness is adjusted. While realizing the transmission of the image data collected by the client to the cloud mobile phone for authentication on the cloud mobile phone, through Adjust the brightness of the screen to improve the success rate of authentication.
  • the client after the cloud mobile phone sends a camera opening request to the client, the client will respond to the request to open the camera to collect image data, and then feed back the collected image data to the cloud mobile phone.
  • the client first encodes the collected image data, and then sends the encoded image data to the control service through a custom streaming media protocol, and the control service sends the received image data to the remote interactive service of the cloud mobile phone, remote interactive service
  • the control service After receiving the image data sent by the client through the control service, it decodes the image data, converts the decoded image data into a set format, and finally writes the image data in the set format to the camera driver of the cloud mobile phone.
  • the client performs H.264 encoding on the collected image data, and then sends the encoded image data to the remote interactive service of the cloud mobile phone through the control service, and the remote interactive service performs H.264 encoding on the received image data.
  • the image data in YUV format is obtained, and the image data in YUV format is converted into RGBA format, and then the image data in RGBA format is written to the camera driver of the cloud phone.
  • the operating system of the cloud phone when the camera driver of the cloud phone is started, the operating system of the cloud phone will monitor the camera driver in real time. After the remote interactive service writes the image data to the camera driver of the cloud phone, the cloud phone’s Driven by the monitoring camera, the operating system obtains the image data fed back by the client, and provides the image data to the target cloud application, so that the target cloud application performs identity recognition and authentication based on the image data collected by the client.
  • the target cloud application after obtaining the image data fed back by the client, the target cloud application performs identity authentication and identification according to the image data. After the identity authentication and identification is completed, the target cloud application will send an image termination request to the operating system of the cloud mobile phone, The operating system of the cloud mobile phone, in response to the image termination request initiated by the target cloud application, first shuts down the camera driver of the cloud mobile phone to indicate to stop receiving the image data fed back by the client.
  • the remote interactive service in the cloud phone detects that the camera driver of the cloud phone is turned off, it will send a camera shutdown request to the control service to instruct the control service to send the camera shutdown request to the client, so that the client turns off the camera , stop the collection of image data, and avoid the situation of high power consumption caused by the untimely shutdown of the camera.
  • the operating system of the cloud mobile phone in response to the image acquisition request, starts the camera driver of the cloud mobile phone, obtains the window brightness of the target cloud application, sends the window brightness to the remote interactive service in the cloud mobile phone, and After the remote interactive service monitors that the camera driver of the cloud mobile phone starts, the control service sends the camera opening request and the window brightness of the target cloud application to the client, and then obtains the image data fed back by the client from the control service through the remote interactive service, and Convert the image data into a set format and write it to the camera driver of the cloud phone.
  • the image data obtained by the camera driver of the cloud phone is provided to the target cloud application, and the client can be obtained on the cloud phone.
  • the image data is obtained, and the quality of the obtained image data is improved by adjusting the brightness of the screen, thereby improving the success rate of identity authentication and identification based on the image data.
  • Fig. 3 is a flow chart of an image acquisition method according to an embodiment of the present disclosure. This embodiment may be applicable to a situation where a cloud application obtains local image data by calling a camera of a client device.
  • the method in this embodiment can be executed by an image acquisition device, which can be implemented in the form of software and/or hardware, and configured in an electronic device with data computing capabilities.
  • the electronic device can be a client device or a server device, and the client End devices such as mobile phones, tablet computers, vehicle terminals and desktop computers.
  • the client receives the camera opening request sent by the cloud mobile phone through the control service and the window brightness of the target cloud application, adjusts the screen brightness based on the window brightness of the target cloud application, and starts the camera for image acquisition based on the camera opening request .
  • the camera opening request and the window brightness of the target cloud application are determined by the operating system of the cloud mobile phone in response to the image acquisition request initiated by the cloud application.
  • the client after receiving the window brightness of the target cloud application and the camera opening request, the client can first control the screen brightness of the client according to the window brightness of the target cloud application, so as to ensure the quality of subsequent captured images. Based on the adjusted screen brightness, the camera is turned on for image acquisition. Adjusting the brightness of the screen before image acquisition can improve the quality of the acquired image.
  • the client after the client obtains the window brightness of the target cloud application and the camera opening request, it first compares the client's initial screen brightness with the window brightness of the target cloud application, and if the client's initial screen brightness is lower than that of the target cloud application Window brightness, adjust the initial screen brightness of the client to the window brightness of the target cloud application, and then turn on the camera to collect face video.
  • the client By increasing the screen brightness, the collected face video is clearer, thereby improving the accuracy of face recognition.
  • the screen brightness of the client is controlled according to the window brightness of the target cloud application
  • the camera is turned on according to the camera opening request, and based on the controlled client's screen Brightness uses the camera to collect images, which can achieve the effect of obtaining local image data of the client in the cloud mobile phone, and improve the clarity of the collected images.
  • Fig. 4 is a schematic diagram of an image acquisition method in an embodiment of the present disclosure.
  • a step of controlling the brightness of the client's screen according to the brightness of the window of the target cloud application is provided, and based on the controlled client's screen Brightness is the step after image acquisition using the camera.
  • An image acquisition method provided by an embodiment of the present disclosure will be described below with reference to FIG. 2, and the method includes the following steps:
  • the client after the client obtains the camera opening request and the window brightness of the target cloud application, it first obtains the initial screen brightness of the client, and compares the initial screen brightness of the client with the window brightness of the target cloud application to obtain Determine whether the current screen brightness of the client meets the brightness required by the target cloud application for image data collection.
  • the brightness of the initial screen of the client can be adjusted to the brightness of the window of the target cloud application to ensure the quality of the collected image data .
  • S450 Use the camera to collect images based on the controlled screen brightness of the client.
  • the cloud application after the cloud application completes the user identity authentication based on the image data fed back by the client, it sends an image termination request to the cloud mobile phone.
  • the cloud mobile phone sends a camera shutdown request to the client through the control service. After receiving the camera shutdown request sent by the cloud mobile phone through the control service, the camera is turned off to reduce the high power consumption of the device caused by the camera not being turned off in time.
  • the client after turning off the camera, the client obtains the initial screen brightness stored before adjusting the screen brightness, and restores the current screen brightness to the initial screen brightness, which satisfies the needs of the user to use the device normally after image collection is completed. Improve user experience.
  • the technical solution of the embodiment of the present disclosure obtains the camera opening request and the window brightness of the target cloud application, and then compares the initial screen brightness of the client with the window brightness of the target cloud application, and compares the initial screen brightness of the client with the window brightness of the target cloud application
  • the brightness is inconsistent
  • store the initial screen brightness of the client and adjust the initial screen brightness of the client to the window brightness, turn on the camera according to the camera opening request, and use the camera to perform image acquisition based on the controlled screen brightness of the client.
  • the target cloud application completes identity authentication based on the collected image data
  • the client responds to the camera shutdown request, turns off the camera, and restores the current screen brightness of the client according to the stored initial screen brightness of the client.
  • the clarity of the received image data improves the success rate of identity authentication.
  • the camera is turned off in time to avoid the waste of equipment power caused by the untimely turn off of the camera, and the client’s screen brightness is turned off after the camera is turned off. Restore to the initial screen brightness of the client to improve user experience.
  • FIG. 5 is a scene diagram of an image acquisition method provided according to an embodiment of the present disclosure. The following describes an image acquisition method provided by an embodiment of the present disclosure in conjunction with FIG. 5 , and the method includes the following steps:
  • the operating system of the cloud phone acquires an image acquisition request initiated by the target cloud application, and acquires the window brightness of the target cloud application in response to the image acquisition request.
  • the cloud phone operating system starts a camera driver of the cloud phone in response to the image acquisition request.
  • the cloud phone operating system sends the acquired window brightness of the target cloud application to the remote interactive service of the cloud phone.
  • the control service transmits the camera opening request and the window brightness of the target cloud application to the client.
  • the client obtains the camera opening request and the window brightness of the target cloud application, controls the screen brightness of the client according to the window brightness of the target cloud application, turns on the camera according to the camera opening request, and uses the camera to collect images based on the controlled screen brightness of the client.
  • the client transmits the collected image data to the control service through a custom streaming media protocol.
  • the remote control interaction service After receiving the image data, the remote control interaction service writes the image data into the camera driver of the cloud mobile phone.
  • the operating system of the cloud mobile phone is driven by the monitoring camera to obtain image data fed back by the client.
  • the operating system of the cloud mobile phone sends the obtained image data to the target cloud application, so that the target cloud application performs identity authentication according to the obtained image data.
  • the cloud phone operating system closes the camera driver of the cloud phone in response to the image termination request.
  • the remote interactive service detects that the camera driver is turned off.
  • the remote interactive service After detecting that the camera driver is closed, the remote interactive service sends a camera close request to the control service.
  • the control service transparently transmits the camera shutdown request to the client.
  • the client turns off the camera and restores the screen brightness to the initial screen brightness.
  • the image data collected by the client in real time can be acquired on the cloud mobile terminal, thereby realizing real-time user identity authentication on the cloud mobile terminal.
  • FIG. 6 is a structural diagram of an image acquisition apparatus in an embodiment of the present disclosure, and the embodiment of the present disclosure is applicable to the case of acquiring local image data by calling a camera of a client device.
  • the device is implemented by software and/or hardware, and is configured in electronic equipment with certain data computing capabilities.
  • An image acquisition device 600 as shown in FIG. 6 comprising: an image acquisition request acquisition module 610 and a camera opening request sending module 620; wherein, the image acquisition request acquisition module 610 is configured to acquire an image acquisition request initiated by a target cloud application;
  • the camera opening request sending module 620 is configured to obtain the window brightness of the target cloud application in response to the image acquisition request, and send the camera opening request and the window brightness of the target cloud application to the client to instruct the client
  • the terminal controls the screen brightness of the client according to the window brightness of the target cloud application, turns on the camera according to the camera opening request, and uses the camera to collect images based on the controlled screen brightness of the client.
  • the technical solution of the embodiment of the present disclosure obtains the image acquisition request initiated by the target cloud application, and then responds to the image acquisition request to obtain the window brightness of the target cloud application, and sends the camera opening request and the window brightness of the target cloud application to the client to obtain Instruct the client to control the client's screen brightness according to the window brightness of the target cloud application, turn on the camera according to the camera opening request, and use the camera to collect images based on the controlled client's screen brightness, realizing the acquisition of the client's local image data on the cloud mobile phone Effect.
  • the camera opening request sending module 620 includes: a driver opening unit, configured to respond to the image acquisition request through the operating system of the cloud mobile phone, to open the camera driver of the cloud mobile phone, and obtain the window brightness of the target cloud application, Send the window brightness of the target cloud application to the remote interactive service in the cloud mobile phone; the camera opening request sending unit is set to after the remote interactive service monitors that the camera driver of the cloud mobile phone starts, through the control service Sending a camera opening request and the window brightness of the target cloud application to the client.
  • a driver opening unit configured to respond to the image acquisition request through the operating system of the cloud mobile phone, to open the camera driver of the cloud mobile phone, and obtain the window brightness of the target cloud application, Send the window brightness of the target cloud application to the remote interactive service in the cloud mobile phone
  • the camera opening request sending unit is set to after the remote interactive service monitors that the camera driver of the cloud mobile phone starts, through the control service Sending a camera opening request and the window brightness of the target cloud application to the client.
  • the image acquisition device 600 also includes: an image data acquisition module, configured to obtain the image data fed back by the client from the control service through the remote interactive service in the cloud mobile phone, and convert the image data into a set format before writing into the camera driver of the cloud phone; the image data providing module is configured to provide the target cloud application with the image data written into the camera driver of the cloud phone through the operating system of the cloud phone.
  • an image data acquisition module configured to obtain the image data fed back by the client from the control service through the remote interactive service in the cloud mobile phone, and convert the image data into a set format before writing into the camera driver of the cloud phone
  • the image data providing module is configured to provide the target cloud application with the image data written into the camera driver of the cloud phone through the operating system of the cloud phone.
  • the image acquisition device 600 also includes: a drive closing module, which is set to close the camera driver of the cloud mobile phone in response to the image termination request initiated by the target cloud application through the operating system of the cloud mobile phone; the camera closing request sending module is set to After the remote interaction service in the cloud mobile phone detects that the camera driver of the cloud mobile phone is turned off, a camera close request is sent to the client through the control service to instruct the client to turn off the camera.
  • a drive closing module which is set to close the camera driver of the cloud mobile phone in response to the image termination request initiated by the target cloud application through the operating system of the cloud mobile phone
  • the camera closing request sending module is set to After the remote interaction service in the cloud mobile phone detects that the camera driver of the cloud mobile phone is turned off, a camera close request is sent to the client through the control service to instruct the client to turn off the camera.
  • the image acquisition device provided in the embodiments of the present disclosure can execute the image acquisition method provided in any embodiment of the present disclosure, and has corresponding functional modules and effects for executing the method.
  • FIG. 7 is a structural diagram of an image acquisition apparatus in an embodiment of the present disclosure, and the embodiment of the present disclosure is applicable to the case of acquiring local image data by calling a camera of a client device.
  • the device is implemented by software and/or hardware, and is configured in electronic equipment with certain data computing capabilities.
  • An image acquisition device 700 as shown in FIG. 7 comprising: a camera opening request acquisition module 710 and an image acquisition module 720; wherein the camera opening request acquisition module 710 is configured to acquire the camera opening request and the window brightness of the target cloud application; The camera opening request and the window brightness of the target cloud application are determined in response to the image acquisition request initiated by the target cloud application; the image acquisition module 720 is configured to control the screen brightness of the client according to the window brightness of the target cloud application, The camera is turned on according to the camera turn-on request, and the camera is used to collect images based on the controlled screen brightness of the client.
  • the technical solution of the embodiment of the present disclosure obtains the camera opening request and the window brightness of the target cloud application, and then controls the screen brightness of the client according to the window brightness of the target cloud application, opens the camera according to the camera opening request, and based on the controlled client's
  • the screen brightness uses the camera for image collection, realizing the effect of obtaining the local image data of the client in the cloud mobile phone.
  • the image acquisition module 720 includes: a brightness comparison unit configured to compare the initial screen brightness of the client with the window brightness of the target cloud application; a brightness adjustment unit configured to compare the brightness of the initial screen of the client with the brightness of the target cloud application. If the window brightness of the target cloud application is inconsistent, store the initial screen brightness of the client, and adjust the initial screen brightness of the client to the window brightness of the target cloud application.
  • the image acquisition device 700 also includes: a camera closing module, configured to close the camera in response to the camera closing request; a brightness restoration module, configured to adjust the current screen brightness of the client according to the stored initial screen brightness of the client. to recover.
  • a camera closing module configured to close the camera in response to the camera closing request
  • a brightness restoration module configured to adjust the current screen brightness of the client according to the stored initial screen brightness of the client. to recover.
  • the image acquisition device provided in the embodiments of the present disclosure can execute the image acquisition method provided in any embodiment of the present disclosure, and has corresponding functional modules and effects for executing the method.
  • the present disclosure also provides an electronic device, a readable storage medium, and a computer program product.
  • FIG. 8 shows a schematic block diagram of an example electronic device 800 in which embodiments of the present disclosure may be implemented.
  • Electronic devices may be various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other computers.
  • Electronic devices may also be various forms of mobile devices, such as personal digital processing, cellular telephones, smart phones, wearable devices, and other computing devices.
  • the components shown herein, their connections and relationships, and their functions, are by way of example only, and are not intended to limit implementations of the disclosure described and/or claimed herein.
  • the device 800 includes a computing unit 801 that can be loaded into a random access memory (Random Access Memory, RAM) according to a computer program stored in a read-only memory (Read-Only Memory, ROM) 802 or from a storage unit 808. ) 803 to perform various actions and processes. In the RAM 803, various programs and data necessary for the operation of the device 800 can also be stored.
  • the computing unit 801, ROM 802, and RAM 803 are connected to each other through a bus 804.
  • An input/output (Input/Output, I/O) interface 805 is also connected to the bus 804 .
  • the I/O interface 805 includes: an input unit 806, such as a keyboard, a mouse, etc.; an output unit 807, such as various types of displays, speakers, etc.; a storage unit 808, such as a magnetic disk, an optical disk, etc. ; and a communication unit 809, such as a network card, a modem, a wireless communication transceiver, and the like.
  • the communication unit 809 allows the device 800 to exchange information/data with other devices over a computer network such as the Internet and/or various telecommunication networks.
  • Computing unit 801 may be various general-purpose and/or special-purpose processing components having processing and computing capabilities. Some examples of computing unit 801 include, but are not limited to, a central processing unit (Central Processing Unit, CPU), a graphics processing unit (Graphics Processing Unit, GPU), various dedicated artificial intelligence (Artificial Intelligence, AI) computing chips, various operating The computing unit of the machine learning model algorithm, the digital signal processor (Digital Singnal Processor, DSP), and any kind of processor, controller, microcontroller, etc.
  • the calculation unit 801 executes various methods and processes described above, such as an image acquisition method.
  • the image acquisition method may be implemented as a computer software program tangibly embodied on a machine-readable medium, such as storage unit 808 .
  • part or all of the computer program may be loaded and/or installed on the device 800 via the ROM 802 and/or the communication unit 809.
  • the computer program When the computer program is loaded into RAM 803 and executed by computing unit 801, one or more steps of the image acquisition method described above may be performed.
  • the computing unit 801 may be configured in any other way (for example, by means of firmware) to execute the image acquisition method.
  • programmable processor can be special-purpose or general-purpose programmable processor, can receive data and instruction from storage system, at least one input device, and at least one output device, and transmit data and instruction to this storage system, this at least one input device, and this at least one output device an output device.
  • Program codes for implementing the methods of the present disclosure may be written in any combination of one or more programming languages. These program codes can be provided to processors or controllers of general-purpose computers, special-purpose computers, or other programmable data processing devices, so that when the program codes are executed by the processors or controllers, the functions/functions specified in the flowcharts and/or block diagrams Action is implemented.
  • the program code may execute entirely on the machine, partly on the machine, as a stand-alone software package partly on the machine and partly on a remote machine or entirely on the remote machine or server.
  • a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, apparatus, or device.
  • a machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium.
  • a machine-readable medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any combination of the foregoing.
  • a machine-readable storage medium includes one or more wire-based electrical connections, a portable computer disk, a hard disk, RAM, ROM, Erasable Programmable Read-Only Memory (EPROM) or flash memory. Flash memory, fiber optics, Compact Disc Read-Only Memory (CD-ROM), optical storage devices, magnetic storage devices, or any combination of the above.
  • the systems and techniques described herein can be implemented on a computer having a display device (e.g., a cathode ray tube (CRT) or a liquid crystal display ( Liquid Crystal Display (LCD)); and a keyboard and pointing device (e.g., a mouse or trackball) through which a user can provide input to the computer.
  • a display device e.g., a cathode ray tube (CRT) or a liquid crystal display ( Liquid Crystal Display (LCD)
  • a keyboard and pointing device e.g., a mouse or trackball
  • Other types of devices may also be configured to provide interaction with the user; for example, the feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and may be in any form (including Acoustic input, speech input or, tactile input) to receive input from the user.
  • the systems and techniques described herein can be implemented in a computing system that includes back-end components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes front-end components (e.g., as a a user computer having a graphical user interface or web browser through which a user can interact with embodiments of the systems and techniques described herein), or including such backend components, middleware components, Or any combination of front-end components in a computing system.
  • the components of the system can be interconnected by any form or medium of digital data communication, eg, a communication network. Examples of communication networks include: Local Area Network (LAN), Wide Area Network (Wide Area Network, WAN), and the Internet.
  • a computer system may include clients and servers.
  • Clients and servers are generally remote from each other and typically interact through a communication network.
  • the relationship of client and server arises by running a computer program having a client-server relationship on the respective computers.
  • the server can be a cloud server, a server of a distributed system, or a server combined with a blockchain.
  • Steps can be reordered, added, or removed from the various forms of flow shown above.
  • steps described in the present disclosure may be executed in parallel, sequentially, or in a different order, as long as the desired result of the technical solution of the present disclosure can be achieved, there is no limitation herein.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Business, Economics & Management (AREA)
  • General Business, Economics & Management (AREA)
  • Telephonic Communication Services (AREA)
  • Studio Devices (AREA)

Abstract

The present disclosure provides an image acquisition method and apparatus, a device, a storage medium, and a program product. The implementation solution is: acquiring an image acquisition request initiated by a target cloud application; and in response to the image acquisition request, acquiring the window brightness of the target cloud application and sending a camera starting request and the window brightness of the target cloud application to a client, so as to instruct the client to control the screen brightness of the client according to the window brightness of the target cloud application, starting a camera according to the camera starting request, and using the camera to perform image acquisition on the basis of the controlled screen brightness of the client.

Description

图像获取方法、装置、设备、存储介质及程序产品Image acquisition method, device, equipment, storage medium and program product
本申请要求在2021年11月03日提交中国专利局、申请号为202111295459.5的中国专利申请的优先权,该申请的全部内容通过引用结合在本申请中。This application claims the priority of a Chinese patent application with application number 202111295459.5 filed with the China Patent Office on November 03, 2021, the entire contents of which are incorporated herein by reference.
技术领域technical field
本公开涉及云计算技术领域,例如涉及一种图像获取方法、装置、设备、存储介质及程序产品。The present disclosure relates to the technical field of cloud computing, for example, to an image acquisition method, device, equipment, storage medium and program product.
背景技术Background technique
云手机是运行在云端的手机,本地手机中安装的云手机客户端可以将云手机屏幕投射到本地手机,实现用户通过本地手机触摸屏来控制云手机执行数据计算与图像渲染编码等操作,本地手机仅作为一个显示终端,向用户显示云手机中的内容。The cloud mobile phone is a mobile phone running on the cloud. The cloud mobile phone client installed in the local mobile phone can project the screen of the cloud mobile phone to the local mobile phone, so that the user can control the cloud mobile phone to perform operations such as data calculation and image rendering and encoding through the touch screen of the local mobile phone. It is only used as a display terminal to display the content in the cloud phone to the user.
用户在使用云手机时,经常会用到需要获取本地设备采集到的图像数据的应用,例如,需要进行人脸识别认证或者扫描支付的应用,如何在云手机端获取本地设备实时采集的图像数据得到关注。When users use cloud mobile phones, they often use applications that need to obtain image data collected by local devices. For example, for applications that require face recognition authentication or scan payment, how to obtain real-time image data collected by local devices on the cloud mobile phone attract attention.
发明内容Contents of the invention
本公开提供了一种图像获取的方法、装置、设备、存储介质及程序产品。The disclosure provides an image acquisition method, device, equipment, storage medium and program product.
本公开提供了一种图像获取方法,包括:The present disclosure provides an image acquisition method, including:
获取目标云应用发起的图像获取请求;Obtain an image acquisition request initiated by the target cloud application;
响应于所述图像获取请求,获取所述目标云应用的窗口亮度,并向客户端发送摄像头开启请求和所述目标云应用的窗口亮度,以指示所述客户端根据所述目标云应用的窗口亮度控制所述客户端的屏幕亮度,根据所述摄像头开启请求开启摄像头,并基于所述经控制的客户端的屏幕亮度使用所述摄像头进行图像采集。In response to the image acquisition request, acquire the window brightness of the target cloud application, and send a camera opening request and the window brightness of the target cloud application to the client, to instruct the client to use the window brightness of the target cloud application The brightness controls the screen brightness of the client, turns on the camera according to the camera opening request, and uses the camera to collect images based on the controlled screen brightness of the client.
本公开提供了一种图像获取方法,包括:The present disclosure provides an image acquisition method, including:
获取摄像头开启请求和目标云应用的窗口亮度;所述摄像头开启请求以及所述目标云应用的窗口亮度响应于所述目标云应用发起的图像获取请求确定;Obtaining the camera opening request and the window brightness of the target cloud application; the camera opening request and the window brightness of the target cloud application are determined in response to the image acquisition request initiated by the target cloud application;
根据所述目标云应用的窗口亮度控制客户端的屏幕亮度,根据所述摄像头开启请求开启摄像头,并基于所述经控制的客户端的屏幕亮度使用所述摄像头进行图像采集。Control the screen brightness of the client according to the window brightness of the target cloud application, turn on the camera according to the camera opening request, and use the camera to collect images based on the controlled screen brightness of the client.
本公开提供了一种图像获取装置,包括:The present disclosure provides an image acquisition device, including:
图像获取请求获取模块,设置为获取目标云应用发起的图像获取请求;The image acquisition request acquisition module is configured to acquire the image acquisition request initiated by the target cloud application;
摄像头开启请求发送模块,设置为响应于所述图像获取请求,获取所述目标云应用的窗口亮度,并向客户端发送摄像头开启请求和所述目标云应用的窗口亮度,以指示所述客户端根据所述目标云应用的窗口亮度控制所述客户端的屏幕亮度,根据所述摄像头开启请求开启摄像头,并基于所述经控制的客户端的屏幕亮度使用所述摄像头进行图像采集。The camera opening request sending module is configured to respond to the image acquisition request, obtain the window brightness of the target cloud application, and send the camera opening request and the window brightness of the target cloud application to the client to instruct the client Control the screen brightness of the client according to the window brightness of the target cloud application, turn on the camera according to the camera opening request, and use the camera to collect images based on the controlled screen brightness of the client.
本公开提供了一种图像获取装置,包括:The present disclosure provides an image acquisition device, including:
摄像头开启请求获取模块,设置为获取摄像头开启请求和目标云应用的窗口亮度;所述摄像头开启请求以及所述目标云应用的窗口亮度响应于所述目标云应用发起的图像获取请求确定;The camera opening request acquisition module is configured to obtain the camera opening request and the window brightness of the target cloud application; the camera opening request and the window brightness of the target cloud application are determined in response to the image acquisition request initiated by the target cloud application;
图像采集模块,设置为根据所述目标云应用的窗口亮度控制客户端的屏幕亮度,根据所述摄像头开启请求开启摄像头,并基于所述经控制的客户端的屏幕亮度使用所述摄像头进行图像采集。The image acquisition module is configured to control the screen brightness of the client according to the window brightness of the target cloud application, turn on the camera according to the camera opening request, and use the camera to perform image acquisition based on the controlled screen brightness of the client.
本公开提供了一种电子设备,包括:The present disclosure provides an electronic device, including:
至少一个处理器;以及at least one processor; and
与至少一个处理器通信连接的存储器;memory communicatively coupled to at least one processor;
其中,存储器存储有可被至少一个处理器执行的指令,指令被至少一个处理器执行,以使至少一个处理器能够执行本公开任一实施例的图像获取方法。Wherein, the memory stores instructions executable by at least one processor, and the instructions are executed by at least one processor, so that the at least one processor can execute the image acquisition method of any embodiment of the present disclosure.
本公开提供了一种存储有计算机指令的非瞬时计算机可读存储介质,其中,计算机指令用于使计算机执行本公开任一实施例的图像获取方法。The present disclosure provides a non-transitory computer-readable storage medium storing computer instructions, wherein the computer instructions are used to cause a computer to execute the image acquisition method of any embodiment of the present disclosure.
本公开提供了一种计算机程序产品,包括计算机程序,计算机程序在被处理器执行时实现本公开任一实施例的图像获取方法。The present disclosure provides a computer program product, including a computer program. When the computer program is executed by a processor, the image acquisition method of any embodiment of the present disclosure is implemented.
本公开实施例可以实现在云手机获取客户端本地图像数据。The embodiment of the present disclosure can realize the acquisition of the client's local image data on the cloud mobile phone.
附图说明Description of drawings
图1是根据本公开实施例提供的一种图像获取方法的示意图;FIG. 1 is a schematic diagram of an image acquisition method provided according to an embodiment of the present disclosure;
图2是根据本公开实施例提供的一种图像获取方法的示意图;Fig. 2 is a schematic diagram of an image acquisition method provided according to an embodiment of the present disclosure;
图3是根据本公开实施例提供的一种图像获取方法的示意图;Fig. 3 is a schematic diagram of an image acquisition method provided according to an embodiment of the present disclosure;
图4是根据本公开实施例提供的一种图像获取方法的示意图;Fig. 4 is a schematic diagram of an image acquisition method provided according to an embodiment of the present disclosure;
图5是根据本公开实施例提供的一种图像获取方法场景图;Fig. 5 is a scene diagram of an image acquisition method provided according to an embodiment of the present disclosure;
图6是根据本公开实施例提供的一种图像获取装置的示意图;Fig. 6 is a schematic diagram of an image acquisition device provided according to an embodiment of the present disclosure;
图7是根据本公开实施例提供的一种图像获取装置的示意图;Fig. 7 is a schematic diagram of an image acquisition device provided according to an embodiment of the present disclosure;
图8是实现本公开实施例的图像获取方法的电子设备的框图。FIG. 8 is a block diagram of an electronic device implementing an image acquisition method of an embodiment of the present disclosure.
具体实施方式Detailed ways
以下结合附图对本公开的示范性实施例做出说明。Exemplary embodiments of the present disclosure will be described below with reference to the accompanying drawings.
图1是根据本公开实施例提供的一种图像获取方法的流程图,本实施例可以适用于云应用通过调用客户端设备的摄像头来获取本地图像数据的情况。本实施例方法可以由图像获取装置来执行,该装置可采用软件和/或硬件的方式实现,并配置于具有数据运算能力的电子设备中,该电子设备可以是客户端设备或服务器设备,客户端设备例如手机、平板电脑、车载终端和台式电脑等。Fig. 1 is a flow chart of an image acquisition method according to an embodiment of the present disclosure. This embodiment may be applicable to a situation where a cloud application acquires local image data by calling a camera of a client device. The method in this embodiment can be executed by an image acquisition device, which can be implemented in the form of software and/or hardware, and configured in an electronic device with data computing capabilities. The electronic device can be a client device or a server device, and the client End devices such as mobile phones, tablet computers, vehicle terminals and desktop computers.
S110、获取目标云应用发起的图像获取请求。S110. Obtain an image acquisition request initiated by the target cloud application.
目标云应用是运行于云手机的需要获取客户端图像数据的应用,示例性的,目标云应用是运行于云手机的需要进行人脸识别的即时通讯应用或者线上游戏应用等。The target cloud application is an application running on the cloud phone that needs to obtain image data of the client. Exemplarily, the target cloud application is an instant messaging application or an online game application running on the cloud phone that needs face recognition.
本公开实施例中,目标云应用在用户登录或者注册时,为了获取客户端用户的人脸图像,进行人脸识别,需要向云手机发送图像获取请求,以指示云手机获取客户端用户的图像数据,云手机首先获取目标云应用发起的图像获取请求,以响应图像获取请求获取客户端采集的图像数据。In the embodiment of the present disclosure, in order to obtain the face image of the client user and perform face recognition when the user logs in or registers, the target cloud application needs to send an image acquisition request to the cloud mobile phone to instruct the cloud mobile phone to obtain the image of the client user Data, the cloud mobile phone first obtains the image acquisition request initiated by the target cloud application, and obtains the image data collected by the client in response to the image acquisition request.
S120、响应于图像获取请求,获取目标云应用的窗口亮度,并向客户端发送摄像头开启请求和目标云应用的窗口亮度,以指示所述客户端根据目标云应用的窗口亮度控制所述客户端的屏幕亮度,根据所述摄像头开启请求开启摄像头,并基于所述经控制的客户端的屏幕亮度使用所述摄像头进行图像采集。S120. In response to the image acquisition request, acquire the window brightness of the target cloud application, and send a camera opening request and the window brightness of the target cloud application to the client, so as to instruct the client to control the client's brightness according to the window brightness of the target cloud application screen brightness, turning on the camera according to the camera opening request, and using the camera to collect images based on the controlled screen brightness of the client.
本公开实施例中,云手机获取到目标云应用发起的图像获取请求后,获取目标云应用的窗口亮度。云手机向客户端发送摄像头开启请求和目标云应用的窗口亮度。其中,云手机获取云应用的窗口亮度是为了使客户端可以在进行图像采集之前,进行屏幕亮度调节,以提高摄像头采集图像的质量。摄像头开启请求用于指示客户端开启摄像头,并基于经控制的客户端的屏幕亮度使用摄像头进行图像数据采集,实现在云手机端获取客户端的图像数据的同时,通过屏幕亮度调节,提高了获取到的图像数据的质量。In the embodiment of the present disclosure, after the cloud mobile phone acquires the image acquisition request initiated by the target cloud application, it acquires the window brightness of the target cloud application. The cloud mobile phone sends a camera opening request and the window brightness of the target cloud application to the client. Among them, the cloud mobile phone acquires the window brightness of the cloud application so that the client can adjust the screen brightness before image collection, so as to improve the quality of the image collected by the camera. The camera opening request is used to instruct the client to turn on the camera, and use the camera to collect image data based on the controlled screen brightness of the client, so as to obtain the image data of the client on the cloud mobile terminal and improve the acquired image data by adjusting the screen brightness. The quality of the image data.
示例性的,云手机获取到游戏应用A发起的人脸视频获取请求后,获取游戏应用A对应的窗口亮度。云手机向客户端发送摄像头开启请求和目标云应用的窗口亮度,以控制客户端根据目标云应用的窗口亮度对当前屏幕亮度进行调 节,使得客户端的屏幕亮度与目标云应用的窗口亮度一致,并在屏幕亮度调节之后开启摄像头进行人脸视频采集,实现在云端进行人脸识别的同时,通过调整屏幕亮度,使得云手机获取到的人脸视频更清晰,从而提高人脸识别的准确度。Exemplarily, after the cloud mobile phone acquires the facial video acquisition request initiated by the game application A, it acquires the brightness of the window corresponding to the game application A. The cloud mobile phone sends the camera opening request and the window brightness of the target cloud application to the client to control the client to adjust the current screen brightness according to the window brightness of the target cloud application, so that the screen brightness of the client is consistent with the window brightness of the target cloud application, and After the screen brightness is adjusted, turn on the camera to collect face video, realize face recognition in the cloud, and adjust the screen brightness to make the face video acquired by the cloud mobile phone clearer, thereby improving the accuracy of face recognition.
本公开实施例的技术方案,获取目标云应用发起的图像获取请求,进而响应于图像获取请求,获取目标云应用的窗口亮度,并向客户端发送摄像头开启请求和目标云应用的窗口亮度,以指示客户端根据目标云应用的窗口亮度控制客户端的屏幕亮度,以及根据摄像头开启请求开启摄像头,并基于经控制的客户端的屏幕亮度使用摄像头进行图像采集,实现了在云手机获取客户端本地图像数据的效果。The technical solution of the embodiment of the present disclosure obtains the image acquisition request initiated by the target cloud application, and then responds to the image acquisition request to obtain the window brightness of the target cloud application, and sends the camera opening request and the window brightness of the target cloud application to the client to obtain Instruct the client to control the client's screen brightness according to the window brightness of the target cloud application, and turn on the camera according to the camera opening request, and use the camera to collect images based on the controlled client's screen brightness, realizing the acquisition of the client's local image data on the cloud mobile phone Effect.
图2是本公开实施例中的一种图像获取方法的示意图,在上述实施例的基础上,提供了响应于图像获取请求,获取目标云应用的窗口亮度,并向客户端发送摄像头开启请求和目标云应用的窗口亮度的步骤,以及向客户端发送摄像头开启请求和目标云应用的窗口亮度之后的步骤。下面结合图2对本公开实施例提供的一种图像获取方法进行说明,所述方法包括以下步骤:Fig. 2 is a schematic diagram of an image acquisition method in an embodiment of the present disclosure. On the basis of the above embodiments, it is provided to obtain the window brightness of the target cloud application in response to an image acquisition request, and send a camera opening request and The steps of the window brightness of the target cloud application, and the steps after sending the camera opening request and the window brightness of the target cloud application to the client. An image acquisition method provided by an embodiment of the present disclosure will be described below with reference to FIG. 2, and the method includes the following steps:
S210、获取目标云应用发起的图像获取请求。S210. Obtain an image acquisition request initiated by the target cloud application.
S220、通过云手机的操作系统,响应于图像获取请求,开启所述云手机的摄像头驱动,并获取目标云应用的窗口亮度,将所述目标云应用的窗口亮度发送至所述云手机中的远程交互服务。S220, through the operating system of the cloud mobile phone, in response to the image acquisition request, start the camera driver of the cloud mobile phone, obtain the window brightness of the target cloud application, and send the window brightness of the target cloud application to the remote interactive service.
本公开实施例中,在云手机的操作系统获取到目标云应用发起的图像获取请求之后,响应于图像获取请求,开启摄像头驱动,以获取客户端反馈的图像数据。云手机的操作系统还需要获取目标云应用的窗口亮度,并将窗口亮度发送至云手机中的远程交互服务,通过发送窗口亮度可以使得远程交互服务将该窗口亮度发送至客户端,使客户端基于窗口亮度进行屏幕亮度调节,提高采集的图像数据的清晰度。In the embodiment of the present disclosure, after the operating system of the cloud mobile phone acquires the image acquisition request initiated by the target cloud application, the camera driver is turned on in response to the image acquisition request to acquire the image data fed back by the client. The operating system of the cloud mobile phone also needs to obtain the window brightness of the target cloud application, and send the window brightness to the remote interactive service in the cloud mobile phone. By sending the window brightness, the remote interactive service can send the window brightness to the client, so that the client Adjust the brightness of the screen based on the brightness of the window to improve the clarity of the collected image data.
示例性的,在云手机的操作系统获取到游戏应用A发起的人脸视频获取请求后,开启云手机的摄像头驱动,并且为了提高获取到的人脸视频的质量,云手机的操作系统获取目标云应用的窗口亮度,并将窗口亮度发送至云手机中的remote-play。Exemplarily, after the operating system of the cloud phone obtains the face video acquisition request initiated by the game application A, the camera driver of the cloud phone is turned on, and in order to improve the quality of the acquired face video, the operating system of the cloud phone acquires the target The window brightness of the cloud application, and send the window brightness to the remote-play in the cloud phone.
S230、在所述远程交互服务监测到所述云手机的摄像头驱动启动后,通过控制服务向所述客户端发送摄像头开启请求和目标云应用的窗口亮度,以指示所述客户端根据目标云应用的窗口亮度控制所述客户端的屏幕亮度,根据所述 摄像头开启请求开启摄像头,并基于所述经控制的客户端的屏幕亮度使用所述摄像头进行图像采集。S230. After the remote interactive service monitors that the camera driver of the cloud mobile phone is started, send a camera start request and the window brightness of the target cloud application to the client through the control service, so as to instruct the client to use the target cloud application The screen brightness of the client is controlled by the brightness of the window, the camera is turned on according to the camera opening request, and image acquisition is performed using the camera based on the controlled screen brightness of the client.
本公开实施例中,云手机中的远程交互服务会对云手机的摄像头状态进行监控,当远程交互服务检测到云手机的摄像头驱动启动时,表明运行于云手机的目标云应用需要获取客户端采集的图像数据,此时远程交互服务会向控制服务发送摄像头开启请求和目标云应用的窗口亮度,以指示控制服务将摄像头开启请求和目标云应用的窗口亮度发送到客户端,从而指示客户端根据目标云应用的窗口亮度控制客户端的屏幕亮度,并在屏幕亮度调节之后开启摄像头进行图像数据采集,在实现将客户端采集的图像数据传输至云手机实现在云手机进行身份验证的同时,通过进行屏幕亮度调节,提高身份验证成功率。In the embodiment of the present disclosure, the remote interactive service in the cloud mobile phone will monitor the camera status of the cloud mobile phone. When the remote interactive service detects that the camera driver of the cloud mobile phone starts, it indicates that the target cloud application running on the cloud mobile phone needs to obtain the client Collected image data, at this time, the remote interactive service will send the camera opening request and the window brightness of the target cloud application to the control service to instruct the control service to send the camera opening request and the window brightness of the target cloud application to the client, thereby instructing the client Control the screen brightness of the client according to the window brightness of the target cloud application, and turn on the camera for image data collection after the screen brightness is adjusted. While realizing the transmission of the image data collected by the client to the cloud mobile phone for authentication on the cloud mobile phone, through Adjust the brightness of the screen to improve the success rate of authentication.
S240、通过云手机中的远程交互服务,从控制服务获取所述客户端反馈的图像数据,并将图像数据转换为设定格式后写入至所述云手机的摄像头驱动。S240. Obtain the image data fed back by the client from the control service through the remote interactive service in the cloud mobile phone, convert the image data into a set format, and write the image data to the camera driver of the cloud mobile phone.
本公开实施例中,在云手机向客户端发送摄像头开启请求后,客户端会响应于该请求开启摄像头进行图像数据采集,继而将采集到的图像数据反馈至云手机。客户端首先会对采集到的图像数据进行编码,进而将编码后的图像数据通过自定义流媒体协议发送至控制服务,控制服务将接收到图像数据发送至云手机的远程交互服务,远程交互服务在接收到客户端通过控制服务发送的图像数据之后,对图像数据进行解码,并将解码后的图像数据转换为设定格式,最终将设定格式的图像数据写入至云手机的摄像头驱动。In the embodiment of the present disclosure, after the cloud mobile phone sends a camera opening request to the client, the client will respond to the request to open the camera to collect image data, and then feed back the collected image data to the cloud mobile phone. The client first encodes the collected image data, and then sends the encoded image data to the control service through a custom streaming media protocol, and the control service sends the received image data to the remote interactive service of the cloud mobile phone, remote interactive service After receiving the image data sent by the client through the control service, it decodes the image data, converts the decoded image data into a set format, and finally writes the image data in the set format to the camera driver of the cloud mobile phone.
示例性的,客户端将采集到的图像数据进行H.264编码,进而将编码后的图像数据通过控制服务发送至云手机的远程交互服务,远程交互服务对接收到的图像数据进行H.264解码后,得到YUV格式的图像数据,并将YUV格式的图像数据转换为RGBA格式,继而将RGBA格式的图像数据写入至云手机的摄像头驱动。Exemplarily, the client performs H.264 encoding on the collected image data, and then sends the encoded image data to the remote interactive service of the cloud mobile phone through the control service, and the remote interactive service performs H.264 encoding on the received image data. After decoding, the image data in YUV format is obtained, and the image data in YUV format is converted into RGBA format, and then the image data in RGBA format is written to the camera driver of the cloud phone.
S250、通过所述云手机的操作系统,将写入所述云手机的摄像头驱动的图像数据提供给目标云应用。S250. Through the operating system of the cloud mobile phone, provide the image data driven by the camera written in the cloud mobile phone to the target cloud application.
本公开实施例中,在云手机的摄像头驱动处于启动状态下,云手机的操作系统会对摄像头驱动进行实时监控,在远程交互服务将图像数据写入至云手机的摄像头驱动后,云手机的操作系统通过监控摄像头驱动,获取客户端反馈的图像数据,并将图像数据提供给目标云应用,实现目标云应用根据客户端采集的图像数据进行身份识别认证。In the embodiment of the present disclosure, when the camera driver of the cloud phone is started, the operating system of the cloud phone will monitor the camera driver in real time. After the remote interactive service writes the image data to the camera driver of the cloud phone, the cloud phone’s Driven by the monitoring camera, the operating system obtains the image data fed back by the client, and provides the image data to the target cloud application, so that the target cloud application performs identity recognition and authentication based on the image data collected by the client.
S260、通过云手机的操作系统,响应于所述目标云应用发起的图像终止请求,关闭所述云手机的摄像头驱动。S260. Turn off the camera driver of the cloud phone in response to the image termination request initiated by the target cloud application through the operating system of the cloud phone.
本公开实施例中,目标云应用在获取到客户端反馈的图像数据后,根据图像数据进行身份认证识别,在身份认证识别结束后,目标云应用会向云手机的操作系统发送图像终止请求,云手机的操作系统,响应于目标云应用发起的图像终止请求,首先关闭云手机的摄像头驱动,以指示停止接收客户端反馈的图像数据。In the embodiment of the present disclosure, after obtaining the image data fed back by the client, the target cloud application performs identity authentication and identification according to the image data. After the identity authentication and identification is completed, the target cloud application will send an image termination request to the operating system of the cloud mobile phone, The operating system of the cloud mobile phone, in response to the image termination request initiated by the target cloud application, first shuts down the camera driver of the cloud mobile phone to indicate to stop receiving the image data fed back by the client.
S270、在所述云手机中的远程交互服务监测到所述云手机的摄像头驱动关闭后,通过控制服务向所述客户端发送摄像头关闭请求,以指示客户端关闭所述摄像头。S270. After the remote interaction service in the cloud mobile phone detects that the camera driver of the cloud mobile phone is turned off, send a camera closing request to the client through the control service, so as to instruct the client to turn off the camera.
本公开实施例中,云手机中的远程交互服务监测到云手机的摄像头驱动关闭后,会向控制服务发送摄像头关闭请求,以指示控制服务将摄像头关闭请求发送至客户端,使得客户端关闭摄像头,停止图像数据的采集,避免因摄像头关闭不及时导致的高耗电的情况。In the embodiment of the present disclosure, after the remote interactive service in the cloud phone detects that the camera driver of the cloud phone is turned off, it will send a camera shutdown request to the control service to instruct the control service to send the camera shutdown request to the client, so that the client turns off the camera , stop the collection of image data, and avoid the situation of high power consumption caused by the untimely shutdown of the camera.
本公开实施例的技术方案,云手机的操作系统,响应于图像获取请求,开启云手机的摄像头驱动,并获取目标云应用的窗口亮度,将窗口亮度发送至云手机中的远程交互服务,并在远程交互服务监测到云手机的摄像头驱动启动后,通过控制服务向客户端发送摄像头开启请求和目标云应用的窗口亮度,进而通过远程交互服务,从控制服务获取客户端反馈的图像数据,并将图像数据转换为设定格式后写入至云手机的摄像头驱动,通过云手机的操作系统,将云手机的摄像头驱动获取的图像数据提供给目标云应用,可以实现在云手机端获取客户端获取得图像数据,同时通过屏幕亮度调节提高了获取到的图像数据的质量,从而提高了根据图像数据进行身份认证识别的成功率。In the technical solution of the embodiment of the present disclosure, the operating system of the cloud mobile phone, in response to the image acquisition request, starts the camera driver of the cloud mobile phone, obtains the window brightness of the target cloud application, sends the window brightness to the remote interactive service in the cloud mobile phone, and After the remote interactive service monitors that the camera driver of the cloud mobile phone starts, the control service sends the camera opening request and the window brightness of the target cloud application to the client, and then obtains the image data fed back by the client from the control service through the remote interactive service, and Convert the image data into a set format and write it to the camera driver of the cloud phone. Through the operating system of the cloud phone, the image data obtained by the camera driver of the cloud phone is provided to the target cloud application, and the client can be obtained on the cloud phone. The image data is obtained, and the quality of the obtained image data is improved by adjusting the brightness of the screen, thereby improving the success rate of identity authentication and identification based on the image data.
图3是根据本公开实施例提供的一种图像获取方法的流程图,本实施例可以适用于云应用通过调用客户端设备的摄像头来获取本地图像数据的情况。本实施例方法可以由图像获取装置来执行,该装置可采用软件和/或硬件的方式实现,并配置于具有数据运算能力的电子设备中,该电子设备可以是客户端设备或服务器设备,客户端设备例如手机、平板电脑、车载终端和台式电脑等。Fig. 3 is a flow chart of an image acquisition method according to an embodiment of the present disclosure. This embodiment may be applicable to a situation where a cloud application obtains local image data by calling a camera of a client device. The method in this embodiment can be executed by an image acquisition device, which can be implemented in the form of software and/or hardware, and configured in an electronic device with data computing capabilities. The electronic device can be a client device or a server device, and the client End devices such as mobile phones, tablet computers, vehicle terminals and desktop computers.
S310、获取摄像头开启请求和目标云应用的窗口亮度;所述摄像头开启请求以及所述目标云应用的窗口亮度响应于所述目标云应用发起的图像获取请求确定。S310. Obtain a camera opening request and a window brightness of a target cloud application; the camera opening request and the window brightness of the target cloud application are determined in response to an image acquisition request initiated by the target cloud application.
本公开实施例中,客户端接收云手机通过控制服务发送的摄像头开启请求以及目标云应用的窗口亮度,以基于目标云应用的窗口亮度进行屏幕亮度调节,并且基于摄像头开启请求启动摄像头进行图像采集。其中,摄像头开启请求以 及目标云应用的窗口亮度是云手机的操作系统响应于云应用发起的图像获取请求而确定的。In the embodiment of the present disclosure, the client receives the camera opening request sent by the cloud mobile phone through the control service and the window brightness of the target cloud application, adjusts the screen brightness based on the window brightness of the target cloud application, and starts the camera for image acquisition based on the camera opening request . Wherein, the camera opening request and the window brightness of the target cloud application are determined by the operating system of the cloud mobile phone in response to the image acquisition request initiated by the cloud application.
S320、根据所述目标云应用的窗口亮度控制客户端的屏幕亮度,根据所述摄像头开启请求开启摄像头,并基于所述经控制的客户端的屏幕亮度使用所述摄像头进行图像采集。S320. Control the screen brightness of the client according to the window brightness of the target cloud application, turn on the camera according to the camera opening request, and use the camera to collect images based on the controlled screen brightness of the client.
本公开实施例中,客户端在收到目标云应用的窗口亮度和摄像头开启请求之后,首先可以根据目标云应用的窗口亮度来控制客户端的屏幕亮度,以保证后续采集图像的质量,进而客户端基于调节后的屏幕亮度,开启摄像头进行图像采集。在进行图像采集之前进行屏幕亮度调节,可以提高采集到的图像质量。In the embodiment of the present disclosure, after receiving the window brightness of the target cloud application and the camera opening request, the client can first control the screen brightness of the client according to the window brightness of the target cloud application, so as to ensure the quality of subsequent captured images. Based on the adjusted screen brightness, the camera is turned on for image acquisition. Adjusting the brightness of the screen before image acquisition can improve the quality of the acquired image.
示例性的,客户端获取到目标云应用的窗口亮度和摄像头开启请求之后,首先将客户端的初始屏幕亮度和目标云应用的窗口亮度进行比对,如果客户端初始屏幕亮度低于目标云应用的窗口亮度,则将客户端的初始屏幕亮度调节至目标云应用的窗口亮度,然后开启摄像头进行人脸视频采集,通过提高屏幕亮度使采集到的人脸视频更清晰,从而提高人脸识别准确度。Exemplarily, after the client obtains the window brightness of the target cloud application and the camera opening request, it first compares the client's initial screen brightness with the window brightness of the target cloud application, and if the client's initial screen brightness is lower than that of the target cloud application Window brightness, adjust the initial screen brightness of the client to the window brightness of the target cloud application, and then turn on the camera to collect face video. By increasing the screen brightness, the collected face video is clearer, thereby improving the accuracy of face recognition.
本公开实施例的技术方案,在获取摄像头开启请求和目标云应用的窗口亮度后,根据目标云应用的窗口亮度控制客户端的屏幕亮度,根据摄像头开启请求开启摄像头,并基于经控制的客户端的屏幕亮度使用摄像头进行图像采集,可以实现在云手机获取客户端本地图像数据的效果,并且提高采集图像的清晰度。In the technical solution of the embodiment of the present disclosure, after obtaining the camera opening request and the window brightness of the target cloud application, the screen brightness of the client is controlled according to the window brightness of the target cloud application, the camera is turned on according to the camera opening request, and based on the controlled client's screen Brightness uses the camera to collect images, which can achieve the effect of obtaining local image data of the client in the cloud mobile phone, and improve the clarity of the collected images.
图4是本公开实施例中的一种图像获取方法的示意图,在上述实施例的基础上,提供了根据目标云应用的窗口亮度控制客户端的屏幕亮度的步骤,以及基于经控制的客户端的屏幕亮度使用摄像头进行图像采集之后的步骤。下面结合图2对本公开实施例提供的一种图像获取方法进行说明,所述方法包括以下步骤:Fig. 4 is a schematic diagram of an image acquisition method in an embodiment of the present disclosure. On the basis of the above embodiments, a step of controlling the brightness of the client's screen according to the brightness of the window of the target cloud application is provided, and based on the controlled client's screen Brightness is the step after image acquisition using the camera. An image acquisition method provided by an embodiment of the present disclosure will be described below with reference to FIG. 2, and the method includes the following steps:
S410、获取摄像头开启请求和目标云应用的窗口亮度;所述摄像头开启请求以及所述目标云应用的窗口亮度响应于所述目标云应用发起的图像获取请求确定。S410. Obtain a camera opening request and a window brightness of a target cloud application; the camera opening request and the window brightness of the target cloud application are determined in response to an image acquisition request initiated by the target cloud application.
S420、将客户端的初始屏幕亮度和所述目标云应用的窗口亮度进行比对。S420. Compare the initial screen brightness of the client with the window brightness of the target cloud application.
本公开实施例中,在客户端获取到摄像头开启请求和目标云应用的窗口亮度后,首先获取客户端的初始屏幕亮度,并将客户端的初始屏幕亮度和目标云应用的窗口亮度进行比对,以确定客户端当前屏幕亮度是否符合目标云应用进行图像数据采集所需要的亮度。In the embodiment of the present disclosure, after the client obtains the camera opening request and the window brightness of the target cloud application, it first obtains the initial screen brightness of the client, and compares the initial screen brightness of the client with the window brightness of the target cloud application to obtain Determine whether the current screen brightness of the client meets the brightness required by the target cloud application for image data collection.
S430、在所述客户端的初始屏幕亮度与所述目标云应用的窗口亮度不一致的情况下,存储所述客户端的初始屏幕亮度,并将所述客户端的初始屏幕亮度调节为所述目标云应用的窗口亮度。S430. In the case that the initial screen brightness of the client is inconsistent with the window brightness of the target cloud application, store the initial screen brightness of the client, and adjust the initial screen brightness of the client to that of the target cloud application Window brightness.
本公开实施例中,在比对得到客户端的初始屏幕亮度与目标云应用的窗口亮度不一致的情况下,可以将客户端的初始屏幕亮度调节为目标云应用的窗口亮度,以保证采集图像数据的质量。在对客户端的初始屏幕亮度进行调节之前,还需要对客户端的初始屏幕亮度进行存储,以在结束图像采集之后,可以根据存储的客户端的初始屏幕亮度来对客户端的屏幕亮度进行恢复,减小对用户使用设备的影响,提高用户的使用体验。In the embodiment of the present disclosure, if the brightness of the initial screen of the client is inconsistent with the brightness of the window of the target cloud application obtained by comparison, the brightness of the initial screen of the client can be adjusted to the brightness of the window of the target cloud application to ensure the quality of the collected image data . Before adjusting the initial screen brightness of the client, it is also necessary to store the initial screen brightness of the client, so that after the image acquisition is finished, the screen brightness of the client can be restored according to the stored initial screen brightness of the client, reducing the The impact of the user's use of the device to improve the user's experience.
S440、根据所述摄像头开启请求开启摄像头。S440. Turn on the camera according to the camera turn-on request.
S450、基于所述经控制的客户端的屏幕亮度使用所述摄像头进行图像采集。S450. Use the camera to collect images based on the controlled screen brightness of the client.
S460、响应于摄像头关闭请求,关闭所述摄像头。S460. In response to the camera shutdown request, turn off the camera.
本公开实施例中,云应用依据客户端反馈的图像数据完成用户身份认证后,向云手机发送图像终止请求,云手机响应于图像终止请求,通过控制服务向客户端发送摄像头关闭请求,客户端接收到云手机通过控制服务发送的摄像头关闭请求后,进行摄像头关闭,减少因摄像头未及时关闭导致的设备耗电量高的情况。In the embodiment of the present disclosure, after the cloud application completes the user identity authentication based on the image data fed back by the client, it sends an image termination request to the cloud mobile phone. In response to the image termination request, the cloud mobile phone sends a camera shutdown request to the client through the control service. After receiving the camera shutdown request sent by the cloud mobile phone through the control service, the camera is turned off to reduce the high power consumption of the device caused by the camera not being turned off in time.
S470、依据所述存储的客户端的初始屏幕亮度,对所述客户端的当前屏幕亮度进行恢复。S470. Restore the current screen brightness of the client according to the stored initial screen brightness of the client.
本公开实施例中,客户端在关闭摄像头之后,获取在进行屏幕亮度调节之前存储的初始屏幕亮度,并将当前屏幕亮度恢复至初始屏幕亮度,满足用户在完成图像采集后正常使用设备的需求,提高用户的使用体验。In the embodiment of the present disclosure, after turning off the camera, the client obtains the initial screen brightness stored before adjusting the screen brightness, and restores the current screen brightness to the initial screen brightness, which satisfies the needs of the user to use the device normally after image collection is completed. Improve user experience.
本公开实施例的技术方案,获取摄像头开启请求和目标云应用的窗口亮度,然后将客户端的初始屏幕亮度和目标云应用的窗口亮度进行比对,在客户端的初始屏幕亮度与目标云应用的窗口亮度不一致的情况下,存储客户端的初始屏幕亮度,并将客户端的初始屏幕亮度调节为窗口亮度,根据所述摄像头开启请求开启摄像头,并基于经控制的客户端的屏幕亮度使用摄像头进行图像采集。在目标云应用依据采集到的图像数据完成身份认证后,客户端响应于摄像头关闭请求,关闭摄像头,并依据存储的客户端的初始屏幕亮度,对客户端当前屏幕亮度进行恢复,一方面可以保证采集到的图像数据的清晰度,提高身份认证的成功率,另一方面,在完成身份认证后及时关闭摄像头,避免因摄像头关闭不及时导致的设备电量浪费,并在关闭摄像头后将客户端的屏幕亮度恢复至客户端的初始屏幕亮度,提用户使用体验。The technical solution of the embodiment of the present disclosure obtains the camera opening request and the window brightness of the target cloud application, and then compares the initial screen brightness of the client with the window brightness of the target cloud application, and compares the initial screen brightness of the client with the window brightness of the target cloud application When the brightness is inconsistent, store the initial screen brightness of the client, and adjust the initial screen brightness of the client to the window brightness, turn on the camera according to the camera opening request, and use the camera to perform image acquisition based on the controlled screen brightness of the client. After the target cloud application completes identity authentication based on the collected image data, the client responds to the camera shutdown request, turns off the camera, and restores the current screen brightness of the client according to the stored initial screen brightness of the client. The clarity of the received image data improves the success rate of identity authentication. On the other hand, after the identity authentication is completed, the camera is turned off in time to avoid the waste of equipment power caused by the untimely turn off of the camera, and the client’s screen brightness is turned off after the camera is turned off. Restore to the initial screen brightness of the client to improve user experience.
图5是根据本公开实施例提供的一种图像获取方法的场景图,下面结合图5对本公开实施例提供的一种图像获取方法进行说明,所述方法包括以下步骤:FIG. 5 is a scene diagram of an image acquisition method provided according to an embodiment of the present disclosure. The following describes an image acquisition method provided by an embodiment of the present disclosure in conjunction with FIG. 5 , and the method includes the following steps:
S501、云手机的操作系统获取目标云应用发起的图像获取请求,并响应于图像获取请求,获取目标云应用的窗口亮度。S501. The operating system of the cloud phone acquires an image acquisition request initiated by the target cloud application, and acquires the window brightness of the target cloud application in response to the image acquisition request.
S502、云手机操作系统响应于图像获取请求,开启云手机的摄像头驱动。S502. The cloud phone operating system starts a camera driver of the cloud phone in response to the image acquisition request.
S503、云手机操作系统将获取到的目标云应用的窗口亮度发送至云手机的远程交互服务。S503. The cloud phone operating system sends the acquired window brightness of the target cloud application to the remote interactive service of the cloud phone.
S504、云手机的远程交互服务监测到摄像头驱动启动(S502.1)后,向控制服务发送摄像头开启请求和目标云应用的窗口亮度。S504. After the remote interactive service of the cloud mobile phone detects that the camera driver is started (S502.1), it sends a camera start request and the window brightness of the target cloud application to the control service.
S505、控制服务将摄像头开启请求和目标云应用的窗口亮度传至客户端。S505. The control service transmits the camera opening request and the window brightness of the target cloud application to the client.
客户端获取摄像头开启请求和目标云应用的窗口亮度,根据目标云应用的窗口亮度控制客户端的屏幕亮度,根据摄像头开启请求开启摄像头,并基于经控制的客户端的屏幕亮度使用摄像头进行图像采集。The client obtains the camera opening request and the window brightness of the target cloud application, controls the screen brightness of the client according to the window brightness of the target cloud application, turns on the camera according to the camera opening request, and uses the camera to collect images based on the controlled screen brightness of the client.
S506、客户端将采集到的图像数据通过自定义流媒体协议传递到控制服务。S506. The client transmits the collected image data to the control service through a custom streaming media protocol.
S507、控制服务接收到的图像数据后,将图像数据传到云手机的远程交互服务。S507. After the image data is received by the control service, the image data is transmitted to the remote interactive service of the cloud mobile phone.
S508、远程控交互服务接收到图像数据后,将图像数据写入云手机的摄像头驱动。S508. After receiving the image data, the remote control interaction service writes the image data into the camera driver of the cloud mobile phone.
S509、云手机的操作系统通过监控摄像头驱动,获取客户端反馈的图像数据。S509. The operating system of the cloud mobile phone is driven by the monitoring camera to obtain image data fed back by the client.
S510、云手机的操作系统将获取到的图像数据,发送至目标云应用,以使目标云应用依据获取到的图像数据进行身份认证。S510. The operating system of the cloud mobile phone sends the obtained image data to the target cloud application, so that the target cloud application performs identity authentication according to the obtained image data.
S511、目标云应用进行身份认证结束后,向云手机操作系统发送图像终止请求。S511. After the identity authentication of the target cloud application is completed, an image termination request is sent to the cloud mobile phone operating system.
S512、云手机操作系统响应于图像终止请求,关闭云手机的摄像头驱动。S512. The cloud phone operating system closes the camera driver of the cloud phone in response to the image termination request.
S513、远程交互服务监测到摄像头驱动关闭。S513. The remote interactive service detects that the camera driver is turned off.
S514、远程交互服务监测到摄像头驱动关闭后,向控制服务发送摄像头关闭请求。S514. After detecting that the camera driver is closed, the remote interactive service sends a camera close request to the control service.
S515、控制服务将摄像头关闭请求透传至客户端。S515. The control service transparently transmits the camera shutdown request to the client.
客户端响应于摄像头关闭请求,关闭摄像头,并将屏幕亮度还原至初始屏幕亮度。In response to the camera off request, the client turns off the camera and restores the screen brightness to the initial screen brightness.
本公开实施例的技术方案,可以在云手机端获取客户端实时采集的图像数据,从而实现在云手机端进行实时用户身份认证。According to the technical solutions of the embodiments of the present disclosure, the image data collected by the client in real time can be acquired on the cloud mobile terminal, thereby realizing real-time user identity authentication on the cloud mobile terminal.
根据本公开的实施例,图6是本公开实施例中的图像获取装置的结构图,本公开实施例适用于通过调用客户端设备的摄像头来获取本地图像数据的情况。该装置采用软件和/或硬件实现,并配置于具备一定数据运算能力的电子设备中。According to an embodiment of the present disclosure, FIG. 6 is a structural diagram of an image acquisition apparatus in an embodiment of the present disclosure, and the embodiment of the present disclosure is applicable to the case of acquiring local image data by calling a camera of a client device. The device is implemented by software and/or hardware, and is configured in electronic equipment with certain data computing capabilities.
如图6所示的一种图像获取装置600,包括:图像获取请求获取模块610和摄像头开启请求发送模块620;其中,图像获取请求获取模块610,设置为获取目标云应用发起的图像获取请求;摄像头开启请求发送模块620,设置为响应于所述图像获取请求,获取所述目标云应用的窗口亮度,并向客户端发送摄像头开启请求和所述目标云应用的窗口亮度,以指示所述客户端根据所述目标云应用的窗口亮度控制所述客户端的屏幕亮度,根据所述摄像头开启请求开启摄像头,并基于所述经控制的客户端的屏幕亮度使用所述摄像头进行图像采集。An image acquisition device 600 as shown in FIG. 6 , comprising: an image acquisition request acquisition module 610 and a camera opening request sending module 620; wherein, the image acquisition request acquisition module 610 is configured to acquire an image acquisition request initiated by a target cloud application; The camera opening request sending module 620 is configured to obtain the window brightness of the target cloud application in response to the image acquisition request, and send the camera opening request and the window brightness of the target cloud application to the client to instruct the client The terminal controls the screen brightness of the client according to the window brightness of the target cloud application, turns on the camera according to the camera opening request, and uses the camera to collect images based on the controlled screen brightness of the client.
本公开实施例的技术方案,获取目标云应用发起的图像获取请求,进而响应于图像获取请求,获取目标云应用的窗口亮度,并向客户端发送摄像头开启请求和目标云应用的窗口亮度,以指示客户端根据目标云应用的窗口亮度控制客户端的屏幕亮度,根据摄像头开启请求开启摄像头,并基于经控制的客户端的屏幕亮度使用摄像头进行图像采集,实现了在云手机获取客户端本地图像数据的效果。The technical solution of the embodiment of the present disclosure obtains the image acquisition request initiated by the target cloud application, and then responds to the image acquisition request to obtain the window brightness of the target cloud application, and sends the camera opening request and the window brightness of the target cloud application to the client to obtain Instruct the client to control the client's screen brightness according to the window brightness of the target cloud application, turn on the camera according to the camera opening request, and use the camera to collect images based on the controlled client's screen brightness, realizing the acquisition of the client's local image data on the cloud mobile phone Effect.
摄像头开启请求发送模块620,包括:驱动开启单元,设置为通过云手机的操作系统,响应于所述图像获取请求,开启所述云手机的摄像头驱动,并获取所述目标云应用的窗口亮度,将所述目标云应用的窗口亮度发送至所述云手机中的远程交互服务;摄像头开启请求发送单元,设置为在所述远程交互服务监测到所述云手机的摄像头驱动启动后,通过控制服务向所述客户端发送摄像头开启请求和所述目标云应用的窗口亮度。The camera opening request sending module 620 includes: a driver opening unit, configured to respond to the image acquisition request through the operating system of the cloud mobile phone, to open the camera driver of the cloud mobile phone, and obtain the window brightness of the target cloud application, Send the window brightness of the target cloud application to the remote interactive service in the cloud mobile phone; the camera opening request sending unit is set to after the remote interactive service monitors that the camera driver of the cloud mobile phone starts, through the control service Sending a camera opening request and the window brightness of the target cloud application to the client.
图像获取装置600,还包括:图像数据获取模块,设置为通过云手机中的远程交互服务,从控制服务获取所述客户端反馈的图像数据,并将所述图像数据转换为设定格式后写入至所述云手机的摄像头驱动;图像数据提供模块,设置为通过所述云手机的操作系统,将写入所述云手机的摄像头驱动的图像数据提供给所述目标云应用。The image acquisition device 600 also includes: an image data acquisition module, configured to obtain the image data fed back by the client from the control service through the remote interactive service in the cloud mobile phone, and convert the image data into a set format before writing into the camera driver of the cloud phone; the image data providing module is configured to provide the target cloud application with the image data written into the camera driver of the cloud phone through the operating system of the cloud phone.
图像获取装置600,还包括:驱动关闭模块,设置为通过云手机的操作系统,响应于所述目标云应用发起的图像终止请求,关闭所述云手机的摄像头驱动;摄像头关闭请求发送模块,设置为在所述云手机中的远程交互服务监测到所述云手机的摄像头驱动关闭后,通过控制服务向所述客户端发送摄像头关闭请求,以指示所述客户端关闭所述摄像头。The image acquisition device 600 also includes: a drive closing module, which is set to close the camera driver of the cloud mobile phone in response to the image termination request initiated by the target cloud application through the operating system of the cloud mobile phone; the camera closing request sending module is set to After the remote interaction service in the cloud mobile phone detects that the camera driver of the cloud mobile phone is turned off, a camera close request is sent to the client through the control service to instruct the client to turn off the camera.
本公开实施例所提供的图像获取装置可执行本公开任意实施例所提供的图像获取方法,具备执行方法相应的功能模块和效果。The image acquisition device provided in the embodiments of the present disclosure can execute the image acquisition method provided in any embodiment of the present disclosure, and has corresponding functional modules and effects for executing the method.
根据本公开的实施例,图7是本公开实施例中的图像获取装置的结构图,本公开实施例适用于通过调用客户端设备的摄像头来获取本地图像数据的情况。该装置采用软件和/或硬件实现,并配置于具备一定数据运算能力的电子设备中。According to an embodiment of the present disclosure, FIG. 7 is a structural diagram of an image acquisition apparatus in an embodiment of the present disclosure, and the embodiment of the present disclosure is applicable to the case of acquiring local image data by calling a camera of a client device. The device is implemented by software and/or hardware, and is configured in electronic equipment with certain data computing capabilities.
如图7所示的一种图像获取装置700,包括:摄像头开启请求获取模块710和图像采集模块720;其中,摄像头开启请求获取模块710,设置为获取摄像头开启请求和目标云应用的窗口亮度;所述摄像头开启请求以及所述目标云应用的窗口亮度响应于所述目标云应用发起的图像获取请求确定;图像采集模块720,设置为根据所述目标云应用的窗口亮度控制客户端的屏幕亮度,根据所述摄像头开启请求开启摄像头,并基于所述经控制的客户端的屏幕亮度使用所述摄像头进行图像采集。An image acquisition device 700 as shown in FIG. 7 , comprising: a camera opening request acquisition module 710 and an image acquisition module 720; wherein the camera opening request acquisition module 710 is configured to acquire the camera opening request and the window brightness of the target cloud application; The camera opening request and the window brightness of the target cloud application are determined in response to the image acquisition request initiated by the target cloud application; the image acquisition module 720 is configured to control the screen brightness of the client according to the window brightness of the target cloud application, The camera is turned on according to the camera turn-on request, and the camera is used to collect images based on the controlled screen brightness of the client.
本公开实施例的技术方案,获取摄像头开启请求和目标云应用的窗口亮度,进而根据目标云应用的窗口亮度控制客户端的屏幕亮度,根据所述摄像头开启请求开启摄像头,并基于经控制的客户端的屏幕亮度使用摄像头进行图像采集,实现了在云手机获取客户端本地图像数据的效果。The technical solution of the embodiment of the present disclosure obtains the camera opening request and the window brightness of the target cloud application, and then controls the screen brightness of the client according to the window brightness of the target cloud application, opens the camera according to the camera opening request, and based on the controlled client's The screen brightness uses the camera for image collection, realizing the effect of obtaining the local image data of the client in the cloud mobile phone.
图像采集模块720,包括:亮度比对单元,设置为将客户端的初始屏幕亮度和所述目标云应用的窗口亮度进行比对;亮度调节单元,设置为在所述客户端的初始屏幕亮度与所述目标云应用的窗口亮度不一致的情况下,存储所述客户端的初始屏幕亮度,并将所述客户端的初始屏幕亮度调节为所述目标云应用的窗口亮度。The image acquisition module 720 includes: a brightness comparison unit configured to compare the initial screen brightness of the client with the window brightness of the target cloud application; a brightness adjustment unit configured to compare the brightness of the initial screen of the client with the brightness of the target cloud application. If the window brightness of the target cloud application is inconsistent, store the initial screen brightness of the client, and adjust the initial screen brightness of the client to the window brightness of the target cloud application.
图像获取装置700,还包括:摄像头关闭模块,设置为响应于摄像头关闭请求,关闭所述摄像头;亮度恢复模块,设置为依据所述存储的客户端的初始屏幕亮度,对所述客户端的当前屏幕亮度进行恢复。The image acquisition device 700 also includes: a camera closing module, configured to close the camera in response to the camera closing request; a brightness restoration module, configured to adjust the current screen brightness of the client according to the stored initial screen brightness of the client. to recover.
本公开实施例所提供的图像获取装置可执行本公开任意实施例所提供的图像获取方法,具备执行方法相应的功能模块和效果。The image acquisition device provided in the embodiments of the present disclosure can execute the image acquisition method provided in any embodiment of the present disclosure, and has corresponding functional modules and effects for executing the method.
本公开的技术方案中,所涉及的用户个人信息的收集、存储、使用、加工、传输、提供和公开等处理,均符合相关法律法规的规定,且不违背公序良俗。In the technical solution of this disclosure, the collection, storage, use, processing, transmission, provision, and disclosure of user personal information involved are all in compliance with relevant laws and regulations, and do not violate public order and good customs.
根据本公开的实施例,本公开还提供了一种电子设备、一种可读存储介质和一种计算机程序产品。According to the embodiments of the present disclosure, the present disclosure also provides an electronic device, a readable storage medium, and a computer program product.
图8示出了可以实施本公开的实施例的示例电子设备800的示意性框图。电子设备可以是多种形式的数字计算机,诸如,膝上型计算机、台式计算机、工作台、个人数字助理、服务器、刀片式服务器、大型计算机、和其它的计算机。电子设备还可以是多种形式的移动装置,诸如,个人数字处理、蜂窝电话、智能电话、可穿戴设备和其它的计算装置。本文所示的部件、它们的连接和关系、以及它们的功能仅仅作为示例,并且不意在限制本文中描述的和/或者要求的本公开的实现。FIG. 8 shows a schematic block diagram of an example electronic device 800 in which embodiments of the present disclosure may be implemented. Electronic devices may be various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other computers. Electronic devices may also be various forms of mobile devices, such as personal digital processing, cellular telephones, smart phones, wearable devices, and other computing devices. The components shown herein, their connections and relationships, and their functions, are by way of example only, and are not intended to limit implementations of the disclosure described and/or claimed herein.
如图8所示,设备800包括计算单元801,其可以根据存储在只读存储器(Read-Only Memory,ROM)802中的计算机程序或者从存储单元808加载到随机访问存储器(Random Access Memory,RAM)803中的计算机程序,来执行多种动作和处理。在RAM 803中,还可存储设备800操作所需的多种程序和数据。计算单元801、ROM 802以及RAM 803通过总线804彼此相连。输入/输出(Input/Output,I/O)接口805也连接至总线804。As shown in FIG. 8 , the device 800 includes a computing unit 801 that can be loaded into a random access memory (Random Access Memory, RAM) according to a computer program stored in a read-only memory (Read-Only Memory, ROM) 802 or from a storage unit 808. ) 803 to perform various actions and processes. In the RAM 803, various programs and data necessary for the operation of the device 800 can also be stored. The computing unit 801, ROM 802, and RAM 803 are connected to each other through a bus 804. An input/output (Input/Output, I/O) interface 805 is also connected to the bus 804 .
设备800中的多个部件连接至I/O接口805,包括:输入单元806,例如键盘、鼠标等;输出单元807,例如多种类型的显示器、扬声器等;存储单元808,例如磁盘、光盘等;以及通信单元809,例如网卡、调制解调器、无线通信收发机等。通信单元809允许设备800通过诸如因特网的计算机网络和/或多种电信网络与其他设备交换信息/数据。Multiple components in the device 800 are connected to the I/O interface 805, including: an input unit 806, such as a keyboard, a mouse, etc.; an output unit 807, such as various types of displays, speakers, etc.; a storage unit 808, such as a magnetic disk, an optical disk, etc. ; and a communication unit 809, such as a network card, a modem, a wireless communication transceiver, and the like. The communication unit 809 allows the device 800 to exchange information/data with other devices over a computer network such as the Internet and/or various telecommunication networks.
计算单元801可以是多种具有处理和计算能力的通用和/或专用处理组件。计算单元801的一些示例包括但不限于中央处理单元(Central Processing Unit,CPU)、图形处理单元(Graphics Processing Unit,GPU)、多种专用的人工智能(Artificial Intelligence,AI)计算芯片、多种运行机器学习模型算法的计算单元、数字信号处理器(Digital Singnal Processor,DSP)、以及任一种处理器、控制器、微控制器等。计算单元801执行上文所描述的多个方法和处理,例如图像获取方法。例如,在一些实施例中,图像获取方法可被实现为计算机软件程序,其被有形地包含于机器可读介质,例如存储单元808。在一些实施例中,计算机程序的部分或者全部可以经由ROM 802和/或通信单元809而被载入和/或安装到设备800上。当计算机程序加载到RAM 803并由计算单元801执行时,可以执行上文描述的图像获取方法的一个或多个步骤。备选地,在其他实施例 中,计算单元801可以通过其他任何方式(例如,借助于固件)而被配置为执行图像获取方法。 Computing unit 801 may be various general-purpose and/or special-purpose processing components having processing and computing capabilities. Some examples of computing unit 801 include, but are not limited to, a central processing unit (Central Processing Unit, CPU), a graphics processing unit (Graphics Processing Unit, GPU), various dedicated artificial intelligence (Artificial Intelligence, AI) computing chips, various operating The computing unit of the machine learning model algorithm, the digital signal processor (Digital Singnal Processor, DSP), and any kind of processor, controller, microcontroller, etc. The calculation unit 801 executes various methods and processes described above, such as an image acquisition method. For example, in some embodiments, the image acquisition method may be implemented as a computer software program tangibly embodied on a machine-readable medium, such as storage unit 808 . In some embodiments, part or all of the computer program may be loaded and/or installed on the device 800 via the ROM 802 and/or the communication unit 809. When the computer program is loaded into RAM 803 and executed by computing unit 801, one or more steps of the image acquisition method described above may be performed. Alternatively, in other embodiments, the computing unit 801 may be configured in any other way (for example, by means of firmware) to execute the image acquisition method.
本文中以上描述的系统和技术的多种实施方式可以在数字电子电路系统、集成电路系统、现场可编程门阵列(Field Programmable Gate Array,FPGA)、专用集成电路(Application Specific Integrated Circuit,ASIC)、专用标准产品(Application Specific Standard Parts,ASSP)、芯片上的系统(System on Chip,SOC)、复杂可编程逻辑设备(Complex Programmable Logic Device,CPLD)、计算机硬件、固件、软件、和/或它们的组合中实现。这些多种实施方式可以包括:实施在一个或者多个计算机程序中,该一个或者多个计算机程序可在包括至少一个可编程处理器的可编程系统上执行和/或解释,该可编程处理器可以是专用或者通用可编程处理器,可以从存储系统、至少一个输入装置、和至少一个输出装置接收数据和指令,并且将数据和指令传输至该存储系统、该至少一个输入装置、和该至少一个输出装置。Various implementations of the systems and technologies described above in this paper can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (Field Programmable Gate Array, FPGA), application specific integrated circuits (Application Specific Integrated Circuit, ASIC), Application Specific Standard Parts (ASSP), System on Chip (System on Chip, SOC), Complex Programmable Logic Device (Complex Programmable Logic Device, CPLD), computer hardware, firmware, software, and/or their realized in combination. These various embodiments may include being implemented in one or more computer programs executable and/or interpreted on a programmable system including at least one programmable processor, the programmable processor Can be special-purpose or general-purpose programmable processor, can receive data and instruction from storage system, at least one input device, and at least one output device, and transmit data and instruction to this storage system, this at least one input device, and this at least one output device an output device.
用于实施本公开的方法的程序代码可以采用一个或多个编程语言的任何组合来编写。这些程序代码可以提供给通用计算机、专用计算机或其他可编程数据处理装置的处理器或控制器,使得当程序代码由处理器或控制器执行时,流程图和/或框图中所规定的功能/操作被实施。程序代码可以完全在机器上执行、部分地在机器上执行,作为独立软件包部分地在机器上执行且部分地在远程机器上执行或完全在远程机器或服务器上执行。Program codes for implementing the methods of the present disclosure may be written in any combination of one or more programming languages. These program codes can be provided to processors or controllers of general-purpose computers, special-purpose computers, or other programmable data processing devices, so that when the program codes are executed by the processors or controllers, the functions/functions specified in the flowcharts and/or block diagrams Action is implemented. The program code may execute entirely on the machine, partly on the machine, as a stand-alone software package partly on the machine and partly on a remote machine or entirely on the remote machine or server.
在本公开的上下文中,机器可读介质可以是有形的介质,其可以包含或存储以供指令执行系统、装置或设备使用或与指令执行系统、装置或设备结合地使用的程序。机器可读介质可以是机器可读信号介质或机器可读储存介质。机器可读介质可以包括但不限于电子的、磁性的、光学的、电磁的、红外的、或半导体系统、装置或设备,或者上述内容的任何组合。示例性的,机器可读存储介质包括基于一个或多个线的电气连接、便携式计算机盘、硬盘、RAM、ROM、可擦除可编程只读存储器(Erasable Programmable Read-Only Memory,EPROM)或快闪存储器、光纤、便捷式紧凑盘只读存储器(Compact Disc Read-Only Memory,CD-ROM)、光学储存设备、磁储存设备、或上述内容的任何组合。In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, apparatus, or device. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any combination of the foregoing. Exemplary, a machine-readable storage medium includes one or more wire-based electrical connections, a portable computer disk, a hard disk, RAM, ROM, Erasable Programmable Read-Only Memory (EPROM) or flash memory. Flash memory, fiber optics, Compact Disc Read-Only Memory (CD-ROM), optical storage devices, magnetic storage devices, or any combination of the above.
为了提供与用户的交互,可以在计算机上实施此处描述的系统和技术,该计算机具有:设置为向用户显示信息的显示装置(例如,阴极射线管(Cathode Ray Tube,CRT)或者液晶显示器(Liquid Crystal Display,LCD));以及键盘和指向装置(例如,鼠标或者轨迹球),用户可以通过该键盘和该指向装置来将输入提供给计算机。其它种类的装置还可以设置为提供与用户的交互;例如,提供给用户的反馈可以是任何形式的传感反馈(例如,视觉反馈、听觉反馈、 或者触觉反馈);并且可以用任何形式(包括声输入、语音输入或者、触觉输入)来接收来自用户的输入。To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having a display device (e.g., a cathode ray tube (CRT) or a liquid crystal display ( Liquid Crystal Display (LCD)); and a keyboard and pointing device (e.g., a mouse or trackball) through which a user can provide input to the computer. Other types of devices may also be configured to provide interaction with the user; for example, the feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and may be in any form (including Acoustic input, speech input or, tactile input) to receive input from the user.
可以将此处描述的系统和技术实施在包括后台部件的计算系统(例如,作为数据服务器)、或者包括中间件部件的计算系统(例如,应用服务器)、或者包括前端部件的计算系统(例如,具有图形用户界面或者网络浏览器的用户计算机,用户可以通过该图形用户界面或者该网络浏览器来与此处描述的系统和技术的实施方式交互)、或者包括这种后台部件、中间件部件、或者前端部件的任何组合的计算系统中。可以通过任何形式或者介质的数字数据通信(例如,通信网络)来将系统的部件相互连接。通信网络的示例包括:局域网(Local Area Network,LAN)、广域网(Wide Area Network,WAN)和互联网。The systems and techniques described herein can be implemented in a computing system that includes back-end components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes front-end components (e.g., as a a user computer having a graphical user interface or web browser through which a user can interact with embodiments of the systems and techniques described herein), or including such backend components, middleware components, Or any combination of front-end components in a computing system. The components of the system can be interconnected by any form or medium of digital data communication, eg, a communication network. Examples of communication networks include: Local Area Network (LAN), Wide Area Network (Wide Area Network, WAN), and the Internet.
计算机系统可以包括客户端和服务器。客户端和服务器一般远离彼此并且通常通过通信网络进行交互。通过在相应的计算机上运行具有客户端-服务器关系的计算机程序来产生客户端和服务器的关系。服务器可以是云服务器,也可以为分布式系统的服务器,或者是结合了区块链的服务器。A computer system may include clients and servers. Clients and servers are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by running a computer program having a client-server relationship on the respective computers. The server can be a cloud server, a server of a distributed system, or a server combined with a blockchain.
可以对上面所示的多种形式的流程,重新排序、增加或删除步骤。例如,本发公开中记载的多个步骤可以并行地执行也可以顺序地执行也可以不同的次序执行,只要能够实现本公开的技术方案所期望的结果,本文在此不进行限制。Steps can be reordered, added, or removed from the various forms of flow shown above. For example, multiple steps described in the present disclosure may be executed in parallel, sequentially, or in a different order, as long as the desired result of the technical solution of the present disclosure can be achieved, there is no limitation herein.

Claims (17)

  1. 一种图像获取方法,包括:An image acquisition method, comprising:
    获取目标云应用发起的图像获取请求;Obtain an image acquisition request initiated by the target cloud application;
    响应于所述图像获取请求,获取所述目标云应用的窗口亮度,并向客户端发送摄像头开启请求和所述目标云应用的窗口亮度,以指示所述客户端根据所述目标云应用的窗口亮度控制所述客户端的屏幕亮度,根据所述摄像头开启请求开启摄像头,并基于所述经控制的客户端的屏幕亮度使用所述摄像头进行图像采集。In response to the image acquisition request, acquire the window brightness of the target cloud application, and send a camera opening request and the window brightness of the target cloud application to the client, to instruct the client to use the window brightness of the target cloud application The brightness controls the screen brightness of the client, turns on the camera according to the camera opening request, and uses the camera to collect images based on the controlled screen brightness of the client.
  2. 根据权利要求1所述的图像获取方法,其中,所述响应于所述图像获取请求,获取所述目标云应用的窗口亮度,并向客户端发送摄像头开启请求和所述目标云应用的窗口亮度,包括:The image acquisition method according to claim 1, wherein, in response to the image acquisition request, acquire the window brightness of the target cloud application, and send a camera opening request and the window brightness of the target cloud application to the client ,include:
    通过云手机的操作系统,响应于所述图像获取请求,开启所述云手机的摄像头驱动,并获取所述目标云应用的窗口亮度,将所述目标云应用的窗口亮度发送至所述云手机中的远程交互服务;Through the operating system of the cloud mobile phone, in response to the image acquisition request, open the camera driver of the cloud mobile phone, and obtain the window brightness of the target cloud application, and send the window brightness of the target cloud application to the cloud mobile phone remote interactive services in
    在所述远程交互服务监测到所述云手机的摄像头驱动启动后,通过控制服务向所述客户端发送摄像头开启请求和所述目标云应用的窗口亮度。After the remote interaction service detects that the camera driver of the cloud mobile phone is started, a camera start request and the window brightness of the target cloud application are sent to the client through the control service.
  3. 根据权利要求1所述的图像获取方法,在所述向客户端发送摄像头开启请求和所述目标云应用的窗口亮度之后,还包括:The image acquisition method according to claim 1, after sending the camera opening request and the window brightness of the target cloud application to the client, further comprising:
    通过云手机中的远程交互服务,从控制服务获取所述客户端反馈的图像数据,并将所述图像数据转换为设定格式后写入至所述云手机的摄像头驱动;Through the remote interactive service in the cloud mobile phone, the image data fed back by the client is obtained from the control service, and the image data is converted into a set format and then written to the camera driver of the cloud mobile phone;
    通过所述云手机的操作系统,将写入所述云手机的摄像头驱动的图像数据提供给所述目标云应用。Through the operating system of the cloud mobile phone, the image data written into the camera drive of the cloud mobile phone is provided to the target cloud application.
  4. 根据权利要求1所述的图像获取方法,在所述向客户端发送摄像头开启请求和所述目标云应用的窗口亮度之后,还包括:The image acquisition method according to claim 1, after sending the camera opening request and the window brightness of the target cloud application to the client, further comprising:
    通过云手机的操作系统,响应于所述目标云应用发起的图像终止请求,关闭所述云手机的摄像头驱动;Through the operating system of the cloud mobile phone, in response to the image termination request initiated by the target cloud application, closing the camera driver of the cloud mobile phone;
    在所述云手机中的远程交互服务监测到所述云手机的摄像头驱动关闭后,通过控制服务向所述客户端发送摄像头关闭请求,以指示所述客户端关闭所述摄像头。After the remote interactive service in the cloud mobile phone detects that the camera driver of the cloud mobile phone is turned off, it sends a camera shutdown request to the client through the control service to instruct the client to turn off the camera.
  5. 一种图像获取方法,包括:An image acquisition method, comprising:
    获取摄像头开启请求和目标云应用的窗口亮度;所述摄像头开启请求以及所述目标云应用的窗口亮度响应于所述目标云应用发起的图像获取请求确定;Obtaining the camera opening request and the window brightness of the target cloud application; the camera opening request and the window brightness of the target cloud application are determined in response to the image acquisition request initiated by the target cloud application;
    根据所述目标云应用的窗口亮度控制客户端的屏幕亮度,根据所述摄像头开启请求开启摄像头,并基于所述经控制的客户端的屏幕亮度使用所述摄像头进行图像采集。Control the screen brightness of the client according to the window brightness of the target cloud application, turn on the camera according to the camera opening request, and use the camera to collect images based on the controlled screen brightness of the client.
  6. 根据权利要求5所述的图像获取方法,其中,所述根据所述目标云应用的窗口亮度控制客户端的屏幕亮度,包括:The image acquisition method according to claim 5, wherein said controlling the screen brightness of the client according to the window brightness of the target cloud application comprises:
    将客户端的初始屏幕亮度和所述目标云应用的窗口亮度进行比对;Comparing the initial screen brightness of the client with the window brightness of the target cloud application;
    在所述客户端的初始屏幕亮度与所述目标云应用的窗口亮度不一致的情况下,存储所述客户端的初始屏幕亮度,并将所述客户端的初始屏幕亮度调节为所述目标云应用的窗口亮度。When the initial screen brightness of the client is inconsistent with the window brightness of the target cloud application, store the initial screen brightness of the client, and adjust the initial screen brightness of the client to the window brightness of the target cloud application .
  7. 根据权利要求6所述的图像获取方法,所述基于所述经控制的客户端的屏幕亮度使用所述摄像头进行图像采集之后,还包括:The image acquisition method according to claim 6, after the said camera is used for image acquisition based on the screen brightness of the controlled client, further comprising:
    响应于摄像头关闭请求,关闭所述摄像头;closing the camera in response to the camera closing request;
    依据所述存储的客户端的初始屏幕亮度,对所述客户端的当前屏幕亮度进行恢复。Restoring the current screen brightness of the client according to the stored initial screen brightness of the client.
  8. 一种图像获取装置,包括:An image acquisition device, comprising:
    图像获取请求获取模块,设置为获取目标云应用发起的图像获取请求;The image acquisition request acquisition module is configured to acquire the image acquisition request initiated by the target cloud application;
    摄像头开启请求发送模块,设置为响应于所述图像获取请求,获取所述目标云应用的窗口亮度,并向客户端发送摄像头开启请求和所述目标云应用的窗口亮度,以指示所述客户端根据所述目标云应用的窗口亮度控制所述客户端的屏幕亮度,根据所述摄像头开启请求开启摄像头,并基于所述经控制的客户端的屏幕亮度使用所述摄像头进行图像采集。The camera opening request sending module is configured to respond to the image acquisition request, obtain the window brightness of the target cloud application, and send the camera opening request and the window brightness of the target cloud application to the client to instruct the client Control the screen brightness of the client according to the window brightness of the target cloud application, turn on the camera according to the camera opening request, and use the camera to collect images based on the controlled screen brightness of the client.
  9. 根据权利要求8所述的图像获取装置,其中,所述摄像头开启请求发送模块,包括:The image acquisition device according to claim 8, wherein the camera opening request sending module includes:
    驱动开启单元,设置为通过云手机的操作系统,响应于所述图像获取请求,开启所述云手机的摄像头驱动,并获取所述目标云应用的窗口亮度,将所述目标云应用的窗口亮度发送至所述云手机中的远程交互服务;The drive opening unit is configured to respond to the image acquisition request through the operating system of the cloud mobile phone, open the camera driver of the cloud mobile phone, and obtain the window brightness of the target cloud application, and set the window brightness of the target cloud application to Send to the remote interactive service in the cloud mobile phone;
    摄像头开启请求发送单元,设置为在所述远程交互服务监测到所述云手机的摄像头驱动启动后,通过控制服务向所述客户端发送摄像头开启请求和所述目标云应用的窗口亮度。The camera opening request sending unit is configured to send the camera opening request and the window brightness of the target cloud application to the client through the control service after the remote interactive service monitors that the camera driver of the cloud mobile phone starts.
  10. 根据权利要求8所述的图像获取装置,还包括:The image acquisition device according to claim 8, further comprising:
    图像数据获取模块,设置为通过云手机中的远程交互服务,从控制服务获取所述客户端反馈的图像数据,并将所述图像数据转换为设定格式后写入至所述云手机的摄像头驱动;The image data acquisition module is configured to obtain the image data fed back by the client from the control service through the remote interactive service in the cloud mobile phone, and convert the image data into a set format and write it to the camera of the cloud mobile phone drive;
    图像数据提供模块,设置为通过所述云手机的操作系统,将写入所述云手机的摄像头驱动的图像数据提供给所述目标云应用。The image data providing module is configured to provide the image data written into the camera driver of the cloud phone to the target cloud application through the operating system of the cloud phone.
  11. 根据权利要求8所述的图像获取装置,还包括:The image acquisition device according to claim 8, further comprising:
    驱动关闭模块,设置为通过云手机的操作系统,响应于所述目标云应用发起的图像终止请求,关闭所述云手机的摄像头驱动;The drive closing module is configured to close the camera driver of the cloud mobile phone in response to the image termination request initiated by the target cloud application through the operating system of the cloud mobile phone;
    摄像头关闭请求发送模块,设置为在所述云手机中的远程交互服务监测到所述云手机的摄像头驱动关闭后,通过控制服务向所述客户端发送摄像头关闭请求,以指示所述客户端关闭所述摄像头。The camera closing request sending module is configured to send a camera closing request to the client through the control service after the remote interactive service in the cloud mobile phone detects that the camera driver of the cloud mobile phone is closed, to instruct the client to close the camera.
  12. 一种图像获取装置,包括:An image acquisition device, comprising:
    摄像头开启请求获取模块,设置为获取摄像头开启请求和目标云应用的窗口亮度;所述摄像头开启请求以及所述目标云应用的窗口亮度响应于所述目标云应用发起的图像获取请求确定;The camera opening request acquisition module is configured to obtain the camera opening request and the window brightness of the target cloud application; the camera opening request and the window brightness of the target cloud application are determined in response to the image acquisition request initiated by the target cloud application;
    图像采集模块,设置为根据所述目标云应用的窗口亮度控制客户端的屏幕亮度,根据所述摄像头开启请求开启摄像头,并基于所述经控制的客户端的屏幕亮度使用所述摄像头进行图像采集。The image acquisition module is configured to control the screen brightness of the client according to the window brightness of the target cloud application, turn on the camera according to the camera opening request, and use the camera to perform image acquisition based on the controlled screen brightness of the client.
  13. 根据权利要求12所述的图像获取装置,其中,所述图像采集模块,包括:The image acquisition device according to claim 12, wherein the image acquisition module comprises:
    亮度比对单元,设置为将客户端的初始屏幕亮度和所述目标云应用的窗口亮度进行比对;A brightness comparison unit, configured to compare the initial screen brightness of the client with the window brightness of the target cloud application;
    亮度调节单元,设置为在所述客户端的初始屏幕亮度与所述目标云应用的窗口亮度不一致的情况下,存储所述客户端的初始屏幕亮度,并将所述客户端的初始屏幕亮度调节为所述目标云应用的窗口亮度。a brightness adjustment unit, configured to store the initial screen brightness of the client and adjust the initial screen brightness of the client to the The window brightness of the target cloud application.
  14. 根据权利要求13所述的图像获取装置,还包括:The image acquisition device according to claim 13, further comprising:
    摄像头关闭模块,设置为响应于摄像头关闭请求,关闭所述摄像头;The camera closing module is configured to close the camera in response to the camera closing request;
    亮度恢复模块,设置为依据所述存储的客户端的初始屏幕亮度,对所述客户端的当前屏幕亮度进行恢复。The brightness restoration module is configured to restore the current screen brightness of the client according to the stored initial screen brightness of the client.
  15. 一种电子设备,包括:An electronic device comprising:
    至少一个处理器;以及at least one processor; and
    与所述至少一个处理器通信连接的存储器;memory communicatively coupled to the at least one processor;
    其中,所述存储器存储有可被所述至少一个处理器执行的指令,所述指令被所述至少一个处理器执行,以使所述至少一个处理器能够执行权利要求1-7中任一项所述的图像获取方法。Wherein, the memory stores instructions executable by the at least one processor, the instructions are executed by the at least one processor, so that the at least one processor can perform any one of claims 1-7 The image acquisition method described.
  16. 一种非瞬时计算机可读存储介质,所述存储介质中存储有计算机指令,所述计算机指令用于使所述计算机执行权利要求1-7中任一项所述的图像获取方法。A non-transitory computer-readable storage medium, wherein computer instructions are stored in the storage medium, and the computer instructions are used to make the computer execute the image acquisition method according to any one of claims 1-7.
  17. 一种计算机程序产品,包括计算机程序或指令中的至少之一,所述计算机程序或指令中的至少之一在被处理器执行时实现权利要求1-7中任一项所述的图像获取方法。A computer program product, comprising at least one of computer programs or instructions, at least one of said computer programs or instructions implements the image acquisition method described in any one of claims 1-7 when executed by a processor .
PCT/CN2022/127760 2021-11-03 2022-10-26 Image acquisition method and apparatus, device, storage medium, and program product WO2023078142A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202111295459.5A CN114051067B (en) 2021-11-03 2021-11-03 Image acquisition method, device, equipment and storage medium
CN202111295459.5 2021-11-03

Publications (1)

Publication Number Publication Date
WO2023078142A1 true WO2023078142A1 (en) 2023-05-11

Family

ID=80206950

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/127760 WO2023078142A1 (en) 2021-11-03 2022-10-26 Image acquisition method and apparatus, device, storage medium, and program product

Country Status (2)

Country Link
CN (1) CN114051067B (en)
WO (1) WO2023078142A1 (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114051067B (en) * 2021-11-03 2023-11-03 北京百度网讯科技有限公司 Image acquisition method, device, equipment and storage medium
CN115633118A (en) * 2022-09-30 2023-01-20 联想(北京)有限公司 Data processing method and device

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107240072A (en) * 2017-04-27 2017-10-10 努比亚技术有限公司 A kind of screen luminance adjustment method, terminal and computer-readable recording medium
CN111371954A (en) * 2020-03-11 2020-07-03 广州微算互联信息技术有限公司 Method and device for dynamically adjusting cloud mobile phone resource configuration
WO2021070982A1 (en) * 2019-10-08 2021-04-15 엘지전자 주식회사 Electronic device for sharing content and control method therefor
CN112839175A (en) * 2021-01-12 2021-05-25 无锡鲲鲸云科技有限公司 Method and device for acquiring image by cloud mobile phone, computer equipment and medium
CN113347372A (en) * 2021-06-18 2021-09-03 深圳传音通讯有限公司 Shooting light supplement method, mobile terminal and readable storage medium
CN113556568A (en) * 2021-07-21 2021-10-26 北京奇艺世纪科技有限公司 Cloud application program operation method, system, device and storage medium
CN114051067A (en) * 2021-11-03 2022-02-15 北京百度网讯科技有限公司 Image acquisition method, apparatus, device, storage medium, and program product

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103533034A (en) * 2013-09-28 2014-01-22 福建星网锐捷软件有限公司 Method for seamlessly using cloud terminal local camera in VDI (Virtual Device Interface) virtual desktop
CN108111772B (en) * 2014-12-04 2020-12-22 Oppo广东移动通信有限公司 Shooting method and terminal
CN105635583A (en) * 2016-01-27 2016-06-01 宇龙计算机通信科技(深圳)有限公司 Shooting method and device
CN111480333B (en) * 2017-09-13 2021-09-24 深圳传音通讯有限公司 Light supplementing photographing method, mobile terminal and computer readable storage medium
CN109495506B (en) * 2018-12-24 2020-05-22 广州微算互联信息技术有限公司 Sensor data input method and server of cloud mobile phone
CN110493203A (en) * 2019-07-31 2019-11-22 湖南微算互联信息技术有限公司 A kind of cloud cell-phone camera head controlling method, system, device and storage medium
CN112492203A (en) * 2020-11-26 2021-03-12 北京指掌易科技有限公司 Virtual photographing method, device, equipment and storage medium

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107240072A (en) * 2017-04-27 2017-10-10 努比亚技术有限公司 A kind of screen luminance adjustment method, terminal and computer-readable recording medium
WO2021070982A1 (en) * 2019-10-08 2021-04-15 엘지전자 주식회사 Electronic device for sharing content and control method therefor
CN111371954A (en) * 2020-03-11 2020-07-03 广州微算互联信息技术有限公司 Method and device for dynamically adjusting cloud mobile phone resource configuration
CN112839175A (en) * 2021-01-12 2021-05-25 无锡鲲鲸云科技有限公司 Method and device for acquiring image by cloud mobile phone, computer equipment and medium
CN113347372A (en) * 2021-06-18 2021-09-03 深圳传音通讯有限公司 Shooting light supplement method, mobile terminal and readable storage medium
CN113556568A (en) * 2021-07-21 2021-10-26 北京奇艺世纪科技有限公司 Cloud application program operation method, system, device and storage medium
CN114051067A (en) * 2021-11-03 2022-02-15 北京百度网讯科技有限公司 Image acquisition method, apparatus, device, storage medium, and program product

Also Published As

Publication number Publication date
CN114051067A (en) 2022-02-15
CN114051067B (en) 2023-11-03

Similar Documents

Publication Publication Date Title
WO2023078142A1 (en) Image acquisition method and apparatus, device, storage medium, and program product
WO2021135160A1 (en) Gaming live stream control method and device, computer storage medium, and electronic apparatus
WO2020042350A1 (en) Desktop screen projection method and device, apparatus, and storage medium
EP3046331B1 (en) Media control method and system based on cloud desktop
CN110430441B (en) Cloud mobile phone video acquisition method, system, device and storage medium
WO2019179283A1 (en) Image recognition method and device
CN107241563B (en) Video transmission method, intelligent mobile terminal and device with storage function
US9344678B2 (en) Information processing apparatus, information processing method and computer-readable storage medium
CN109085950B (en) Multi-screen interaction method and device based on electronic whiteboard and electronic whiteboard
CN113542875B (en) Video processing method, device, electronic equipment and storage medium
WO2016070688A1 (en) Remote control method and system for virtual operation interface
EP3410302A1 (en) Graphic instruction data processing method, apparatus and system
CN103517072A (en) Video communication method and video communication equipment
US20220076476A1 (en) Method for generating user avatar, related apparatus and computer program product
WO2020062998A1 (en) Image processing method, storage medium, and electronic device
WO2023066183A1 (en) Data processing method and apparatus, device, and storage medium
WO2023045551A1 (en) Camera control method and system, electronic device and storage medium
WO2022057362A1 (en) Image processing method and apparatus, cloud real machine system, storage medium, and electronic device
CN116866658A (en) Video data processing method, device, equipment and medium
CN104391576A (en) Remote input method and device based on wireless Ethernet
CN116033235B (en) Data transmission method, digital person production equipment and digital person display equipment
CN111143017A (en) Cloud operating system interaction processing method, client and cloud operating system
CN114173158B (en) Face recognition method, cloud device, client device, electronic device and medium
CN113965714B (en) Video stream processing method and device, electronic equipment and storage medium
CN114967928A (en) Screen sharing method and device, electronic equipment and medium

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22889167

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE