WO2023072038A1 - Image data processing method and electronic device - Google Patents

Image data processing method and electronic device Download PDF

Info

Publication number
WO2023072038A1
WO2023072038A1 PCT/CN2022/127267 CN2022127267W WO2023072038A1 WO 2023072038 A1 WO2023072038 A1 WO 2023072038A1 CN 2022127267 W CN2022127267 W CN 2022127267W WO 2023072038 A1 WO2023072038 A1 WO 2023072038A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
target
area
user
interface
Prior art date
Application number
PCT/CN2022/127267
Other languages
French (fr)
Chinese (zh)
Inventor
向永航
Original Assignee
维沃移动通信有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 维沃移动通信有限公司 filed Critical 维沃移动通信有限公司
Publication of WO2023072038A1 publication Critical patent/WO2023072038A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/70Protecting specific internal or peripheral components, in which the protection of a component leads to protection of the entire computer
    • G06F21/82Protecting input, output or interconnection devices
    • G06F21/84Protecting input, output or interconnection devices output devices, e.g. displays or monitors
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/60Protecting data
    • G06F21/62Protecting access to data via a platform, e.g. using keys or access control rules
    • G06F21/6218Protecting access to data via a platform, e.g. using keys or access control rules to a system of files or objects, e.g. local or distributed file system or database
    • G06F21/6245Protecting personal data, e.g. for financial or medical purposes

Definitions

  • the present application belongs to the field of artificial intelligence, and specifically relates to an image data processing method and electronic equipment.
  • the purpose of the embodiments of the present application is to provide a method for processing image data and an electronic device, which can solve the problem of leakage of user's private data in the prior art.
  • the embodiment of the present application provides a method for processing image data, the method comprising:
  • the matching degree between the first image and the display content of the interface is less than or equal to a target value, privacy processing is performed on the first image, or prompt information is output.
  • an embodiment of the present application provides an electronic device, and the electronic device includes:
  • the first image acquisition module is used to acquire the first image collected by the camera, and the first image includes the face image area of the target user;
  • the first image processing module is configured to perform privacy processing on the first image or output prompt information when the matching degree between the first image and the display content of the interface is less than or equal to a target value.
  • the embodiment of the present application provides an electronic device, the electronic device includes: a processor, a memory, and a program or instruction stored in the memory and operable on the processor, the program or instruction When executed by the processor, the steps of the image data processing method according to the first aspect are realized.
  • an embodiment of the present application provides a chip, the chip includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is used to run programs or instructions, so as to implement the first aspect The processing method of the image data.
  • the first image captured by the camera is first obtained, the first image includes the face image area of the target user, and when the matching degree between the first image and the display content of the interface is less than or equal to the target value
  • perform privacy processing on the first image, or output prompt information that is, match the first image actually captured by the camera with the content actually displayed on the interface of the target application, if the matching degree is less than or equal to the target value, the first image actually collected by the camera cannot be completely displayed on the interface of the target application, and the part of the first image that is not displayed on the interface of the target application may contain the user's private data, so it will There is a risk that the user's private data will be leaked without knowing it.
  • the disclosure of the private data of the target user achieves the effect of protecting the private data of the user, and improves the security of the image data captured by the target application when calling the camera for shooting.
  • Fig. 1 is a first schematic flow chart of the image data processing method provided by the embodiment of the present application.
  • Fig. 2 is a second schematic flow chart of the image data processing method provided by the embodiment of the present application.
  • FIG. 3 is a schematic diagram of the implementation principle of the first image privacy protection processing of the image data processing method provided by the embodiment of the present application;
  • Fig. 4 is a schematic diagram of the implementation principle of the second image privacy protection processing of the image data processing method provided by the embodiment of the present application;
  • Fig. 5 is a third schematic flow chart of the image data processing method provided by the embodiment of the present application.
  • FIG. 6 is a schematic diagram of the composition of the first module of the electronic device provided by the embodiment of the present application.
  • FIG. 7 is a schematic diagram of the second type of module composition of the electronic device provided by the embodiment of the present application.
  • FIG. 8 is a schematic structural diagram of an electronic device provided by an embodiment of the present application.
  • Fig. 1 is a schematic flow chart of the first image data processing method provided by the embodiment of the present application.
  • the method in Fig. 1 can be executed by an electronic device, especially a processor in the electronic device.
  • the method at least Include the following steps:
  • the target application calls the camera application to call the camera to collect the first image.
  • the electronic device detects the user's access request for the specified service of the target application, if the current service processing node needs to collect the user's image data, it calls the camera application to call the camera to collect the user's first image; for example , when the user uses the payment application, if it detects that the current business processing node is face recognition, then call the camera application to call the camera to collect the user's first image; another example, when the user uses the video sharing application program, if the current business processing node The node calls the camera application for video creation and shooting, so as to call the camera to collect the first image of the user.
  • the first image may be partially displayed in the interface of the target application, that is, the first image collected by the target application calling the camera is not completely displayed in the above interface, and Since the part of the first image that is not displayed on the interface of the target application may contain the user's private data, if the first image is directly transmitted to the target application, there may be problems caused by the user not being able to observe the complete first image. Therefore, it is necessary to perform privacy processing on the first image, or output prompt information. Based on this, before the target application obtains the first image, the processor in the electronic device obtains the information collected by the camera.
  • the first image may include the face image area of the target user captured by the camera, and other image areas except the face image area, and the other image areas may include other images other than the face of the target user. At least one of the user's face image area, the non-face image area of the target user, the non-face image area of other users, and the image area of the target user's current environment;
  • the matching degree between the first image captured by the camera and the display content of the interface of the target application is less than or equal to the target value, then it is determined that the display mode of the target application is displayed in a partial area of the image, that is, the first image is displayed in the interface of the target application It is a partial display; if the matching degree between the first image captured by the camera and the display content of the interface is greater than the target value, then determine that the display mode of the target application is to display the entire area of the image, that is, the first image is fully displayed in the interface of the target application.
  • the processor in the electronic device obtains the image captured by the camera.
  • the above-mentioned method of performing privacy processing on the first image can be to perform privacy processing on other images except the face image area of the target user
  • the target image area in the area is subjected to image replacement processing, that is, the target image area is replaced or filled with publicly available data, for example, a preset image (which can be a uniform color background or other backgrounds), and then the target image area that does not contain the target user
  • a preset image which can be a uniform color background or other backgrounds
  • the first image (that is, the content of the picture actually captured by the camera) is displayed to prompt the target user to adjust the pose based on the first image, that is, to adjust the pose based on the real shooting picture displayed on the floating window in real time, so as to ensure The subsequent collected images do not contain the user's private data.
  • the user can be prompted to continue using the camera and adjust the pose, or the user can be prompted to temporarily stop using the camera function.
  • the first image actually captured by the camera by matching the first image actually captured by the camera with the content actually displayed on the interface of the target application, if the matching degree is less than or equal to the target value, then the first image actually captured by the camera An image cannot be completely displayed on the interface of the target application, and the part of the first image that is not displayed on the interface of the target application may contain the user's private data, so the user's private data may be leaked without knowing it Therefore, before transmitting the first image to the target application, it is necessary to perform privacy processing on the part of the first image that is not displayed on the interface of the target application, so as to obtain an image that does not contain user privacy data, or output a prompt information, which can reduce the risk of leakage of user privacy data due to the presence of user privacy data in the part of the first image that is not displayed on the interface of the target application, thereby avoiding the leakage of the target user’s privacy data at the root and achieving protection
  • the second image obtained by performing privacy processing on the first image is a second image that does not contain user privacy data
  • the second image can be directly transmitted to the target application.
  • the method further includes:
  • the specific application scenarios of the image data processing method provided by this application may be: face recognition, video conferencing, short video release, etc. need to use the target application for corresponding business processing, and at the same time need to call the camera application to call The scene where the camera takes pictures; wherein, the target application and the camera application are different applications;
  • the target application needs to perform face recognition on the target user based on the face image area of the target user collected by the camera; for the application scenario of video conferencing, the target application needs to The portrait data of the target user is displayed on the display interface (display screen); for the application scenario of short video publishing, the target application needs to display the short video data of the target user collected by the camera on the display interface (display screen).
  • the target application since the target application only recognizes the face data of the target user when performing face recognition on the target user, only the first image collected by the camera is displayed on the display interface of the target application.
  • the face image area of the target user in an image, that is, the matching degree between the first image and the display content of the interface is less than or equal to the target value (that is, the first image is partially displayed on the display interface of the target application), but the first image captured by the camera
  • the image includes not only the face image area of the target user, but also other image areas except the face image area of the target user. Therefore, the target user will not be able to observe the target user’s privacy information collected by the camera and transmitted to the target application.
  • the first image of the user (that is, the target user's face image area and other image areas except the target user's face image area), and then the processor performs privacy processing on the other image areas of the target user in the above-mentioned first image , and then obtain the second image, and transmit the second image obtained based on the privacy processing of the first image to the target application, that is, determine the combination of the target user’s face image area and other image areas after privacy processing as the second image, and then transmit the second image to the target application, so that the target application can perform face recognition on the target user based on the face image area of the target user in the second image; or output prompt information, and display it in the form of a floating window , to display the first image (that is, the content of the picture actually captured by the camera) to prompt the target user to adjust the pose based on the first image, that is, to adjust the pose based on the real shooting picture displayed on the floating window in real time, so as to ensure that the subsequent acquisition
  • the image does not contain the user's private data
  • the processor collects and transmits the camera to the target application in advance, and performs privacy protection processing on other image areas except the target user's face image area that may contain the target user's private data, the final transmission to the target application Other image areas do not contain the private data of the target user, so as to avoid the leakage of the user's private data from the root, and then realize the function of protecting the user's private data.
  • the processing specifically includes: performing image replacement processing on the target image area in other image areas in the first image except the target user's face image area;
  • the matching degree between the first image and the display content of the interface is less than or equal to the target value (that is, the image display mode of the target application is displayed in a partial area of the image)
  • the target value that is, the image display mode of the target application is displayed in a partial area of the image
  • the above-mentioned second image that does not contain the target user's privacy data can be transmitted to the target application, and based on this, the second image obtained based on the above-mentioned first image is transmitted to the target application, specifically including: other images based on image replacement region and the face image region of the target user to generate a second image of the target user; and transmit the second image to the target application.
  • prompt information can also be output, so that the target user can adjust the pose based on the prompt information, so as to ensure that the subsequent images collected by the camera do not contain the user's privacy data, based on
  • outputting prompt information specifically includes: displaying the first image in the form of a floating window, so as to prompt the target user to adjust the pose based on the first image.
  • the image picture actually captured by the camera can also be completely displayed in the form of a thumbnail or a floating window (that is, not only on the display interface of the target application)
  • the first image is partially displayed, and the first image is also completely displayed in the thumbnail or floating window)
  • the target user can be prompted to adjust the pose based on the fully displayed first image, so that the user can pass Pose is adjusted to ensure that the camera's image capture range does not contain private data.
  • the target user determines that the first image does not contain user privacy data after the pose adjustment
  • the image collected by the camera can be transmitted to the target application. Based on this, after outputting the prompt information, it also includes: When receiving the confirmation input that the target user's pose adjustment is completed, acquire a third image captured by the camera; and transmit the third image to the target application.
  • the processor in the electronic device can directly use the third image transmitted to the target application.
  • the target In the first image of the user other image regions except the face image region of the target user are processed for privacy and prompt information is output in combination.
  • the processor of the electronic device can first obtain the first image of the target user collected by the camera after the pose adjustment.
  • An image and when the matching degree between the first image and the display content of the interface of the target application is less than or equal to the target value, privacy processing is performed on the first image, that is, privacy risk identification is performed on the first image.
  • If there is a risk of privacy leakage perform image replacement processing on the target image area containing user privacy data in the first image, and determine the second image of the target user that does not contain user privacy data based on the first image after image replacement processing; or An image replacement process is directly performed on the target image area in the first image, and based on the first image after the image replacement process, a second image that does not contain the user privacy data of the target user is determined.
  • Step 1 displaying the face image area of the target user and other image areas except the face image area of the target user in the form of a floating window on the display interface of the target application;
  • a floating window pops up on a designated area of the display interface of the target application.
  • the floating window can be at least one of a translucent floating window and a fully transparent floating window, and the complete target user's profile is displayed on the floating window.
  • the first image i.e. the face image area of the target user and other image areas except the face image area of the target user;
  • Step 2 prompting the target user to perform pose adjustment based on the first image of the target user displayed in the floating window;
  • the above-mentioned pose adjustment may include at least one of the pose adjustment of the electronic device (that is, adjusting the pose of the camera) and the pose adjustment of the target user itself;
  • the first image area displayed in the floating window does not contain the private data of the target user;
  • Step 3 in the case of receiving the confirmation input that the target user's pose adjustment is completed, obtain the third image collected by the camera;
  • the third image acquired after receiving the confirmation input of the end of the target user's pose adjustment does not contain the private data of the target user (that is, the target of the pose adjustment is Other image areas other than the adjusted face image area of the target user do not contain the user's privacy data).
  • a floating window pops up on the display interface of the target application, and the floating window can completely display the first image (that is, the target user's facial image area and the target user's facial image area) to the target user.
  • Other image areas other than other image areas that is, the display effect shown in (b) in Figure 3, and prompt the target user to adjust the pose based on the first image of the target user displayed in the above floating window.
  • the pose adjustment will be based on the
  • the final first image is determined as the third image (that is, the third image captured by the camera is obtained), and the third image is transmitted to the target application, so that the target application performs corresponding business processing based on the third image.
  • image replacement processing is performed on the target image area in other image areas in the first image of the target user except the face image area of the target user, specifically including:
  • Step 1 determining the target image area in other image areas in the first image except the target user's face image area; wherein, the target image area includes: other image areas, or other image areas that are not displayed on the interface image area;
  • the target image area includes other image areas, perform image recognition processing on the first image, determine the area where the face image area of the target user is located, and determine the image area outside the area where the face image area is located as the target Image area: for the case where the target image area includes an image area not displayed on the interface in other image areas, based on the pre-stored positional relationship between the display area and the non-displayed area of the display interface of the target application, the non-displayed area is determined as the target image area ;
  • the pre-stored positional relationship between the display area and the non-display area of the display interface of the target application may be based on the preset default image in the complete image display area on the display screen and the image partial area display area on the display interface of the target application Determined by the proportional relationship, specifically, the default image can be transmitted to the target application first (the image transmitted from the processor to the target application and can be disclosed), and then the image part displayed by the default image on the display interface of the target application can be obtained.
  • Step 2 performing image replacement processing on the above target image area based on the preset image
  • the preset image can be a public background image such as a mosaic background or a background of uniform color.
  • a combination of the face image area of the target user in the first image and other image areas after image replacement processing except the face image area of the target user is determined as the second image of the target user.
  • image replacement processing is performed on other image areas in the first image except the face image area of the target user to obtain the updated first image area.
  • image that is, replace other image areas in the first image with preset images
  • the first image is displayed on the display interface of the , that is, the display effect shown in (a) in Figure 4, wherein the complete display effect of the first image is as shown in Figure 4 In (b), replace the undisplayed image areas in other image areas except the target user's face image area in the first image with the preset image, and obtain the target user's face image area (that is, the displayed image target user's face image area in the target user's face image area), the displayed image area in other image areas except the target user's face image area,
  • the privacy protection process is further improved by flexibly setting the range of the target image area flexibility.
  • the execution of the image privacy protection mechanism can be directly triggered, that is, the above step S104 can be directly triggered to perform privacy processing on the first image, or output prompt information; further, Considering that only the image display mode of the target application is displayed in a partial area of the image, there is a relatively high risk of privacy data leakage. Therefore, in order to improve the pertinence of image privacy protection and ensure the security of user privacy data, Improve the business processing response efficiency of the target application, that is, first confirm that the matching degree of the display content of the first image and the interface of the target application is less than or equal to the target value, that is, only when the image display mode of the target application is determined to be displayed in a partial area of the image.
  • the above step S104 when the matching degree between the first image and the display content of the interface is less than or equal to the target value, perform privacy processing on the first image, or output Before prompting information, specifically include:
  • step S108 is executed to obtain the display content of the interface, to ensure that the display content on the interface and the first image collected by the camera are collected in the same shooting environment and have part of the same image content, so that The image content comparison between the first image and the display content can be performed to determine the degree of matching between the first image and the display content, and then determine the image display mode of the target application.
  • step S108, obtaining the display content of the interface may also be executed before S102, obtaining the first image collected by the camera, or after S102, obtaining the first image collected by the camera, so as to solve the problem that the target application may Automatically call the camera to collect the first image of the target user, and then leak the user's private data.
  • the matching degree between the first image and the display content if the matching degree between the first image and the display content of the interface is less than or equal to the target value , then determine that the first image of the target user on the display interface of the target application is displayed in a partial area of the image; if the matching degree between the first image and the display content of the interface is greater than the target value, then determine the first image of the target user on the display interface of the target application Displayed for the entire area of the image.
  • the process of determining the matching degree between the first image captured by the camera and the display content of the target application interface in addition to the above-mentioned acquisition of the first image captured by the camera, the display content of the interface is acquired, and the camera captures the
  • the method of comparing the image content between the first image of the camera and the display content of the interface can also determine the matching degree between the first image captured by the camera and the display content of the target application interface based on the default image.
  • the matching degree between the first image and the display content of the target application interface is determined based on the default image, and then the image display method of the target application is determined, that is, the first image is determined to be an image Part of the area is displayed, or the entire area of the image is displayed; it can also be determined based on the default image when the target application is installed for the first time or the target application has a version update, and the target application meets the preset usage conditions.
  • Display the matching degree of content and then determine the image display mode of the target application, and store the image display mode of the target application (for example, the display of a part of the image or the display of the entire image area), so that the follow-up can be directly based on the pre-stored display mode of the target application label to determine whether the first image is displayed in a partial area of the image or in the entire area of the image;
  • the image display mode of the target application for example, the display of a part of the image or the display of the entire image area
  • the above-mentioned step S104 is performed to perform privacy processing on the above-mentioned first image, or output prompt information.
  • the first image of the target user is directly transmitted to the target application; wherein, in order to further ensure the security of private data, after determining that the display mode of the target application is displayed in the entire image area
  • the target user may be prompted to confirm that the first image displayed in the interface of the target application does not have the risk of privacy leakage, and after receiving the confirmation information of the target user, the first image of the target user is transmitted to the target application, so that the target The application performs corresponding service processing based on the first image.
  • the process of determining the match degree between the first image captured by the camera and the display content of the target application interface based on the default image, and then determining the image display mode of the target application specifically includes:
  • Step 1 displaying a default image on the display interface of the target application, and taking a screenshot of the display interface to obtain a fourth image;
  • the above-mentioned default image is different from the first image of the target user collected by the camera.
  • the default image is a default image (public image) directly transmitted by the processor to the target application, and does not contain the private data of the target user.
  • Step 2 Compare the image content of the first image captured by the camera with the display content of the default image in the interface of the target application, and determine the matching degree between the first image and the display content, that is, judge the default image and the fourth image above. Whether the area occupied by the same image between images is less than or equal to the target value;
  • the above-mentioned area occupied by the same image is specifically the area occupied by the same image between the above-mentioned default image and the above-mentioned fourth image on the fourth image (ie, the display interface); specifically, if the occupied area is less than or equal to the target value (that is, the matching degree between the first image and the display content of the interface is less than or equal to the target value), then it is determined that the image display mode of the target application is displayed in a partial area of the image, and then the first image is processed for privacy, or a prompt message is output; if the If the occupied area is greater than the target value (that is, the matching degree between the first image and the display content of the interface is greater than the target value), then it is determined that the image display mode in the target application is displayed in the entire area of the image, and the first image of the target user can be directly transmitted to the target application;
  • the target value that is, the matching degree between the first image and the display content of the interface is less than or equal to the target value
  • the process of determining the image display mode of the target application can be determined based on the default image every time, that is, the above-mentioned determination of the target application based on the default image is performed once every time the target application is detected to call the camera to take pictures.
  • the image display mode of the target application (that is, the image display mode label of the target application) is determined in advance based on the default image, and the image display mode of the target image
  • the corresponding relationship between the target application and the label of the image display mode can be stored, and the image display mode label includes: displaying a part of the image or displaying the entire area of the image; then, during the use of the target application, you can Directly based on the image display mode label, quickly determine the image display mode corresponding to the target application; wherein, if the image display mode is partial area display of the image, it is determined that the matching degree between the first image and the display content of the interface is less than or equal to the target value, and then the Privacy processing is performed on the first image, or prompt information is output.
  • the above-mentioned image display method determination process (that is, to determine the default image image of the specified application) is performed once in advance.
  • the display mode is partial image display or all image display), and the image display mode of the specified application is marked according to the determination result of the image display mode, and further, the camera is called by the target application whose image display mode is partial image display
  • step S104 is automatically performed to perform privacy processing on the first image, and then the second image obtained based on the first image is transmitted to the target application, or output prompt information to prompt the user to adjust the pose.
  • the introduction of the target application The verification mechanism of the image display method label; specifically, when it is detected that the target application has an application version update, the above steps 1 to 2 are performed, that is, the image display method of the target application is determined based on the default image again, and the new image is displayed.
  • the method updates the original image display mode, so as to determine whether to trigger the execution of the step of performing privacy processing on the first image or outputting prompt information in S104 above based on the updated image display mode label.
  • the image display mode of the target application may change. Since the target application has been marked as displayed in all areas of the image, once the image display mode There is a change, but the original image display method of the target application has not been updated. At this time, user privacy data may be leaked. Based on this, label verification can be performed on the target application that has been marked for display in all areas of the image at preset time intervals.
  • the above-mentioned image display mode of the target application based on the default image is determined once, but also according to the preset time interval , execute the above-mentioned image display mode of the target application based on the default image, and execute the above-mentioned image display mode of the target application based on the default image at a preset time interval (that is, determine whether the image display mode of the specified application for the default image is to display a part of the image or The entire area of the image is displayed), and then according to the recognition result of the image display mode, it is determined whether to update the image display mode label of the target application. Specifically, if the image display mode label recognized this time is different from the image display mode recognized last time If the mode tags are inconsistent, update the image display mode of the target application based on the recognized image display mode tag this time.
  • the image display mode tag of the target application is pre-recorded, so that during the use of the target application, it can be directly determined based on the image display mode tag whether the image display mode of the target application is partial image display or all image display Area display, there is no need to determine the image display mode of the target application based on the default image every time, so the response efficiency of the target application to the user's business request can be improved, but there may be a problem with the display mode of the application's shooting interface due to the update of the application version Therefore, it is necessary to introduce the above-mentioned label verification mechanism to verify the image display method of the target application, so as to improve the accuracy of privacy protection for the first image, thereby further improving the privacy data of the target user. security.
  • the matching degree between the first image and the display content of the interface is less than or equal to the target value, that is, it is determined that the first image is displayed in a partial area of the image on the display interface of the target application (that is, the image of the target application
  • the display method is displaying a partial area of the image), directly performing privacy processing on the first image, or outputting prompt information; further, considering that the first image is displayed as a partial area of the image on the display interface of the target application, the first image may contain privacy data that cannot be observed by the user. At this time, there will be a risk of user privacy data leakage. Correspondingly, the first image may not contain user privacy data.
  • the existing machine learning method can be used to iteratively train and update the model parameters of the preset image recognition model to obtain the updated model parameters until the model function corresponding to the image recognition model converges, and then obtain the trained image recognition model , wherein the image recognition model is used to perform image recognition on the first image, and then obtain a privacy risk recognition result.
  • the image recognition model when using the image recognition model for prediction, if the first image input to the pre-trained image recognition model contains the privacy data of the target user, then it is determined that the recognition result of the image recognition model has a risk of privacy disclosure; if the above If the result of the privacy risk identification is that there is a risk of privacy leakage, the first image is processed for privacy to obtain a second image that does not contain the private data of the target user, and then the second image is transmitted to the target application for related business processing; or a prompt is output Information, so that the target user can adjust the pose based on the real-time observed image content.
  • privacy processing can be directly performed on the first image. Further, in order to improve the pertinence of privacy processing, it is also possible to carry out privacy risk identification on the first image first, and then perform privacy processing on the first image if it is identified that the first image contains the privacy data of the target user; In the process of identifying the private data in the image, based on the identified image area where the private data is located in the first image containing the private data, corresponding prompt information can be output to prompt the target user to adjust the pose.
  • the target user can be prompted to " Privacy leak, please adjust the angle”, "Privacy leak, please pay attention to clothing”, and "Privacy leak, please change the shooting location”.
  • the image area so that the user can quickly identify the location of the private data; and/or directly replace the image area where the private data is located in the first image containing the private data with a preset image.
  • the recognition result of the image recognition model is that there is no risk of privacy leakage
  • the first image is directly transmitted to the target application for further processing.
  • the user may be prompted to confirm that there is no risk of privacy leakage, and after the user's confirmation information is detected, the above-mentioned first image is transmitted to the target application for corresponding processing. business processing.
  • the image data processing method in the embodiment of the present application first acquires the first image collected by the camera, the first image includes the face image area of the target user, and the matching degree between the first image and the display content of the interface is less than or equal to the target value, perform privacy processing on the first image, or output prompt information, that is, by matching the first image actually captured by the camera with the content actually displayed on the interface of the target application , if the matching degree is less than or equal to the target value, the first image actually captured by the camera cannot be completely displayed on the interface of the target application, and the part of the first image that is not displayed on the interface of the target application may contain user Therefore, there will be a risk that the user’s private data will be leaked without knowing it.
  • the image data processing method provided by the embodiment of the present application may be executed by an electronic device, especially a processor in the electronic device, or a control module in the electronic device for executing the image data processing method .
  • the electronic device provided in the embodiment of the present application is described by taking the image data processing method performed by the electronic device as an example.
  • FIG. 6 is a schematic diagram of the module composition of the electronic device provided in the embodiment of the present application.
  • the electronic device uses To execute the image data processing method described in FIGS. 1 to 5, as shown in FIG. 6, the electronic device includes:
  • the first image acquisition module 602 is configured to acquire a first image collected by a camera, the first image including the face image area of the target user;
  • the first image processing module 604 is configured to perform privacy processing on the first image or output prompt information when the matching degree between the first image and the display content of the interface is less than or equal to a target value.
  • the first image actually captured by the camera by matching the first image actually captured by the camera with the content actually displayed on the interface of the target application, if the matching degree is less than or equal to the target value, then the first image actually captured by the camera An image cannot be completely displayed on the interface of the target application, and the part of the first image that is not displayed on the interface of the target application may contain the user's private data, so the user's private data may be leaked without knowing it Therefore, before transmitting the first image to the target application, it is necessary to perform privacy processing on the part of the first image that is not displayed on the interface of the target application, so as to obtain an image that does not contain user privacy data, or output a prompt information, which can reduce the risk of leakage of user privacy data due to the presence of user privacy data in the part of the first image that is not displayed on the interface of the target application, thereby avoiding the leakage of the target user’s privacy data at the root and achieving protection
  • the electronic device further includes a second image transmission module 606, configured to:
  • the second image obtained based on the first image is transmitted to a target application, and the target application performs corresponding service processing based on the second image.
  • the electronic device further includes:
  • the image comparison module 610 is configured to perform image content comparison between the first image and the display content, and determine the degree of matching between the first image and the display content.
  • the first image further includes: other image areas except the face image area of the target user;
  • the first image processing module 604 is specifically used for:
  • the second image transmission module 606 is specifically used for:
  • the second image is transmitted to a target application.
  • the first image processing module 604 is further specifically configured to:
  • Determining a target image area in the other image area where the target image area includes: the other image area, or an image area not displayed on the interface in the other image area;
  • an image replacement process is performed on the target image area.
  • the first image processing module 604 is further specifically configured to:
  • the first image is displayed in the form of a floating window to prompt the target user to adjust the pose based on the first image.
  • the electronic device also includes:
  • the third image acquisition module is configured to acquire the third image captured by the camera when receiving the confirmation input that the target user pose adjustment is completed;
  • a third image transmission module configured to transmit the third image to a target application.
  • the electronic device in the embodiment of the present application first obtains the first image captured by the camera, the first image includes the face image area of the target user, and the matching degree between the first image and the display content of the interface is less than or equal to the target user
  • perform privacy processing on the first image, or output prompt information that is, match the first image actually captured by the camera with the content actually displayed on the target application interface of the first image, if they match
  • the degree is less than or equal to the target value
  • the first image actually captured by the camera cannot be completely displayed on the interface of the target application, and the part of the first image that is not displayed on the interface of the target application may contain the user's private data , so there will be a risk that the user's private data will be leaked without knowing it.
  • the target application before transmitting the first image to the target application, it is necessary to perform privacy processing on the part of the first image that is not displayed on the interface of the target application , so as to obtain an image that does not contain user privacy data, or output prompt information, which can reduce the risk of leakage of user privacy data due to the existence of user privacy data in the part of the first image that is not displayed on the interface of the target application, thereby realizing the root cause It avoids the leakage of the private data of the target user, achieves the effect of protecting the private data of the user, and improves the security of the image data captured by the target application when calling the camera for shooting.
  • the electronic device in the embodiment of the present application may be a device, or a component, an integrated circuit, or a chip in a terminal.
  • the device may be a mobile electronic device or a non-mobile electronic device.
  • the mobile electronic device may be a mobile phone, a tablet computer, a notebook computer, a handheld computer, a vehicle electronic device, a wearable device, an ultra-mobile personal computer (ultra-mobile personal computer, UMPC), a netbook or a personal digital assistant (personal digital assistant).
  • assistant, PDA personal digital assistant
  • non-mobile electronic devices can be servers, network attached storage (Network Attached Storage, NAS), personal computer (personal computer, PC), television (television, TV), teller machine or self-service machine, etc., this application Examples are not specifically limited.
  • the electronic device in this embodiment of the present application may be a device with an operating system.
  • the operating system may be an Android (Android) operating system, an ios operating system, or other possible operating systems, which are not specifically limited in this embodiment of the present application.
  • the electronic device provided in the embodiment of the present application can implement each process implemented in the embodiment of the image data processing method in FIGS. 1 to 5 , and details are not repeated here to avoid repetition.
  • the embodiment of the present application further provides an electronic device, including a processor 810, a memory 809, and programs or instructions stored in the memory 809 and operable on the processor 810, the When the programs or instructions are executed by the processor 810, various processes of the above image data processing method embodiments can be realized, and the same technical effect can be achieved. To avoid repetition, details are not repeated here.
  • the electronic devices in the embodiments of the present application include the above-mentioned mobile electronic devices and non-mobile electronic devices.
  • FIG. 8 is a schematic diagram of a hardware structure of an electronic device implementing an embodiment of the present application.
  • the electronic device includes but not limited to: a radio frequency unit 801, a network module 802, an audio output unit 803, an input unit 804, a sensor 805, a display unit 806, a user input unit 807, an interface unit 808, a memory 809, a processor 810, and a power supply 811 and other components.
  • the electronic device can also include a power supply 811 (such as a battery) for supplying power to various components, and the power supply 811 can be logically connected to the processor 810 through a power management system, so that the power management system can manage charging, discharging, and functions such as power management.
  • a power supply 811 such as a battery
  • the power supply 811 can be logically connected to the processor 810 through a power management system, so that the power management system can manage charging, discharging, and functions such as power management.
  • the structure of the electronic device shown in FIG. 8 does not constitute a limitation to the electronic device.
  • the electronic device may include more or fewer components than shown in the figure, or combine some components, or arrange different components, and details will not be repeated here. .
  • the processor 810 is configured to acquire a first image collected by a camera, where the first image includes a face image area of the target user;
  • the matching degree between the first image and the display content of the interface is less than or equal to a target value, privacy processing is performed on the first image, or prompt information is output.
  • the first image actually captured by the camera by matching the first image actually captured by the camera with the content actually displayed on the interface of the target application, if the matching degree is less than or equal to the target value, then the first image actually captured by the camera An image cannot be completely displayed on the interface of the target application, and the part of the first image that is not displayed on the interface of the target application may contain the user's private data, so the user's private data may be leaked without knowing it Therefore, before transmitting the first image to the target application, it is necessary to perform privacy processing on the part of the first image that is not displayed on the interface of the target application, so as to obtain an image that does not contain user privacy data, or output a prompt information, which can reduce the risk of leakage of user privacy data due to the presence of user privacy data in the part of the first image that is not displayed on the interface of the target application, thereby avoiding the leakage of the target user’s privacy data at the root and achieving protection
  • the processor 810 is further configured to transmit the second image obtained based on the first image to a target application after performing privacy processing on the first image or outputting prompt information, and the target application Perform corresponding service processing based on the second image.
  • the above-mentioned processor 810 is further configured to perform privacy processing on the first image, or before outputting prompt information, when the matching degree between the first image and the display content of the interface is less than or equal to a target value, Acquire the display content of the interface; compare the image content of the first image with the display content, and determine the matching degree between the first image and the display content.
  • the first image further includes: other image areas except the face image area of the target user; the processor 810 is further configured to image the target image area in the other image areas Replacement processing: generating a second image of the target user based on other image areas after image replacement and the face image area of the target user; transmitting the second image to the target application.
  • the processor 810 is further configured to determine a target image area in the other image area, where the target image area includes: the other image area, or an image not displayed on the interface in the other image area An area: performing image replacement processing on the target image area based on a preset image.
  • the processor 810 is further configured to display the first image in the form of a floating window, so as to prompt the target user to adjust the pose based on the first image.
  • the above-mentioned processor 810 is further configured to, after outputting the prompt information, acquire the third image captured by the camera when receiving the confirmation input that the target user pose adjustment is completed; The third image is transmitted to the target application.
  • the electronic device in the embodiment of the present application first obtains the first image captured by the camera, the first image includes the face image area of the target user, and the matching degree between the first image and the display content of the interface is less than or equal to the target user
  • perform privacy processing on the first image, or output prompt information that is, match the first image actually captured by the camera with the content actually displayed on the target application interface of the first image, if they match
  • the degree is less than or equal to the target value
  • the first image actually captured by the camera cannot be completely displayed on the interface of the target application, and the part of the first image that is not displayed on the interface of the target application may contain the user's private data , so there will be a risk that the user's private data will be leaked without knowing it.
  • the target application before transmitting the first image to the target application, it is necessary to perform privacy processing on the part of the first image that is not displayed on the interface of the target application , so as to obtain an image that does not contain user privacy data, or output prompt information, which can reduce the risk of leakage of user privacy data due to the existence of user privacy data in the part of the first image that is not displayed on the interface of the target application, thereby realizing the root cause It avoids the leakage of the private data of the target user, achieves the effect of protecting the private data of the user, and improves the security of the image data captured by the target application when calling the camera for shooting.
  • the radio frequency unit 801 can be used for receiving and sending signals during sending and receiving information or during a call. Specifically, the downlink data from the base station is received and processed by the processor 810; Uplink data is sent to the base station.
  • the radio frequency unit 801 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like.
  • the radio frequency unit 801 can also communicate with the network and other devices through a wireless communication system.
  • the electronic device provides users with wireless broadband Internet access through the network module 802, such as helping users send and receive emails, browse web pages, and access streaming media.
  • the audio output unit 803 may convert audio data received by the radio frequency unit 801 or the network module 802 or stored in the memory 809 into an audio signal and output as sound. Also, the audio output unit 803 can also provide audio output related to a specific function performed by the electronic device (eg, call signal reception sound, message reception sound, etc.).
  • the audio output unit 803 includes a speaker, a buzzer, a receiver, and the like.
  • the input unit 804 may include a graphics processor (Graphics Processing Unit, GPU) 8041 and a microphone 8042, and the graphics processor 8041 is used for still pictures or video images obtained by an image capture device (such as a camera) in video capture mode or image capture mode The data is processed.
  • the display unit 806 may include a display panel 8061, and the display panel 8061 may be configured in the form of a liquid crystal display, an organic light emitting diode, or the like.
  • the user input unit 807 includes a touch panel 8071 and other input devices 8072 .
  • the touch panel 8071 is also called a touch screen.
  • the touch panel 8071 may include two parts, a touch detection device and a touch controller.
  • Other input devices 8072 may include, but are not limited to, physical keyboards, function keys (such as volume control buttons, switch buttons, etc.), trackballs, mice, and joysticks, which will not be repeated here.
  • Memory 809 may be used to store software programs as well as various data, including but not limited to application programs and operating systems.
  • the processor 810 may integrate an application processor and a modem processor, wherein the application processor mainly processes operating systems, user interfaces, and application programs, and the modem processor mainly processes wireless communications. It can be understood that, the foregoing modem processor may not be integrated into the processor 810 .
  • the electronic device also includes at least one sensor 805, such as a light sensor, a motion sensor, and other sensors.
  • the light sensor includes an ambient light sensor and a proximity sensor, wherein the ambient light sensor can adjust the brightness of the display panel 8061 according to the brightness of the ambient light, and the proximity sensor can turn off the display panel 8061 and/or when the electronic device moves to the ear. or backlight.
  • the accelerometer sensor can detect the magnitude of acceleration in various directions (generally three axes), and can detect the magnitude and direction of gravity when it is still, and can be used to identify the posture of electronic equipment (such as horizontal and vertical screen switching, related games) , magnetometer posture calibration), vibration recognition-related functions (such as pedometer, knocking), etc.; the sensor 805 can also include fingerprint sensors, pressure sensors, iris sensors, molecular sensors, gyroscopes, barometers, hygrometers, thermometers, Infrared sensors, etc., will not be repeated here.
  • the display unit 806 is used to display information input by the user or information provided to the user.
  • the display unit 806 may include a display panel 8061, and the display panel 8061 may be configured in the form of a liquid crystal display (Liquid Crystal Display, LCD), an organic light-emitting diode (Organic Light-Emitting Diode, OLED), or the like.
  • LCD Liquid Crystal Display
  • OLED Organic Light-Emitting Diode
  • the user input unit 807 can be used to receive input numbers or character information, and generate key signal input related to user settings and function control of the electronic device.
  • the user input unit 807 includes a touch panel 8071 and other input devices 8072 .
  • the touch panel 8071 also referred to as a touch screen, can collect touch operations of the user on or near it (for example, the user uses any suitable object or accessory such as a finger or a stylus on the touch panel 8071 or near the touch panel 8071). operate).
  • the touch panel 8071 may include two parts, a touch detection device and a touch controller.
  • the touch detection device detects the user's touch orientation, and detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into contact coordinates, and sends it to the For the processor 810, receive the command sent by the processor 810 and execute it.
  • the touch panel 8071 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic wave.
  • the user input unit 807 may also include other input devices 8072 .
  • other input devices 8072 may include, but are not limited to, physical keyboards, function keys (such as volume control keys, switch keys, etc.), trackballs, mice, and joysticks, which will not be repeated here.
  • the touch panel 8071 can be covered on the display panel 8061, and when the touch panel 8071 detects a touch operation on or near it, it will be sent to the processor 810 to determine the type of the touch event, and then the processor 810 will The type of event provides a corresponding visual output on the display panel 8061.
  • the touch panel 8071 and the display panel 8061 are used as two independent components to realize the input and output functions of the electronic device, in some embodiments, the touch panel 8071 and the display panel 8061 can be integrated. The implementation of the input and output functions of the electronic device is not specifically limited here.
  • the interface unit 808 is an interface for connecting external devices to electronic equipment.
  • an external device may include a wired or wireless headset port, an external power source 811 (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device with an identification module, an audio input/ Line-out (I/O) ports, video I/O ports, headphone ports, and more.
  • the interface unit 808 may be used to receive input (eg, data information, power, etc.) from an external device and transmit the received input to one or more elements within the electronic device or may be used transfer data between.
  • the memory 809 can be used to store software programs as well as various data.
  • the memory 809 can mainly include a program storage area and a data storage area, wherein the program storage area can store an operating system, at least one application program required by a function (such as a sound playback function, an image playback function, etc.); Data created by the use of mobile phones (such as audio data, phonebook, etc.), etc.
  • the memory 809 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage devices.
  • the processor 810 is the control center of the electronic device, and uses various interfaces and lines to connect various parts of the entire electronic device, by running or executing software programs and/or modules stored in the memory 809, and calling data stored in the memory 809 , to perform various functions of the electronic equipment and process data, so as to monitor the electronic equipment as a whole.
  • the processor 810 may include one or more processing units; preferably, the processor 810 may integrate an application processor 810 and a modem processor 810, wherein the application processor 810 mainly processes operating systems, user interfaces, and application programs, etc., Modem processor 810 primarily handles wireless communications. It can be understood that, the foregoing modem processor 810 may not be integrated into the processor 810 .
  • the electronic device can also include a power supply 811 (such as a battery) for supplying power to each component.
  • a power supply 811 (such as a battery) for supplying power to each component.
  • the power supply 811 can be logically connected to the processor 810 through the power management system 811, so as to manage charging, discharging, and power consumption through the power management system 811. Management and other functions.
  • the electronic device includes some functional modules not shown, which will not be repeated here.
  • the embodiment of the present application also provides an electronic device, including a processor 810, a memory 809, a program or instruction stored in the memory 809 and operable on the processor 810, and the program or instruction is executed by the processor 810 During execution, each process of the above embodiment of the image data processing method can be realized, and the same technical effect can be achieved. To avoid repetition, details are not repeated here.
  • the embodiment of the present application also provides a readable storage medium, the readable storage medium stores a program or an instruction, and when the program or instruction is executed by the processor 810, each process of the above image data processing method embodiment is implemented, and The same technical effect can be achieved, so in order to avoid repetition, details will not be repeated here.
  • the processor 810 is the processor 810 in the electronic device described in the foregoing embodiments.
  • the readable storage medium includes computer readable storage medium, such as computer read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), magnetic disk or optical disk, etc.
  • the embodiment of the present application also provides a chip, the chip includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the above image data processing method
  • the chip includes a processor and a communication interface
  • the communication interface is coupled to the processor
  • the processor is used to run programs or instructions to implement the above image data processing method
  • chips mentioned in the embodiments of the present application may also be called system-on-chip, system-on-chip, system-on-a-chip, or system-on-a-chip.
  • the term “comprising”, “comprising” or any other variation thereof is intended to cover a non-exclusive inclusion such that a process, method, article or apparatus comprising a set of elements includes not only those elements, It also includes other elements not expressly listed, or elements inherent in the process, method, article, or device. Without further limitations, an element defined by the phrase “comprising a " does not preclude the presence of additional identical elements in the process, method, article, or apparatus comprising that element.
  • the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved. Functions are performed, for example, the described methods may be performed in an order different from that described, and various steps may also be added, omitted, or combined. Additionally, features described with reference to certain examples may be combined in other examples.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Hardware Design (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Computer Security & Cryptography (AREA)
  • Software Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Bioethics (AREA)
  • Medical Informatics (AREA)
  • Databases & Information Systems (AREA)
  • Image Processing (AREA)
  • Studio Devices (AREA)

Abstract

The present application belongs to the field of artificial intelligence. Disclosed are an image data processing method and an electronic device. The method comprises: acquiring a first image, which is collected by using a camera, wherein the first image comprises a facial image area of a target user; and when the matching degree between the first image and displayed content of an interface is less than or equal to a target value, performing privacy processing on the first image, or outputting prompt information.

Description

图像数据的处理方法和电子设备Image data processing method and electronic device
相关申请的交叉引用Cross References to Related Applications
本申请要求在2021年10月28日提交的中国专利申请第202111265900.5号的优先权,该中国专利申请的全部内容通过引用包含于此。This application claims priority to Chinese Patent Application No. 202111265900.5 filed on October 28, 2021, the entire content of which is hereby incorporated by reference.
技术领域technical field
本申请属于人工智能领域,具体涉及一种图像数据的处理方法和电子设备。The present application belongs to the field of artificial intelligence, and specifically relates to an image data processing method and electronic equipment.
背景技术Background technique
随着人工智能领域的快速发展,某些应用程序在业务处理过程中,需要调用相机应用以调用摄像头采集目标用户的人脸图像数据,进而基于该人脸图像数据进行相应的业务处理,例如,基于该人脸图像数据进行人脸识别、视频会议等业务处理。With the rapid development of the field of artificial intelligence, some applications need to call the camera application in the process of business processing to call the camera to collect the face image data of the target user, and then perform corresponding business processing based on the face image data, for example, Based on the face image data, business processing such as face recognition and video conferencing is performed.
但是,某些应用程序在业务处理过程中,可能会存在用户处于隐私暴露的环境中而不自知,进而导致用户的隐私数据泄露的问题。However, some applications may have the problem that the user is in an environment where the privacy is exposed without knowing it during business processing, which may lead to the leakage of the user's private data.
发明内容Contents of the invention
本申请实施例的目的是提供一种图像数据的处理方法和电子设备,能够解决现有技术中存在用户的隐私数据泄露的问题。The purpose of the embodiments of the present application is to provide a method for processing image data and an electronic device, which can solve the problem of leakage of user's private data in the prior art.
第一方面,本申请实施例提供了一种图像数据的处理方法,该方法包括:In the first aspect, the embodiment of the present application provides a method for processing image data, the method comprising:
获取利用摄像头采集到的第一图像,所述第一图像包括目标用户的脸部图像区域;Obtaining a first image collected by a camera, the first image including the face image area of the target user;
在所述第一图像与界面的显示内容匹配度小于或等于目标值的情况下,对所述第一图像进行隐私处理,或者输出提示信息。In a case where the matching degree between the first image and the display content of the interface is less than or equal to a target value, privacy processing is performed on the first image, or prompt information is output.
第二方面,本申请实施例提供了一种电子设备,该电子设备包括:In a second aspect, an embodiment of the present application provides an electronic device, and the electronic device includes:
第一图像获取模块,用于获取利用摄像头采集到的第一图像,所述第一图像包括目标用户的脸部图像区域;The first image acquisition module is used to acquire the first image collected by the camera, and the first image includes the face image area of the target user;
第一图像处理模块,用于在所述第一图像与界面的显示内容匹配度小于或等于目标值的情况下,对所述第一图像进行隐私处理,或者输出提示信息。The first image processing module is configured to perform privacy processing on the first image or output prompt information when the matching degree between the first image and the display content of the interface is less than or equal to a target value.
第三方面,本申请实施例提供了一种电子设备,该电子设备包括:处理器、存储器及存储在所述存储器上并可在所述处理器上运行的程序或指令,所述程序或指令被所述处理器执行时实现如第一方面所述的图像数据的处理方法的步骤。In a third aspect, the embodiment of the present application provides an electronic device, the electronic device includes: a processor, a memory, and a program or instruction stored in the memory and operable on the processor, the program or instruction When executed by the processor, the steps of the image data processing method according to the first aspect are realized.
第四方面,本申请实施例提供了一种芯片,所述芯片包括处理器和通信接口,所述通信接口和所述处理器耦合,所述处理器用于运行程序或指令,实现如第一方面所述的图像数据的处理方法。In a fourth aspect, an embodiment of the present application provides a chip, the chip includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is used to run programs or instructions, so as to implement the first aspect The processing method of the image data.
本申请实施例中,先获取利用摄像头采集到的第一图像,该第一图像包括目标用户的脸部图像区域,并在该第一图像与界面的显示内容匹配度小于或等于目标值的情况下,对该第一图像进行隐私处理,或者输出提示信息,即通过将摄像头实际采集到的第一图像与该第一图像在目标应用的界面上实际显示的内容进行匹配,若匹配度小于或等于目标值,则摄像头实际采集到的第一图像不能完整地显示在该目标应用的界面上,且该第一图像中未在目标应用的界面上显示的部分可能包含用户的隐私数据,因此会存在用户的隐私数据被泄露而不自知的风险,因此在将该第一图像传输至目标应用之前,需要对该第一图像中未在目标应用的界面上显示的部分进行隐私处理,从而得到不包含用户隐私数据的图像,或者输出提示信息,这样能够减少因第一图像中未在目标应用的界面上显示的部分存在用户隐私数据而导致用户隐私数据泄露的风险,从而实现根源上避免了目标用户的隐私数据的泄露,达到了保护用户隐私数据的效果,以及提升了目标应用在调用摄像头进行拍摄时所拍摄的图像数据的安全性。In the embodiment of the present application, the first image captured by the camera is first obtained, the first image includes the face image area of the target user, and when the matching degree between the first image and the display content of the interface is less than or equal to the target value Next, perform privacy processing on the first image, or output prompt information, that is, match the first image actually captured by the camera with the content actually displayed on the interface of the target application, if the matching degree is less than or equal to the target value, the first image actually collected by the camera cannot be completely displayed on the interface of the target application, and the part of the first image that is not displayed on the interface of the target application may contain the user's private data, so it will There is a risk that the user's private data will be leaked without knowing it. Therefore, before transmitting the first image to the target application, it is necessary to perform privacy processing on the part of the first image that is not displayed on the interface of the target application, so as to obtain Images that do not contain user privacy data, or output prompt information, can reduce the risk of leakage of user privacy data due to the presence of user privacy data in the part of the first image that is not displayed on the interface of the target application, thereby avoiding the root cause The disclosure of the private data of the target user achieves the effect of protecting the private data of the user, and improves the security of the image data captured by the target application when calling the camera for shooting.
附图说明Description of drawings
图1是本申请实施例提供的图像数据的处理方法的第一种流程示意图;Fig. 1 is a first schematic flow chart of the image data processing method provided by the embodiment of the present application;
图2是本申请实施例提供的图像数据的处理方法的第二种流程示意图;Fig. 2 is a second schematic flow chart of the image data processing method provided by the embodiment of the present application;
图3是本申请实施例提供的图像数据的处理方法的第一种图像隐私保护处理的实现原理示意图;3 is a schematic diagram of the implementation principle of the first image privacy protection processing of the image data processing method provided by the embodiment of the present application;
图4是本申请实施例提供的图像数据的处理方法的第二种图像隐私保护处理的实现原理示意图;Fig. 4 is a schematic diagram of the implementation principle of the second image privacy protection processing of the image data processing method provided by the embodiment of the present application;
图5是本申请实施例提供的图像数据的处理方法的第三种流程示意图;Fig. 5 is a third schematic flow chart of the image data processing method provided by the embodiment of the present application;
图6是本申请实施例提供的电子设备的第一种模块组成示意图;FIG. 6 is a schematic diagram of the composition of the first module of the electronic device provided by the embodiment of the present application;
图7是本申请实施例提供的电子设备的第二种模块组成示意图;FIG. 7 is a schematic diagram of the second type of module composition of the electronic device provided by the embodiment of the present application;
图8是本申请实施例提供的电子设备的结构示意图。FIG. 8 is a schematic structural diagram of an electronic device provided by an embodiment of the present application.
具体实施方式Detailed ways
下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚地描述,显然,所描述的实施例是本申请一部分实施例,而不是全部的实施例。基于本申请中的实施例,本领域普通技术人员获得的所有其他实施例,都属于本申请保护的范围。The following will clearly describe the technical solutions in the embodiments of the present application with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, but not all of them. All other embodiments obtained by persons of ordinary skill in the art based on the embodiments in this application belong to the protection scope of this application.
本申请的说明书和权利要求书中的术语“第一”、“第二”等是用于区别类似的对象,而不用于描述特定的顺序或先后次序。应该理解这样使用的数据在适当情况下可以互换,以便本申请的实施例能够以除了在这里图示或描述的那些以外的顺序实施,且“第一”、“第二”等所区分的对象通常为一类,并不限定对象的个数,例如第一对象可以是一个,也可以是多个。此外,说明书以及权利要求中“和/或”表示所连接对象的至少其中之一,字符“/”,一般表示前后关联对象是一种“或”的关系。The terms "first", "second" and the like in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific sequence or sequence. It should be understood that the terms so used are interchangeable under appropriate circumstances such that the embodiments of the application can be practiced in sequences other than those illustrated or described herein, and that references to "first," "second," etc. distinguish Objects are generally of one type, and the number of objects is not limited. For example, there may be one or more first objects. In addition, "and/or" in the specification and claims means at least one of the connected objects, and the character "/" generally means that the related objects are an "or" relationship.
下面结合附图,通过具体的实施例及其应用场景对本申请实施例提供的图像数据的处理方法和电子设备进行详细地说明。The method for processing image data and the electronic device provided by the embodiments of the present application will be described in detail below through specific embodiments and application scenarios with reference to the accompanying drawings.
图1为本申请实施例提供的图像数据的处理方法的第一种流程示意图,图1中的方法能够由电子设备执行,特别是电子设备中的处理器,如图1所 示,该方法至少包括以下步骤:Fig. 1 is a schematic flow chart of the first image data processing method provided by the embodiment of the present application. The method in Fig. 1 can be executed by an electronic device, especially a processor in the electronic device. As shown in Fig. 1, the method at least Include the following steps:
S102,获取利用摄像头采集到的第一图像,该第一图像包括目标用户的脸部图像区域;S102. Acquire a first image collected by a camera, where the first image includes a face image area of a target user;
其中,在获取利用摄像头采集到的第一图像之前,还包括:目标应用调用相机应用,以调用摄像头采集第一图像。Wherein, before acquiring the first image collected by the camera, it further includes: the target application calls the camera application to call the camera to collect the first image.
具体的,电子设备在检测到用户针对目标应用的指定业务的访问请求的情况下,若当前业务处理节点需要采集用户的图像数据,则调用相机应用,以调用摄像头采集用户的第一图像;例如,用户使用支付应用时,若检测到当前业务处理节点为人脸识别,则调用相机应用,以调用摄像头采集用户的第一图像;又如,用户使用视频分享应用程序时,若检测到当前业务处理节点为视频创作拍摄,则调用相机应用,以调用摄像头采集用户的第一图像。Specifically, when the electronic device detects the user's access request for the specified service of the target application, if the current service processing node needs to collect the user's image data, it calls the camera application to call the camera to collect the user's first image; for example , when the user uses the payment application, if it detects that the current business processing node is face recognition, then call the camera application to call the camera to collect the user's first image; another example, when the user uses the video sharing application program, if the current business processing node The node calls the camera application for video creation and shooting, so as to call the camera to collect the first image of the user.
进一步的,考虑到目标应用的图像显示方式的不同,会导致第一图像在目标应用的界面中可能为部分显示,即目标应用调用摄像头采集到的第一图像没有完整显示在上述界面中,并且由于第一图像中未在目标应用的界面上显示的部分可能包含用户的隐私数据,因此,如果直接将该第一图像传输至目标应用,可能存在用户由于观测不到完整的第一图像而导致的用户隐私数据被泄露的风险,因此需要对第一图像进行隐私处理,或输出提示信息,基于此,在目标应用获取到第一图像之前,由电子设备中的处理器获取利用摄像头采集到的第一图像,该第一图像可以包括摄像头所采集的目标用户的脸部图像区域、以及除该脸部图像区域之外的其他图像区域,该其他图像区域可以包括除目标用户人脸以外的其他用户脸部图像区域、目标用户的非脸部图像区域、其他用户的非脸部图像区域、目标用户当前所处环境的图像区域中至少一项;Further, considering the difference in image display methods of the target application, the first image may be partially displayed in the interface of the target application, that is, the first image collected by the target application calling the camera is not completely displayed in the above interface, and Since the part of the first image that is not displayed on the interface of the target application may contain the user's private data, if the first image is directly transmitted to the target application, there may be problems caused by the user not being able to observe the complete first image. Therefore, it is necessary to perform privacy processing on the first image, or output prompt information. Based on this, before the target application obtains the first image, the processor in the electronic device obtains the information collected by the camera. The first image, the first image may include the face image area of the target user captured by the camera, and other image areas except the face image area, and the other image areas may include other images other than the face of the target user. At least one of the user's face image area, the non-face image area of the target user, the non-face image area of other users, and the image area of the target user's current environment;
S104,在上述第一图像与界面的显示内容匹配度小于或等于目标值的情况下,对上述第一图像进行隐私处理,或者输出提示信息。S104. In a case where the matching degree between the first image and the display content of the interface is less than or equal to the target value, perform privacy processing on the first image, or output prompt information.
具体的,若摄像头采集到的第一图像与目标应用的界面的显示内容匹配度小于或等于目标值,则确定目标应用的显示方式为图像部分区域显示,即 第一图像在目标应用的界面中为部分显示;若摄像头采集到的第一图像与界面的显示内容匹配度大于目标值,则确定目标应用的显示方式为图像全部区域显示,即第一图像在目标应用的界面中全部显示。Specifically, if the matching degree between the first image captured by the camera and the display content of the interface of the target application is less than or equal to the target value, then it is determined that the display mode of the target application is displayed in a partial area of the image, that is, the first image is displayed in the interface of the target application It is a partial display; if the matching degree between the first image captured by the camera and the display content of the interface is greater than the target value, then determine that the display mode of the target application is to display the entire area of the image, that is, the first image is fully displayed in the interface of the target application.
具体的,针对摄像头采集到的第一图像与界面的显示内容匹配度小于或等于目标值,即目标应用的图像显示方式为图像部分区域显示的情况,电子设备中的处理器在获取利用摄像头采集到的第一图像之后,需要对该第一图像进行隐私处理,或者输出提示信息;其中,上述对第一图像进行隐私处理的方式可以为对除目标用户的脸部图像区域之外的其他图像区域中的目标图像区域进行图像替换处理,即将目标图像区域替换或填充为可公开的数据,例如,预设图像(可以是统一颜色的背景,也可以是其他背景),进而得到不包含目标用户的隐私数据的第二图像,再传输至目标应用;上述输出提示信息的方式可以为在界面中向用户显示提示信息、语音提醒、震动等方式,以提示目标用户调整位姿,例如,以悬浮窗的形式,显示第一图像(即摄像头真实拍摄到的画面内容),以提示目标用户基于该第一图像调整位姿,即基于实时显示在悬浮窗上真实的拍摄画面调整位姿,以确保后续采集到的图像中不包含用户的隐私数据,具体的,可以提示用户继续使用相机,并调整位姿、或者提示用户暂时终止使用相机功能。Specifically, in view of the fact that the matching degree between the first image captured by the camera and the display content of the interface is less than or equal to the target value, that is, the image display mode of the target application is displayed in a partial area of the image, the processor in the electronic device obtains the image captured by the camera. After receiving the first image, it is necessary to perform privacy processing on the first image, or output prompt information; wherein, the above-mentioned method of performing privacy processing on the first image can be to perform privacy processing on other images except the face image area of the target user The target image area in the area is subjected to image replacement processing, that is, the target image area is replaced or filled with publicly available data, for example, a preset image (which can be a uniform color background or other backgrounds), and then the target image area that does not contain the target user The second image of the private data, and then transmitted to the target application; the above-mentioned output prompt information can be to display prompt information, voice reminder, vibration, etc. to the user in the interface to prompt the target user to adjust the posture, for example, by hovering In the form of a window, the first image (that is, the content of the picture actually captured by the camera) is displayed to prompt the target user to adjust the pose based on the first image, that is, to adjust the pose based on the real shooting picture displayed on the floating window in real time, so as to ensure The subsequent collected images do not contain the user's private data. Specifically, the user can be prompted to continue using the camera and adjust the pose, or the user can be prompted to temporarily stop using the camera function.
本申请实施例中,通过将摄像头实际采集到的第一图像与该第一图像在目标应用的界面上实际显示的内容进行匹配,若匹配度小于或等于目标值,则摄像头实际采集到的第一图像不能完整地显示在该目标应用的界面上,且该第一图像中未在目标应用的界面上显示的部分可能包含用户的隐私数据,因此会存在用户的隐私数据被泄露而不自知的风险,因此在将该第一图像传输至目标应用之前,需要对该第一图像中未在目标应用的界面上显示的部分进行隐私处理,从而得到不包含用户隐私数据的图像,或者输出提示信息,这样能够减少因第一图像中未在目标应用的界面上显示的部分存在用户隐私数据而导致用户隐私数据泄露的风险,从而实现根源上避免了目标用户的隐私数据的泄露,达到了保护用户隐私数据的效果,以及提升了目标应用在调 用摄像头进行拍摄时所拍摄的图像数据的安全性。In this embodiment of the application, by matching the first image actually captured by the camera with the content actually displayed on the interface of the target application, if the matching degree is less than or equal to the target value, then the first image actually captured by the camera An image cannot be completely displayed on the interface of the target application, and the part of the first image that is not displayed on the interface of the target application may contain the user's private data, so the user's private data may be leaked without knowing it Therefore, before transmitting the first image to the target application, it is necessary to perform privacy processing on the part of the first image that is not displayed on the interface of the target application, so as to obtain an image that does not contain user privacy data, or output a prompt information, which can reduce the risk of leakage of user privacy data due to the presence of user privacy data in the part of the first image that is not displayed on the interface of the target application, thereby avoiding the leakage of the target user’s privacy data at the root and achieving protection The effect of user privacy data, and the security of the image data captured by the target application when calling the camera for shooting is improved.
其中,考虑到对第一图像进行隐私处理得到的第二图像是不包含用户隐私数据的第二图像,因此可以直接将该第二图像传输至目标应用,基于此,如图2所示,上述步骤S104中,在对上述第一图像进行隐私处理,或者输出提示信息之后,还包括:Wherein, considering that the second image obtained by performing privacy processing on the first image is a second image that does not contain user privacy data, the second image can be directly transmitted to the target application. Based on this, as shown in FIG. 2, the above In step S104, after performing privacy processing on the above-mentioned first image, or outputting prompt information, the method further includes:
S106,将基于第一图像得到的第二图像传输至目标应用,该目标应用基于该第二图像进行相应的业务处理。S106. Transmit the second image obtained based on the first image to the target application, and the target application performs corresponding service processing based on the second image.
具体的,本申请提供的图像数据的处理方法的具体应用场景可以是:人脸识别、视频会议、短视频发布等需要使用目标应用进行相应的业务处理的同时,还需要调用相机应用,以调用摄像头进行拍摄的场景;其中,目标应用和相机应用是不同的应用;Specifically, the specific application scenarios of the image data processing method provided by this application may be: face recognition, video conferencing, short video release, etc. need to use the target application for corresponding business processing, and at the same time need to call the camera application to call The scene where the camera takes pictures; wherein, the target application and the camera application are different applications;
在具体实施时,针对人脸识别的应用场景,目标应用需要基于摄像头所采集的目标用户的脸部图像区域对目标用户进行人脸识别;针对视频会议的应用场景,目标应用需要将摄像头所采集的目标用户的人像数据在显示界面(显示屏)上显示;针对短视频发布的应用场景,目标应用需要将摄像头所采集的目标用户的短视频数据在显示界面(显示屏)上显示。In the specific implementation, for the application scenario of face recognition, the target application needs to perform face recognition on the target user based on the face image area of the target user collected by the camera; for the application scenario of video conferencing, the target application needs to The portrait data of the target user is displayed on the display interface (display screen); for the application scenario of short video publishing, the target application needs to display the short video data of the target user collected by the camera on the display interface (display screen).
在具体实施时,以人脸识别场景为例,由于目标应用对目标用户进行人脸识别时只对目标用户的脸部数据进行识别,因此,目标应用的显示界面上只显示摄像头所采集的第一图像中目标用户的脸部图像区域,即第一图像与界面的显示内容匹配度小于或等于目标值(即第一图像在目标应用的显示界面上部分显示),但摄像头所采集的第一图像不仅包括目标用户的脸部图像区域,还包括除目标用户的脸部图像区域之外的其他图像区域,因此,目标用户将观测不到由摄像头采集并传输至目标应用、可能包含目标用户隐私数据的其他图像区域,进而导致目标用户隐私数据的泄露;基于此,为了保护目标用户的隐私数据,在目标应用获取到第一图像之前,首先由电子设备的处理器获取利用摄像头采集到的目标用户的第一图像(即目标用户的脸部图像区域和除目标用户的脸部图像区域之外的其他图像区域),然后由处理器对上 述第一图像中目标用户的其他图像区域进行隐私处理,进而得到第二图像,并将基于对第一图像进行隐私处理得到的第二图像传输至目标应用,即将上述目标用户的脸部图像区域和隐私处理后的其他图像区域的组合确定为第二图像,再将该第二图像传输至目标应用,以使该目标应用基于该第二图像中目标用户的脸部图像区域对目标用户进行人脸识别;或者输出提示信息,并以悬浮窗的形式,显示第一图像(即摄像头真实拍摄到的画面内容),以提示目标用户基于该第一图像调整位姿,即基于实时显示在悬浮窗上真实的拍摄画面调整位姿,以确保后续采集到的图像中不包含用户的隐私数据,进而以确保后续采集到的图像中不包含用户的隐私数据。In the specific implementation, taking the face recognition scene as an example, since the target application only recognizes the face data of the target user when performing face recognition on the target user, only the first image collected by the camera is displayed on the display interface of the target application. The face image area of the target user in an image, that is, the matching degree between the first image and the display content of the interface is less than or equal to the target value (that is, the first image is partially displayed on the display interface of the target application), but the first image captured by the camera The image includes not only the face image area of the target user, but also other image areas except the face image area of the target user. Therefore, the target user will not be able to observe the target user’s privacy information collected by the camera and transmitted to the target application. Other image areas of the data, which in turn lead to the leakage of the target user’s private data; based on this, in order to protect the target user’s private data, before the target application obtains the first image, the processor of the electronic device first obtains the target captured by the camera. The first image of the user (that is, the target user's face image area and other image areas except the target user's face image area), and then the processor performs privacy processing on the other image areas of the target user in the above-mentioned first image , and then obtain the second image, and transmit the second image obtained based on the privacy processing of the first image to the target application, that is, determine the combination of the target user’s face image area and other image areas after privacy processing as the second image, and then transmit the second image to the target application, so that the target application can perform face recognition on the target user based on the face image area of the target user in the second image; or output prompt information, and display it in the form of a floating window , to display the first image (that is, the content of the picture actually captured by the camera) to prompt the target user to adjust the pose based on the first image, that is, to adjust the pose based on the real shooting picture displayed on the floating window in real time, so as to ensure that the subsequent acquisition The image does not contain the user's private data, so as to ensure that the subsequent collected images do not contain the user's private data.
本申请中由于处理器预先将摄像头采集并传输至目标应用、可能包含目标用户隐私数据的、除目标用户的脸部图像区域之外的其他图像区域进行隐私保护处理,因此最后传输至目标应用的其他图像区域中不包含目标用户的隐私数据,从而达到从根源上避免用户隐私数据的泄露的目的,进而实现保护用户隐私数据的作用。In this application, since the processor collects and transmits the camera to the target application in advance, and performs privacy protection processing on other image areas except the target user's face image area that may contain the target user's private data, the final transmission to the target application Other image areas do not contain the private data of the target user, so as to avoid the leakage of the user's private data from the root, and then realize the function of protecting the user's private data.
其中,考虑到对第一图像进行隐私处理时,可以是将该第一图像中包含隐私数据的目标图像区域替换为可公开的数据,基于此,上述步骤S104中,对上述第一图像进行隐私处理,具体包括:对第一图像中除目标用户的脸部图像区域之外的其他图像区域中的目标图像区域进行图像替换处理;Wherein, when considering the privacy processing of the first image, it may be to replace the target image area containing private data in the first image with data that can be made public. The processing specifically includes: performing image replacement processing on the target image area in other image areas in the first image except the target user's face image area;
具体的,针对在第一图像与界面的显示内容匹配度小于或等于目标值的情况下(即在目标应用的图像显示方式为图像部分区域显示),首先获取利用摄像头采集到的目标用户的第一图像,然后对上述第一图像除所述目标用户的脸部图像区域之外的其他图像区域中包含目标用户隐私数据的目标图像区域进行图像替换处理,将目标用户的隐私数据替换为可公开的数据,进而得到不包含目标用户隐私数据的第二图像;Specifically, for the case where the matching degree between the first image and the display content of the interface is less than or equal to the target value (that is, the image display mode of the target application is displayed in a partial area of the image), first obtain the first image of the target user captured by the camera. image, and then perform image replacement processing on the target image area containing the target user’s private data in other image areas of the first image except the target user’s face image area, and replace the target user’s private data with publicly available data, and then obtain the second image that does not contain the private data of the target user;
进一步的,可以将上述不包含目标用户隐私数据的第二图像传输至目标应用,基于此,将基于上述第一图像得到的第二图像传输至目标应用,具体包括:基于图像替换后的其他图像区域和目标用户的脸部图像区域,生成目 标用户的第二图像;将该第二图像传输至目标应用。Further, the above-mentioned second image that does not contain the target user's privacy data can be transmitted to the target application, and based on this, the second image obtained based on the above-mentioned first image is transmitted to the target application, specifically including: other images based on image replacement region and the face image region of the target user to generate a second image of the target user; and transmit the second image to the target application.
其中,考虑到除了可以对第一图像进行隐私处理,还可以输出提示信息,以使目标用户基于该提示信息进行位姿调整,以确保后续摄像头采集到的图像中不包含用户的隐私数据,基于此,上述步骤S104中,输出提示信息,具体包括:以悬浮窗的形式,显示第一图像,以提示目标用户基于该第一图像调整位姿。Among them, considering that in addition to performing privacy processing on the first image, prompt information can also be output, so that the target user can adjust the pose based on the prompt information, so as to ensure that the subsequent images collected by the camera do not contain the user's privacy data, based on Here, in the above step S104, outputting prompt information specifically includes: displaying the first image in the form of a floating window, so as to prompt the target user to adjust the pose based on the first image.
具体的,在电子设备的显示屏上按照目标应用的原图像显示方式的同时,还可以以缩略图或者悬浮窗等形式完整显示摄像头实际拍摄的图像画面,(即在目标应用的显示界面上不仅按照目标应用的原图像显示方式部分显示第一图像,还在缩略图或者悬浮窗完整显示第一图像),基于此,可以提示目标用户基于完整显示的第一图像调整位姿,以便使得用户通过位姿调整来确保摄像头的图像拍摄范围不会包含隐私数据。Specifically, while following the original image display mode of the target application on the display screen of the electronic device, the image picture actually captured by the camera can also be completely displayed in the form of a thumbnail or a floating window (that is, not only on the display interface of the target application) According to the original image display method of the target application, the first image is partially displayed, and the first image is also completely displayed in the thumbnail or floating window), based on this, the target user can be prompted to adjust the pose based on the fully displayed first image, so that the user can pass Pose is adjusted to ensure that the camera's image capture range does not contain private data.
进一步的,在目标用户确定通过位姿调整后第一图像中不包含用户隐私数据的情况下,可以将摄像头采集到的图像传输至目标应用,基于此,在输出提示信息之后,还包括:在接收到目标用户位姿调整结束的确认输入的情况下,获取利用摄像头采集到的第三图像;将该第三图像传输至目标应用。Further, in the case where the target user determines that the first image does not contain user privacy data after the pose adjustment, the image collected by the camera can be transmitted to the target application. Based on this, after outputting the prompt information, it also includes: When receiving the confirmation input that the target user's pose adjustment is completed, acquire a third image captured by the camera; and transmit the third image to the target application.
具体的,接收目标用户基于实时观测到的完整显示的第一图像所反馈的目标用户位姿调整结束的确认输入(即接收目标用户基于实时观测到的完整显示的第一图像所反馈的第一图像中不包含目标用户隐私数据的确认输入),基于该确认输入,获取利用摄像头所采集的目标用户进行位姿调整后的第三图像,由于该第三图像中不包含目标用户的隐私数据,即基于位姿调整后的第一图像,确定不包含用户隐私信息的第三图像,因此,电子设备中的处理器在接收到摄像头所采集到的第三图像后,可以直接将该第三图像传输至目标应用。Specifically, receiving the confirmation input of the completion of the target user's pose adjustment fed back by the target user based on the fully displayed first image observed in real time (that is, receiving the first The image does not contain the confirmation input of the target user's privacy data), based on the confirmation input, the third image after the pose adjustment of the target user collected by the camera is obtained, since the third image does not contain the privacy data of the target user, That is, based on the first image after pose adjustment, the third image that does not contain user privacy information is determined. Therefore, after receiving the third image collected by the camera, the processor in the electronic device can directly use the third image transmitted to the target application.
其中,考虑到针对不同的情况可以采用不同的隐私处理方式或多种隐私处理方式的组合,以增加隐私处理的灵活性、以及为了进一步的提高用户隐私数据的安全性,因此,可以将对目标用户的第一图像中除目标用户的脸部 图像区域之外的其他图像区域进行隐私处理、以及输出提示信息两种方式进行结合。Among them, considering that different privacy processing methods or a combination of multiple privacy processing methods can be used for different situations to increase the flexibility of privacy processing and to further improve the security of user privacy data. Therefore, the target In the first image of the user, other image regions except the face image region of the target user are processed for privacy and prompt information is output in combination.
具体的,首先以悬浮窗的形式,显示目标用户第一图像,以提示目标用户基于第一图像调整位姿,并接收目标用户基于实时观测到的第一图像所反馈的位姿调整结束的确认输入(即第一图像中不包含目标用户隐私数据的确认输入),为了提升该确认输入的准确性,可以由电子设备的处理器先获取利用摄像头所采集的目标用户进行位姿调整后的第一图像,并在该第一图像与目标应用的界面的显示内容匹配度小于或等于目标值的情况下,对该第一图像进行隐私处理,即对该第一图像进行隐私风险识别,如果识别出存在隐私泄露的风险,则对第一图像中包含用户隐私数据的目标图像区域进行图像替换处理,基于图像替换处理后的第一图像,确定不包含用户隐私数据目标用户的第二图像;或者直接对第一图像中的目标图像区域进行图像替换处理,并基于图像替换处理后的第一图像,确定不包含用户隐私数据目标用户的第二图像。Specifically, first, display the first image of the target user in the form of a floating window to prompt the target user to adjust the pose based on the first image, and receive the confirmation that the pose adjustment is completed based on the feedback of the target user based on the first image observed in real time Input (that is, the first image does not contain the confirmation input of the target user's privacy data), in order to improve the accuracy of the confirmation input, the processor of the electronic device can first obtain the first image of the target user collected by the camera after the pose adjustment. An image, and when the matching degree between the first image and the display content of the interface of the target application is less than or equal to the target value, privacy processing is performed on the first image, that is, privacy risk identification is performed on the first image. If there is a risk of privacy leakage, perform image replacement processing on the target image area containing user privacy data in the first image, and determine the second image of the target user that does not contain user privacy data based on the first image after image replacement processing; or An image replacement process is directly performed on the target image area in the first image, and based on the first image after the image replacement process, a second image that does not contain the user privacy data of the target user is determined.
在本申请实施例中,通过设置输出提示信息,以提示目标用户调整位姿、以及对第一图像区域中的目标图像区域进行图像替换处理等不同的隐私保护处理方式,以增加隐私保护的灵活性,并且将两种方式进行结合,可以进一步提升用户隐私数据的安全性。In the embodiment of the present application, by setting the output prompt information to prompt the target user to adjust the pose, and to perform image replacement processing on the target image area in the first image area, etc., to increase the flexibility of privacy protection Sex, and combining the two methods can further improve the security of user privacy data.
进一步的,针对上述输出提示信息的方式,以提示目标用户进行位姿调整,并在接收到目标用户位姿调整结束的确认输入的情况下,获取利用摄像头采集到的第三图像,具体包括:Further, aiming at the above-mentioned way of outputting prompt information, to prompt the target user to perform pose adjustment, and to obtain the third image collected by the camera after receiving the confirmation input that the target user’s pose adjustment is completed, specifically including:
步骤一,在目标应用的显示界面上以悬浮窗的形式,显示目标用户的脸部图像区域和除目标用户的脸部图像区域之外的其他图像区域;Step 1, displaying the face image area of the target user and other image areas except the face image area of the target user in the form of a floating window on the display interface of the target application;
具体的,在目标应用的显示界面的指定区域上弹出悬浮窗,该悬浮窗可以是半透明悬浮窗、全透明悬浮窗中至少一种悬浮窗,并在该悬浮窗上显示完整的目标用户的第一图像(即目标用户的脸部图像区域和除目标用户的脸部图像区域之外的其他图像区域);Specifically, a floating window pops up on a designated area of the display interface of the target application. The floating window can be at least one of a translucent floating window and a fully transparent floating window, and the complete target user's profile is displayed on the floating window. The first image (i.e. the face image area of the target user and other image areas except the face image area of the target user);
步骤二,提示目标用户基于上述悬浮窗中显示的目标用户的第一图像进行位姿调整;Step 2, prompting the target user to perform pose adjustment based on the first image of the target user displayed in the floating window;
其中,上述位姿调整可以包括电子设备的位姿调整(即对摄像头的位姿进行调整)、以及目标用户本身的位姿调整中至少一项;上述位姿调整的标准是目标用户通过实时观测悬浮窗中显示的第一图像区域中不包含目标用户的隐私数据;Wherein, the above-mentioned pose adjustment may include at least one of the pose adjustment of the electronic device (that is, adjusting the pose of the camera) and the pose adjustment of the target user itself; The first image area displayed in the floating window does not contain the private data of the target user;
步骤三,在接收到目标用户位姿调整结束的确认输入的情况下,获取利用摄像头采集到的第三图像;Step 3, in the case of receiving the confirmation input that the target user's pose adjustment is completed, obtain the third image collected by the camera;
其中,在接收到目标用户位姿调整结束的确认输入后所获取的第三图像(即目标用户进行位姿调整后的第三图像)中不包含目标用户的隐私数据(即位姿调整的目标是调整后的目标用户的脸部图像区域之外的其他图像区域不包含用户的隐私数据)。Among them, the third image acquired after receiving the confirmation input of the end of the target user's pose adjustment (that is, the third image after the target user performs pose adjustment) does not contain the private data of the target user (that is, the target of the pose adjustment is Other image areas other than the adjusted face image area of the target user do not contain the user's privacy data).
具体的,如图3所示,在目标应用的显示界面上弹出悬浮窗,该悬浮窗可以向目标用户完整显示第一图像(即目标用户的脸部图像区域和除目标用户的脸部图像区域之外的其他图像区域),即图3中的(b)所示的显示效果,并提示目标用户基于上述悬浮窗中显示的目标用户的第一图像进行位姿调整,在接收到目标用户位姿调整结束的确认输入的情况下,即当接收到目标用户基于在目标应用的界面中观测到的图像所反馈的第一图像中不包含目标用户隐私数据的确认输入时,将基于位姿调整后的第一图像确定为第三图像(即获取利用摄像头采集到的第三图像),并将上述第三图像传输至目标应用,以使目标应用基于该第三图像进行相应的业务处理。Specifically, as shown in FIG. 3 , a floating window pops up on the display interface of the target application, and the floating window can completely display the first image (that is, the target user's facial image area and the target user's facial image area) to the target user. Other image areas other than other image areas), that is, the display effect shown in (b) in Figure 3, and prompt the target user to adjust the pose based on the first image of the target user displayed in the above floating window. In the case of the confirmation input of the end of the pose adjustment, that is, when the target user receives the confirmation input that the first image fed back by the target user based on the image observed in the target application interface does not contain the target user's privacy data, the pose adjustment will be based on the The final first image is determined as the third image (that is, the third image captured by the camera is obtained), and the third image is transmitted to the target application, so that the target application performs corresponding business processing based on the third image.
进一步的,针对上述对第一图像进行隐私处理的方式,对目标用户的第一图像中除目标用户的脸部图像区域之外的其他图像区域中的目标图像区域进行图像替换处理,具体包括:Further, for the aforementioned method of performing privacy processing on the first image, image replacement processing is performed on the target image area in other image areas in the first image of the target user except the face image area of the target user, specifically including:
步骤一,确定第一图像中除目标用户的脸部图像区域之外的其他图像区域中的目标图像区域;其中,该目标图像区域包括:其他图像区域、或者其他图像区域中界面上未显示的图像区域;Step 1, determining the target image area in other image areas in the first image except the target user's face image area; wherein, the target image area includes: other image areas, or other image areas that are not displayed on the interface image area;
具体的,针对目标图像区域包括其他图像区域的情况,对第一图像进行图像识别处理,确定目标用户的脸部图像区域所在区域,将该脸部图像区域所在区域之外的图像区域确定为目标图像区域;针对目标图像区域包括其他图像区域中界面上未显示的图像区域的情况,基于预存的目标应用的显示界面的显示区域与未显示区域的位置关系,将未显示区域确定为目标图像区域;其中,预存的目标应用的显示界面的显示区域与未显示区域的位置关系可以是基于预设的默认图像在显示屏上完整图像显示区域与在目标应用的显示界面上图像部分区域显示区域的比例关系所确定的,具体的,可以先将默认图像传输至目标应用(由处理器传输至目标应用的、可公开的图像),再获取默认图像在目标应用的显示界面上所显示的图像部分区域显示区域,并计算该默认图像中的图像部分区域显示区域和完整图像显示区域的比例关系。Specifically, for the case where the target image area includes other image areas, perform image recognition processing on the first image, determine the area where the face image area of the target user is located, and determine the image area outside the area where the face image area is located as the target Image area: for the case where the target image area includes an image area not displayed on the interface in other image areas, based on the pre-stored positional relationship between the display area and the non-displayed area of the display interface of the target application, the non-displayed area is determined as the target image area ; Wherein, the pre-stored positional relationship between the display area and the non-display area of the display interface of the target application may be based on the preset default image in the complete image display area on the display screen and the image partial area display area on the display interface of the target application Determined by the proportional relationship, specifically, the default image can be transmitted to the target application first (the image transmitted from the processor to the target application and can be disclosed), and then the image part displayed by the default image on the display interface of the target application can be obtained The area displays the area, and calculates the proportional relationship between the image partial area display area and the complete image display area in the default image.
步骤二,基于预设图像,对上述目标图像区域进行图像替换处理;Step 2, performing image replacement processing on the above target image area based on the preset image;
具体的,将上述第一图像中目标图像区域中的图像内容,替换为预设图像,即对该目标图像区域进行图像替换处理,即更新上述第一图像区域中的目标图像区域,其中,上述预设图像可以是马赛克背景、统一颜色的背景等可公开的背景图像。Specifically, replace the image content in the target image area in the first image with a preset image, that is, perform image replacement processing on the target image area, that is, update the target image area in the first image area, wherein the above The preset image can be a public background image such as a mosaic background or a background of uniform color.
进一步的,将上述第一图像中目标用户的脸部图像区域、图像替换处理后的除目标用户的脸部图像区域之外的其他图像区域的组合确定为目标用户的第二图像。Further, a combination of the face image area of the target user in the first image and other image areas after image replacement processing except the face image area of the target user is determined as the second image of the target user.
具体的,针对目标图像区域为其他图像区域中的情况,基于预设图像,对第一图像中除目标用户的脸部图像区域之外的其他图像区域进行图像替换处理,得到更新后的第一图像(即将第一图像中的其他图像区域替换为预设图像);如图4所示,针对目标图像区域为第一图像的其他图像区域中界面上未显示的图像区域的情况,在目标应用的显示界面上显示第一图像(包括已显示的图像区域和未显示的图像区域),即图4中的(a)所示的显示效果,其中,第一图像的完整显示效果即为图4中(b),将第一图像中除目标用户的脸部图像区域之外的其他图像区域中未显示的图像区域替换为预设图像, 得到目标用户的脸部图像区域(即已显示的图像区域中目标用户脸部图像区域)、除目标用户的脸部图像区域之外的其他图像区域中已显示的图像区域、以及其他图像区域中未显示的图像区域图像替换处理后的的组合,即图4中(c)所示的显示效果,上述其他图像区域中包括,图像替换处理后的其他图像区域中未显示的图像区域(即为预设图像)、以及其他图像区域中界面上已显示的图像区域的组合。Specifically, for the case where the target image area is in other image areas, based on the preset image, image replacement processing is performed on other image areas in the first image except the face image area of the target user to obtain the updated first image area. image (that is, replace other image areas in the first image with preset images); as shown in Figure 4, for the situation that the target image area is an image area not displayed on the interface in other image areas of the first image, in the target application The first image (including the displayed image area and the undisplayed image area) is displayed on the display interface of the , that is, the display effect shown in (a) in Figure 4, wherein the complete display effect of the first image is as shown in Figure 4 In (b), replace the undisplayed image areas in other image areas except the target user's face image area in the first image with the preset image, and obtain the target user's face image area (that is, the displayed image target user's face image area in the target user's face image area), the displayed image area in other image areas except the target user's face image area, and the combination of image replacement processing of the image area not displayed in other image areas, that is For the display effect shown in (c) in Figure 4, the above-mentioned other image areas include image areas not displayed in other image areas after image replacement processing (that is, preset images), and other image areas that have been displayed on the interface combination of image regions.
本申请实施例中,对第一图像进行隐私处理的方式中,在对目标用户的第一图像中的目标图像区域进行图像替换时,通过灵活设置目标图像区域的范围,进一步提升了隐私保护处理的灵活性。In the embodiment of the present application, in the method of performing privacy processing on the first image, when replacing the target image area in the target user's first image, the privacy protection process is further improved by flexibly setting the range of the target image area flexibility.
在具体实施时,可以在获取到利用摄像头采集的第一图像后,直接触发执行图像隐私保护机制,即直接触发上述步骤S104中,对第一图像进行隐私处理,或者输出提示信息;进一步的,考虑到只有目标应用的图像显示方式为图像部分区域显示时,存在隐私数据泄露的风险比较大,因此,为了提高图像隐私保护的针对性,从而实现在确保用户隐私数据的安全性的情况下,提高目标应用的业务处理响应效率,即先确认第一图像与目标应用的界面的显示内容匹配度小于或等于目标值,即只有确定目标应用的图像显示方式为图像部分区域显示的情况下,才触发执行图像隐私保护机制,具体的,如图5所示,上述步骤S104,在第一图像与界面的显示内容匹配度小于或等于目标值的情况下,对第一图像进行隐私处理,或者输出提示信息之前,具体包括:In a specific implementation, after the first image captured by the camera is obtained, the execution of the image privacy protection mechanism can be directly triggered, that is, the above step S104 can be directly triggered to perform privacy processing on the first image, or output prompt information; further, Considering that only the image display mode of the target application is displayed in a partial area of the image, there is a relatively high risk of privacy data leakage. Therefore, in order to improve the pertinence of image privacy protection and ensure the security of user privacy data, Improve the business processing response efficiency of the target application, that is, first confirm that the matching degree of the display content of the first image and the interface of the target application is less than or equal to the target value, that is, only when the image display mode of the target application is determined to be displayed in a partial area of the image. Trigger the execution of the image privacy protection mechanism. Specifically, as shown in FIG. 5, the above step S104, when the matching degree between the first image and the display content of the interface is less than or equal to the target value, perform privacy processing on the first image, or output Before prompting information, specifically include:
S108,获取界面的显示内容;S108, acquire the display content of the interface;
S110,将利用摄像头采集到的第一图像与界面的显示内容进行图像内容比对,确定该第一图像与该显示内容匹配度。S110. Compare the image content of the first image captured by the camera with the display content of the interface, and determine the degree of matching between the first image and the display content.
具体的,由于在获取到利用摄像头采集的第一图像之后,该第一图像中可能包含用户的隐私数据,因此不能直接将该第一图像传输至目标应用,因此可以在获取利用摄像头采集到的第一图像的同时,执行步骤S108,获取界面的显示内容,以确保该界面上的显示内容与摄像头采集到的第一图像是在 同一拍摄环境所采集的,具有一部分相同的图像内容,以使该第一图像与该显示内容可以进行图像内容比对,确定该第一图像与该显示内容匹配度,进而确定目标应用的图像显示方式。其中,上述步骤S108,获取界面的显示内容也可以在S102,获取利用摄像头采集到的第一图像之前执行,或在S102,获取利用摄像头采集到的第一图像之后执行,以解决目标应用可能会自动调用摄像头采集目标用户的第一图像,进而泄露用户隐私数据的问题。Specifically, after the first image captured by the camera is acquired, the first image may contain the user's privacy data, so the first image cannot be directly transmitted to the target application, so the first image captured by the camera can be acquired At the same time as the first image, step S108 is executed to obtain the display content of the interface, to ensure that the display content on the interface and the first image collected by the camera are collected in the same shooting environment and have part of the same image content, so that The image content comparison between the first image and the display content can be performed to determine the degree of matching between the first image and the display content, and then determine the image display mode of the target application. Wherein, the above step S108, obtaining the display content of the interface may also be executed before S102, obtaining the first image collected by the camera, or after S102, obtaining the first image collected by the camera, so as to solve the problem that the target application may Automatically call the camera to collect the first image of the target user, and then leak the user's private data.
具体的,将摄像头采集到的第一图像与界面的显示内容进行图像内容比对,确定该第一图像与该显示内容匹配度,若第一图像与界面的显示内容匹配度小于或等于目标值,则确定目标应用的显示界面上目标用户的第一图像为图像部分区域显示;若第一图像与界面的显示内容匹配度大于目标值,则确定目标应用的显示界面上目标用户的第一图像为图像全部区域显示。Specifically, compare the image content of the first image captured by the camera with the display content of the interface to determine the matching degree between the first image and the display content, if the matching degree between the first image and the display content of the interface is less than or equal to the target value , then determine that the first image of the target user on the display interface of the target application is displayed in a partial area of the image; if the matching degree between the first image and the display content of the interface is greater than the target value, then determine the first image of the target user on the display interface of the target application Displayed for the entire area of the image.
进一步的,针对确定摄像头采集到的第一图像与目标应用界面的显示内容匹配度的过程,除了上述在获取利用摄像头采集到的第一图像的同时,获取界面的显示内容,并将摄像头采集到的第一图像与界面的显示内容进行图像内容比对的方式,还可以基于默认图像来确定摄像头采集到的第一图像与目标应用界面的显示内容匹配度,具体的,可以是每次目标应用通过调起摄像头采集目标用户的第一图像的情况下均基于默认图像来确定该第一图像与目标应用界面的显示内容匹配度,进而确定目标应用的图像显示方式,即确定第一图像为图像部分区域显示、还是图像全部区域显示;也可以是首次安装目标应用或者目标应用存在版本更新等目标应用满足预设使用条件的情况下,基于默认图像来来确定该第一图像与目标应用界面的显示内容匹配度,进而确定目标应用的图像显示方式,并存储该目标应用的图像显示方式(例如,图像部分区域显示或者图像全部区域显示),这样后续可以直接基于预存的该目标应用的显示方式标签来确定第一图像为图像部分区域显示、还是图像全部区域显示;Further, for the process of determining the matching degree between the first image captured by the camera and the display content of the target application interface, in addition to the above-mentioned acquisition of the first image captured by the camera, the display content of the interface is acquired, and the camera captures the The method of comparing the image content between the first image of the camera and the display content of the interface can also determine the matching degree between the first image captured by the camera and the display content of the target application interface based on the default image. Specifically, it can be each time the target application When the camera is used to capture the first image of the target user, the matching degree between the first image and the display content of the target application interface is determined based on the default image, and then the image display method of the target application is determined, that is, the first image is determined to be an image Part of the area is displayed, or the entire area of the image is displayed; it can also be determined based on the default image when the target application is installed for the first time or the target application has a version update, and the target application meets the preset usage conditions. Display the matching degree of content, and then determine the image display mode of the target application, and store the image display mode of the target application (for example, the display of a part of the image or the display of the entire image area), so that the follow-up can be directly based on the pre-stored display mode of the target application label to determine whether the first image is displayed in a partial area of the image or in the entire area of the image;
具体的,若确定目标应用的显示方式为图像部分区域显示,则执行上述步骤S104中,对上述第一图像进行隐私处理,或者输出提示信息。Specifically, if it is determined that the display mode of the target application is to display a partial area of an image, the above-mentioned step S104 is performed to perform privacy processing on the above-mentioned first image, or output prompt information.
若确定目标应用的显示方式为图像全部区域显示,则直接将目标用户的第一图像传输至目标应用;其中,为了进一步保证隐私数据的安全,在确定在目标应用的显示方式为图像全部区域显示后,可以先提示目标用户确认目标应用的界面中显示的第一图像不存在隐私泄露风险,在接收到目标用户的确认信息后,再将目标用户的第一图像传输至目标应用,以使目标应用基于该第一图像进行相应的业务处理。If it is determined that the display mode of the target application is displayed in the entire image area, the first image of the target user is directly transmitted to the target application; wherein, in order to further ensure the security of private data, after determining that the display mode of the target application is displayed in the entire image area Finally, the target user may be prompted to confirm that the first image displayed in the interface of the target application does not have the risk of privacy leakage, and after receiving the confirmation information of the target user, the first image of the target user is transmitted to the target application, so that the target The application performs corresponding service processing based on the first image.
具体的,针对基于默认图像确定摄像头采集到的第一图像与目标应用界面的显示内容匹配度,进而确定目标应用的图像显示方式的过程,具体包括:Specifically, the process of determining the match degree between the first image captured by the camera and the display content of the target application interface based on the default image, and then determining the image display mode of the target application specifically includes:
步骤一,在目标应用的显示界面上显示默认图像,并对该显示界面进行截图,得到第四图像;Step 1, displaying a default image on the display interface of the target application, and taking a screenshot of the display interface to obtain a fourth image;
其中,上述默认图像与摄像头所采集的目标用户的第一图像不同,该默认图像为处理器直接传输至目标应用的默认图像(可公开图像),不包含目标用户的隐私数据。Wherein, the above-mentioned default image is different from the first image of the target user collected by the camera. The default image is a default image (public image) directly transmitted by the processor to the target application, and does not contain the private data of the target user.
步骤二,将摄像头所采集的第一图像与默认图像在目标应用的界面中的显示内容进行图像内容比对,确定该第一图像与该显示内容匹配度,即判断上述默认图像与上述第四图像之间的相同图像所占面积是否小于或等于目标值;Step 2: Compare the image content of the first image captured by the camera with the display content of the default image in the interface of the target application, and determine the matching degree between the first image and the display content, that is, judge the default image and the fourth image above. Whether the area occupied by the same image between images is less than or equal to the target value;
其中,上述相同图像所占面积具体为上述默认图像与上述第四图像之间的相同图像在第四图像(即显示界面)上所占的面积;具体的,若所占面积小于或等于目标值(即第一图像与界面的显示内容匹配度小于或等于目标值),则确定在目标应用的图像显示方式为图像部分区域显示,则对第一图像进行隐私处理,或者输出提示信息;若所占面积大于目标值(即第一图像与界面的显示内容匹配度大于目标值),则确定在目标应用的图像显示方式为图像全部区域显示,则可以直接将目标用户的第一图像传输至目标应用;Wherein, the above-mentioned area occupied by the same image is specifically the area occupied by the same image between the above-mentioned default image and the above-mentioned fourth image on the fourth image (ie, the display interface); specifically, if the occupied area is less than or equal to the target value (that is, the matching degree between the first image and the display content of the interface is less than or equal to the target value), then it is determined that the image display mode of the target application is displayed in a partial area of the image, and then the first image is processed for privacy, or a prompt message is output; if the If the occupied area is greater than the target value (that is, the matching degree between the first image and the display content of the interface is greater than the target value), then it is determined that the image display mode in the target application is displayed in the entire area of the image, and the first image of the target user can be directly transmitted to the target application;
在具体实施时,针对确定目标应用的图像显示方式的过程,可以是每次均基于默认图像确定,即在每次检测到目标应用调用摄像头进行拍摄时,均执行一次上述基于默认图像确定目标应用的图像显示方式的过程;In specific implementation, the process of determining the image display mode of the target application can be determined based on the default image every time, that is, the above-mentioned determination of the target application based on the default image is performed once every time the target application is detected to call the camera to take pictures. The process of image display mode;
或者,可以是直接基于预先存储的目标应用的图像显示方式标签进行确定;具体的,预先基于默认图像确定目标应用的图像显示方式(即目标应用的图像显示方式标签),并对目标图像的图像显示方式进行标记,例如,可以存储目标应用与图像显示方式标签之间的对应关系,该图像显示方式标签包括:图像部分区域显示或者图像全部区域显示;然后,在目标应用的使用过程中,可以直接基于该图像显示方式标签,快速确定目标应用对应的图像显示方式;其中,若图像显示方式为图像部分区域显示,则确定第一图像与界面的显示内容匹配度小于或等于目标值,进而对第一图像进行隐私处理,或者输出提示信息。Or, it may be determined directly based on the pre-stored image display mode tag of the target application; specifically, the image display mode of the target application (that is, the image display mode label of the target application) is determined in advance based on the default image, and the image display mode of the target image For example, the corresponding relationship between the target application and the label of the image display mode can be stored, and the image display mode label includes: displaying a part of the image or displaying the entire area of the image; then, during the use of the target application, you can Directly based on the image display mode label, quickly determine the image display mode corresponding to the target application; wherein, if the image display mode is partial area display of the image, it is determined that the matching degree between the first image and the display content of the interface is less than or equal to the target value, and then the Privacy processing is performed on the first image, or prompt information is output.
具体的,针对电子设备上安装的每个指定应用(包括目标应用和其他具有调用相机应用功能的应用程序),均预先执行一次上述图像显示方式的确定过程(即确定指定应用针对默认图像的图像显示方式为图像部分区域显示、还是图像全部区域显示),并根据图像显示方式的确定结果对指定应用的图像显示方式进行标记,进一步的,在图像显示方式为图像部分区域显示的目标应用调用摄像头(相机应用)的情况下,在获取利用摄像头采集到的第一图像之后,先自动执行步骤S104中,对第一图像进行隐私处理,再将基于该第一图像得到的第二图像传输至目标应用,或者输出提示信息,以提示用户调整位姿。Specifically, for each specified application installed on the electronic device (including the target application and other applications with the function of calling the camera application), the above-mentioned image display method determination process (that is, to determine the default image image of the specified application) is performed once in advance. The display mode is partial image display or all image display), and the image display mode of the specified application is marked according to the determination result of the image display mode, and further, the camera is called by the target application whose image display mode is partial image display In the case of (camera application), after the first image captured by the camera is acquired, step S104 is automatically performed to perform privacy processing on the first image, and then the second image obtained based on the first image is transmitted to the target application, or output prompt information to prompt the user to adjust the pose.
进一步的,考虑到可能存在目标用户的图像数据在目标应用的图像显示方式变更的情况,因此需要在图像显示方式变更后,对目标应用的图像显示方式标签进行变更,因此,引入针对目标应用的图像显示方式标签的核验机制;具体的,在检测到目标应用存在应用版本更新的情况下,执行上述步骤一至步骤二,即再次基于默认图像确定目标应用的图像显示方式,并基于新的图像显示方式更新原图像显示方式,以便后续基于更新后的图像显示方式标签,来决定是否触发执行上述S104中,对第一图像进行隐私处理,或者输出提示信息的步骤。Furthermore, considering that the target user’s image data may change in the image display mode of the target application, it is necessary to change the image display mode label of the target application after the image display mode is changed. Therefore, the introduction of the target application The verification mechanism of the image display method label; specifically, when it is detected that the target application has an application version update, the above steps 1 to 2 are performed, that is, the image display method of the target application is determined based on the default image again, and the new image is displayed. The method updates the original image display mode, so as to determine whether to trigger the execution of the step of performing privacy processing on the first image or outputting prompt information in S104 above based on the updated image display mode label.
更进一步的,考虑到即使未检测出目标应用的版本更新,可能也会存在 目标应用的图像显示方式存在变更的情况,由于针对已将目标应用标记为图像全部区域显示的情况,一旦图像显示方式存在变更,但未对目标应用的原图像显示方式进行更新,此时可能存在用户隐私数据泄露的情况,基于此,可以按照预设时间间隔对已标记为图像全部区域显示的目标应用执行标签核验过程,具体的,针对显示方式标签为图像全部区域显示的目标应用,不仅在检测到应用版本更新的情况,执行一次上述基于默认图像确定目标应用的图像显示方式,而且,还按照预设时间间隔,执行上述基于默认图像确定目标应用的图像显示方式,按照预设时间间隔执行上述基于默认图像确定目标应用的图像显示方式(即确定指定应用针对默认图像的图像显示方式为图像部分区域显示、还是图像全部区域显示),然后根据图像显示方式的识别结果来确定是否需要对目标应用的图像显示方式标签进行更新,具体的,若本次识别出的图像显示方式标签与上一次识别出的图像显示方式标签不一致,则基于本次识别出的图像显示方式标签更新目标应用的图像显示方式。Furthermore, considering that even if the version update of the target application is not detected, the image display mode of the target application may change. Since the target application has been marked as displayed in all areas of the image, once the image display mode There is a change, but the original image display method of the target application has not been updated. At this time, user privacy data may be leaked. Based on this, label verification can be performed on the target application that has been marked for display in all areas of the image at preset time intervals. The process, specifically, for the target application whose display mode label is displayed in all areas of the image, not only when the application version update is detected, the above-mentioned image display mode of the target application based on the default image is determined once, but also according to the preset time interval , execute the above-mentioned image display mode of the target application based on the default image, and execute the above-mentioned image display mode of the target application based on the default image at a preset time interval (that is, determine whether the image display mode of the specified application for the default image is to display a part of the image or The entire area of the image is displayed), and then according to the recognition result of the image display mode, it is determined whether to update the image display mode label of the target application. Specifically, if the image display mode label recognized this time is different from the image display mode recognized last time If the mode tags are inconsistent, update the image display mode of the target application based on the recognized image display mode tag this time.
本申请实施例中,采用预先记录目标应用的图像显示方式标签,这样在目标应用的使用过程中,可以直接基于该图像显示方式标签确定目标应用的图像显示方式为图像部分区域显示、还是图像全部区域显示,无需每次均执行一次基于默认图像确定目标应用的图像显示方式,因此,可以提高目标应用针对用户业务请求的响应效率,但是可能存在因应用版本更新,导致应用的拍摄界面的显示方式发生变化,从而导致显示方式标签发生变化,因此,需要引入上述标签核验机制对目标应用的图像显示方式进行验证,以便提高针对第一图像进行隐私保护的准确度,从而进一步提高目标用户的隐私数据的安全性。In this embodiment of the application, the image display mode tag of the target application is pre-recorded, so that during the use of the target application, it can be directly determined based on the image display mode tag whether the image display mode of the target application is partial image display or all image display Area display, there is no need to determine the image display mode of the target application based on the default image every time, so the response efficiency of the target application to the user's business request can be improved, but there may be a problem with the display mode of the application's shooting interface due to the update of the application version Therefore, it is necessary to introduce the above-mentioned label verification mechanism to verify the image display method of the target application, so as to improve the accuracy of privacy protection for the first image, thereby further improving the privacy data of the target user. security.
进一步的,可以在确定第一图像与界面的显示内容匹配度小于或等于目标值的情况下,即确定第一图像在目标应用的显示界面上为图像部分区域显示的情况(即目标应用的图像显示方式为图像部分区域显示),直接对该第一图像进行隐私处理,或者输出提示信息;进一步的,考虑到第一图像在目标应用的显示界面上为图像部分区域显示的情况,第一图像中可能会包含用户 观测不到的隐私数据,此时将存在用户隐私数据泄露的风险,对应的,第一图像中也可能不包含用户隐私数据,因此,为了提高图像隐私保护处理的针对性,从而实现在确保用户隐私数据的安全性的情况下,可以先对第一图像进行图像识别,来确定是否包含用户隐私数据,只有包含用户隐私数据的情况下,才执行对第一图像进行隐私保护处理的过程,基于此,在确定第一图像与界面的显示内容匹配度小于或等于目标值,即在确定目标应用的图像显示方式为图像部分区域显示的情况下,对上述第一图像进行隐私处理,或者输出提示信息,具体包括:Further, when it is determined that the matching degree between the first image and the display content of the interface is less than or equal to the target value, that is, it is determined that the first image is displayed in a partial area of the image on the display interface of the target application (that is, the image of the target application The display method is displaying a partial area of the image), directly performing privacy processing on the first image, or outputting prompt information; further, considering that the first image is displayed as a partial area of the image on the display interface of the target application, the first image may contain privacy data that cannot be observed by the user. At this time, there will be a risk of user privacy data leakage. Correspondingly, the first image may not contain user privacy data. Therefore, in order to improve the pertinence of image privacy protection processing, In this way, under the condition of ensuring the security of user privacy data, image recognition can be performed on the first image to determine whether it contains user privacy data, and only when the user privacy data is included, privacy protection is performed on the first image The process of processing, based on this, when it is determined that the matching degree between the first image and the display content of the interface is less than or equal to the target value, that is, when it is determined that the image display mode of the target application is displayed in a partial area of the image, the privacy of the above-mentioned first image is determined. Processing, or output prompt information, including:
利用预先训练好的图像识别模型对上述第一图像进行图像识别,得到隐私风险识别结果;若所述隐私风险识别结果为存在隐私泄露风险,则对上述第一图像进行隐私处理,或者输出提示信息。Using a pre-trained image recognition model to perform image recognition on the above-mentioned first image to obtain a privacy risk identification result; if the privacy risk identification result indicates that there is a risk of privacy leakage, then perform privacy processing on the above-mentioned first image, or output a prompt message .
其中,可以采用现有的机器学习方法对预设的图像识别模型的模型参数进行迭代训练更新,得到更新后的模型参数,直到图像识别模型对应的模型函数收敛,进而得到训练好的图像识别模型,其中,该图像识别模型用于对第一图像进行图像识别,进而得到隐私风险识别结果。Among them, the existing machine learning method can be used to iteratively train and update the model parameters of the preset image recognition model to obtain the updated model parameters until the model function corresponding to the image recognition model converges, and then obtain the trained image recognition model , wherein the image recognition model is used to perform image recognition on the first image, and then obtain a privacy risk recognition result.
其中,在利用图像识别模型进行预测时,若输入至预先训练好的图像识别模型中的第一图像中包含目标用户的隐私数据,则确定图像识别模型的识别结果为存在隐私泄露风险;若上述隐私风险识别结果为存在隐私泄露风险,则对第一图像进行隐私处理,从而得到不包含目标用户隐私数据的第二图像,再将第二图像传输至目标应用进行相关的业务处理;或者输出提示信息,以使目标用户基于实时观测到的图像内容调整位姿。Wherein, when using the image recognition model for prediction, if the first image input to the pre-trained image recognition model contains the privacy data of the target user, then it is determined that the recognition result of the image recognition model has a risk of privacy disclosure; if the above If the result of the privacy risk identification is that there is a risk of privacy leakage, the first image is processed for privacy to obtain a second image that does not contain the private data of the target user, and then the second image is transmitted to the target application for related business processing; or a prompt is output Information, so that the target user can adjust the pose based on the real-time observed image content.
具体的,确定第一图像与界面的显示内容匹配度小于或等于目标值之后,即确定在目标应用的图像显示方式为图像部分区域显示之后,可以直接对第一图像进行隐私处理,进一步的,为了提高隐私处理的针对性,也可以先对第一图像进行隐私风险识别,若识别出第一图像中包含目标用户的隐私数据,再对第一图像进行隐私处理;其中,针对增加对第一图像中隐私数据识别过程的情况,可以基于识别出的包含隐私数据的第一图像中隐私数据所在的图 像区域,输出相应的提示信息,提示目标用户进行位姿调整,例如,可以提示目标用户“隐私泄露,请调整角度”、“隐私泄露,请注意衣物穿戴”、以及“隐私泄露,请更换拍摄场所”,在具体实施时,可以在悬浮窗中显示的第一图像标记出隐私数据所在的图像区域,以使用户快速识别隐私数据所在位置;和/或直接将包含隐私数据的第一图像中隐私数据所在的图像区域替换为预设图像。Specifically, after it is determined that the matching degree between the first image and the display content of the interface is less than or equal to the target value, that is, after it is determined that the image display mode of the target application is displayed in a partial area of the image, privacy processing can be directly performed on the first image. Further, In order to improve the pertinence of privacy processing, it is also possible to carry out privacy risk identification on the first image first, and then perform privacy processing on the first image if it is identified that the first image contains the privacy data of the target user; In the process of identifying the private data in the image, based on the identified image area where the private data is located in the first image containing the private data, corresponding prompt information can be output to prompt the target user to adjust the pose. For example, the target user can be prompted to " Privacy leak, please adjust the angle", "Privacy leak, please pay attention to clothing", and "Privacy leak, please change the shooting location". The image area, so that the user can quickly identify the location of the private data; and/or directly replace the image area where the private data is located in the first image containing the private data with a preset image.
若输入至预先训练好的图像识别模型中的第一图像中不包含目标用户的隐私数据,则确定图像识别模型的识别结果为不存在隐私泄露风险,则直接将第一图像传输至目标应用进行相应的业务处理,进一步的,为了提高识别结果的准确性,也可以先提示用户确认不存在隐私泄露风险,在检测到用户的确认信息后,再将上述第一图像传输至目标应用进行相应的业务处理。If the first image input into the pre-trained image recognition model does not contain the privacy data of the target user, then it is determined that the recognition result of the image recognition model is that there is no risk of privacy leakage, and the first image is directly transmitted to the target application for further processing. For corresponding business processing, further, in order to improve the accuracy of the recognition results, the user may be prompted to confirm that there is no risk of privacy leakage, and after the user's confirmation information is detected, the above-mentioned first image is transmitted to the target application for corresponding processing. business processing.
本申请实施例中的图像数据的处理方法,先获取利用摄像头采集到的第一图像,该第一图像包括目标用户的脸部图像区域,并在该第一图像与界面的显示内容匹配度小于或等于目标值的情况下,对该第一图像进行隐私处理,或者输出提示信息,即通过将摄像头实际采集到的第一图像与该第一图像在目标应用的界面上实际显示的内容进行匹配,若匹配度小于或等于目标值,则摄像头实际采集到的第一图像不能完整地显示在该目标应用的界面上,且该第一图像中未在目标应用的界面上显示的部分可能包含用户的隐私数据,因此会存在用户的隐私数据被泄露而不自知的风险,因此在将该第一图像传输至目标应用之前,需要对该第一图像中未在目标应用的界面上显示的部分进行隐私处理,从而得到不包含用户隐私数据的图像,或者输出提示信息,这样能够减少因第一图像中未在目标应用的界面上显示的部分存在用户隐私数据而导致用户隐私数据泄露的风险,从而实现根源上避免了目标用户的隐私数据的泄露,达到了保护用户隐私数据的效果,以及提升了目标应用在调用摄像头进行拍摄时所拍摄的图像数据的安全性。The image data processing method in the embodiment of the present application first acquires the first image collected by the camera, the first image includes the face image area of the target user, and the matching degree between the first image and the display content of the interface is less than or equal to the target value, perform privacy processing on the first image, or output prompt information, that is, by matching the first image actually captured by the camera with the content actually displayed on the interface of the target application , if the matching degree is less than or equal to the target value, the first image actually captured by the camera cannot be completely displayed on the interface of the target application, and the part of the first image that is not displayed on the interface of the target application may contain user Therefore, there will be a risk that the user’s private data will be leaked without knowing it. Therefore, before transmitting the first image to the target application, it is necessary to check the part of the first image that is not displayed on the interface of the target application Perform privacy processing to obtain images that do not contain user privacy data, or output prompt information, which can reduce the risk of leakage of user privacy data due to the presence of user privacy data in the part of the first image that is not displayed on the interface of the target application, In this way, the disclosure of the private data of the target user is avoided fundamentally, the effect of protecting the private data of the user is achieved, and the security of the image data captured by the target application when calling the camera is improved.
需要说明的是,本申请实施例提供的图像数据的处理方法,执行主体可以为电子设备,特别是电子设备中的处理器,或者该电子设备中的用于执行 图像数据的处理方法的控制模块。本申请实施例中以电子设备执行图像数据的处理方法为例,说明本申请实施例提供的电子设备。It should be noted that, the image data processing method provided by the embodiment of the present application may be executed by an electronic device, especially a processor in the electronic device, or a control module in the electronic device for executing the image data processing method . In the embodiment of the present application, the electronic device provided in the embodiment of the present application is described by taking the image data processing method performed by the electronic device as an example.
对应上述实施例提供的图像数据的处理方法,基于相同的技术构思,本申请实施例还提供了一种电子设备,图6为本申请实施例提供的电子设备的模块组成示意图,该电子设备用于执行图1至图5描述的图像数据的处理方法,如图6所示,该电子设备包括:Corresponding to the image data processing method provided in the above-mentioned embodiments, based on the same technical concept, the embodiment of the present application also provides an electronic device. FIG. 6 is a schematic diagram of the module composition of the electronic device provided in the embodiment of the present application. The electronic device uses To execute the image data processing method described in FIGS. 1 to 5, as shown in FIG. 6, the electronic device includes:
第一图像获取模块602,用于获取利用摄像头采集到的第一图像,所述第一图像包括目标用户的脸部图像区域;The first image acquisition module 602 is configured to acquire a first image collected by a camera, the first image including the face image area of the target user;
第一图像处理模块604,用于在所述第一图像与界面的显示内容匹配度小于或等于目标值的情况下,对所述第一图像进行隐私处理,或者输出提示信息。The first image processing module 604 is configured to perform privacy processing on the first image or output prompt information when the matching degree between the first image and the display content of the interface is less than or equal to a target value.
本申请实施例中,通过将摄像头实际采集到的第一图像与该第一图像在目标应用的界面上实际显示的内容进行匹配,若匹配度小于或等于目标值,则摄像头实际采集到的第一图像不能完整地显示在该目标应用的界面上,且该第一图像中未在目标应用的界面上显示的部分可能包含用户的隐私数据,因此会存在用户的隐私数据被泄露而不自知的风险,因此在将该第一图像传输至目标应用之前,需要对该第一图像中未在目标应用的界面上显示的部分进行隐私处理,从而得到不包含用户隐私数据的图像,或者输出提示信息,这样能够减少因第一图像中未在目标应用的界面上显示的部分存在用户隐私数据而导致用户隐私数据泄露的风险,从而实现根源上避免了目标用户的隐私数据的泄露,达到了保护用户隐私数据的效果,以及提升了目标应用在调用摄像头进行拍摄时所拍摄的图像数据的安全性。In this embodiment of the application, by matching the first image actually captured by the camera with the content actually displayed on the interface of the target application, if the matching degree is less than or equal to the target value, then the first image actually captured by the camera An image cannot be completely displayed on the interface of the target application, and the part of the first image that is not displayed on the interface of the target application may contain the user's private data, so the user's private data may be leaked without knowing it Therefore, before transmitting the first image to the target application, it is necessary to perform privacy processing on the part of the first image that is not displayed on the interface of the target application, so as to obtain an image that does not contain user privacy data, or output a prompt information, which can reduce the risk of leakage of user privacy data due to the presence of user privacy data in the part of the first image that is not displayed on the interface of the target application, thereby avoiding the leakage of the target user’s privacy data at the root and achieving protection The effect of user privacy data, and the security of the image data captured by the target application when calling the camera for shooting is improved.
可选的,如图7所示,所述电子设备,还包括,第二图像传输模块606,用于:Optionally, as shown in FIG. 7, the electronic device further includes a second image transmission module 606, configured to:
将基于所述第一图像得到的第二图像传输至目标应用,所述目标应用基于所述第二图像进行相应的业务处理。The second image obtained based on the first image is transmitted to a target application, and the target application performs corresponding service processing based on the second image.
可选的,如图7所示,所述电子设备,还包括:Optionally, as shown in Figure 7, the electronic device further includes:
界面内容获取模块608,用于获取界面的显示内容;An interface content acquisition module 608, configured to acquire the display content of the interface;
图像比对模块610,用于将所述第一图像与所述显示内容进行图像内容比对,确定所述第一图像与所述显示内容匹配度。The image comparison module 610 is configured to perform image content comparison between the first image and the display content, and determine the degree of matching between the first image and the display content.
可选的,所述第一图像还包括:除所述目标用户的脸部图像区域之外的其他图像区域;Optionally, the first image further includes: other image areas except the face image area of the target user;
所述第一图像处理模块604,具体用于:The first image processing module 604 is specifically used for:
对所述其他图像区域中的目标图像区域进行图像替换处理;performing image replacement processing on the target image area in the other image areas;
所述第二图像传输模块606,具体用于:The second image transmission module 606 is specifically used for:
基于图像替换后的其他图像区域和所述目标用户的脸部图像区域,生成所述目标用户的第二图像;generating a second image of the target user based on other image areas after image replacement and the face image area of the target user;
将所述第二图像传输至目标应用。The second image is transmitted to a target application.
可选的,所述第一图像处理模块604,还具体用于:Optionally, the first image processing module 604 is further specifically configured to:
确定所述其他图像区域中的目标图像区域,所述目标图像区域包括:所述其他图像区域、或者所述其他图像区域中界面上未显示的图像区域;Determining a target image area in the other image area, where the target image area includes: the other image area, or an image area not displayed on the interface in the other image area;
基于预设图像,对所述目标图像区域进行图像替换处理。Based on the preset image, an image replacement process is performed on the target image area.
可选的,所述第一图像处理模块604,还具体用于:Optionally, the first image processing module 604 is further specifically configured to:
以悬浮窗的形式,显示所述第一图像,以提示所述目标用户基于所述第一图像调整位姿。The first image is displayed in the form of a floating window to prompt the target user to adjust the pose based on the first image.
可选的,所述电子设备还包括:Optionally, the electronic device also includes:
第三图像获取模块,用于在接收到所述目标用户位姿调整结束的确认输入的情况下,获取利用所述摄像头采集到的第三图像;The third image acquisition module is configured to acquire the third image captured by the camera when receiving the confirmation input that the target user pose adjustment is completed;
第三图像传输模块,用于将所述第三图像传输至目标应用。A third image transmission module, configured to transmit the third image to a target application.
本申请实施例中的电子设备,先获取利用摄像头采集到的第一图像,该第一图像包括目标用户的脸部图像区域,并在该第一图像与界面的显示内容匹配度小于或等于目标值的情况下,对该第一图像进行隐私处理,或者输出提示信息,即通过将摄像头实际采集到的第一图像与该第一图像在目标应用的界面上实际显示的内容进行匹配,若匹配度小于或等于目标值,则摄像头 实际采集到的第一图像不能完整地显示在该目标应用的界面上,且该第一图像中未在目标应用的界面上显示的部分可能包含用户的隐私数据,因此会存在用户的隐私数据被泄露而不自知的风险,因此在将该第一图像传输至目标应用之前,需要对该第一图像中未在目标应用的界面上显示的部分进行隐私处理,从而得到不包含用户隐私数据的图像,或者输出提示信息,这样能够减少因第一图像中未在目标应用的界面上显示的部分存在用户隐私数据而导致用户隐私数据泄露的风险,从而实现根源上避免了目标用户的隐私数据的泄露,达到了保护用户隐私数据的效果,以及提升了目标应用在调用摄像头进行拍摄时所拍摄的图像数据的安全性。The electronic device in the embodiment of the present application first obtains the first image captured by the camera, the first image includes the face image area of the target user, and the matching degree between the first image and the display content of the interface is less than or equal to the target user In the case of a value, perform privacy processing on the first image, or output prompt information, that is, match the first image actually captured by the camera with the content actually displayed on the target application interface of the first image, if they match If the degree is less than or equal to the target value, the first image actually captured by the camera cannot be completely displayed on the interface of the target application, and the part of the first image that is not displayed on the interface of the target application may contain the user's private data , so there will be a risk that the user's private data will be leaked without knowing it. Therefore, before transmitting the first image to the target application, it is necessary to perform privacy processing on the part of the first image that is not displayed on the interface of the target application , so as to obtain an image that does not contain user privacy data, or output prompt information, which can reduce the risk of leakage of user privacy data due to the existence of user privacy data in the part of the first image that is not displayed on the interface of the target application, thereby realizing the root cause It avoids the leakage of the private data of the target user, achieves the effect of protecting the private data of the user, and improves the security of the image data captured by the target application when calling the camera for shooting.
本申请实施例中的电子设备可以是装置,也可以是终端中的部件、集成电路、或芯片。该装置可以是移动电子设备,也可以为非移动电子设备。示例性的,移动电子设备可以为手机、平板电脑、笔记本电脑、掌上电脑、车载电子设备、可穿戴设备、超级移动个人计算机(ultra-mobile personal computer,UMPC)、上网本或者个人数字助理(personal digital assistant,PDA)等,非移动电子设备可以为服务器、网络附属存储器(Network Attached Storage,NAS)、个人计算机(personal computer,PC)、电视机(television,TV)、柜员机或者自助机等,本申请实施例不作具体限定。The electronic device in the embodiment of the present application may be a device, or a component, an integrated circuit, or a chip in a terminal. The device may be a mobile electronic device or a non-mobile electronic device. Exemplarily, the mobile electronic device may be a mobile phone, a tablet computer, a notebook computer, a handheld computer, a vehicle electronic device, a wearable device, an ultra-mobile personal computer (ultra-mobile personal computer, UMPC), a netbook or a personal digital assistant (personal digital assistant). assistant, PDA), etc., non-mobile electronic devices can be servers, network attached storage (Network Attached Storage, NAS), personal computer (personal computer, PC), television (television, TV), teller machine or self-service machine, etc., this application Examples are not specifically limited.
本申请实施例中的电子设备可以为具有操作系统的装置。该操作系统可以为安卓(Android)操作系统,可以为ios操作系统,还可以为其他可能的操作系统,本申请实施例不作具体限定。The electronic device in this embodiment of the present application may be a device with an operating system. The operating system may be an Android (Android) operating system, an ios operating system, or other possible operating systems, which are not specifically limited in this embodiment of the present application.
本申请实施例提供的电子设备能够实现图1至图5的图像数据的处理方法实施例实现的各个过程,为避免重复,这里不再赘述。The electronic device provided in the embodiment of the present application can implement each process implemented in the embodiment of the image data processing method in FIGS. 1 to 5 , and details are not repeated here to avoid repetition.
可选地,如图8所示,本申请实施例还提供一种电子设备,包括处理器810,存储器809,存储在存储器809上并可在所述处理器810上运行的程序或指令,该程序或指令被处理器810执行时实现上述图像数据的处理方法实施例的各个过程,且能达到相同的技术效果,为避免重复,这里不再赘述。Optionally, as shown in FIG. 8 , the embodiment of the present application further provides an electronic device, including a processor 810, a memory 809, and programs or instructions stored in the memory 809 and operable on the processor 810, the When the programs or instructions are executed by the processor 810, various processes of the above image data processing method embodiments can be realized, and the same technical effect can be achieved. To avoid repetition, details are not repeated here.
需要说明的是,本申请实施例中的电子设备包括上述所述的移动电子设 备和非移动电子设备。It should be noted that the electronic devices in the embodiments of the present application include the above-mentioned mobile electronic devices and non-mobile electronic devices.
图8为实现本申请实施例的一种电子设备的硬件结构示意图。FIG. 8 is a schematic diagram of a hardware structure of an electronic device implementing an embodiment of the present application.
该电子设备包括但不限于:射频单元801、网络模块802、音频输出单元803、输入单元804、传感器805、显示单元806、用户输入单元807、接口单元808、存储器809、处理器810、以及电源811等部件。The electronic device includes but not limited to: a radio frequency unit 801, a network module 802, an audio output unit 803, an input unit 804, a sensor 805, a display unit 806, a user input unit 807, an interface unit 808, a memory 809, a processor 810, and a power supply 811 and other components.
本领域技术人员可以理解,电子设备还可以包括给各个部件供电的电源811(比如电池),电源811可以通过电源管理系统与处理器810逻辑相连,从而通过电源管理系统实现管理充电、放电、以及功耗管理等功能。图8中示出的电子设备结构并不构成对电子设备的限定,电子设备可以包括比图示更多或更少的部件,或者组合某些部件,或者不同的部件布置,在此不再赘述。Those skilled in the art can understand that the electronic device can also include a power supply 811 (such as a battery) for supplying power to various components, and the power supply 811 can be logically connected to the processor 810 through a power management system, so that the power management system can manage charging, discharging, and functions such as power management. The structure of the electronic device shown in FIG. 8 does not constitute a limitation to the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine some components, or arrange different components, and details will not be repeated here. .
其中,处理器810,用于获取利用摄像头采集到的第一图像,所述第一图像包括目标用户的脸部图像区域;Wherein, the processor 810 is configured to acquire a first image collected by a camera, where the first image includes a face image area of the target user;
在所述第一图像与界面的显示内容匹配度小于或等于目标值的情况下,对所述第一图像进行隐私处理,或者输出提示信息。In a case where the matching degree between the first image and the display content of the interface is less than or equal to a target value, privacy processing is performed on the first image, or prompt information is output.
本申请实施例中,通过将摄像头实际采集到的第一图像与该第一图像在目标应用的界面上实际显示的内容进行匹配,若匹配度小于或等于目标值,则摄像头实际采集到的第一图像不能完整地显示在该目标应用的界面上,且该第一图像中未在目标应用的界面上显示的部分可能包含用户的隐私数据,因此会存在用户的隐私数据被泄露而不自知的风险,因此在将该第一图像传输至目标应用之前,需要对该第一图像中未在目标应用的界面上显示的部分进行隐私处理,从而得到不包含用户隐私数据的图像,或者输出提示信息,这样能够减少因第一图像中未在目标应用的界面上显示的部分存在用户隐私数据而导致用户隐私数据泄露的风险,从而实现根源上避免了目标用户的隐私数据的泄露,达到了保护用户隐私数据的效果,以及提升了目标应用在调用摄像头进行拍摄时所拍摄的图像数据的安全性。In this embodiment of the application, by matching the first image actually captured by the camera with the content actually displayed on the interface of the target application, if the matching degree is less than or equal to the target value, then the first image actually captured by the camera An image cannot be completely displayed on the interface of the target application, and the part of the first image that is not displayed on the interface of the target application may contain the user's private data, so the user's private data may be leaked without knowing it Therefore, before transmitting the first image to the target application, it is necessary to perform privacy processing on the part of the first image that is not displayed on the interface of the target application, so as to obtain an image that does not contain user privacy data, or output a prompt information, which can reduce the risk of leakage of user privacy data due to the presence of user privacy data in the part of the first image that is not displayed on the interface of the target application, thereby avoiding the leakage of the target user’s privacy data at the root and achieving protection The effect of user privacy data, and the security of the image data captured by the target application when calling the camera for shooting is improved.
可选的,上述处理器810,还用于在对所述第一图像进行隐私处理,或 者输出提示信息之后,将基于所述第一图像得到的第二图像传输至目标应用,所述目标应用基于所述第二图像进行相应的业务处理。Optionally, the processor 810 is further configured to transmit the second image obtained based on the first image to a target application after performing privacy processing on the first image or outputting prompt information, and the target application Perform corresponding service processing based on the second image.
可选的,上述处理器810,还用于在所述第一图像与界面的显示内容匹配度小于或等于目标值的情况下,对所述第一图像进行隐私处理,或者输出提示信息之前,获取界面的显示内容;将所述第一图像与所述显示内容进行图像内容比对,确定所述第一图像与所述显示内容匹配度。Optionally, the above-mentioned processor 810 is further configured to perform privacy processing on the first image, or before outputting prompt information, when the matching degree between the first image and the display content of the interface is less than or equal to a target value, Acquire the display content of the interface; compare the image content of the first image with the display content, and determine the matching degree between the first image and the display content.
可选的,所述第一图像还包括:除所述目标用户的脸部图像区域之外的其他图像区域;上述处理器810,还用于对所述其他图像区域中的目标图像区域进行图像替换处理;基于图像替换后的其他图像区域和所述目标用户的脸部图像区域,生成所述目标用户的第二图像;将所述第二图像传输至目标应用。Optionally, the first image further includes: other image areas except the face image area of the target user; the processor 810 is further configured to image the target image area in the other image areas Replacement processing: generating a second image of the target user based on other image areas after image replacement and the face image area of the target user; transmitting the second image to the target application.
可选的,上述处理器810,还用于确定所述其他图像区域中的目标图像区域,所述目标图像区域包括:所述其他图像区域、或者所述其他图像区域中界面上未显示的图像区域;基于预设图像,对所述目标图像区域进行图像替换处理。Optionally, the processor 810 is further configured to determine a target image area in the other image area, where the target image area includes: the other image area, or an image not displayed on the interface in the other image area An area: performing image replacement processing on the target image area based on a preset image.
可选的,上述处理器810,还用于以悬浮窗的形式,显示所述第一图像,以提示所述目标用户基于所述第一图像调整位姿。Optionally, the processor 810 is further configured to display the first image in the form of a floating window, so as to prompt the target user to adjust the pose based on the first image.
可选的,上述处理器810,还用于在输出提示信息之后,在接收到所述目标用户位姿调整结束的确认输入的情况下,获取利用所述摄像头采集到的第三图像;将所述第三图像传输至目标应用。Optionally, the above-mentioned processor 810 is further configured to, after outputting the prompt information, acquire the third image captured by the camera when receiving the confirmation input that the target user pose adjustment is completed; The third image is transmitted to the target application.
本申请实施例中的电子设备,先获取利用摄像头采集到的第一图像,该第一图像包括目标用户的脸部图像区域,并在该第一图像与界面的显示内容匹配度小于或等于目标值的情况下,对该第一图像进行隐私处理,或者输出提示信息,即通过将摄像头实际采集到的第一图像与该第一图像在目标应用的界面上实际显示的内容进行匹配,若匹配度小于或等于目标值,则摄像头实际采集到的第一图像不能完整地显示在该目标应用的界面上,且该第一图像中未在目标应用的界面上显示的部分可能包含用户的隐私数据,因此会存 在用户的隐私数据被泄露而不自知的风险,因此在将该第一图像传输至目标应用之前,需要对该第一图像中未在目标应用的界面上显示的部分进行隐私处理,从而得到不包含用户隐私数据的图像,或者输出提示信息,这样能够减少因第一图像中未在目标应用的界面上显示的部分存在用户隐私数据而导致用户隐私数据泄露的风险,从而实现根源上避免了目标用户的隐私数据的泄露,达到了保护用户隐私数据的效果,以及提升了目标应用在调用摄像头进行拍摄时所拍摄的图像数据的安全性。The electronic device in the embodiment of the present application first obtains the first image captured by the camera, the first image includes the face image area of the target user, and the matching degree between the first image and the display content of the interface is less than or equal to the target user In the case of a value, perform privacy processing on the first image, or output prompt information, that is, match the first image actually captured by the camera with the content actually displayed on the target application interface of the first image, if they match If the degree is less than or equal to the target value, the first image actually captured by the camera cannot be completely displayed on the interface of the target application, and the part of the first image that is not displayed on the interface of the target application may contain the user's private data , so there will be a risk that the user's private data will be leaked without knowing it. Therefore, before transmitting the first image to the target application, it is necessary to perform privacy processing on the part of the first image that is not displayed on the interface of the target application , so as to obtain an image that does not contain user privacy data, or output prompt information, which can reduce the risk of leakage of user privacy data due to the existence of user privacy data in the part of the first image that is not displayed on the interface of the target application, thereby realizing the root cause It avoids the leakage of the private data of the target user, achieves the effect of protecting the private data of the user, and improves the security of the image data captured by the target application when calling the camera for shooting.
应理解的是,本申请实施例中,射频单元801可用于收发信息或通话过程中,信号的接收和发送,具体的,将来自基站的下行数据接收后,给处理器810处理;另外,将上行的数据发送给基站。通常,射频单元801包括但不限于天线、至少一个放大器、收发信机、耦合器、低噪声放大器、双工器等。此外,射频单元801还可以通过无线通信系统与网络和其他设备通信。It should be understood that, in the embodiment of the present application, the radio frequency unit 801 can be used for receiving and sending signals during sending and receiving information or during a call. Specifically, the downlink data from the base station is received and processed by the processor 810; Uplink data is sent to the base station. Generally, the radio frequency unit 801 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. In addition, the radio frequency unit 801 can also communicate with the network and other devices through a wireless communication system.
电子设备通过网络模块802为用户提供了无线的宽带互联网访问,如帮助用户收发电子邮件、浏览网页和访问流式媒体等。The electronic device provides users with wireless broadband Internet access through the network module 802, such as helping users send and receive emails, browse web pages, and access streaming media.
音频输出单元803可以将射频单元801或网络模块802接收的或者在存储器809中存储的音频数据转换成音频信号并且输出为声音。而且,音频输出单元803还可以提供与电子设备执行的特定功能相关的音频输出(例如,呼叫信号接收声音、消息接收声音等等)。音频输出单元803包括扬声器、蜂鸣器以及受话器等。The audio output unit 803 may convert audio data received by the radio frequency unit 801 or the network module 802 or stored in the memory 809 into an audio signal and output as sound. Also, the audio output unit 803 can also provide audio output related to a specific function performed by the electronic device (eg, call signal reception sound, message reception sound, etc.). The audio output unit 803 includes a speaker, a buzzer, a receiver, and the like.
输入单元804可以包括图形处理器(Graphics Processing Unit,GPU)8041和麦克风8042,图形处理器8041对在视频捕获模式或图像捕获模式中由图像捕获装置(如摄像头)获得的静态图片或视频的图像数据进行处理。显示单元806可包括显示面板8061,可以采用液晶显示器、有机发光二极管等形式来配置显示面板8061。用户输入单元807包括触控面板8071以及其他输入设备8072。触控面板8071,也称为触摸屏。触控面板8071可包括触摸检测装置和触摸控制器两个部分。其他输入设备8072可以包括但不限于物理键盘、功能键(比如音量控制按键、开关按键等)、轨迹球、鼠标、操作杆,在 此不再赘述。存储器809可用于存储软件程序以及各种数据,包括但不限于应用程序和操作系统。处理器810可集成应用处理器和调制解调处理器,其中,应用处理器主要处理操作系统、用户界面和应用程序等,调制解调处理器主要处理无线通信。可以理解的是,上述调制解调处理器也可以不集成到处理器810中。The input unit 804 may include a graphics processor (Graphics Processing Unit, GPU) 8041 and a microphone 8042, and the graphics processor 8041 is used for still pictures or video images obtained by an image capture device (such as a camera) in video capture mode or image capture mode The data is processed. The display unit 806 may include a display panel 8061, and the display panel 8061 may be configured in the form of a liquid crystal display, an organic light emitting diode, or the like. The user input unit 807 includes a touch panel 8071 and other input devices 8072 . The touch panel 8071 is also called a touch screen. The touch panel 8071 may include two parts, a touch detection device and a touch controller. Other input devices 8072 may include, but are not limited to, physical keyboards, function keys (such as volume control buttons, switch buttons, etc.), trackballs, mice, and joysticks, which will not be repeated here. Memory 809 may be used to store software programs as well as various data, including but not limited to application programs and operating systems. The processor 810 may integrate an application processor and a modem processor, wherein the application processor mainly processes operating systems, user interfaces, and application programs, and the modem processor mainly processes wireless communications. It can be understood that, the foregoing modem processor may not be integrated into the processor 810 .
电子设备还包括至少一种传感器805,比如光传感器、运动传感器以及其他传感器。具体地,光传感器包括环境光传感器及接近传感器,其中,环境光传感器可根据环境光线的明暗来调节显示面板8061的亮度,接近传感器可在电子设备移动到耳边时,关闭显示面板8061和/或背光。作为运动传感器的一种,加速计传感器可检测各个方向上(一般为三轴)加速度的大小,静止时可检测出重力的大小及方向,可用于识别电子设备姿态(比如横竖屏切换、相关游戏、磁力计姿态校准)、振动识别相关功能(比如计步器、敲击)等;传感器805还可以包括指纹传感器、压力传感器、虹膜传感器、分子传感器、陀螺仪、气压计、湿度计、温度计、红外线传感器等,在此不再赘述。The electronic device also includes at least one sensor 805, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor includes an ambient light sensor and a proximity sensor, wherein the ambient light sensor can adjust the brightness of the display panel 8061 according to the brightness of the ambient light, and the proximity sensor can turn off the display panel 8061 and/or when the electronic device moves to the ear. or backlight. As a kind of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in various directions (generally three axes), and can detect the magnitude and direction of gravity when it is still, and can be used to identify the posture of electronic equipment (such as horizontal and vertical screen switching, related games) , magnetometer posture calibration), vibration recognition-related functions (such as pedometer, knocking), etc.; the sensor 805 can also include fingerprint sensors, pressure sensors, iris sensors, molecular sensors, gyroscopes, barometers, hygrometers, thermometers, Infrared sensors, etc., will not be repeated here.
显示单元806用于显示由用户输入的信息或提供给用户的信息。显示单元806可包括显示面板8061,可以采用液晶显示器(Liquid Crystal Display,LCD)、有机发光二极管(Organic Light-Emitting Diode,OLED)等形式来配置显示面板8061。The display unit 806 is used to display information input by the user or information provided to the user. The display unit 806 may include a display panel 8061, and the display panel 8061 may be configured in the form of a liquid crystal display (Liquid Crystal Display, LCD), an organic light-emitting diode (Organic Light-Emitting Diode, OLED), or the like.
用户输入单元807可用于接收输入的数字或字符信息,以及产生与电子设备的用户设置以及功能控制有关的键信号输入。具体地,用户输入单元807包括触控面板8071以及其他输入设备8072。触控面板8071,也称为触摸屏,可收集用户在其上或附近的触摸操作(比如用户使用手指、触笔等任何适合的物体或附件在触控面板8071上或在触控面板8071附近的操作)。触控面板8071可包括触摸检测装置和触摸控制器两个部分。其中,触摸检测装置检测用户的触摸方位,并检测触摸操作带来的信号,将信号传送给触摸控制器;触摸控制器从触摸检测装置上接收触摸信息,并将它转换成触点坐标,再送给处理器810,接收处理器810发来的命令并加以执行。此外,可以采用电 阻式、电容式、红外线以及表面声波等多种类型实现触控面板8071。除了触控面板8071,用户输入单元807还可以包括其他输入设备8072。具体地,其他输入设备8072可以包括但不限于物理键盘、功能键(比如音量控制按键、开关按键等)、轨迹球、鼠标、操作杆,在此不再赘述。The user input unit 807 can be used to receive input numbers or character information, and generate key signal input related to user settings and function control of the electronic device. Specifically, the user input unit 807 includes a touch panel 8071 and other input devices 8072 . The touch panel 8071, also referred to as a touch screen, can collect touch operations of the user on or near it (for example, the user uses any suitable object or accessory such as a finger or a stylus on the touch panel 8071 or near the touch panel 8071). operate). The touch panel 8071 may include two parts, a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch orientation, and detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into contact coordinates, and sends it to the For the processor 810, receive the command sent by the processor 810 and execute it. In addition, the touch panel 8071 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic wave. In addition to the touch panel 8071 , the user input unit 807 may also include other input devices 8072 . Specifically, other input devices 8072 may include, but are not limited to, physical keyboards, function keys (such as volume control keys, switch keys, etc.), trackballs, mice, and joysticks, which will not be repeated here.
进一步的,触控面板8071可覆盖在显示面板8061上,当触控面板8071检测到在其上或附近的触摸操作后,传送给处理器810以确定触摸事件的类型,随后处理器810根据触摸事件的类型在显示面板8061上提供相应的视觉输出。虽然在图8中,触控面板8071与显示面板8061是作为两个独立的部件来实现电子设备的输入和输出功能,但是在某些实施例中,可以将触控面板8071与显示面板8061集成而实现电子设备的输入和输出功能,具体此处不做限定。Furthermore, the touch panel 8071 can be covered on the display panel 8061, and when the touch panel 8071 detects a touch operation on or near it, it will be sent to the processor 810 to determine the type of the touch event, and then the processor 810 will The type of event provides a corresponding visual output on the display panel 8061. Although in FIG. 8, the touch panel 8071 and the display panel 8061 are used as two independent components to realize the input and output functions of the electronic device, in some embodiments, the touch panel 8071 and the display panel 8061 can be integrated. The implementation of the input and output functions of the electronic device is not specifically limited here.
接口单元808为外部装置与电子设备连接的接口。例如,外部装置可以包括有线或无线头戴式耳机端口、外部电源811(或电池充电器)端口、有线或无线数据端口、存储卡端口、用于连接具有识别模块的装置的端口、音频输入/输出(I/O)端口、视频I/O端口、耳机端口等等。接口单元808可以用于接收来自外部装置的输入(例如,数据信息、电力等等)并且将接收到的输入传输到电子设备内的一个或多个元件或者可以用于在电子设备和外部装置之间传输数据。The interface unit 808 is an interface for connecting external devices to electronic equipment. For example, an external device may include a wired or wireless headset port, an external power source 811 (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device with an identification module, an audio input/ Line-out (I/O) ports, video I/O ports, headphone ports, and more. The interface unit 808 may be used to receive input (eg, data information, power, etc.) from an external device and transmit the received input to one or more elements within the electronic device or may be used transfer data between.
存储器809可用于存储软件程序以及各种数据。存储器809可主要包括存储程序区和存储数据区,其中,存储程序区可存储操作系统、至少一个功能所需的应用程序(比如声音播放功能、图像播放功能等)等;存储数据区可存储根据手机的使用所创建的数据(比如音频数据、电话本等)等。此外,存储器809可以包括高速随机存取存储器,还可以包括非易失性存储器,例如至少一个磁盘存储器件、闪存器件、或其他易失性固态存储器件。The memory 809 can be used to store software programs as well as various data. The memory 809 can mainly include a program storage area and a data storage area, wherein the program storage area can store an operating system, at least one application program required by a function (such as a sound playback function, an image playback function, etc.); Data created by the use of mobile phones (such as audio data, phonebook, etc.), etc. In addition, the memory 809 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage devices.
处理器810是电子设备的控制中心,利用各种接口和线路连接整个电子设备的各个部分,通过运行或执行存储在存储器809内的软件程序和/或模块,以及调用存储在存储器809内的数据,执行电子设备的各种功能和处理数据, 从而对电子设备进行整体监控。处理器810可包括一个或多个处理单元;优选的,处理器810可集成应用处理器810和调制解调处理器810,其中,应用处理器810主要处理操作系统、用户界面和应用程序等,调制解调处理器810主要处理无线通信。可以理解的是,上述调制解调处理器810也可以不集成到处理器810中。The processor 810 is the control center of the electronic device, and uses various interfaces and lines to connect various parts of the entire electronic device, by running or executing software programs and/or modules stored in the memory 809, and calling data stored in the memory 809 , to perform various functions of the electronic equipment and process data, so as to monitor the electronic equipment as a whole. The processor 810 may include one or more processing units; preferably, the processor 810 may integrate an application processor 810 and a modem processor 810, wherein the application processor 810 mainly processes operating systems, user interfaces, and application programs, etc., Modem processor 810 primarily handles wireless communications. It can be understood that, the foregoing modem processor 810 may not be integrated into the processor 810 .
电子设备还可以包括给各个部件供电的电源811(比如电池),优选的,电源811可以通过电源811管理系统与处理器810逻辑相连,从而通过电源811管理系统实现管理充电、放电、以及功耗管理等功能。The electronic device can also include a power supply 811 (such as a battery) for supplying power to each component. Preferably, the power supply 811 can be logically connected to the processor 810 through the power management system 811, so as to manage charging, discharging, and power consumption through the power management system 811. Management and other functions.
另外,电子设备包括一些未示出的功能模块,在此不再赘述。In addition, the electronic device includes some functional modules not shown, which will not be repeated here.
优选的,本申请实施例还提供一种电子设备,包括处理器810,存储器809,存储在存储器809上并可在所述处理器810上运行的程序或指令,该程序或指令被处理器810执行时实现上述图像数据的处理方法实施例的各个过程,且能达到相同的技术效果,为避免重复,这里不再赘述。Preferably, the embodiment of the present application also provides an electronic device, including a processor 810, a memory 809, a program or instruction stored in the memory 809 and operable on the processor 810, and the program or instruction is executed by the processor 810 During execution, each process of the above embodiment of the image data processing method can be realized, and the same technical effect can be achieved. To avoid repetition, details are not repeated here.
本申请实施例还提供一种可读存储介质,所述可读存储介质上存储有程序或指令,该程序或指令被处理器810执行时实现上述图像数据的处理方法实施例的各个过程,且能达到相同的技术效果,为避免重复,这里不再赘述。The embodiment of the present application also provides a readable storage medium, the readable storage medium stores a program or an instruction, and when the program or instruction is executed by the processor 810, each process of the above image data processing method embodiment is implemented, and The same technical effect can be achieved, so in order to avoid repetition, details will not be repeated here.
其中,所述处理器810为上述实施例中所述的电子设备中的处理器810。所述可读存储介质,包括计算机可读存储介质,如计算机只读存储器(Read-Only Memory,ROM)、随机存取存储器(Random Access Memory,RAM)、磁碟或者光盘等。Wherein, the processor 810 is the processor 810 in the electronic device described in the foregoing embodiments. The readable storage medium includes computer readable storage medium, such as computer read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), magnetic disk or optical disk, etc.
本申请实施例还提供了一种芯片,所述芯片包括处理器和通信接口,所述通信接口和所述处理器耦合,所述处理器用于运行程序或指令,实现上述图像数据的处理方法实施例的各个过程,且能达到相同的技术效果,为避免重复,这里不再赘述。The embodiment of the present application also provides a chip, the chip includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the above image data processing method Each process of the example, and can achieve the same technical effect, in order to avoid repetition, will not repeat them here.
应理解,本申请实施例提到的芯片还可以称为系统级芯片、系统芯片、芯片系统或片上系统芯片等。It should be understood that the chips mentioned in the embodiments of the present application may also be called system-on-chip, system-on-chip, system-on-a-chip, or system-on-a-chip.
需要说明的是,在本文中,术语“包括”、“包含”或者其任何其他变体 意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、物品或者装置不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、物品或者装置所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括该要素的过程、方法、物品或者装置中还存在另外的相同要素。此外,需要指出的是,本申请实施方式中的方法和装置的范围不限按示出或讨论的顺序来执行功能,还可包括根据所涉及的功能按基本同时的方式或按相反的顺序来执行功能,例如,可以按不同于所描述的次序来执行所描述的方法,并且还可以添加、省去、或组合各种步骤。另外,参照某些示例所描述的特征可在其他示例中被组合。It should be noted that, in this document, the term "comprising", "comprising" or any other variation thereof is intended to cover a non-exclusive inclusion such that a process, method, article or apparatus comprising a set of elements includes not only those elements, It also includes other elements not expressly listed, or elements inherent in the process, method, article, or device. Without further limitations, an element defined by the phrase "comprising a ..." does not preclude the presence of additional identical elements in the process, method, article, or apparatus comprising that element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved. Functions are performed, for example, the described methods may be performed in an order different from that described, and various steps may also be added, omitted, or combined. Additionally, features described with reference to certain examples may be combined in other examples.
通过以上的实施方式的描述,本领域的技术人员可以清楚地了解到上述实施例方法可借助软件加必需的通用硬件平台的方式来实现,当然也可以通过硬件,但很多情况下前者是更佳的实施方式。基于这样的理解,本申请的技术方案本质上或者说对现有技术做出贡献的部分可以以计算机软件产品的形式体现出来,该计算机软件产品存储在一个存储介质(如ROM/RAM、磁碟、光盘)中,包括若干指令用以使得一台终端(可以是手机,计算机,服务器,或者网络设备等)执行本申请各个实施例所述的方法。Through the description of the above embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus a necessary general-purpose hardware platform, and of course also by hardware, but in many cases the former is better implementation. Based on such an understanding, the technical solution of the present application can be embodied in the form of computer software products, which are stored in a storage medium (such as ROM/RAM, magnetic disk, etc.) , optical disc), including several instructions to enable a terminal (which may be a mobile phone, computer, server, or network device, etc.) to execute the methods described in various embodiments of the present application.
上面结合附图对本申请的实施例进行了描述,但是本申请并不局限于上述的具体实施方式,上述的具体实施方式仅仅是示意性的,而不是限制性的,本领域的普通技术人员在本申请的启示下,在不脱离本申请宗旨和权利要求所保护的范围情况下,还可做出很多形式,均属于本申请的保护之内。The embodiments of the present application have been described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementations. The above-mentioned specific implementations are only illustrative and not restrictive. Those of ordinary skill in the art will Under the inspiration of this application, without departing from the purpose of this application and the scope of protection of the claims, many forms can also be made, all of which belong to the protection of this application.

Claims (19)

  1. 一种图像数据的处理方法,所述方法包括:A method for processing image data, the method comprising:
    获取利用摄像头采集到的第一图像,所述第一图像包括目标用户的脸部图像区域;Obtaining a first image collected by a camera, the first image including the face image area of the target user;
    在所述第一图像与界面的显示内容匹配度小于或等于目标值的情况下,对所述第一图像进行隐私处理,或者输出提示信息。In a case where the matching degree between the first image and the display content of the interface is less than or equal to a target value, privacy processing is performed on the first image, or prompt information is output.
  2. 根据权利要求1所述的方法,其中,在对所述第一图像进行隐私处理,或者输出提示信息之后,还包括:The method according to claim 1, wherein, after performing privacy processing on the first image or outputting prompt information, further comprising:
    将基于所述第一图像得到的第二图像传输至目标应用,所述目标应用基于所述第二图像进行相应的业务处理。The second image obtained based on the first image is transmitted to a target application, and the target application performs corresponding service processing based on the second image.
  3. 根据权利要求1所述的方法,其中,所述在所述第一图像与界面的显示内容匹配度小于或等于目标值的情况下,对所述第一图像进行隐私处理,或者输出提示信息之前,还包括:The method according to claim 1, wherein, when the matching degree between the first image and the display content of the interface is less than or equal to the target value, performing privacy processing on the first image, or before outputting prompt information ,Also includes:
    获取界面的显示内容;Obtain the display content of the interface;
    将所述第一图像与所述显示内容进行图像内容比对,确定所述第一图像与所述显示内容匹配度。Comparing the first image with the display content to determine the degree of matching between the first image and the display content.
  4. 根据权利要求2所述的方法,其中,所述第一图像还包括:除所述目标用户的脸部图像区域之外的其他图像区域;The method according to claim 2, wherein the first image further comprises: other image areas except the face image area of the target user;
    所述对所述第一图像进行隐私处理,包括:The performing privacy processing on the first image includes:
    对所述其他图像区域中的目标图像区域进行图像替换处理;performing image replacement processing on the target image area in the other image areas;
    所述将基于所述第一图像得到的第二图像传输至目标应用,包括:The transmitting the second image obtained based on the first image to the target application includes:
    基于图像替换后的其他图像区域和所述目标用户的脸部图像区域,生成所述目标用户的第二图像;generating a second image of the target user based on other image areas after image replacement and the face image area of the target user;
    将所述第二图像传输至目标应用。The second image is transmitted to a target application.
  5. 根据权利要求4所述的方法,其中,所述对所述其他图像区域中的目标图像区域进行图像替换处理,包括:The method according to claim 4, wherein the performing image replacement processing on the target image area in the other image areas comprises:
    确定所述其他图像区域中的目标图像区域,所述目标图像区域包括:所述其他图像区域、或者所述其他图像区域中界面上未显示的图像区域;Determining a target image area in the other image area, where the target image area includes: the other image area, or an image area not displayed on the interface in the other image area;
    基于预设图像,对所述目标图像区域进行图像替换处理。Based on the preset image, an image replacement process is performed on the target image area.
  6. 根据权利要求1所述的方法,其中,所述输出提示信息,包括:The method according to claim 1, wherein said outputting prompt information comprises:
    以悬浮窗的形式,显示所述第一图像,以提示所述目标用户基于所述第一图像调整位姿。The first image is displayed in the form of a floating window to prompt the target user to adjust the pose based on the first image.
  7. 根据权利要求6所述的方法,其中,所述输出提示信息之后,还包括:The method according to claim 6, wherein, after outputting the prompt information, further comprising:
    在接收到所述目标用户位姿调整结束的确认输入的情况下,获取利用所述摄像头采集到的第三图像;In the case of receiving a confirmation input that the target user's pose adjustment is completed, acquiring a third image captured by the camera;
    将所述第三图像传输至目标应用。The third image is transmitted to a target application.
  8. 一种电子设备,所述电子设备包括:An electronic device comprising:
    第一图像获取模块,用于获取利用摄像头采集到的第一图像,所述第一图像包括目标用户的脸部图像区域;The first image acquisition module is used to acquire the first image collected by the camera, and the first image includes the face image area of the target user;
    第一图像处理模块,用于在所述第一图像与界面的显示内容匹配度小于或等于目标值的情况下,对所述第一图像进行隐私处理,或者输出提示信息。The first image processing module is configured to perform privacy processing on the first image or output prompt information when the matching degree between the first image and the display content of the interface is less than or equal to a target value.
  9. 根据权利要求8所述的电子设备,其中,所述电子设备,还包括:The electronic device according to claim 8, wherein the electronic device further comprises:
    第二图像传输模块,用于将基于所述第一图像得到的第二图像传输至目标应用,所述目标应用基于所述第二图像进行相应的业务处理。The second image transmission module is configured to transmit the second image obtained based on the first image to a target application, and the target application performs corresponding service processing based on the second image.
  10. 根据权利要求8所述的电子设备,其中,所述电子设备,还包括:The electronic device according to claim 8, wherein the electronic device further comprises:
    界面内容获取模块,用于获取界面的显示内容;The interface content acquisition module is used to acquire the display content of the interface;
    图像比对模块,用于将所述第一图像与所述显示内容进行图像内容比对,确定所述第一图像与所述显示内容匹配度。An image comparison module, configured to perform image content comparison between the first image and the display content, and determine the degree of matching between the first image and the display content.
  11. 根据权利要求9所述的电子设备,其中,所述第一图像还包括:除所述目标用户的脸部图像区域之外的其他图像区域;The electronic device according to claim 9, wherein the first image further comprises: other image areas except the face image area of the target user;
    所述第一图像处理模块,具体用于:The first image processing module is specifically used for:
    对所述其他图像区域中的目标图像区域进行图像替换处理;performing image replacement processing on the target image area in the other image areas;
    所述第二图像传输模块,具体用于:The second image transmission module is specifically used for:
    基于图像替换后的其他图像区域和所述目标用户的脸部图像区域,生成所述目标用户的第二图像;generating a second image of the target user based on other image areas after image replacement and the face image area of the target user;
    将所述第二图像传输至目标应用。The second image is transmitted to a target application.
  12. 根据权利要求11所述的电子设备,其中,所述第一图像处理模块,还具体用于:The electronic device according to claim 11, wherein the first image processing module is further specifically configured to:
    确定所述其他图像区域中的目标图像区域,所述目标图像区域包括:所述其他图像区域、或者所述其他图像区域中界面上未显示的图像区域;Determining a target image area in the other image area, where the target image area includes: the other image area, or an image area not displayed on the interface in the other image area;
    基于预设图像,对所述目标图像区域进行图像替换处理。Based on the preset image, an image replacement process is performed on the target image area.
  13. 根据权利要求8所述的电子设备,其中,所述第一图像处理模块,还具体用于:The electronic device according to claim 8, wherein the first image processing module is further specifically configured to:
    以悬浮窗的形式,显示所述第一图像,以提示所述目标用户基于所述第一图像调整位姿。The first image is displayed in the form of a floating window to prompt the target user to adjust the pose based on the first image.
  14. 根据权利要求13所述的电子设备,其中,所述电子设备,还包括:The electronic device according to claim 13, wherein the electronic device further comprises:
    第三图像获取模块,用于在接收到所述目标用户位姿调整结束的确认输入的情况下,获取利用所述摄像头采集到的第三图像;The third image acquisition module is configured to acquire the third image captured by the camera when receiving the confirmation input that the target user pose adjustment is completed;
    第三图像传输模块,用于将所述第三图像传输至目标应用。A third image transmission module, configured to transmit the third image to a target application.
  15. 一种电子设备,包括:处理器、存储器及存储在所述存储器上并可在所述处理器上运行的程序或指令,所述程序或指令被所述处理器执行时实现如权利要求1至7中任一项所述的图像数据的处理方法的步骤。An electronic device, comprising: a processor, a memory, and a program or instruction stored on the memory and operable on the processor, and when the program or instruction is executed by the processor, the following claims 1 to 1 are implemented. Steps in the image data processing method described in any one of 7.
  16. 一种可读存储介质,所述可读存储介质上存储程序或指令,所述程序或指令被处理器执行时实现如权利要求1至7中任一项所述的图像数据的处理方法的步骤。A readable storage medium, on which a program or instruction is stored, and when the program or instruction is executed by a processor, the steps of the image data processing method according to any one of claims 1 to 7 are realized .
  17. 一种芯片,所述芯片包括处理器和通信接口,所述通信接口和所述处理器耦合,所述处理器用于运行程序或指令,实现如权利要求1至7中任一项所述的图像数据的处理方法的步骤。A chip, the chip includes a processor and a communication interface, the communication interface is coupled to the processor, the processor is used to run programs or instructions, and realize the image as described in any one of claims 1 to 7 The steps of the data processing method.
  18. 一种电子设备,所述电子设备用于执行如权利要求1至7中任一项所述的图像数据的处理方法的步骤。An electronic device configured to execute the steps of the method for processing image data according to any one of claims 1 to 7.
  19. 一种计算机软件产品,所述计算机软件产品被至少一个处理器执行以实现如权利要求1至7中任一项所述的图像数据的处理方法的步骤。A computer software product, the computer software product is executed by at least one processor to implement the steps of the image data processing method according to any one of claims 1 to 7.
PCT/CN2022/127267 2021-10-28 2022-10-25 Image data processing method and electronic device WO2023072038A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202111265900.5A CN113987602A (en) 2021-10-28 2021-10-28 Image data processing method and electronic equipment
CN202111265900.5 2021-10-28

Publications (1)

Publication Number Publication Date
WO2023072038A1 true WO2023072038A1 (en) 2023-05-04

Family

ID=79743783

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/127267 WO2023072038A1 (en) 2021-10-28 2022-10-25 Image data processing method and electronic device

Country Status (2)

Country Link
CN (1) CN113987602A (en)
WO (1) WO2023072038A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113987602A (en) * 2021-10-28 2022-01-28 维沃移动通信有限公司 Image data processing method and electronic equipment

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070229669A1 (en) * 2004-03-31 2007-10-04 Kyocera Corporation Portable Terminal
CN103415839A (en) * 2012-09-19 2013-11-27 华为终端有限公司 Photo processing method and terminal apparatus
CN104125396A (en) * 2014-06-24 2014-10-29 小米科技有限责任公司 Image shooting method and device
CN109743503A (en) * 2019-01-17 2019-05-10 维沃移动通信有限公司 Reminding method and terminal
CN110719402A (en) * 2019-09-24 2020-01-21 维沃移动通信(杭州)有限公司 Image processing method and terminal equipment
CN112770049A (en) * 2020-12-30 2021-05-07 维沃移动通信有限公司 Shooting method, shooting device and storage medium
CN113987602A (en) * 2021-10-28 2022-01-28 维沃移动通信有限公司 Image data processing method and electronic equipment

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070229669A1 (en) * 2004-03-31 2007-10-04 Kyocera Corporation Portable Terminal
CN103415839A (en) * 2012-09-19 2013-11-27 华为终端有限公司 Photo processing method and terminal apparatus
CN104125396A (en) * 2014-06-24 2014-10-29 小米科技有限责任公司 Image shooting method and device
CN109743503A (en) * 2019-01-17 2019-05-10 维沃移动通信有限公司 Reminding method and terminal
CN110719402A (en) * 2019-09-24 2020-01-21 维沃移动通信(杭州)有限公司 Image processing method and terminal equipment
CN112770049A (en) * 2020-12-30 2021-05-07 维沃移动通信有限公司 Shooting method, shooting device and storage medium
CN113987602A (en) * 2021-10-28 2022-01-28 维沃移动通信有限公司 Image data processing method and electronic equipment

Also Published As

Publication number Publication date
CN113987602A (en) 2022-01-28

Similar Documents

Publication Publication Date Title
WO2021098678A1 (en) Screencast control method and electronic device
US20220279116A1 (en) Object tracking method and electronic device
WO2021057267A1 (en) Image processing method and terminal device
CN110062105B (en) Interface display method and terminal equipment
CN109743498B (en) Shooting parameter adjusting method and terminal equipment
CN109240577B (en) Screen capturing method and terminal
CN110109593B (en) Screen capturing method and terminal equipment
CN108307106B (en) Image processing method and device and mobile terminal
US20220329741A1 (en) Camera start method and electronic device
JP7467667B2 (en) Detection result output method, electronic device and medium
WO2021136138A1 (en) Information prompting method and electronic device
US20220286622A1 (en) Object display method and electronic device
WO2021082772A1 (en) Screenshot method and electronic device
CN111124706A (en) Application program sharing method and electronic equipment
CN111124569B (en) Application sharing method, electronic device and computer readable storage medium
CN111124231B (en) Picture generation method and electronic equipment
WO2023072038A1 (en) Image data processing method and electronic device
CN108833791B (en) Shooting method and device
CN108093119B (en) Strange incoming call number marking method and mobile terminal
WO2021017785A1 (en) Data transmission method and terminal device
WO2021057243A1 (en) Note information display method, note information sending method and electronic device
CN111093033B (en) Information processing method and device
WO2021036504A1 (en) Picture deletion method and terminal device
WO2020238477A1 (en) Editing method and mobile terminal
CN110099170B (en) Picture deleting method and mobile terminal

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22885915

Country of ref document: EP

Kind code of ref document: A1