WO2023279777A1

WO2023279777A1 - Method and apparatus for providing eye protection mode, storage medium, and mobile device

Info

Publication number: WO2023279777A1
Application number: PCT/CN2022/082595
Authority: WO
Inventors: 刘俊启
Original assignee: 北京百度网讯科技有限公司
Priority date: 2021-07-07
Filing date: 2022-03-23
Publication date: 2023-01-12
Also published as: CN113486802A

Abstract

The present disclosure relates to the technical field of image processing, in particular to an application of an image processing technology in mobile devices, and provides a method and apparatus for providing an eye protection mode, a storage medium, and a mobile device. An implementation solution is a method for providing an eye protection mode on a mobile device, comprising: acquiring, at a reference distance between a user and the mobile device, a face image of the user as a reference image, the reference image corresponding to a first face area; during use of the mobile device by the user, acquiring a face image of the user as an image to be compared, the image to be compared corresponding to a second face area; and in response to determining that the second face area exceeds the first face area by a predetermined threshold, issuing prompt information to enter an eye protection mode.

Description

Method, device, storage medium and mobile device for providing eye protection mode

Cross References to Related Applications

This application claims the priority of Chinese patent application 202110767545.5 filed on July 7, 2021, the entire contents of which are incorporated in this application by reference.

technical field

The present disclosure relates to the field of image processing technology, in particular to the application of image processing technology in mobile devices, and in particular to a method, device, computer readable storage medium, computer program product and a mobile device for providing an eye protection mode. equipment.

Background technique

In recent years, with the development of mobile communication technology, the penetration rate of mobile devices such as mobile phones or tablet computers is getting higher and higher. Especially with the gradual rise of Internet online education, the frequency of children or teenagers using mobile devices is also increasing. Compared with adults, the eye health problems caused by long-term use of mobile devices by this group of people are more prominent and obvious.

The approaches described in this section are not necessarily approaches that have been previously conceived or employed. Unless otherwise indicated, it should not be assumed that any approaches described in this section are admitted to be prior art solely by virtue of their inclusion in this section. Similarly, issues mentioned in this section should not be considered to have been recognized in any prior art unless otherwise indicated.

Contents of the invention

The present disclosure provides a method, a device, a computer-readable storage medium, a computer program product and a mobile device for providing an eye protection mode for a mobile device.

According to an aspect of the present disclosure, there is provided a method for providing an eye protection mode for a mobile device, including: acquiring a user's facial image at a reference distance between the user and the mobile device as a reference image, the reference image corresponding to The first facial area; during the user's use of the mobile device, acquiring the user's facial image as an image to be compared, the image to be compared corresponds to the second facial area; and in response to determining that the second facial area exceeds the first facial area by an amount of Predetermined threshold, send out a prompt message to enter the eye protection mode.

According to another aspect of the present disclosure, there is provided an apparatus for providing an eye protection mode for a mobile device, including: a first image acquisition module configured to acquire a facial image of a user at a reference distance between the user and the mobile device As a reference image, the reference image corresponds to the first facial area; the second image acquisition module is configured to acquire the user's facial image as an image to be compared during the user's use of the mobile device, and the image to be compared corresponds to the first facial area two facial areas; and a comparison module configured to send a prompt message to enter the eye protection mode in response to determining that the second facial area exceeds the first facial area by a predetermined threshold.

According to another aspect of the present disclosure, there is provided a non-transitory computer-readable storage medium storing computer instructions, wherein the computer instructions are used to cause a computer to execute the above method.

According to another aspect of the present disclosure, there is provided a computer program product comprising a computer program, wherein the computer program implements the method as described above when executed by a processor.

According to another aspect of the present disclosure, a mobile device is provided, including: at least one processor; and a memory communicatively connected to the at least one processor, wherein the memory stores information that can be read by the at least one processor Executable instructions that, when executed by the at least one processor, cause the at least one processor to perform the method as described above.

According to one or more embodiments of the present disclosure, the judgment of the distance between the user and the mobile device can be realized in a simple manner by comparing the difference between the size of the face image acquired in real time and the size of the reference image.

It should be understood that what is described in this section is not intended to identify key or important features of the embodiments of the present disclosure, nor is it intended to limit the scope of the present disclosure. Other features of the present disclosure will be readily understood through the following description.

Description of drawings

The drawings exemplarily illustrate the embodiment and constitute a part of the specification, and together with the text description of the specification, serve to explain the exemplary implementation of the embodiment. The illustrated embodiments are for illustrative purposes only and do not limit the scope of the claims. Throughout the drawings, like reference numbers designate similar, but not necessarily identical, elements.

Fig. 1 shows a flowchart of a method for providing an eye protection mode for a mobile device according to an embodiment of the present disclosure.

Fig. 2 shows a flowchart of a method for acquiring a reference image or an image to be compared according to an embodiment of the present disclosure.

Fig. 3 shows a schematic diagram of generating a bounding box for a facial contour according to an embodiment of the present disclosure.

Fig. 4 shows a block diagram of an apparatus for providing an eye protection mode for a mobile device according to an embodiment of the present disclosure.

Fig. 5 shows a block diagram of an apparatus for providing an eye protection mode for a mobile device according to another embodiment of the present disclosure.

Fig. 6 shows a structural block diagram of a mobile device according to an embodiment of the present disclosure.

detailed description

Exemplary embodiments of the present disclosure are described below in conjunction with the accompanying drawings, which include various details of the embodiments of the present disclosure to facilitate understanding, and they should be regarded as exemplary only. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope of the present disclosure. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.

In the present disclosure, unless otherwise stated, using the terms "first", "second", etc. to describe various elements is not intended to limit the positional relationship, temporal relationship or importance relationship of these elements, and such terms are only used for Distinguishes one element from another. In some examples, the first element and the second element may refer to the same instance of the element, and in some cases, they may also refer to different instances based on contextual description.

The terminology used in describing the various described examples in this disclosure is for the purpose of describing particular examples only and is not intended to be limiting. Unless the context clearly indicates otherwise, if the number of elements is not specifically limited, there may be one or more elements. In addition, the term "and/or" used in the present disclosure covers any one and all possible combinations of the listed items.

In related technologies, mobile devices such as mobile phones or tablet computers lack targeted optimization for certain groups of people (such as children and teenagers). For example, when such people watch videos played on mobile phones for a long time and are too close to the mobile phone, it is easy to cause health problems such as myopia. Therefore, it is necessary to remind when the distance between the user and the mobile device is too short. Traditional solutions often rely on setting up hardware devices dedicated to distance measurement (such as infrared distance measuring equipment) on mobile devices or using complex distance calculation algorithms to determine the distance by directly calculating the distance value between the user and the mobile device near and far. However, for mobile devices, such a solution may be complicated and impractical, especially when many factors such as portability, miniaturization, economy, and computing performance need to be considered.

In view of the above technical problem, according to one aspect of the present disclosure, a method for providing an eye protection mode for a mobile device is provided. Embodiments of the disclosed method will be described in detail below with reference to the accompanying drawings.

Fig. 1 shows a flow chart of a method 100 for providing an eye protection mode for a mobile device according to an embodiment of the present disclosure. As shown in FIG. 1, the flow chart of a method 100 according to an embodiment of the present disclosure may include the following steps:

S102, acquiring a facial image of the user at a reference distance between the user and the mobile device as a reference image, the reference image corresponding to the first facial area;

S104. During the user's use of the mobile device, acquire the user's facial image as an image to be compared, and the image to be compared corresponds to the second facial area; and

S106. In response to determining that the area of the second face exceeds the area of the first face by a predetermined threshold, send a prompt message to enter the eye protection mode.

According to the method for providing an eye protection mode for a mobile device according to an embodiment of the present disclosure, by using the principle that when taking an image, the size of the facial image that can represent the appropriate distance between the user and the mobile device is first acquired, and then by It is compared with the size of the facial image acquired in real time during use to determine whether the distance between the user and the mobile device is too close. Thus, avoiding the use of hardware devices dedicated to distance measurement or the use of complex distance calculation algorithms for distance measurement, the distance can be realized by comparing the size of the face image acquired in real time with the reference image in a simple way. Judgment from near and far. The method is simple to implement, and is especially convenient to be applied to mobile devices.

The above steps will be described in detail below with reference to FIG. 1 to FIG. 3 .

Referring next to FIG. 1 , in step S102 , the reference distance may refer to an appropriate distance between the user and the mobile device in terms of eye health.

Herein, the mobile device may include a portable smart mobile device with a camera, such as a mobile phone, a tablet computer, and a notebook computer. Those skilled in the art can understand that the present disclosure does not limit the specific type of the mobile device, as long as the method provided by the present disclosure can be implemented on it, it is within the scope of the present disclosure.

The reference distance may be determined based on various factors. Taking watching videos on mobile phones as an example, it is generally believed that the distance between an ordinary adult and a mobile device is greater than 30cm for eye health. In the case that the user is a child or a teenager, the above-mentioned appropriate distance may be appropriately increased. In addition, for different types of mobile devices, the above-mentioned appropriate distance may also vary. For example, for a tablet computer, the above-mentioned distance will be correspondingly farther, because the display screen of the tablet computer will be larger. In addition, the above-mentioned appropriate distance can also be determined in combination with the user's own experience. For example, users with normal vision or nearsightedness may have different clear vision distances. Therefore, the reference distance can be determined by different users considering their own vision. The appropriate distance determined under the circumstances.

As mentioned above, the present disclosure utilizes the principle that when taking an image, the near image is larger and the far image is smaller. Therefore, the face image that can represent the above-mentioned appropriate distance between the user and the mobile device is first obtained, and set as a subsequent comparison The standard, that is, the reference image. Here, there may be a problem that since the facial image is the original image captured, it may contain a lot of image information that is not conducive to or irrelevant to the implementation of the method of the present disclosure, which may cause interference in subsequent calculations. For example, when shooting indoors, in addition to the user's face, indoor furniture, electrical appliances and other objects may also be photographed in it, and the image information corresponding to these objects is irrelevant to subsequent calculations. For this reason, targeted image processing needs to be performed on the captured original facial image to obtain the reference image required for implementing the method of the present disclosure. In other words, the reference image may be an original facial image subjected to specific image processing. This is described in detail below in conjunction with FIG. 2 .

Fig. 2 shows a flowchart of a method 200 for acquiring a reference image according to an embodiment of the present disclosure. As shown in FIG. 2 , the flowchart of a method 200 according to an embodiment of the present disclosure may include the following processes.

In step S202, the front-facing camera installed on the mobile device may be called to capture the facial image of the user at a reference distance.

In one example, the method according to the embodiment of the present disclosure may be applied to an application installed in an operating system of a mobile device (or an applet embedded in some application). Taking the application program as a video playing application program as an example, it can provide the user with an entry (or function module, item, option, etc.) for shooting a reference image, so that the user can start shooting the reference image through the entry. Afterwards, the application program can call the front-facing camera installed on the mobile device, such as the front-facing camera of the mobile phone, to capture the facial image of the user at the reference distance. As mentioned above, the reference distance may be determined according to various factors, which will not be repeated here.

After capturing the facial image of the user, in step S204, the facial contour in the facial image may be detected.

As mentioned above, since the present disclosure needs to compare the sizes of the facial images, accordingly, it is necessary to determine the range of the facial images by detecting the facial contours in the facial images to obtain their sizes. Here, those skilled in the art know that detecting facial contours is a known technology in face recognition technology, and in order to avoid obscuring the gist of the present disclosure, details thereof will not be repeated here.

According to some embodiments, the step S204 of detecting facial contours in the facial image may further include a step of judging the quality of the facial image. Considering that sometimes the acquired facial image is inclined to the side instead of facing the user's face due to the shooting angle, an additional step for judging the quality of the facial image can be set to ensure the accuracy of subsequent calculations. Specifically, step S204 may include sub-steps S2040 and S2042. In sub-step S2040, it may be determined whether the face image is taken for the user's front face. If it is determined that the facial image is not taken from the front of the user (as indicated by "N"), it means that the quality of the acquired facial image is not good, which may affect the accuracy of calculating the facial area, thereby affecting the subsequent comparison process, so the process can be Return to step S202, and take another facial image. Or alternatively, the face image can also be corrected by common image processing techniques (such as deformation, stretching, etc.) to obtain a relatively frontal image with high quality. If it is determined that the facial image is taken for the user's front face (as shown by "Y"), the facial contour is extracted in step S2042, and the process proceeds to step S206. Here, the technology of determining whether the face is frontal and the technology of extracting the facial contour also belong to the commonly used face recognition technology known to those skilled in the art, and will not be repeated here. Through the above method, the user's front face image can be obtained, thereby ensuring the accuracy of the calculation of the facial area and the accuracy of the subsequent comparison process.

After detecting the facial contour in the facial image through step S204, in step S206, a bounding box containing the facial contour may be generated, and the bounding box may correspond to the boundary of the reference image. This is described in detail below in conjunction with FIG. 3 .

FIG. 3 shows a schematic diagram of generating a bounding box 304 for a facial contour 302 according to an embodiment of the disclosure. The facial contour 302 shown in FIG. 3 may be the facial contour detected after step S204 is performed. Based on the facial contour 302, a bounding box 304 containing the facial contour 302 therein may be generated. The bounding box 304 may correspond to the border of the reference image 300. In this way, a reference image suitable for subsequent comparison is intentionally created based on the facial image, in which irrelevant image information contained in the original facial image is eliminated. As mentioned above, the reference image can be understood as the original facial image subjected to specific image processing.

According to some embodiments, bounding box 304 may be a rectangle that encloses facial contour 302 in a tangent manner to facial contour 302 . Meanwhile, the bounding box 304 defines the face area of the reference image 300 . In an example, the facial area can be calculated by projecting the reference image 300 in a coordinate system, and obtaining the corresponding coordinates of its four corners A, B, C, D to calculate the area of the rectangle. Constructing a bounding box tangent to the face contour as a rectangle simplifies the creation of the reference image, as well as the calculation of the area and subsequent comparison.

Returning again to the flow chart of the method 100 shown in FIG. 1, after the step S102 of acquiring the reference image, in step S104, the user's facial image may be acquired in real time during the user's use of the mobile device and used as the image to be compared. In one example, using the mobile device may include watching a video played on the mobile device, etc., which require the user to watch continuously.

According to some embodiments, the step S104 of acquiring the user's facial image as the image to be compared may be performed in a manner similar to the step S102 of acquiring the user's facial image as the reference image. That is, step S104 may also include the following sub-steps: i) calling the front-facing camera installed on the mobile device to take a facial image of the user; ii) detecting the facial contour in the facial image; and iii) in response to detecting the facial contour, A bounding box is generated enclosing the contour of the face, the bounding box corresponding to the boundaries of the images to be compared. Sub-step i) in step S104 may be automatically executed by an application such as the aforementioned one after step S102.

Since the details of the above sub-steps have been described in detail above with reference to FIG. 2 and FIG. 3 , details are not repeated here. Similarly, the facial contour 302 shown in FIG. 3 at this time may represent the detected facial contour after performing the above sub-step ii). Based on the facial contour 302, a bounding box 304 containing the facial contour 302 therein may be generated. At this time, reference numeral 300 may represent an image to be compared, the boundary of which is defined by a bounding box 304 . Similarly, a to-be-compared image suitable for subsequent comparison is intentionally created based on the facial image, and irrelevant image information contained in the original facial image is removed from the to-be-compared image. Similarly, the image to be compared can also be understood as subjecting the original facial image (in terms of the facial image acquired in real time during the user's use of the mobile device) to specific image processing.

According to some embodiments, the aforementioned bounding box may also be a rectangle, and the rectangle includes the facial contour in a manner of being tangent to the facial contour. Meanwhile, the bounding box defines the face area of the images to be compared. Constructing a bounding box tangent to the facial contour with a rectangle can simplify the creation of the images to be compared, as well as the calculation of the area and the subsequent comparison.

According to some embodiments, step S102 may further include: acquiring a user's facial image at a preset time point as an image to be compared, wherein the preset time point includes a plurality of sub-time points with gradually decreasing time intervals. For example, from the start time when the user starts to use the mobile phone to watch the video, monitoring can be performed every 15 minutes and executed twice, that is, the time interval between the first sub-time point and the start time point, the time interval between the first sub-time point and the second sub-time point. The time interval between time points is 15 minutes. Thereafter, the frequency of monitoring can be doubled, for example at approximately 8 minute intervals and performed twice, i.e. the time intervals between the second sub-time point and the third sub-time point, and the time interval between the third sub-time point and the fourth sub-time point Both are 8 minutes. As the time for the user to use the mobile device becomes longer, it may be more difficult for the user to maintain an appropriate distance from the mobile device due to reasons such as fatigue. For this reason, by monitoring the distance between the user and the mobile device more frequently as the usage time increases, more timely and accurate reminders can be achieved, thereby reducing unhealthy eye use time.

After the image to be compared is acquired in step S104, in step S106, the second facial area obtained in step S104 may be compared with the first facial area obtained in step S102. Since the first facial area can represent the appropriate distance between the user and the mobile device in terms of eye health, using the principle that when taking images, the size of the near side is larger than that of the far side, when the area of the second face is larger than the area of the first face, it means The distance between the user and the mobile device is shorter than the suitable distance, that is, the user is closer to the mobile device. And when the area of the second face is larger than the area of the first face to a certain extent, it may be considered that the distance between the user and the mobile device is too short.

In one example, since step S104 involves the entire time period during which the user uses the mobile device, whenever the second facial area is obtained according to a certain preset time point for monitoring, it is compared with the first facial area. area for comparison. The predetermined threshold exceeded may have a default setting or be set by the user. For example, the predetermined threshold may represent a ratio of the area of the second face exceeding the area of the first face, such as 5%. The smaller the value, the stricter the monitoring of the distance, and the more times the user may be prompted.

According to some embodiments, in step S104, there may be various ways of issuing a prompt message to enter the eye protection mode. For example, a pop-up box with a reminder sentence may pop up on the screen of the mobile device, such as the reminder sentence "You are too close to the mobile phone, please pay attention to the health of your eyes". If the user is watching a video, you can pause video playback on the mobile device, or black out the mobile device's screen. In this way, it is possible to intervene in the user's use of the mobile device if the user becomes too close to the mobile device.

According to some embodiments of the disclosed method, it may further include calling a motion detection device installed on the mobile device to detect whether the mobile device is in a motion state during the user's use of the mobile device. If it is determined that the mobile device is in a motion state, a prompt message may also be issued to enter the eye protection mode.

For example, the motion detection device may be a gyroscope. Whether a certain motion state of the mobile device is accumulated over a certain period of time can be detected by the gyroscope. If the exercise state is accumulated, it means that it is not conducive for the user to use the mobile device at this time, such as watching videos. Such a situation may occur, for example, when a user takes a bus or a subway or other means of transportation. At this point, there can be various ways to send out the prompt message to enter the eye protection mode, which will not be repeated here. In this way, the judgment of eye health is additionally provided, and when the mobile device is in a motion state that is not suitable for viewing, the user is reminded.

As mentioned above, according to the method of the embodiment of the present disclosure, the size of the facial image that can represent the appropriate distance between the user and the mobile device is first obtained by using the principle that when the image is taken, the size of the facial image can represent the appropriate distance between the user and the mobile device, and then by combining it with the use process Compare the size of the face image acquired in real time in the mobile device to determine whether the distance between the user and the mobile device is too close. Thus, avoiding the use of hardware devices dedicated to distance measurement or the use of complex distance calculation algorithms for distance measurement, the distance can be realized by comparing the size of the face image acquired in real time with the reference image in a simple way. Judgment from near and far. The method is simple to implement, and is especially convenient to be applied to mobile devices.

Fig. 4 shows a block diagram of an apparatus 400 for providing an eye protection mode for a mobile device according to an embodiment of the present disclosure. As shown in FIG. 4 , an apparatus 400 according to an embodiment of the present disclosure may include: a first image acquisition module 402 configured to acquire a user's facial image at a reference distance between the user and the mobile device as a reference image, the reference The image corresponds to the first facial area; the second image acquisition module 404 is configured to acquire the user's facial image as an image to be compared during the user's use of the mobile device, and the image to be compared corresponds to the second facial area; and compare Module 406, configured to issue a prompt message to enter the eye protection mode in response to determining that the area of the second face exceeds the area of the first face by a predetermined threshold.

The operations performed by the

above modules

402 , 404 and 406 correspond to the steps S102 , S104 and S106 described with reference to FIG. 1 , so details thereof will not be repeated here.

Fig. 5 shows a block diagram of an apparatus 500 for providing an eye protection mode for a mobile device according to another embodiment of the present disclosure. The modules 502 , 504 and 506 shown in FIG. 5 may respectively correspond to the first image acquisition module 402 , the second image acquisition module 404 and the comparison module 406 shown in FIG. 4 . In addition, the above-mentioned modules 502, 504 and 506 may also include the following further sub-function modules.

In some embodiments, the first image acquisition module 502 may include: an image capture module 5020 configured to invoke a front-facing camera installed on the mobile device to capture a facial image of the user at a reference distance; a contour detection module 5022 , configured to detect a facial contour in the facial image; and a boundary generation module 5024 configured, in response to detecting the facial contour, to generate a bounding box containing the facial contour therein, the bounding box corresponding to a boundary of the reference image.

In some embodiments, the bounding box may be a rectangle enclosing the contour of the face in a tangential manner to the contour of the face, and the area of the face is defined by the bounding box.

In some embodiments, the contour detection module 5022 may include: a judging module 5022-1 configured to determine whether the facial image is taken for the front of the user; and a feedback module 5022-2 configured to respond to the determined facial image The face image is corrected or the face image is re-taken if it is not taken for the user's front face.

In some embodiments, the second image acquisition module 504 may share its sub-function modules with the first image acquisition module 502 . That is, the second image acquisition module 504 may also include the above-mentioned image capture module 5020 , contour detection module 5022 and boundary generation module 5024 . The difference is that the processing objects involved in the second image acquisition module 504 are different, because the second image acquisition module 504 corresponds to the image to be compared. In FIG. 5 , for ease of illustration, the first and second image acquisition modules 502 and 504 are labeled together.

In some embodiments, the second image acquisition module 504 may also be configured to: acquire the facial image of the user at a preset time point as the image to be compared, wherein the preset time point includes gradually decreasing time intervals between each other multiple sub-time points.

In some embodiments, the apparatus 500 according to the embodiment of the present disclosure may further include a motion detection module 508, which includes: a calling module 5080 configured to call a motion detection device installed on the mobile device to detect movement during the user's use of the mobile device Whether the device is in motion; and a determination module 5082 configured to, in response to determining that the mobile device is in motion, send a prompt message to enter the eye protection mode.

In some embodiments, each of the determination module 5082 in the comparison module 506 and the motion detection module 508 may include a prompt module configured to perform one of the following: pop up a reminder statement on the screen of the mobile device pop-up box, pause video playback on the mobile device, or blacken the screen of the mobile device.

Operations performed by each module described in conjunction with FIG. 5 may correspond to each method step described with reference to FIG. 2 and FIG. 3 , and therefore details thereof will not be repeated.

According to another aspect of the present disclosure, there is also provided a non-transitory computer-readable storage medium storing computer instructions, wherein the computer instructions are used to cause the computer to execute the above method.

According to another aspect of the present disclosure, there is also provided a computer program product, including a computer program, wherein the computer program implements the above method when executed by a processor.

According to another aspect of the present disclosure, there is also provided a mobile device, including at least one processor; and a memory communicatively connected to the at least one processor, wherein the memory stores information that can be used by the at least one processor Executable instructions that, when executed by the at least one processor, cause the at least one processor to perform the method as described above.

FIG. 6 shows a structural block diagram of a mobile device 600 according to an embodiment of the present disclosure. Mobile device 600 may represent various forms of mobile devices, such as personal digital processing, cellular telephones, smartphones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are by way of example only, and are not intended to limit implementations of the disclosure described and/or claimed herein.

As shown in FIG. 6 , the mobile device 600 includes a computing unit 601, which can perform calculations according to a computer program stored in a read-only memory (ROM) 602 or a computer program loaded from a storage unit 608 into a random access memory (RAM) 603. Various appropriate actions and processes are performed. In the RAM 603, various programs and data required for the operation of the mobile device 600 can also be stored. The computing unit 601, ROM 602, and RAM 603 are connected to each other through a bus 604. An input/output (I/O) interface 605 is also connected to the bus 604 .

Multiple components in the mobile device 600 are connected to the I/O interface 605 , including: an input unit 606 , an output unit 607 , a storage unit 608 and a communication unit 609 . The input unit 606 can be any type of equipment capable of inputting information to the mobile device 600, the input unit 606 can receive input digital or character information, and generate key signal input related to user settings and/or function control of the mobile device, and Can include touch screen, joystick, microphone and/or remote control. The output unit 607 may be any type of device capable of presenting information, and may include, but is not limited to, a display, a speaker, a video/audio output terminal, and/or a vibrator. The communication unit 609 allows the mobile device 600 to exchange information/data with other devices through a computer network such as the Internet and/or various telecommunication networks, and may include, but is not limited to, infrared communication devices, wireless communication transceivers and/or chipsets, such as Bluetooth ^TM devices, 802.11 devices, WiFi devices, WiMax devices, cellular communication devices, and/or the like.

The computing unit 601 may be various general-purpose and/or special-purpose processing components having processing and computing capabilities. Some examples of computing units 601 include, but are not limited to, central processing units (CPUs), graphics processing units (GPUs), various dedicated artificial intelligence (AI) computing chips, various computing units that run machine learning model algorithms, digital signal processing processor (DSP), and any suitable processor, controller, microcontroller, etc. The calculation unit 601 executes the various methods and processes described above. For example, in some embodiments, the method may be implemented as a computer software program tangibly embodied on a machine-readable medium, such as storage unit 608 . In some embodiments, part or all of the computer program can be loaded and/or installed on the mobile device 600 via the ROM 602 and/or the communication unit 609. When a computer program is loaded into RAM 603 and executed by computing unit 601, one or more steps of the methods described above may be performed. Alternatively, in other embodiments, the computing unit 601 may be configured to execute the method in any other suitable manner (for example, by means of firmware).

Various implementations of the systems and techniques described herein above can be implemented in digital electronic circuitry, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips Implemented in a system of systems (SOC), load programmable logic device (CPLD), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include being implemented in one or more computer programs executable and/or interpreted on a programmable system including at least one programmable processor, the programmable processor Can be special-purpose or general-purpose programmable processor, can receive data and instruction from storage system, at least one input device, and at least one output device, and transmit data and instruction to this storage system, this at least one input device, and this at least one output device an output device.

Program codes for implementing the methods of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general-purpose computer, a special purpose computer, or other programmable data processing devices, so that the program codes, when executed by the processor or controller, make the functions/functions specified in the flow diagrams and/or block diagrams Action is implemented. The program code may execute entirely on the machine, partly on the machine, as a stand-alone software package partly on the machine and partly on a remote machine or entirely on the remote machine or server.

In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, apparatus, or device. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specific examples of machine-readable storage media would include one or more wire-based electrical connections, portable computer discs, hard drives, random access memory (RAM), read only memory (ROM), erasable programmable read only memory (EPROM or flash memory), optical fiber, compact disk read only memory (CD-ROM), optical storage, magnetic storage, or any suitable combination of the foregoing.

The systems and techniques described herein can be implemented in a computing system that includes back-end components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes front-end components (e.g., as a a user computer having a graphical user interface or web browser through which a user can interact with embodiments of the systems and techniques described herein), or including such backend components, middleware components, Or any combination of front-end components in a computing system. The components of the system can be interconnected by any form or medium of digital data communication, eg, a communication network. Examples of communication networks include: Local Area Network (LAN), Wide Area Network (WAN) and the Internet.

It should be understood that steps may be reordered, added or deleted using the various forms of flow shown above. For example, each step described in the present disclosure may be executed in parallel, sequentially or in a different order, as long as the desired result of the technical solution disclosed in the present disclosure can be achieved, no limitation is imposed herein.

In the technical solution of the present disclosure, the acquisition, storage and application of the user's personal information involved are in compliance with relevant laws and regulations, and do not violate public order and good customs. It is the intent of this disclosure that personal information data should be managed and processed in such a way that the risk of unintentional or unauthorized access to use is minimized. Minimize risk by limiting data collection and deleting data when it is no longer needed. It should be noted that all information related to personnel in this application is collected with the knowledge and consent of the personnel.

Although the embodiments or examples of the present disclosure have been described with reference to the accompanying drawings, it should be understood that the above-mentioned methods, systems and devices are merely exemplary embodiments or examples, and the scope of the present invention is not limited by these embodiments or examples, but It is limited only by the appended claims and their equivalents. Various elements in the embodiments or examples may be omitted or replaced by equivalent elements thereof. Also, steps may be performed in an order different from that described in the present disclosure. Further, various elements in the embodiments or examples can be combined in various ways. Importantly, as technology advances, many of the elements described herein may be replaced by equivalent elements appearing after this disclosure.

Claims

A method for providing an eye protection mode for a mobile device, comprising:

acquiring a facial image of the user at a reference distance between the user and the mobile device as a reference image, the reference image corresponding to a first facial area;

During the user's use of the mobile device, acquiring a facial image of the user as an image to be compared, the image to be compared corresponds to a second facial area; and

In response to determining that the area of the second face exceeds the area of the first face by a predetermined threshold, a prompt message is issued to enter the eye protection mode.
The method according to claim 1, wherein said obtaining the facial image of the user as a reference image comprises:

Calling the front-facing camera installed on the mobile device to take a facial image of the user at the reference distance;

detecting facial contours in the facial image; and

In response to detecting the facial contour, a first bounding box containing the facial contour is generated, the first bounding box corresponding to a boundary of the reference image.
The method of claim 2, wherein said detection of facial contours in said facial image comprises:

determining whether the facial image was taken for the user's front face; and

In response to determining that the facial image was not taken for a front face of the user, correcting the facial image or retaking the facial image.
The method according to claim 2, wherein said obtaining the facial image of the user as an image to be compared comprises:

Calling the front-facing camera installed on the mobile device to capture the user's facial image;

detecting facial contours in the facial image; and

In response to detecting the facial contour, a second bounding box containing the facial contour is generated, the second bounding box corresponding to a boundary of the images to be compared.
The method of claim 4, wherein each of the first bounding box and the second bounding box is a rectangle that encloses the facial contour in a tangent manner to the facial contour. in it, and

Wherein, the first facial area is bounded by the first bounding box, and the second facial area is bounded by the second bounding box.
The method according to claim 1, wherein said acquiring the facial image of the user as the image to be compared during the use of the mobile device by the user comprises:

The facial image of the user is acquired at a preset time point as an image to be compared, wherein the preset time point includes a plurality of sub-time points with gradually decreasing time intervals between them.
The method of claim 1, further comprising:

During the user's use of the mobile device, calling a motion detection device installed on the mobile device to detect whether the mobile device is in motion; and

In response to determining that the mobile device is in the motion state, sending the prompt message to enter the eye protection mode.
The method according to claim 1 or 7, wherein the sending out a prompt message to enter the eye protection mode comprises one of the following: popping up a pop-up box with a reminder sentence on the screen of the mobile device, making the Video playback on the mobile device is paused, or the screen of the mobile device is blacked out.
A device for providing an eye protection mode for a mobile device, comprising:

A first image acquisition module configured to acquire a facial image of the user at a reference distance between the user and the mobile device as a reference image, the reference image corresponding to a first facial area;

The second image acquisition module is configured to acquire the user's facial image as an image to be compared during the user's use of the mobile device, and the image to be compared corresponds to a second facial area; and

The comparison module is configured to, in response to determining that the area of the second face exceeds the area of the first face by a predetermined threshold, send a prompt message to enter the eye protection mode.
The device according to claim 9, wherein the first image acquisition module comprises:

An image capturing module configured to call a front-facing camera installed on the mobile device to capture a facial image of the user at the reference distance;

a contour detection module configured to detect facial contours in the facial image; and

A boundary generating module configured to, in response to detecting the facial contour, generate a first bounding box containing the facial contour therein, the first bounding box corresponding to a boundary of the reference image.
The apparatus of claim 10, wherein the contour detection module comprises:

a judging module configured to determine whether the facial image is taken against the user's front face; and

A feedback module configured to correct the facial image or recapture the facial image in response to determining that the facial image was not taken for the user's front face.
The apparatus of claim 10, wherein the second image acquisition module comprises:

The image capture module is configured to call the front camera installed on the mobile device to capture the user's facial image;

the contour detection module configured to detect facial contours in the facial image; and

The boundary generating module is configured to, in response to detecting the facial contour, generate a second bounding box containing the facial contour therein, the second bounding box corresponding to the boundary of the images to be compared.
The apparatus of claim 12 , wherein each of the first bounding box and the second bounding box is a rectangle that encloses the facial contour in a tangent manner to the facial contour. in it, and

Wherein, the first facial area is bounded by the first bounding box, and the second facial area is bounded by the second bounding box.
The device according to claim 9, wherein the second image acquisition module is further configured to: acquire the facial image of the user at a preset time point as an image to be compared, wherein the preset time point includes mutual Multiple sub-time points with gradually decreasing time intervals between them.
The apparatus according to claim 9, wherein the comparison module includes a prompt module, and the prompt module is configured to perform one of the following: pop up a pop-up box with a reminder sentence on the screen of the mobile device, make the The video playback on the mobile device is paused, or the screen of the mobile device is blacked out.
The apparatus of claim 1, further comprising a motion detection module, the motion detection module comprising:

A calling module configured to call a motion detection device installed on the mobile device to detect whether the mobile device is in a motion state during the user's use of the mobile device; and

The determination module is configured to, in response to determining that the mobile device is in the motion state, send the prompt information to enter the eye protection mode.
The apparatus according to claim 16, wherein the determination module includes a prompt module, and the prompt module is configured to perform one of the following: pop up a pop-up box with a reminder sentence on the screen of the mobile device, make the The video playback on the mobile device is paused, or the screen of the mobile device is blacked out.
A mobile device comprising:

at least one processor; and

a memory communicatively coupled to the at least one processor,

Wherein, the memory stores instructions capable of being executed by the at least one processor, and when the instructions are executed by the at least one processor, the at least one processor is executed as described in any one of claims 1-8. method described in the item.
A non-transitory computer-readable storage medium storing computer instructions, wherein the computer instructions are used to cause the computer to execute the method according to any one of claims 1-8.
A computer program product comprising a computer program, wherein said computer program implements the method according to any one of claims 1-8 when executed by a processor.