CN110413239B - Terminal setting parameter adjusting method and device and storage medium - Google Patents

Terminal setting parameter adjusting method and device and storage medium Download PDF

Info

Publication number
CN110413239B
CN110413239B CN201810408980.7A CN201810408980A CN110413239B CN 110413239 B CN110413239 B CN 110413239B CN 201810408980 A CN201810408980 A CN 201810408980A CN 110413239 B CN110413239 B CN 110413239B
Authority
CN
China
Prior art keywords
user
interval
terminal
parameter
setting
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201810408980.7A
Other languages
Chinese (zh)
Other versions
CN110413239A (en
Inventor
刘艳峰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tencent Technology Shenzhen Co Ltd
Original Assignee
Tencent Technology Shenzhen Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tencent Technology Shenzhen Co Ltd filed Critical Tencent Technology Shenzhen Co Ltd
Priority to CN201810408980.7A priority Critical patent/CN110413239B/en
Publication of CN110413239A publication Critical patent/CN110413239A/en
Application granted granted Critical
Publication of CN110413239B publication Critical patent/CN110413239B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/21—Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
    • G06F18/213—Feature extraction, e.g. by transforming the feature space; Summarisation; Mappings, e.g. subspace methods
    • G06F18/2135—Feature extraction, e.g. by transforming the feature space; Summarisation; Mappings, e.g. subspace methods based on approximation criteria, e.g. principal component analysis
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/168—Feature extraction; Face representation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/174—Facial expression recognition
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72448—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions
    • H04M1/72454—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions according to context-related or environment-related conditions

Abstract

The embodiment of the invention provides a method, a device and a storage medium for adjusting terminal setting parameters, wherein the method comprises the following steps: acquiring an environment image of a terminal; when a target user with an uncomfortable expression is detected from the environment image, acquiring a first interval of a setting parameter determined according to a pre-learned corresponding relation and the user characteristics of the target user; wherein the user characteristics include at least: user expression and age bracket; the corresponding relation comprises: setting parameter intervals corresponding to the user characteristics; and adjusting the setting parameters of the terminal according to the first interval of the setting parameters. The embodiment of the invention can realize convenient, intelligent and accurate terminal setting parameter adjustment of the terminal.

Description

Terminal setting parameter adjusting method and device and storage medium
Technical Field
The invention relates to the technical field of data processing, in particular to a method and a device for adjusting terminal setting parameters and a storage medium.
Background
A television, a mobile phone, a computer, etc. are used as a terminal for daily use of a user, and the user often adjusts setting parameters of the terminal, such as screen brightness, and/or volume, and/or contrast of the terminal, at times during the use of the terminal.
Currently, the setting parameter adjustment of the terminal is mainly realized through manual adjustment of a user, for example, the user uses a remote controller, or the setting parameter of the terminal is manually adjusted on a setting parameter adjustment interface of the terminal; the way that the user manually adjusts the setting parameters of the terminal is undoubtedly more complicated; therefore, how to conveniently adjust the setting parameters of the terminal becomes a problem to be considered by those skilled in the art.
Disclosure of Invention
In view of this, embodiments of the present invention provide a method, an apparatus, and a storage medium for adjusting terminal setting parameters, so as to implement convenient and intelligent terminal setting parameter adjustment and improve accuracy of adjusting terminal setting parameters.
In order to achieve the above purpose, the embodiments of the present invention provide the following technical solutions:
a terminal setting parameter adjusting method is applied to a terminal, and comprises the following steps:
acquiring an environment image of a terminal;
when a target user with an uncomfortable expression is detected from the environment image, acquiring a first interval of a setting parameter determined according to a pre-learned corresponding relation and the user characteristics of the target user; wherein the user characteristics include at least: user expression and age bracket; the corresponding relation comprises: setting parameter intervals corresponding to the user characteristics;
and adjusting the setting parameters of the terminal according to the first interval of the setting parameters.
The embodiment of the invention also provides a terminal setting parameter adjusting method which is applied to the server and comprises the following steps:
acquiring initial setting parameter intervals corresponding to user characteristics; the user characteristics include at least: user expression and age bracket;
acquiring corresponding adjustment result data of each user; the adjustment result data includes: the user expression is in the corresponding user characteristic of the uncomfortable state, and the corresponding parameter adjustment interval which makes the user expression in the comfortable state;
for any user, solving the intersection of the parameter adjusting interval corresponding to each user characteristic of the user and the corresponding initial setting parameter interval by using a machine learning method so as to obtain the setting parameter interval corresponding to each user characteristic of each user;
determining a union set of setting parameter intervals corresponding to the same user characteristic of each user to obtain a corresponding relation;
and when a target user with an uncomfortable expression is detected from the environment image of the terminal, determining a first setting parameter interval corresponding to the user characteristic of the target user so as to guide the adjustment of the setting parameter of the terminal.
The embodiment of the invention also provides a terminal setting parameter adjusting device, which is applied to a terminal and comprises the following components:
the environment image acquisition module is used for acquiring an environment image of the terminal;
a parameter setting first interval acquisition module, configured to acquire a parameter setting first interval determined according to a pre-learned correspondence and a user characteristic of a target user when the target user whose expression is in an uncomfortable state is detected from the environment image; wherein the user characteristics include at least: user expression and age bracket; the corresponding relation comprises: setting parameter intervals corresponding to the user characteristics;
and the setting parameter adjusting module is used for adjusting the setting parameters of the terminal according to the setting parameter first interval.
The embodiment of the invention also provides a terminal setting parameter adjusting device, which is applied to the server, and the terminal setting parameter adjusting device comprises:
the initial relation acquisition module is used for acquiring initial setting parameter intervals corresponding to the user characteristics; the user characteristics include at least: user expression and age bracket;
the adjustment result data acquisition module is used for acquiring adjustment result data corresponding to each user; the adjustment result data includes: the user expression is in the corresponding user characteristic of the uncomfortable state, and the corresponding parameter adjustment interval which makes the user expression in the comfortable state;
the learning module is used for solving the intersection of the parameter adjusting interval corresponding to each user characteristic of the user and the corresponding initial setting parameter interval by utilizing a machine learning method for any user so as to obtain the setting parameter interval corresponding to each user characteristic of each user;
a corresponding relation obtaining module, configured to determine a union of setting parameter intervals corresponding to the same user characteristic for each user, so as to obtain a corresponding relation;
and when a target user with an uncomfortable expression is detected from the environment image of the terminal, determining a first setting parameter interval corresponding to the user characteristic of the target user so as to guide the adjustment of the setting parameter of the terminal.
The embodiment of the present invention further provides a storage medium, where the storage medium records a program suitable for being executed by a processor of a terminal, so as to implement the steps of the terminal setting parameter adjusting method described above.
The embodiment of the present invention further provides a storage medium, where the storage medium records a program suitable for being executed by a processor of a server, so as to implement the steps of the terminal setting parameter adjusting method described above.
Based on the technical scheme, the terminal setting parameter adjusting method provided by the embodiment of the invention can automatically adjust the terminal setting parameters at least according to the expression, age and other user characteristics of the target user in the environment where the terminal is located, so that the terminal can conveniently and intelligently adjust the terminal setting parameters, and the adjusting accuracy is higher.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts.
Fig. 1 is an architecture diagram of a terminal setting parameter adjusting system according to an embodiment of the present invention;
fig. 2 is a signaling flowchart of a method for adjusting a terminal setting parameter according to an embodiment of the present invention;
FIG. 3 is an exemplary diagram of determining the users currently in use;
FIG. 4 is a diagram illustrating an exemplary determination of a first interval of setting parameters;
fig. 5 is another signaling flowchart of a method for adjusting terminal setting parameters according to an embodiment of the present invention;
FIG. 6 is a flowchart of a method for adjusting a setting parameter based on a first interval of the setting parameter;
FIG. 7 is a diagram illustrating an exemplary determination of a parameter setting target interval;
fig. 8 is a diagram showing an example of processing of expression recognition;
fig. 9 is an exemplary diagram of an application scenario provided in an embodiment of the present invention;
fig. 10 is a signaling flowchart of a method for adjusting terminal setting parameters according to an embodiment of the present invention;
FIG. 11 is a diagram illustrating an example of a process for identifying the gender of a user;
FIG. 12 is a diagram of another example of a process for identifying the gender of a user;
fig. 13 is a diagram illustrating another exemplary application scenario provided by an embodiment of the present invention;
fig. 14 is a block diagram of a configuration of a terminal setting parameter adjusting apparatus according to an embodiment of the present invention;
fig. 15 is another block diagram of the terminal setting parameter adjusting apparatus according to the embodiment of the present invention;
fig. 16 is a further structural block diagram of the terminal setting parameter adjusting apparatus according to the embodiment of the present invention;
fig. 17 is a block diagram of another structure of the terminal setting parameter adjusting apparatus according to the embodiment of the present invention;
fig. 18 is still another block diagram of the terminal setting parameter adjusting apparatus according to the embodiment of the present invention;
fig. 19 is a block diagram of a hardware configuration of the terminal.
Detailed Description
The inventor of the invention researches and finds that: when the setting parameters such as screen brightness, volume and the like of the terminal are not accurate enough, the expression of the user often becomes uncomfortable, so that the setting parameter adjustment of the terminal can be triggered by the change of the expression of the user; in the setting parameter adjusting process of the terminal, the accuracy requirements of users of different ages on the setting parameters of the terminal, such as screen brightness, volume and the like, are often different; therefore, the user expression and the age bracket can be at least used as the user characteristics, and the setting parameter intervals corresponding to different user characteristics are set, so that the adjustment of the terminal setting parameters with higher accuracy is realized.
Based on the thought, the embodiment of the invention can at least take the expression and the age group of the user as the user characteristics, and realize the determination of the setting parameter intervals corresponding to different user characteristics by learning the corresponding relation between each user characteristic and the setting parameter interval, thereby guiding the setting parameter adjustment of the terminal and further ensuring that the adjusted setting parameter interval is more accurate; optionally, the user characteristics may include at least: the user expression and age range dimension can also further include: the user gender and/or the environmental parameters of the environment where the user is located, etc. in the embodiment of the present invention, the user characteristics are considered to be different as long as any dimension is different.
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Fig. 1 is an optional system architecture for implementing parameter adjustment of terminal settings according to an embodiment of the present invention, and as shown in fig. 1, the system architecture may include: a terminal 10 and a server 20;
the terminal 10 may be a terminal device such as a television, a mobile phone, a computer, etc. which is being used by a user; during the operation of the terminal 10, the screen brightness, and/or volume, and/or contrast of the terminal will affect the sense of the user; the embodiment of the invention is expected to realize convenient, intelligent and accurate setting parameter adjustment on the terminal 10;
the server 20 may be a service device installed on a network side, the server 20 may perform data interaction with the terminal 10 through the network, and the server 20 may be implemented by a single server or a server group consisting of a plurality of servers; in the embodiment of the present invention, the server 20 needs to learn at least the corresponding relationship between the user characteristics and the setting parameter intervals, as an example, the server 20 may learn the setting parameter intervals corresponding to the user characteristics by using at least the expression and the age group of the user as the user characteristics (in the embodiment of the present invention, if any dimension is different, the user characteristics are different, such as the expression and the age group, the user characteristics are different), so as to provide guidance for adjusting the setting parameters of the terminal 10.
Optionally, in the embodiment of the present invention, at least the expression and age group of the user may be used as the user characteristics to determine the corresponding setting parameter interval, so as to guide the setting parameter adjustment of the terminal; in an optional implementation, a face region can be detected from an environment image of the terminal, facial features of the face region are extracted, so that at least the expression and age of a user can be recognized based on the facial features, and the process can be realized by processing of the server, namely the environment image of the terminal can be processed by the server; based on the system architecture shown in fig. 1, fig. 2 shows an optional signaling flow of the method for adjusting the terminal setting parameter provided in the embodiment of the present invention, and referring to fig. 2, the flow may include:
and step S10, the terminal acquires the environment image acquired by the image acquisition device.
Optionally, an image acquisition device carried by the terminal or an image acquisition device connected with a data interface (such as a USB interface) of the terminal may be used to acquire the environmental image; the image acquisition device can be realized by equipment with imaging function such as a camera; the environment image may be regarded as an image of an environment in which the terminal is located, and may include a user and a background in the environment;
optionally, the purpose of image acquisition is to serve user features such as expression and age of a user in the subsequent at least recognition environment image; as an optional implementation, the image acquisition device can acquire images corresponding to the screen light projection range of the terminal, so that the acquired environment images can cover different viewing angles at which the terminal screen can be viewed; preferably, the image acquisition device can be realized by a wide-angle camera;
of course, the image acquisition device may also acquire an image of the user who is facing the terminal screen to identify the user characteristics such as expression and age of the user who is facing the terminal screen.
Optionally, the terminal may trigger the image acquisition device to acquire the environmental image at regular time, for example, by setting the timing time, the image acquisition device is triggered to acquire the environmental image at regular intervals;
as a parallel mode, when the user expression is uncomfortable, the user expression may not reach a comfortable state due to one-time terminal setting parameter adjustment, and multiple times of fine adjustment of the terminal setting parameter are required, so that the embodiment of the invention can acquire the environment image again after the last time of adjusting the setting parameter of the terminal until the user expression reaches the comfortable state;
and step S11, the terminal uploads the environment image to the server.
In the embodiment of the invention, the processing of the image is executed by the server, so the terminal needs to upload the environment image to the server for processing after acquiring the environment image.
Step S12, the server recognizes an expression of the user used in the environment image.
Optionally, the user in the environment image may include: the user identified in the environment image, or the user using the terminal identified in the environment image.
After the server acquires the environment image, whether a user exists in the environment image can be detected, namely the user in the environment image is identified; as an optional implementation, the server may perform face detection or portrait detection on the environmental image to detect whether a user exists in the environmental image; obviously, if no user exists in the environment image, the setting parameter adjustment of the terminal is generally meaningless, the execution of the subsequent process can be terminated, the environment image is collected again when the next timing time comes, and the process of the terminal setting parameter adjustment method provided by the embodiment of the invention is executed again.
Optionally, the embodiment of the present invention may use the user identified from the environment image as the user, and the number of the users is at least one.
Optionally, as another implementation, in the case that the user is identified from the environment image, the server may further identify the user who is using the terminal as the user; the number of the users is at least one;
it can be understood that, in a scene of adjusting the screen brightness of the terminal (for example, in a scene of adjusting the screen brightness of a television), the adjustment of the screen brightness may cause an influence on a user watching a terminal screen in an environment (the watching terminal screen may be considered as a form of a terminal being used), and cause a smaller influence on a user not watching the terminal screen in the environment, so that when the user is identified to be present in an environment image, the user watching the terminal screen may be further determined, and an expression of the user is analyzed;
as an example, as shown in fig. 3, a user a and a user B exist before a television, and a face of the user a and a face of the user B will exist in a collected environment image, since the user a is playing a mobile phone and the user B is watching the television, setting parameters such as screen brightness of the television may have a large influence on the user B, and the influence on the user a is small, it may be determined that the user a does not belong to a user and the user B belongs to a user.
When the user watching the terminal screen is determined, as an optional implementation, the user with the face angle corresponding to the preset angle range can be used as the detected user by analyzing the face angle of each user identified in the environment image; the preset angle range can be set according to the size of a terminal screen, the position of a camera and the like, and can represent the face angle range of a user watching the terminal screen;
of course, the user who is watching the terminal screen in the environment image is only a preferred mode in the scene of adjusting the screen brightness of the terminal, and the embodiment of the present invention may also support users identified in the environment image to be all used users.
In the scene of adjusting the volume of the terminal, the embodiment of the invention can support the user who is watching the terminal screen and identified in the environment image as the user, and can also support the user who is identified in the environment image as the user.
Under the condition that a user in an environment image is determined, facial features of the user can be extracted, expression recognition is carried out based on the facial features of the user, and the expression of the user is recognized (the expression pointed by the user can be the expression features or the expression types); it should be noted that, when the number of users is multiple, the server extracts facial features of each user (for multiple users, the facial features of each user may be extracted simultaneously or separately), and identifies expressions of each user based on the facial features of each user (for multiple users, the facial features of each user may be identified simultaneously or separately); optionally, the expression recognition based on the facial features may be regarded as an expression classification process based on the facial features, and the expression type corresponding to the facial features is determined to recognize the corresponding expression.
Step S13, the server detects whether there is a target user whose expression is in an uncomfortable state according to the expression of the user.
The idea of adjusting the setting parameters of the terminal is that when the expression of a user is in an uncomfortable state, the setting parameters of the terminal are triggered to be adjusted; therefore, after determining to use the expression of the user, the embodiment of the present invention needs to further determine whether there is a target user whose expression is in an uncomfortable state; in the embodiment of the present invention, a user whose expression is in an uncomfortable state may be referred to as a target user.
Optionally, in the embodiment of the present invention, a predefined uncomfortable expression may be set, an expression of a user is matched with the predefined uncomfortable expression, whether a target user whose expression is matched with the uncomfortable expression exists in the user is detected (the target user may be considered as a user whose expression is matched with the predefined uncomfortable expression in the user), if the result of the determination is yes, it is indicated that the target user exists in the user, and if the result of the determination is no, it is indicated that the target user does not exist in the user, that is, the expressions of the user are both comfortable expressions, and terminal setting parameter adjustment is not needed;
optionally, as another implementation, in the embodiment of the present invention, a predefined comfortable expression may also be set, the expression of the user is matched with the predefined comfortable expression, it is determined whether a target user that is not matched with the comfortable expression exists in the user (the target user may be considered as a user whose expression is not matched with the predefined comfortable expression in the user, and the definition is actually consistent with the meaning of the definition), if the determination result is yes, the target user exists in the user, and if the determination result is no, it is determined that the target user does not exist in the user, even if the expressions of the user are all comfortable expressions, the terminal setting parameter adjustment is not needed.
It can be understood that, in the case that there are a plurality of users, the embodiment of the present invention matches the expression of each user with a predetermined uncomfortable expression, and detects whether there is a target user by determining whether the expression of each user is an uncomfortable expression; the target users may be some users among the users, that is, when the number of users is multiple, the expressions of some users may be comfortable, and the expressions of some users may not be comfortable; it is also possible that the user is the target user, for example, the number of users is one and the expression is not comfortable, or the number of users is plural and the expression is not comfortable.
And step S14, if the target user is detected to exist, the server determines the age bracket of the target user according to the facial features of the target user.
The embodiment of the invention is characterized in that when the setting parameters of the terminal enable the expression of a user to be uncomfortable, the setting parameter interval which enables the expression of the user to tend to be comfortable is determined at least by taking the expression and the age group of the user as the characteristics of the user, and the setting parameter of the terminal is guided to be adjusted based on the setting parameter interval; therefore, after the target user with the uncomfortable expression is determined, at least the age bracket of the target user needs to be determined besides the expression of the target user, so as to determine the user characteristics of the target user;
the identification of the age group of the user based on the facial features may be considered as a classification process of the age group of the user based on the facial features, such as determining the age group into which the facial features of the target user are classified, and determining the age group of the target user.
Optionally, when there is no target user, it is described that the current setting parameter of the terminal is suitable for using the sensory experience of the user, the setting parameter may be adjusted, and the terminal setting parameter adjusting method provided by the embodiment of the present invention is executed again at the interval timing time.
And step S15, the server determines a first interval of setting parameters by taking at least the expression and age bracket of the target user as the user characteristics according to the pre-learned corresponding relation.
In the embodiment of the invention, the server can learn the setting parameter intervals corresponding to the user characteristics at least by taking the user expressions and age groups as the user characteristics, so as to realize the pre-establishment of the corresponding relationship.
That is, in the embodiment of the present invention, the correspondence relationship may include: setting parameter intervals corresponding to the user characteristics; and the user characteristics may include at least: user expression and age bracket; and determining a first parameter setting interval according to the corresponding relation by the user characteristics of the target user by learning the corresponding relation between the parameter setting interval and the user characteristics.
After the server learns the corresponding relationship between the set parameter intervals and at least user characteristics such as user expressions and age groups in advance, if the number of target users is multiple, the server can respectively determine the set parameter intervals corresponding to the user characteristics such as the expressions and the age groups of the target users according to the corresponding relationship to obtain the set parameter intervals corresponding to the target users, a union set of the set parameter intervals corresponding to the target users is taken to obtain a set parameter first interval, so that the set parameter intervals suitable for the multiple users can be obtained under the condition that the expressions of the multiple users are uncomfortable, the terminal set parameter adjustment of the terminal is guided, and the expression of the multiple users is ensured to be in a comfortable state;
as an example, as shown in fig. 4, if the target users are user a and user B, according to the corresponding relationship, the setting parameter interval corresponding to user a may be determined based on at least user characteristics, such as expression and age of user a, and the setting parameter interval corresponding to user B may be determined based on at least user characteristics, such as expression and age of user B, assuming that the setting parameter interval corresponding to user a is [ d2, d4], and the setting parameter interval corresponding to user B is [ d3, d5], taking a union [ d2, d5] of the setting parameter intervals corresponding to user a and user B as a first setting parameter interval; it can be seen that taking the union of multiple setting parameter intervals actually takes the sum of the multiple setting parameter intervals;
of course, if the number of the target users is one, the server may determine, according to the correspondence, a setting parameter interval corresponding to the user characteristics, such as the expression and age of the target user, to obtain a first setting parameter interval.
And step S16, the server feeds back the first interval of the setting parameter to the terminal.
And step S17, the terminal adjusts the setting parameters of the terminal according to the first interval of the setting parameters, and the step S10 is returned.
After the terminal acquires the first interval of the setting parameters fed back by the server, the terminal setting parameters of the terminal can be adjusted based on the first interval of the setting parameters, so that the setting parameters of the terminal tend to be comfortable for a user; however, one adjustment may not make the expression of the user comfortable immediately, and often fine adjustment of the setting parameters needs to be performed for multiple times, so after the setting parameters of the terminal are adjusted once, the process returns to step S10, and the process of fig. 2 is repeated, and the process is repeated until the expressions of the users of the terminal are comfortable (that is, the expressions of the users in the environment where the terminal is located are in a comfortable state).
According to the terminal setting parameter adjusting method provided by the embodiment of the invention, the expression recognition of the user in the environment where the terminal is located can be carried out based on the environment image of the terminal, and the target user with uncomfortable expression can be determined, so that the first setting parameter interval can be determined by taking at least the expression and the age bracket of the target user as the user characteristics according to the pre-learned corresponding relation, and the first setting parameter interval guides the adjustment of the setting parameters of the terminal, so that the accurate adjustment of the setting parameters of the terminal is realized. The terminal setting parameter adjusting method provided by the embodiment of the invention can automatically adjust the terminal setting parameters at least according to the expression, age and other user characteristics of the target user in the environment where the terminal is located, so that the terminal can conveniently and intelligently adjust the terminal setting parameters, and the adjusting accuracy is higher.
Optionally, the server learning correspondence may be obtained based on big data learning adjusted by the terminal setting parameter; for example, the initial setting parameter interval corresponding to each user feature may be obtained through investigation, collection, and sorting, and an initial setting parameter interval corresponding to a user feature may be considered as: setting parameters of a corresponding initial setting parameter interval adjusting terminal are utilized under a certain user characteristic determined by investigation and analysis when the user is uncomfortable in expression, so that the user expression can be in a setting parameter interval in a comfortable state;
it can be understood that the initial setting parameter interval corresponding to each user feature is a rough selection interval which is obtained by investigation and the accuracy is to be further improved, the embodiment of the invention can obtain the user features when the user expression is uncomfortable and the corresponding parameter adjusting interval which enables the user expression to be comfortable by adjusting the setting parameters in the terminal setting parameter adjusting process, thereby obtaining the corresponding relation based on the machine learning process training;
specifically, the corresponding adjustment result data of each user can be obtained; the adjustment result data includes: the user expression is in the corresponding user characteristic of the uncomfortable state, and the corresponding parameter adjustment interval which makes the user expression in the comfortable state;
for any user, solving the intersection of the parameter adjusting interval corresponding to each user characteristic of the user and the corresponding initial setting parameter interval by using a machine learning method so as to obtain the setting parameter interval corresponding to each user characteristic of each user;
further determining a union set of the setting parameter intervals corresponding to the same user characteristic of each user to obtain a corresponding relation;
meanwhile, the obtained corresponding relation can be continuously updated based on the continuous adjustment of the terminal setting parameters.
Taking the user characteristics including the user expression and the age bracket as an example, after the initial setting parameter intervals corresponding to the user characteristics are obtained through sorting, setting parameters comfortable for each user are in an interval form; therefore, for a certain user, in the process that the user uses the terminal, the user characteristics of the user when the expression of the user is uncomfortable can be continuously obtained, and the parameter adjusting interval which enables the expression to be in a comfortable state is correspondingly obtained, so that the parameter adjusting interval corresponding to the user under different user characteristics is obtained;
by utilizing a machine learning method, acquiring the intersection of the parameter adjusting interval corresponding to each user characteristic of the user and the corresponding initial setting parameter interval, and acquiring the setting parameter interval corresponding to each user characteristic of the user;
and processing the plurality of users in the manner to obtain the setting parameter intervals corresponding to the user characteristics of the plurality of users, taking the union of the setting parameter intervals corresponding to the same user characteristic of the plurality of users, determining the more refined setting parameter interval corresponding to the user characteristic, and obtaining the corresponding relation.
Obviously, in the process of learning the corresponding relationship, besides the expression of the user and the age group of the user as the user characteristics, the gender and the environmental parameters of the user are also combined in the user characteristics (for example, when the screen brightness is adjusted, the environmental brightness can be combined, and when the volume is adjusted, the environmental noise intensity can be combined).
It should be noted that, in the embodiment of the present invention, terminal setting parameters of the terminal are adjusted not only by using the expression of the user as a dimension, but also by combining at least user characteristics of other dimensions such as the age of the user, and the sensitivity of users of different ages to the setting parameters of the terminal is different; taking screen brightness adjustment as an example, the inventor analyzes the hair style: the eyesight of people in the age group is in an unstable period, the screen brightness cannot be too dark to cause visual fatigue, and cannot be too bright to stimulate eyeballs to cause discomfort; the aged people, whose vision is different from that of young people, gradually yellow the cornea and crystalline lens of the aged eyes, have reduced color discrimination, reduced color difference recognition ability, reduced ability to distinguish colors with closer color tone, such as red, orange, blue and green, and reduced crystalline lens elasticity, reduced ability to control the amount of light entering the eyes, and reduced adaptability to environment from bright environment to dark environment or from dark environment to bright environment, and is more sensitive to glare, so that for the aged people, the screen brightness should be properly increased, the uniformity of the brightness should be improved, and sudden brightness change should be avoided;
therefore, compared with the method for adjusting the setting parameters of the terminal simply according to the expression of the user, the method and the device for adjusting the setting parameters of the terminal are very necessary by combining the dimensions of the user such as the age group and the like as the characteristics of the user, so that the setting parameters of the terminal can be adjusted to adapt to different expressions of people of different age groups, and more accurate adjustment of the setting parameters of the terminal is realized. The scheme for automatically adjusting the setting parameters of the terminal at least according to the expression, age and other user characteristics of the target user in the environment where the terminal is located is essentially different from the scheme for simply adjusting the setting parameters of the screen brightness of the terminal based on the expression of the user.
In the flow shown in fig. 2, the processing of the image and the determination of the setting parameter interval are both performed by the server; as a variation, the embodiment of the present invention may only perform, by the server, identification of the user characteristics such as age, expression, etc. of the user in the image, perform, by the terminal, further judgment on whether the expression is comfortable, and perform, by the terminal, determination of setting parameter intervals based on the correspondence updated by the terminal from the server;
optionally, taking the user characteristics including an expression and an age group as an example, fig. 5 illustrates another optional signaling flow of the terminal setting parameter adjusting method provided in the embodiment of the present invention, and a terminal setting parameter adjusting principle of the flow illustrated in fig. 5 is similar to the terminal setting parameter adjusting principle of the flow illustrated in fig. 2, and both the terminal setting parameter adjusting principle and the terminal setting parameter adjusting principle are determined based on at least the user characteristics such as the expression and the age group of the user, and the difference is a deformation of a flow execution position; obviously, the following procedure may be adapted to the case of increasing the gender of the user in the user characteristics, and/or the environmental parameters of the environment in which the user is located;
referring to fig. 5, the process may include:
and step S20, the terminal acquires the environment image acquired by the image acquisition device.
And step S21, the terminal uploads the environment image to the server.
The descriptions of step S20 and step S21 can refer to step S10 and step S11 of fig. 2.
Step S22, the server identifies at least the expression and age bracket of the user used in the environment image.
Alternatively, the user in the environment image may be a user identified in the environment image, or a user who is using the terminal, among users identified in the environment image, and further identified.
The server acquires the environment image, and after determining the user in the environment image, the facial features of the user can be extracted; performing expression classification based on the facial features of the user, determining the corresponding expression of the user, performing age classification based on the facial features of the user, and determining the corresponding age group of the user; it should be noted that, when the number of users is large, at least the expression and the age group of each user are identified.
Further, if the server does not recognize the user in the environment image, the terminal setting parameter adjustment of the terminal is generally meaningless, the subsequent flow execution can be terminated, and the flow of the terminal setting parameter adjustment method provided by the embodiment of the invention is executed again when the next timing time comes.
And step S23, the server feeds back at least the expression and age bracket of the user to the terminal.
After recognizing the expression and age of each user in the environment image, the server can feed back the expression and age to the terminal, and the terminal performs subsequent processing.
Optionally, if the gender of the user is carried in the user characteristics, the server may further identify the gender of the user, and feed back the gender of the user to the terminal along with the expression and age of the user.
And step S24, the terminal detects whether a target user with uncomfortable expression exists according to the expression of the user.
Step S25, if the target user is detected to exist, the terminal determines a first interval of setting parameters according to a pre-stored corresponding relation and at least by taking the expression and age bracket of the target user as the user characteristics.
Optionally, if it is detected that there is no target user, execution of the subsequent process may be stopped, and when the next timing time comes, the process of the terminal setting parameter adjustment method provided by the embodiment of the present invention is executed again.
When the terminal detects that a target user exists in the users, the terminal considers that the setting parameters of the terminal need to be adjusted; the terminal can determine a first interval of setting parameters corresponding to the user characteristics of the target user according to the corresponding relation updated and stored in advance from the server; optionally, if the number of the target users is multiple, the setting parameter intervals corresponding to the user characteristics of each target user may be determined respectively, and the union set of the setting parameter intervals corresponding to each target user is taken to obtain the first setting parameter interval.
And step S26, the terminal adjusts the setting parameters of the terminal according to the first interval of the setting parameters, and the step S20 is returned.
In order to adapt the setting parameters adjusted by the terminal to the sensory experience of the target user, fine adjustment of the setting parameters may need to be performed for multiple times, so after the setting parameters of the terminal are adjusted once, the process of fig. 5 needs to be repeated by returning to step S20, and the process is repeated until the expression of the user is comfortable.
Optionally, as a variation of the process shown in fig. 5, the terminal may also perform image processing to recognize the expression and age bracket of the user in the environment image, i.e., the terminal may directly perform the adjustment of the setting parameters without the participation of the server.
Optionally, the setting parameter of the terminal is adjusted according to the setting parameter first interval, and after the setting parameter target interval is determined according to the setting parameter first interval adjustment, the setting parameter of the terminal is adjusted according to the setting parameter target interval;
in the embodiment of the invention, the adjustment of the terminal setting parameters of multiple loops can be carried out, and the termination condition of the adjustment of the terminal setting parameters of each loop is that the expression of the user reaches a comfortable state, or the setting parameters of the terminal are adjusted according to the target interval of the setting parameters, and the expression of the user is not in the comfortable state; and one-time terminal setting parameter adjustment can be carried out for multiple times or once;
specifically, if the expression of the target user is still in an uncomfortable state after the setting parameters of the terminal are adjusted according to the setting parameter target interval, directly entering the next time of adjusting the setting parameters of the terminal, and re-executing the flow of the method for adjusting the setting parameters of the terminal provided by the embodiment of the invention;
if the expression of the target user is in a comfortable state after the setting parameters of the terminal are adjusted according to the setting parameter target interval, timing time is set, next time of adjusting the setting parameters of the terminal is entered, and the flow of the method for adjusting the setting parameters of the terminal provided by the embodiment of the invention is executed again;
wherein, in the terminal setting parameter adjusting process of each time, there is one or more times of terminal setting parameter adjusting.
It should be further noted that, after adjusting the setting parameters of the terminal in the previous time, under the condition that the target user with uncomfortable expression still exists, the target interval of the setting parameters determined in the previous time can be used in combination when adjusting the setting parameters of the terminal in the current time; taking the intersection of the last determined target interval of the setting parameters and the first interval of the setting parameters to determine the target interval of the setting parameters of the current time;
after adjusting the setting parameters of the terminal in the previous time, the user's expression is already in a comfortable state, and when adjusting the setting parameters of the terminal in the current time (i.e. after the interval timing time, entering the terminal setting parameter adjustment of the current time), the determined first interval of the setting parameters can be used as the target interval of the setting parameters of the current time.
Optionally, fig. 6 shows a flow of a method for adjusting a setting parameter of a terminal according to a setting parameter first interval, where the flow of the method may be implemented by the terminal, and referring to fig. 6, the flow may include:
and step S30, acquiring the target interval of the setting parameters determined in the previous time under the condition that the expression of the target user is still in an uncomfortable state after the setting parameters of the terminal are adjusted according to the target interval of the setting parameters determined in the previous time.
And step S31, determining the intersection of the first setting parameter interval and the last setting parameter target interval to obtain the determined setting parameter target interval.
And step S32, adjusting the setting parameters of the terminal according to the determined setting parameter target interval.
When a target user with uncomfortable expression is identified from an environment image, the embodiment of the invention may need to make the expression of the user reach a comfortable state through continuous multi-turn terminal setting parameter adjustment; therefore, in this process, if there is still a target user with uncomfortable expression after adjusting the setting parameter of the terminal in the previous time, the intersection of the setting parameter target interval of the setting parameter in the previous time and the setting parameter first interval needs to be determined, and the setting parameter interval corresponding to the intersection is used as the setting parameter target interval adjusted in the current time, so as to adjust the setting parameter of the terminal according to the setting parameter target interval.
As an example, as shown in fig. 7, if there is still a target user with uncomfortable expression after adjusting the setting parameters of the terminal last time, the setting parameter target interval used for adjusting the setting parameters last time may be obtained, assuming that the setting parameter target interval used for adjusting the setting parameters last time is [ d1, d4 ]; simultaneously calling a first setting parameter interval, and if the first setting parameter interval is [ d2, d5], taking the intersection [ d2, d4] of the first setting parameter interval and the second setting parameter interval as a setting parameter target interval used by the setting parameter of the callback terminal;
generally speaking, in the process of adjusting the setting parameters of the terminal with multiple continuous loops, the target interval of the setting parameters used for the subsequent adjustment is generally included in the target interval of the setting parameters used for the previous adjustment; therefore, in the process of adjusting the terminal setting parameters of multiple continuous loops, the target interval of the setting parameters used in the loop is determined by the target interval of the adjusting setting parameters of the previous loop and the first interval of the determined setting parameters, so that the target interval of the setting parameters according to which the adjustment is carried out is more accurate and fine.
Optionally, in the embodiment of the present invention, when the setting parameter of the terminal is adjusted according to the setting parameter target interval, the setting parameter may be implemented based on a bisection method, where the bisection method is a method for continuously subdividing an interval to achieve a desired purpose;
the embodiment of the invention can select a parameter adjusting interval from the parameter setting target area based on the dichotomy, and adjust the setting parameters of the terminal until the expression of the target user is in a comfortable state, or the adjusting times of the setting parameters of the terminal reach the preset times; namely, the stopping condition for selecting the parameter adjusting interval from the parameter setting target area based on the dichotomy is as follows: after the setting parameters of the terminal are adjusted according to the parameter adjustment interval selected in a certain subdivision mode, the expression of the target user is in a comfortable state, or the number of times of adjusting the setting parameters reaches the preset number of times based on the parameter adjustment interval selected in a dichotomy mode.
As a specific implementation, the optional use of the dichotomy may include the following procedures:
starting from the parameter setting target interval serving as a reference interval, iteratively executing a first step until an iteration execution termination condition is reached;
the first step comprises: carrying out interval equalization on the reference interval to obtain a first parameter adjusting interval and a second parameter adjusting interval; adjusting the setting parameters of the terminal to be positioned in the first parameter adjusting interval and the second parameter adjusting interval respectively, and determining the expression change of the corresponding target user respectively; and if the expression of the target user is still in an uncomfortable state, selecting a parameter adjusting interval in which the expression change of the target user tends to be in a comfortable state from the first parameter adjusting interval and the second parameter adjusting interval, and taking the selected parameter adjusting interval as a reference interval.
Obviously, after the selected parameter adjustment interval is taken as a reference interval, the first step is executed again, and the iterative execution is executed in this way until the expression of the target user is in a comfortable state or the iterative execution times reaches the preset times;
the actual interval average division of the reference interval is to determine a middle value, a lowest value and a highest value of the reference interval, use an interval from the lowest value to the middle value as a first parameter adjustment interval, and use an interval from the middle value to the highest value as a second parameter adjustment interval;
therefore, the corresponding changed expression of the target user can be determined by adjusting the terminal setting parameters through the first parameter adjusting interval, and the corresponding changed expression of the target user can be determined by adjusting the terminal setting parameters through the second parameter adjusting interval; thereby selecting a parameter adjusting interval with comfortable expression change;
the terminal setting parameter is adjusted through the first parameter adjustment interval, which may be selecting a middle value adjustment terminal setting parameter of the first parameter adjustment interval, or randomly selecting a value from a first parameter adjustment area to adjust the terminal setting parameter; and the mode of adjusting the setting parameters of the terminal through the second parameter adjusting area is the same as the mode of adjusting the setting parameters of the terminal through the second parameter adjusting area.
Optionally, as another specific implementation, the optional use of the bisection method may include the following process:
equally dividing the set parameter target interval to obtain a first parameter adjusting interval and a second parameter adjusting interval;
adjusting the setting parameters of the terminal to be positioned in the first parameter adjusting interval and the second parameter adjusting interval respectively, and determining the expression change of the corresponding target user respectively;
if the expression of the target user is still in an uncomfortable state, selecting a parameter adjusting interval in which the expression of the target user is in a comfortable state or the expression change of the target user tends to be in a comfortable state from the first parameter adjusting interval and the second parameter adjusting interval;
starting with the initial value of the selected parameter adjusting interval, and gradually selecting the setting parameters at intervals of preset values to adjust the setting parameters of the terminal until the expression of the target user is in a comfortable state or the selected setting parameters reach the tail value of the selected parameter adjusting interval.
In the embodiment of the invention, after the parameter setting target interval is subjected to interval equalization, a parameter adjusting interval which enables the expression change of a target user to tend to a comfortable state can be selected from the equalized parameter adjusting intervals; and then, starting with the initial value of the selected parameter adjusting interval, superposing the preset value every time to adjust the setting parameter of the terminal until the expression of the target user is in a comfortable state or the end value of the selected parameter adjusting interval is reached.
It should be noted that, in the manner shown in fig. 6, determining the set parameter target interval of the current loop by determining the intersection of the first interval of the set parameter and the set parameter target interval determined in the previous loop and the set parameter interval corresponding to the intersection is only an optional implementation manner; the embodiment of the invention can also directly use the determined first interval of the setting parameter as the target interval of the setting parameter, for example, under the condition that the expression of the target user is in a comfortable state after the setting parameter of the terminal is adjusted according to the target interval of the setting parameter determined in the last time.
Optionally, when the user expression and the age bracket of the user in the image are identified, the embodiment of the invention may first locate the face region of the user from the image, extract the facial features of the face region of the user, and implement the identification of the user expression and the age bracket based on the facial features of the user; as an optional implementation of extracting facial features, the facial features can be extracted from a human face region by positioning the human face region of a user in an environment image, using integral template matching, or based on a geometric feature mode;
it should be noted here that the template used in the overall template matching manner may be a pixel or a vector, and the mask matching recognition is performed mainly based on the main facial feature points of the human face and the human face image, so as to extract the facial features of the human face region;
based on a geometric characteristic mode, low-dimensional representation of a face area is obtained by widely adopting principal component analysis and a multilayer neural network, and main characteristic points and main parts are detected in the face area; obtaining a feature vector through the distance of the main feature points and the relative size of the main part, and realizing the extraction of facial features; optionally, the distance of the main feature point may be determined by extracting a Gabor wavelet coefficient of the main feature point through image convolution after the main feature point is located, obtaining a Gabor feature, and determining the distance of the main feature point by using a matching distance of the Gabor feature as a metric of similarity;
in general, geometric feature-based approaches are more computationally intensive relative to global template matching approaches, but are not sensitive to image scale, size, head orientation, face position.
Obviously, for an image with a human face, there are various ways to locate each face region in the image and extract facial features of each face region, and the embodiments of the present invention can be used in support of the above description, and are not limited to the above description.
After the facial features of the user are extracted, the expression recognition of the user can be regarded as an expression classification problem based on the facial features of the user, the embodiment of the invention can be realized by means of neural network models such as a multilayer neural network, the facial features of the user are used as the input of an expression detection model by training the expression detection model, and the expression detection model outputs the correspondingly classified expressions;
optionally, the training process of the expression detection model may include: collecting different facial features, marking expression types corresponding to the facial features, inputting the collected facial features into a neural network model as input samples one by one, updating parameters of the neural network model by taking the expression types output by the neural network model tending to the expression types marked by the facial features as training targets, and realizing the training of an expression detection model;
as an alternative example, the training target of the expression detection model may be expressed using a minimum cross entropy E, and the formula is as follows:
Figure BDA0001646592120000181
where n is the number of samples, k is the dispersion, t is the marking result (i.e., the expression type of the mark), y is the actual output result (i.e., the expression type of the actual output), and c is the setting parameter.
Optionally, as for an example of recognizing facial features from an image and determining an expression to which the facial features belong based on a trained expression detection model, as shown in fig. 8, specifically, the method includes:
after the facial features in the image are extracted in a mode of matching the integral template or a mode based on geometric features, the facial features are used as the input of an expression detection model, and the results are output by the expression detection model to obtain the expression corresponding to the facial features.
Similarly, after the facial features of the user are extracted, the age group identification of the user can be regarded as an age group classification problem based on the facial features of the user, the embodiment of the invention can be realized by means of neural network models such as a multilayer neural network, and the like, the facial features of the user are used as the input of an age group detection model by training the age group detection model, and the age group detection model outputs the age group of corresponding classification;
optionally, the training process of the age group detection model may include: collecting different facial features, marking age groups corresponding to the facial features, inputting the collected facial features into the neural network model as input samples one by one, updating parameters of the neural network model by taking the age groups output by the neural network model and tending to the age groups marked by the facial features as training targets, and realizing the training of the age group detection model.
Taking the user expression and age group as user characteristics, and adjusting the screen brightness of the television to be a scene, an application scene example of the terminal setting parameter adjusting method provided by the embodiment of the invention can be shown in fig. 9; as shown in connection with fig. 9, this example process may include:
the server continuously learns and adjusts the corresponding relation between the brightness comfortable interval (one form of the setting parameter interval) and the expression and the age bracket of the user, and the television periodically updates the latest brightness comfortable interval from the server and the corresponding relation between the brightness comfortable interval and the expression and the age bracket of the user;
after a user A opens a television, the television can trigger a camera of the television to acquire an environment image at intervals of a timing time after the expression of the user reaches a comfortable state;
the television uploads the environment image to a server; the environment image has the human faces of a user A and a user B;
the server can detect users (user A and user B) watching the television screen in the environment image, identify the expression and age bracket of the users and feed back the expression and age bracket to the television;
the television determines a first interval with comfortable brightness corresponding to the expression and age group of the user A according to the corresponding relation when the target user with uncomfortable expression is judged to be the user A by the television based on the expression of the user; of course, if the user a and the user B are both target users, the first luminance comfort interval may be a union of the luminance comfort interval corresponding to the expression and age group of the user a and the luminance comfort interval corresponding to the expression and age group of the user B;
if the expression of the user A is not comfortable, the screen brightness of the television can be adjusted according to the first comfortable brightness interval; optionally, after the screen brightness of the previous time is adjusted, when the expressions of all users are comfortable, the first comfortable-brightness interval can be directly used as a comfortable-brightness target interval (one form of a parameter setting target interval), and the brightness of the screen is adjusted by using the comfortable-brightness target interval based on the dichotomy; optionally, when the expression of the user is still uncomfortable after the brightness of the screen of the previous time is adjusted, the intersection of the first brightness comfort interval and the brightness comfort target interval determined in the previous time can be used as the determined brightness comfort interval;
after the brightness of the television is adjusted, the camera of the television collects the environment image again, the process is executed until no user with uncomfortable expression exists in the collected environment image, and the process is repeated when the next timing time comes.
Optionally, in the embodiment of the present invention, besides setting the correspondence between parameter intervals by using the expression and age group of the user as the user characteristics, the user characteristics may also include the user gender and/or the environmental parameters of the environment where the user is located; it should be noted that the environmental parameters may be acquired by the terminal through a sensor (e.g., acquiring environmental brightness through a photosensitive sensor connected to the terminal, and acquiring environmental noise through a decibel meter connected to the terminal), or may be acquired by the server based on network data; in an embodiment of the present invention, the gender, expression, age group of the user may be determined by facial features of the user in the environment image, and the determination of the environment parameters may rely on processing for the environment image;
optionally, fig. 10 shows another optional signaling flow of the method for adjusting the terminal setting parameter according to the embodiment of the present invention, and referring to fig. 10, the flow may include:
and step S40, the terminal acquires the environment image acquired by the image acquisition device.
And step S41, the terminal uploads the environment image to the server.
Step S42, the server identifies the expression, age group, and sex of the user used in the environment image.
Optionally, when the gender of the user in the image is identified, the gender identification method can be realized based on a gender identification algorithm of a characteristic face or based on a Fisher criterion;
alternatively, as shown in fig. 11, the gender identification algorithm based on EigenFace (EigenFace) may mainly use PCA (principal component analysis); reducing the face image of the user to a low-dimensional space by eliminating the correlation in the data, and mapping a face image sample in a training set to one point in the low-dimensional space, wherein the face image sample in the training set is marked with the user gender in advance; when the gender of a certain user needs to be judged, the face image of the user can be mapped into a preset low-dimensional space, the mapping point of the face image sample closest to the mapping point corresponding to the face image of the user is calculated, and the gender corresponding to the face image sample closest to the mapping point is assigned to the user; correspondingly, after the face area of each user in the environment image is positioned, the gender identification of each user can be realized by a gender identification algorithm based on the characteristic face based on the face area image of each user;
alternatively, as shown in fig. 12, the gender identification method based on Fisher's criterion may mainly use the idea of LDA (linear projection analysis); by collecting a plurality of male face samples and female face samples, respectively projecting each male face sample and each female face sample onto a straight line passing through an original point, and ensuring that the projection intra-class distance of the male face samples and the projection intra-class distance of the female face samples on the straight line are minimum and the inter-class distance is maximum, thereby determining a classification area for separating gender; when the gender of a certain user needs to be judged, the face image of the user can be projected onto the straight line passing through the origin to determine the position of the projection point relative to the gender-separated classification region, the gender corresponding to the position of the projection point relative to the gender-separated classification region is determined according to the preset corresponding relationship between the position of the gender-separated classification region and the gender, and the gender of the user is determined, as shown in fig. 12, the male gender corresponds to the left side of the classification region, and the female gender corresponds to the right side of the classification region; accordingly, after the face area of the user in the environment image is located, the gender identification of the user can be realized by a gender identification method based on the Fisher criterion based on the face area image of the user.
Optionally, the expression and the age bracket of the user in the environment image may be identified by referring to the foregoing description, and details are not repeated here.
And step S43, the server feeds back the expression, age bracket and gender of the user to the terminal.
And step S44, the terminal detects whether a target user with uncomfortable expression exists according to the expression of the user.
Step S45, if the target user is detected, the terminal determines a first setting parameter interval according to the corresponding relationship between the pre-stored setting parameter interval and the expression, age group, gender and environment parameters of the user, and at least by taking the expression, age group, gender and environment parameters of the target user as the user characteristics.
When the terminal judges that a target user with uncomfortable expression exists in the users, the terminal considers that the setting parameters of the terminal need to be adjusted; the corresponding relation of the embodiment of the invention records the user characteristics such as user expression, age bracket, gender and environmental parameters and the relation of the setting parameter interval, so that based on the corresponding relation, when a target user with uncomfortable expression is determined, the embodiment of the invention can determine the first setting parameter interval based on the user characteristics such as expression, age bracket, gender and environmental parameters of the target user;
optionally, when a plurality of target users are provided, the first setting parameter interval may be a union of setting parameter intervals corresponding to user characteristics, such as expression, age, gender, and environmental parameters, of each target user.
And step S46, the terminal adjusts the setting parameters of the terminal according to the first interval of the setting parameters, and the step S40 is returned.
Optionally, after adjusting the setting parameter of the terminal in the previous time, under the condition that the target user with uncomfortable expression still exists, the set parameter target interval used by adjusting the setting parameter in the previous time and the intersection of the set parameter target interval and the first interval of the set parameter may be used as the set parameter target interval of the current time, so that the setting parameter is adjusted according to the set parameter target interval of the current time.
Based on the target interval of the setting parameters, adjusting the setting parameters of the terminal may be implemented based on a dichotomy, including one or more terminal setting parameter adjustments, which may be described with reference to the corresponding parts above.
Taking the expression, sex, age group and environment brightness of the user as the characteristics of the user, and adjusting the screen brightness of the television as a scene, an application scene example of the method for adjusting the terminal setting parameters provided by the embodiment of the invention can be shown in fig. 13; as shown in connection with fig. 13, this example process may include:
the server continuously learns and adjusts the corresponding relation between the comfortable brightness interval and the user expression, gender, age bracket and environment brightness, and the television regularly updates the latest comfortable brightness interval from the server and the corresponding relation between the latest comfortable brightness interval and the user expression, gender, age bracket and environment brightness;
after a user A turns on the television, the television can trigger a camera of the television to acquire an environment image at intervals of a timing time after the expression of the user reaches a comfortable state;
the server can detect a user (user A) watching a television screen in the environment image, identify the expression and age bracket of each user and feed back the expression and age bracket to the television;
if the ambient brightness is gradually darkened from noon to night when the user A watches the television, the television can judge that the expression of the user A is not comfortable based on the expression of the user A detected by the server when the ambient brightness is darkened and the brightness of the television screen is not bright enough; at this time, the television can determine a corresponding first comfortable brightness interval based on the expression, gender, age bracket and ambient brightness of the user A;
determining a brightness comfortable target interval according to the brightness comfortable first interval; and adjusting the screen brightness of the television according to the target interval with comfortable brightness.
Based on the scheme of the terminal setting parameter adjusting method, from the terminal perspective, the terminal can update the corresponding relationship from the server, wherein the corresponding relationship comprises the setting parameter interval corresponding to each user characteristic; thus the terminal obtains the environment image; when a target user with an uncomfortable expression is detected from the environment image, acquiring a first interval of a setting parameter determined according to a pre-learned corresponding relation and the user characteristics of the target user; wherein the user characteristics include at least: user expression and age bracket; and adjusting the setting parameters of the terminal according to the first interval of the setting parameters.
For the server, the server can obtain initial setting parameter intervals corresponding to the user characteristics; the user characteristics include at least: user expression and age bracket; acquiring corresponding adjustment result data of each user; the adjustment result data includes: the user expression is in the corresponding user characteristic of the uncomfortable state, and the corresponding parameter adjustment interval which makes the user expression in the comfortable state; for any user, solving the intersection of the parameter adjusting interval corresponding to each user characteristic of the user and the corresponding initial setting parameter interval by using a machine learning method so as to obtain the setting parameter interval corresponding to each user characteristic of each user; determining a union set of setting parameter intervals corresponding to the same user characteristic of each user to obtain a corresponding relation; and when a target user with an uncomfortable expression is detected from the environment image of the terminal, determining a first setting parameter interval corresponding to the user characteristic of the target user so as to guide the adjustment of the setting parameter of the terminal.
According to the terminal setting parameter adjusting method provided by the embodiment of the invention, at least the expression and the age group determined according to the facial features of the user are used as the user features, so that when a target user with uncomfortable expressions is identified from the environment image of the terminal, the setting parameters of the terminal can be adjusted according to the pre-learned corresponding relation and the setting parameter first interval determined by the user features of the target user; therefore, the automatic adjustment of the setting parameters of the terminal is realized at least according to the expression, age and other user characteristics of the target user in the environment where the terminal is located, the convenient and intelligent terminal setting parameter adjustment of the terminal is realized, and the terminal has higher adjustment precision.
In the following, the terminal setting parameter adjusting apparatus provided in the embodiment of the present invention is introduced, and the terminal setting parameter adjusting apparatus described below may be considered as a program module that is required to be set by a terminal to implement the terminal setting parameter adjusting method provided in the embodiment of the present invention. The contents of the terminal setting parameter adjustment device described below may be referred to in correspondence with the contents of the terminal setting parameter adjustment method described above.
Fig. 14 is a block diagram of a configuration of a terminal setting parameter adjusting apparatus according to an embodiment of the present invention, where the terminal setting parameter adjusting apparatus is applicable to a terminal, and referring to fig. 14, the terminal setting parameter adjusting apparatus may include:
an environment image obtaining module 100, configured to obtain an environment image of a terminal;
a parameter setting first interval obtaining module 110, configured to, when a target user whose expression is in an uncomfortable state is detected from the environment image, obtain a parameter setting first interval determined according to a pre-learned correspondence and a user characteristic of the target user; wherein the user characteristics include at least: user expression and age bracket; the corresponding relation comprises: setting parameter intervals corresponding to the user characteristics; (ii) a
And a setting parameter adjusting module 120, configured to adjust the setting parameter of the terminal according to the setting parameter first interval.
Optionally, the setting parameter adjusting module 120 is configured to adjust the setting parameter of the terminal according to the setting parameter first interval, and specifically includes:
determining a parameter setting target interval according to the parameter setting first interval;
and selecting a parameter adjusting interval from the parameter setting target area based on the dichotomy, and adjusting the setting parameters of the terminal until the expression of the target user is in a comfortable state or the number of times of adjusting the setting parameters of the terminal reaches a preset number of times.
Optionally, the parameter setting adjustment module 120 is configured to select a parameter adjustment interval from the parameter setting target area based on a bisection method, and adjust the setting parameter of the terminal, specifically including:
starting from the parameter setting target interval serving as a reference interval, iteratively executing a first step until an iteration execution termination condition is reached;
the first step comprises: carrying out interval equalization on the reference interval to obtain a first parameter adjusting interval and a second parameter adjusting interval; adjusting the setting parameters of the terminal to be positioned in the first parameter adjusting interval and the second parameter adjusting interval respectively, and determining the expression change of the corresponding target user respectively; and if the expression of the target user is still in an uncomfortable state, selecting a parameter adjusting interval in which the expression change of the target user tends to be in a comfortable state from the first parameter adjusting interval and the second parameter adjusting interval, and taking the selected parameter adjusting interval as a reference interval.
Optionally, fig. 15 shows another structural block diagram of the terminal setting parameter adjusting apparatus according to the embodiment of the present invention, and in combination with fig. 14 and fig. 15, the terminal setting parameter adjusting apparatus may further include:
a first loop triggering module 130, configured to, if the expression of the target user is still in an uncomfortable state after the setting parameters of the terminal are adjusted according to the setting parameter target interval, enter the next time of adjusting the setting parameters of the terminal, and trigger the environmental image obtaining module 100 to perform the step of obtaining the environmental image of the terminal;
a second cycle triggering module 140, configured to, if the expression of the target user is in a comfortable state after the setting parameters of the terminal are adjusted according to the setting parameter target interval, enter the next time of adjusting the setting parameters of the terminal at a certain interval, and trigger the environmental image obtaining module 100 to perform the step of obtaining the environmental image of the terminal;
correspondingly, the setting parameter adjusting module 120 is configured to determine a setting parameter target interval according to the setting parameter first interval, and specifically includes:
after adjusting the setting parameters of the terminal according to the setting parameter target interval determined in the previous time, acquiring the setting parameter target interval determined in the previous time under the condition that the expression of the target user is still in an uncomfortable state;
and determining the intersection of the first setting parameter interval and the last determined setting parameter target interval to obtain the determined setting parameter target interval.
Optionally, after the setting parameter of the terminal is adjusted according to the target interval of the setting parameter determined in the previous time, the first interval of the setting parameter may be used as the determined target interval of the setting parameter under the condition that the expression of the target user is in a comfortable state.
Optionally, if the number of the target users is multiple, the parameter setting first interval obtaining module 110 is configured to obtain a parameter setting first interval determined according to the pre-learned correspondence and the user characteristics of the target users, and specifically includes:
acquiring user characteristics of each target user;
respectively determining the corresponding setting parameter intervals of the target users according to the corresponding relations;
and taking a union set of the setting parameter intervals corresponding to the target users to obtain the first setting parameter interval.
Optionally, in this embodiment of the present invention, the terminal setting parameter adjusting apparatus may be further configured to:
acquiring at least the expression and age bracket of the user identified from the environment image; the user comprises a user identified in the environment image or a user who is watching a terminal screen and is identified in the environment image;
and detecting whether a target user with an uncomfortable expression exists according to the expression of the user.
Correspondingly, the parameter setting first interval obtaining module 110 is configured to obtain the user characteristics of each target user, and specifically includes:
and under the condition that the target users exist and the number of the target users is multiple, at least extracting the expression and age bracket of each target user to determine the user characteristics of each target user.
Optionally, the user characteristics further include: environmental parameters of the environment in which the user is located, and/or the user's gender.
Optionally, fig. 16 shows another structural block diagram of the terminal setting parameter adjusting apparatus according to the embodiment of the present invention, and in combination with fig. 14 and fig. 16, the terminal setting parameter adjusting apparatus may further include:
a data uploading module 150, configured to, if the expression of the target user is in a comfortable state after the setting parameters of the terminal are adjusted, upload the adjustment result data to the server, so that the server updates and adjusts the corresponding relationship; the adjustment result data includes: the parameter adjusting interval and the user characteristics of the target user.
Specifically, the adjustment result data may include: the corresponding user characteristics that the user expression is in an uncomfortable state, and the corresponding parameter adjusting interval that the user expression is in a comfortable state.
In the following, the terminal setting parameter adjusting apparatus applied to the server according to the embodiment of the present invention is described, and the terminal setting parameter adjusting apparatus described below may be regarded as a program module that is required to be set by the server to implement the terminal setting parameter adjusting method according to the embodiment of the present invention. The contents of the terminal setting parameter adjustment device described below may be referred to in correspondence with the contents of the terminal setting parameter adjustment method described above.
Fig. 17 is a block diagram of another structure of a terminal setting parameter adjusting apparatus according to an embodiment of the present invention, where the terminal setting parameter adjusting apparatus is applicable to a server, and referring to fig. 17, the terminal setting parameter adjusting apparatus may include:
an initial relationship obtaining module 200, configured to obtain an initial setting parameter interval corresponding to each user characteristic; the user characteristics include at least: user expression and age bracket;
an adjustment result data obtaining module 210, configured to obtain adjustment result data corresponding to each user; the adjustment result data includes: the user expression is in the corresponding user characteristic of the uncomfortable state, and the corresponding parameter adjustment interval which makes the user expression in the comfortable state;
the learning module 220 is configured to, for any user, use a machine learning method to obtain an intersection of a parameter adjustment interval corresponding to each user feature of the user and a corresponding initial setting parameter interval, so as to obtain a setting parameter interval corresponding to each user feature of each user;
a corresponding relationship obtaining module 230, configured to determine a union of parameter setting intervals corresponding to the same user characteristic for each user, so as to obtain a corresponding relationship;
and when a target user with an uncomfortable expression is detected from the environment image of the terminal, determining a first setting parameter interval corresponding to the user characteristic of the target user so as to guide the adjustment of the setting parameter of the terminal.
Optionally, fig. 18 shows yet another structural block diagram of the terminal setting parameter adjusting apparatus according to the embodiment of the present invention, and in combination with fig. 17 and fig. 18, the terminal setting parameter adjusting apparatus may further include:
an uploaded image acquiring module 240, configured to acquire an environment image uploaded by the terminal;
a using user feature recognition module 250 for recognizing at least an expression and an age of a using user based on facial features of the using user recognized from the environment image;
optionally, the gender of the user can be further identified.
And the characteristic feedback module 260 is configured to feed back at least the expression and the age group of the user to the terminal, so that when the terminal identifies a target user with an uncomfortable expression from the users, the terminal determines, according to the corresponding relationship, a first setting parameter interval corresponding to the user characteristic of the target user, so that the terminal can adjust the setting parameter of the terminal.
The embodiment of the present invention further provides a terminal, where a hardware structure of the terminal may be as shown in fig. 19, and the terminal stores and executes a program that implements the function of the corresponding terminal setting parameter adjusting apparatus, so as to implement the execution of the terminal setting parameter adjusting method provided in the embodiment of the present invention; referring to fig. 19, the hardware structure of the terminal may include: at least one processor 1, at least one communication interface 2, at least one memory 3 and at least one communication bus 4;
in the embodiment of the present invention, the number of the processor 1, the communication interface 2, the memory 3, and the communication bus 4 is at least one, and the processor 1, the communication interface 2, and the memory 3 complete mutual communication through the communication bus 4;
optionally, the communication interface 2 may be an interface of a communication module, such as an interface of a GSM module;
the processor 1 may be a central processing unit CPU or an application Specific Integrated circuit asic or one or more Integrated circuits configured to implement embodiments of the present invention.
The memory 3 may comprise a high-speed RAM memory and may also comprise a non-volatile memory, such as at least one disk memory.
Wherein, the memorizer 3 stores the procedure, the processor 1 calls the procedure stored in the memorizer 3, in order to realize the above-mentioned terminal setting parameter adjustment method applied to terminal step;
optionally, the program may be used mainly for: acquiring an environment image of a terminal; when a target user with an uncomfortable expression is detected from the environment image, acquiring a first interval of a setting parameter determined according to a pre-learned corresponding relation and the user characteristics of the target user; wherein the user characteristics include at least: user expression and age bracket; the corresponding relation comprises: setting parameter intervals corresponding to the user characteristics; determining a parameter setting target interval according to the parameter setting first interval; and adjusting the setting parameters of the terminal according to the setting parameter target interval.
An embodiment of the present invention further provides a storage medium, where a program suitable for being executed by a processor of a terminal is recorded in the storage medium, so as to implement the steps of the terminal setting parameter adjusting method applied to the terminal.
The embodiment of the invention also provides a server, and the server stores and executes the program for realizing the corresponding function of the terminal setting parameter adjusting device so as to realize the execution of the terminal setting parameter adjusting method provided by the embodiment of the invention; the hardware structure of the server can refer to fig. 18, which are similar; optionally, the server may include: at least one memory and at least one processor, wherein the memory stores programs, and the processor executes the programs to realize the steps of the terminal setting parameter adjusting method applied to the server;
optionally, the program is mainly used for: acquiring initial setting parameter intervals corresponding to user characteristics; the user characteristics include at least: user expression and age bracket;
acquiring corresponding adjustment result data of each user; the adjustment result data includes: the user expression is in the corresponding user characteristic of the uncomfortable state, and the corresponding parameter adjustment interval which makes the user expression in the comfortable state;
for any user, solving the intersection of the parameter adjusting interval corresponding to each user characteristic of the user and the corresponding initial setting parameter interval by using a machine learning method so as to obtain the setting parameter interval corresponding to each user characteristic of each user;
determining a union set of setting parameter intervals corresponding to the same user characteristic of each user to obtain a corresponding relation;
and when a target user with an uncomfortable expression is detected from the environment image of the terminal, determining a first setting parameter interval corresponding to the user characteristic of the target user so as to guide the adjustment of the setting parameter of the terminal.
The embodiment of the invention also provides a storage medium, which is recorded with a program suitable for being executed by a processor of the server so as to realize the steps of the terminal setting parameter adjusting method applied to the server.
The embodiments in the present description are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other. The device disclosed by the embodiment corresponds to the method disclosed by the embodiment, so that the description is simple, and the relevant points can be referred to the method part for description.
Those of skill would further appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both, and that the various illustrative components and steps have been described above generally in terms of their functionality in order to clearly illustrate this interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
The steps of a method or algorithm described in connection with the embodiments disclosed herein may be embodied directly in hardware, in a software module executed by a processor, or in a combination of the two. A software module may reside in Random Access Memory (RAM), memory, Read Only Memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.
The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims (14)

1. A terminal setting parameter adjusting method is applied to a terminal, and comprises the following steps:
acquiring an environment image of a terminal;
when a target user with an uncomfortable expression is detected from the environment image, acquiring a first interval of a setting parameter determined according to a pre-learned corresponding relation and the user characteristics of the target user; wherein the user characteristics include at least: user expression and age bracket; the corresponding relation is the corresponding relation between each user characteristic and the set parameter interval; the corresponding relation is obtained in the following manner: in the parameter setting and adjusting process, acquiring user characteristics when the user is uncomfortable in expression and a parameter adjusting interval for enabling the user to be comfortable in expression, and training in combination with a machine learning process to obtain the corresponding relation;
determining a parameter setting target interval according to the parameter setting first interval, and adjusting the setting parameters of the terminal according to the parameter setting target interval;
the determining a parameter setting target interval according to the parameter setting first interval comprises: and if the expression of the target user is still in an uncomfortable state after the setting parameters of the terminal are adjusted according to the setting parameter target interval, determining the intersection of the setting parameter target interval determined in the previous time and the setting parameter first interval when the setting parameters of the terminal are adjusted in the current time, and obtaining the setting parameter target interval of the current time.
2. The method according to claim 1, wherein the adjusting the setting parameters of the terminal according to the setting parameter target interval comprises:
and selecting a parameter adjusting interval from the parameter setting target interval based on the dichotomy, and adjusting the setting parameters of the terminal until the expression of the target user is in a comfortable state or the number of times of adjusting the setting parameters of the terminal reaches a preset number of times.
3. The method according to claim 2, wherein the selecting a parameter adjustment interval from the parameter setting target area based on dichotomy comprises:
starting from the parameter setting target interval serving as a reference interval, iteratively executing a first step until an iteration execution termination condition is reached;
the first step comprises: carrying out interval equalization on the reference interval to obtain a first parameter adjusting interval and a second parameter adjusting interval; adjusting the setting parameters of the terminal to be positioned in the first parameter adjusting interval and the second parameter adjusting interval respectively, and determining the expression change of the corresponding target user respectively; and if the expression of the target user is still in an uncomfortable state, selecting a parameter adjusting interval in which the expression change of the target user tends to be in a comfortable state from the first parameter adjusting interval and the second parameter adjusting interval, and taking the selected parameter adjusting interval as a reference interval.
4. The terminal setting parameter adjusting method according to any one of claims 2-3, wherein the method further comprises:
if the expression of the target user is still in an uncomfortable state after the setting parameters of the terminal are adjusted according to the setting parameter target interval, entering the next time of adjusting the setting parameters of the terminal, and triggering and executing the step of acquiring the environment image of the terminal;
or, if the expression of the target user is in a comfortable state after the setting parameters of the terminal are adjusted according to the setting parameter target interval, the next time of adjusting the setting parameters of the terminal is entered at intervals of timing time, and the step of acquiring the environment image of the terminal is triggered and executed.
5. The method according to claim 1, wherein if the number of the target users is multiple, the obtaining of the first interval of the setting parameters determined according to the pre-learned correspondence and the user characteristics of the target users comprises:
acquiring user characteristics of each target user;
respectively determining the corresponding setting parameter intervals of the target users according to the corresponding relations;
and taking a union set of the setting parameter intervals corresponding to the target users to obtain the first setting parameter interval.
6. The method for adjusting the setting parameters of the terminal according to claim 5, wherein the method further comprises:
acquiring at least the expression and age bracket of the user identified from the environment image; the user comprises a user identified in the environment image or a user who is watching a terminal screen and is identified in the environment image;
detecting whether a target user with an uncomfortable expression exists according to the expression of the user;
the acquiring of the user characteristics of each target user includes:
and under the condition that the target users exist and the number of the target users is multiple, at least extracting the expression and age bracket of each target user to determine the user characteristics of each target user.
7. The terminal setting parameter adjusting method according to any one of claims 1-3 and 5-6, wherein the user characteristics further include: environmental parameters of the environment in which the user is located, and/or a gender of the user determined from facial features of the user.
8. The terminal setting parameter adjusting method according to any one of claims 2-3, wherein the method further comprises:
if the expression of the target user is in a comfortable state after the setting parameters of the terminal are adjusted, uploading the adjustment result data to a server so that the server updates and adjusts the corresponding relation; the adjustment result data includes: the parameter adjusting interval and the user characteristics of the target user.
9. A terminal setting parameter adjusting method is applied to a server, and comprises the following steps:
acquiring initial setting parameter intervals corresponding to user characteristics; the user characteristics include at least: user expression and age bracket;
acquiring corresponding adjustment result data of each user; the adjustment result data includes: the user expression is in the corresponding user characteristic of the uncomfortable state, and the corresponding parameter adjustment interval which makes the user expression in the comfortable state;
for any user, solving the intersection of the parameter adjusting interval corresponding to each user characteristic of the user and the corresponding initial setting parameter interval by using a machine learning method so as to obtain the setting parameter interval corresponding to each user characteristic of each user;
determining a union set of setting parameter intervals corresponding to the same user characteristic of each user to obtain a corresponding relation;
the corresponding relation is used for determining a first setting parameter interval corresponding to the user characteristic of a target user when the target user with the uncomfortable expression is detected from an environment image of the terminal, determining a setting parameter target interval, and guiding to adjust the setting parameter of the terminal according to the setting parameter target interval; the corresponding relation is the corresponding relation between each user characteristic and the set parameter interval; the corresponding relation is obtained in the following manner: in the parameter setting and adjusting process, acquiring user characteristics when the user is uncomfortable in expression and a parameter adjusting interval for enabling the user to be comfortable in expression, and training in combination with a machine learning process to obtain the corresponding relation;
the determining a parameter setting target interval according to the parameter setting first interval comprises: and if the expression of the target user is still in an uncomfortable state after the setting parameters of the terminal are adjusted according to the setting parameter target interval, determining the intersection of the setting parameter target interval determined in the previous time and the setting parameter first interval when the setting parameters of the terminal are adjusted in the current time, and obtaining the setting parameter target interval of the current time.
10. The terminal setting parameter adjusting method according to claim 9, the method further comprising:
acquiring an environment image uploaded by a terminal;
identifying at least an expression and an age group of the user according to the facial features of the user identified from the environment image;
and at least feeding back the expression and the age bracket of the user to the terminal, so that when the terminal detects a target user with an uncomfortable expression from the user, the terminal determines a first setting parameter interval according to the corresponding relation and the user characteristic of the target user, and the terminal adjusts the setting parameters of the terminal.
11. The utility model provides a terminal setting parameter adjusting device which characterized in that is applied to the terminal, terminal setting parameter adjusting device includes:
the environment image acquisition module is used for acquiring an environment image of the terminal;
a parameter setting first interval acquisition module, configured to acquire a parameter setting first interval determined according to a pre-learned correspondence and a user characteristic of a target user when the target user whose expression is in an uncomfortable state is detected from the environment image; wherein the user characteristics include at least: user expression and age bracket; the corresponding relation is the corresponding relation between each user characteristic and the set parameter interval; the corresponding relation is obtained in the following manner: in the parameter setting and adjusting process, acquiring user characteristics when the user is uncomfortable in expression and a parameter adjusting interval for enabling the user to be comfortable in expression, and training in combination with a machine learning process to obtain the corresponding relation;
the setting parameter adjusting module is used for determining a setting parameter target interval according to the setting parameter first interval and adjusting the setting parameter of the terminal according to the setting parameter target interval;
the determining a parameter setting target interval according to the parameter setting first interval comprises: and if the expression of the target user is still in an uncomfortable state after the setting parameters of the terminal are adjusted according to the setting parameter target interval, determining the intersection of the setting parameter target interval determined in the previous time and the setting parameter first interval when the setting parameters of the terminal are adjusted in the current time, and obtaining the setting parameter target interval of the current time.
12. The utility model provides a terminal setting parameter adjusting device which characterized in that is applied to the server, terminal setting parameter adjusting device includes:
the initial relation acquisition module is used for acquiring initial setting parameter intervals corresponding to the user characteristics; the user characteristics include at least: user expression and age bracket;
the adjustment result data acquisition module is used for acquiring adjustment result data corresponding to each user; the adjustment result data includes: the user expression is in the corresponding user characteristic of the uncomfortable state, and the corresponding parameter adjustment interval which makes the user expression in the comfortable state;
the learning module is used for solving the intersection of the parameter adjusting interval corresponding to each user characteristic of the user and the corresponding initial setting parameter interval by utilizing a machine learning method for any user so as to obtain the setting parameter interval corresponding to each user characteristic of each user;
a corresponding relation obtaining module, configured to determine a union of setting parameter intervals corresponding to the same user characteristic for each user, so as to obtain a corresponding relation; the corresponding relation is the corresponding relation between each user characteristic and the set parameter interval; the corresponding relation is obtained in the following manner: in the parameter setting and adjusting process, acquiring user characteristics when the user is uncomfortable in expression and a parameter adjusting interval for enabling the user to be comfortable in expression, and training in combination with a machine learning process to obtain the corresponding relation;
the corresponding relation is used for determining a first setting parameter interval corresponding to the user characteristic of a target user when the target user with the uncomfortable expression is detected from an environment image of the terminal, determining a setting parameter target interval, and guiding to adjust the setting parameter of the terminal according to the setting parameter target interval;
the determining a parameter setting target interval according to the parameter setting first interval comprises: and if the expression of the target user is still in an uncomfortable state after the setting parameters of the terminal are adjusted according to the setting parameter target interval, determining the intersection of the setting parameter target interval determined in the previous time and the setting parameter first interval when the setting parameters of the terminal are adjusted in the current time, and obtaining the setting parameter target interval of the current time.
13. A storage medium characterized in that the storage medium is recorded with a program adapted to be executed by a processor of a terminal to realize the steps of the terminal setting parameter adjusting method according to any one of claims 1 to 8.
14. A storage medium characterized in that the storage medium is recorded with a program adapted to be executed by a processor of a server to implement the steps of the terminal setting parameter adjusting method according to any one of claims 9 to 10.
CN201810408980.7A 2018-04-28 2018-04-28 Terminal setting parameter adjusting method and device and storage medium Active CN110413239B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810408980.7A CN110413239B (en) 2018-04-28 2018-04-28 Terminal setting parameter adjusting method and device and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810408980.7A CN110413239B (en) 2018-04-28 2018-04-28 Terminal setting parameter adjusting method and device and storage medium

Publications (2)

Publication Number Publication Date
CN110413239A CN110413239A (en) 2019-11-05
CN110413239B true CN110413239B (en) 2021-08-06

Family

ID=68357890

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810408980.7A Active CN110413239B (en) 2018-04-28 2018-04-28 Terminal setting parameter adjusting method and device and storage medium

Country Status (1)

Country Link
CN (1) CN110413239B (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112860046B (en) * 2019-11-27 2023-05-12 宇龙计算机通信科技(深圳)有限公司 Method, device, electronic equipment and medium for selecting operation mode
CN111930336A (en) * 2020-07-29 2020-11-13 歌尔科技有限公司 Volume adjusting method and device of audio device and storage medium
JP7369884B1 (en) 2023-04-06 2023-10-26 輝明 村上 Information processing device, information processing method, and information processing program

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103677516A (en) * 2013-11-27 2014-03-26 青岛海信电器股份有限公司 Interface generating method and device of terminal
CN104470128A (en) * 2014-12-01 2015-03-25 联想(北京)有限公司 Luminance adjusting method and electronic equipment
CN104636097A (en) * 2013-11-12 2015-05-20 广州华久信息科技有限公司 Font size adaptive adjustment method and mobile terminal based on eyes

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TW200540732A (en) * 2004-06-04 2005-12-16 Bextech Inc System and method for automatically generating animation

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104636097A (en) * 2013-11-12 2015-05-20 广州华久信息科技有限公司 Font size adaptive adjustment method and mobile terminal based on eyes
CN103677516A (en) * 2013-11-27 2014-03-26 青岛海信电器股份有限公司 Interface generating method and device of terminal
CN104470128A (en) * 2014-12-01 2015-03-25 联想(北京)有限公司 Luminance adjusting method and electronic equipment

Also Published As

Publication number Publication date
CN110413239A (en) 2019-11-05

Similar Documents

Publication Publication Date Title
US20210329208A1 (en) Illuminant estimation referencing facial color features
CN110413239B (en) Terminal setting parameter adjusting method and device and storage medium
US11113511B2 (en) Makeup evaluation system and operating method thereof
CN107122744B (en) Living body detection system and method based on face recognition
CN110235169B (en) Cosmetic evaluation system and operation method thereof
US11849998B2 (en) Method for pupil detection for cognitive monitoring, analysis, and biofeedback-based treatment and training
JP6700791B2 (en) Information processing apparatus, information processing method, and program
CN107106018B (en) Information processing apparatus, information processing method, and computer-readable storage medium
US20230206685A1 (en) Decreasing lighting-induced false facial recognition
EP3158503B1 (en) Biometric identification
US9460521B2 (en) Digital image analysis
JP2010520542A (en) Illumination detection using a classifier chain
JP7098365B2 (en) Image processing equipment, image processing methods and programs
JP5955031B2 (en) Face image authentication device
US11375133B2 (en) Automatic exposure module for an image acquisition system
CN112312210A (en) Television word size sound automatic adjustment processing method and device, intelligent terminal and medium
CN110838102A (en) Intelligent image uploading method
JP2012531652A (en) Gesture recognition using chroma key
JP2013101551A (en) Face image authentication device
CN111160299A (en) Living body identification method and device
CN107995476B (en) Image processing method and device
EP4083937A1 (en) System and method for hair analysis of user
CN111832567B (en) Blind person friendly book character reading detection interaction method
CN111353348B (en) Image processing method, device, acquisition equipment and storage medium
CN106780809B (en) Punch card method based on water purifier

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant