CN113130044B - Recipe optimization method, recipe optimization display device and computer-readable storage medium - Google Patents
Recipe optimization method, recipe optimization display device and computer-readable storage medium Download PDFInfo
- Publication number
- CN113130044B CN113130044B CN201911416664.5A CN201911416664A CN113130044B CN 113130044 B CN113130044 B CN 113130044B CN 201911416664 A CN201911416664 A CN 201911416664A CN 113130044 B CN113130044 B CN 113130044B
- Authority
- CN
- China
- Prior art keywords
- recipe
- information
- user
- read
- understanding level
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H20/00—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance
- G16H20/60—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to nutrition control, e.g. diets
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/174—Facial expression recognition
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Nutrition Science (AREA)
- Epidemiology (AREA)
- Medical Informatics (AREA)
- Primary Health Care (AREA)
- Public Health (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses a recipe optimizing method, a recipe displaying optimizing device and a computer readable storage medium, wherein the recipe optimizing method comprises the following steps: acquiring recipe information read currently by a user, facial information of the user and/or time information read by the user; generating emotion analysis information of the user based on the face information of the user; and optimizing the recipe information based on the emotion analysis information and/or the time information read by the user, and outputting optimized recipe information.
Description
Technical Field
The invention relates to an intelligent household appliance technology, in particular to a recipe optimizing method based on user interaction information, a recipe optimizing display method, a recipe optimizing display device and a computer readable storage medium.
Background
At present, the related application of the recipe making guidance is one-way output, and whether the content of the recipe meets the real requirement of a user cannot be determined. In the prior art, by adding an evaluation area in a recipe detail page, a platform is provided for a user, the user puts forward content which is not understood in the making process through comments, and operators need to pay attention to comment information at all times to determine the recipe content which needs to be optimized, so that the time cost is high and the implementation efficiency is low.
Disclosure of Invention
To solve the above technical problems, embodiments of the present invention provide a method, an apparatus, and a computer-readable storage medium for recipe optimization based on user interaction information.
The recipe optimizing method provided by the embodiment of the invention comprises the following steps:
acquiring recipe information read currently by a user, facial information of the user and/or time information read by the user;
generating emotion analysis information of the user based on the face information of the user;
and optimizing the recipe information based on the emotion analysis information and/or the time information read by the user, and outputting optimized recipe information.
As one implementation manner, the generating emotion analysis information of the user based on the face information of the user includes:
determining emotion corresponding to the face information based on the face information;
generating an understanding parameter of the recipe information based on the emotion, the understanding parameter corresponding to an understanding level of the recipe information;
and taking the recipe understanding grade corresponding to the understanding parameter as the emotion analysis information.
As an implementation manner, the recipe information currently read by the user at least includes one of the following items:
Page position information of a recipe read by a user at present and position information of a data embedded point of the recipe read by the user at present;
the time information read by the user at least comprises one of the following content items:
the residence time of the user on the page of the current recipe and the residence time of the user on the data embedded point of the current recipe.
The embodiment of the invention also provides a recipe display optimization method, which comprises the following steps:
transmitting recipe information read currently by a user, facial information of the user and/or time information read by the user;
receiving recipe optimization information obtained based on the facial information of the user corresponding to the recipe information read by the user currently and/or the time information read by the user;
and displaying the recipe optimization information.
As an implementation manner, the recipe information currently read by the user at least includes one of the following items:
page position information of a recipe read by a user at present and position information of a data embedded point of the recipe read by the user at present;
the time information read by the user at least comprises one of the following content items:
the residence time of the user on the page of the current recipe and the residence time of the user on the data embedded point of the current recipe.
As an implementation, the method further includes:
determining an understanding parameter of the recipe information based on at least one of the facial information of the user, the stay time of the user on a page of the current recipe and the stay time of the user on a data embedded point of the current recipe, wherein the understanding parameter corresponds to a recipe understanding level of the recipe information;
determining new understanding levels for the recipe information again, optimizing corresponding content points in the recipe information according to the new understanding levels, and updating the recipe information into a database;
and outputting the updated recipe information.
As an implementation manner, optimizing the corresponding content points in the recipe information according to the new understanding level includes:
determining whether the understanding parameters of the optimized recipe information are smaller than a preset value, stopping optimizing when the understanding parameters are smaller than the optimized value, and outputting updated recipe information; otherwise, optimizing the corresponding content points in the recipe information again until the understanding parameters of the optimized recipe information are smaller than the preset value.
As an implementation, the method further includes:
and determining a new understanding level for the user according to the recipe understanding level, searching recipe information corresponding to the new understanding level, and outputting the searched recipe information.
The embodiment of the invention also provides a recipe optimizing device, which comprises:
the acquisition module is used for acquiring recipe information read currently by a user, facial information of the user and/or time information read by the user;
the generating module is used for generating emotion analysis information of the user based on the facial information of the user;
the optimizing module is used for optimizing the recipe information based on the emotion analysis information and/or the time information read by the user;
and the output module is used for outputting the optimized recipe information.
As one implementation manner, the generating module comprises a determining module, a generating module,
the determining module is used for determining emotion corresponding to the face information based on the face information;
the generating module is used for generating understanding parameters of the recipe information based on the emotion, wherein the understanding parameters correspond to the understanding level of the recipe information; and taking the recipe understanding grade as the emotion analysis information.
As an implementation manner, in the obtaining module, recipe information currently read by the user includes at least one of the following items:
page position information of a recipe read by a user at present and position information of a data embedded point of the recipe read by the user at present;
In the acquisition module, the time information read by the user at least comprises one of the following content items:
the residence time of the user on the page of the current recipe and the residence time of the user on the data embedded point of the current recipe.
The embodiment of the invention also provides a device for optimizing the recipe display, which comprises the following steps:
the transmitting module is used for transmitting recipe information read currently by a user and/or time information read by the user;
the receiving module is used for receiving recipe optimization information obtained based on the facial information of the user corresponding to the recipe information read by the user currently and/or the time information read by the user;
and the display module is used for displaying the recipe optimization information.
As an implementation manner, the recipe information currently read by the user at least includes one of the following items:
page position information of a recipe read by a user at present and position information of a data embedded point of the recipe read by the user at present;
the time information read by the user at least comprises one of the following content items:
the residence time of the user on the page of the current recipe and the residence time of the user on the data embedded point of the current recipe.
As an implementation, the apparatus further includes:
A determining module, configured to determine an understanding parameter of the recipe information based on at least one of facial information of the user, a residence time of the user on a page of a current recipe, and a residence time of the user on a data embedded point of the current recipe, where the understanding parameter corresponds to a recipe understanding level of the recipe information;
the optimizing updating module is used for redefining a new understanding level for the recipe information, optimizing corresponding content points in the recipe information according to the new understanding level, and updating the recipe information into a database;
the display module is also used for outputting updated recipe information.
As an implementation manner, the determining module is further configured to determine whether the understanding parameter of the optimized recipe information is smaller than a preset value, stop optimizing when the understanding parameter is smaller than the optimizing value, and trigger the display module to display updated recipe information.
As an implementation, the apparatus further includes:
the searching module is used for determining a new understanding level for the user according to the recipe understanding level and searching recipe information corresponding to the new understanding level;
the display module is also used for outputting the searched recipe information.
The embodiments of the present invention also provide a computer readable storage medium having stored thereon a computer program which, when executed by a processor, performs the steps of the aforementioned recipe optimization and recipe presentation optimization based method.
According to the technical scheme provided by the embodiment of the invention, the facial information of the user is analyzed and the time information read by the user is combined, so that the recipe is optimized in time and efficiently in a targeted manner, and the user experience of reading the recipe is improved.
Drawings
The accompanying drawings generally illustrate, by way of example and not limitation, various embodiments discussed herein;
FIG. 1 is a flow chart of a recipe optimizing method based on user interaction information according to an embodiment of the present invention;
FIG. 2 is a flow chart of a recipe display optimization method based on user interaction information according to an embodiment of the present invention;
FIG. 3 is a schematic diagram of a system for recipe optimization based on user interaction information according to an embodiment of the present invention;
FIG. 4 is a schematic structural diagram of a recipe optimizing apparatus based on user interaction information according to an embodiment of the present invention;
FIG. 5 is a schematic diagram of a device for optimizing a recipe presentation based on user interaction information according to an embodiment of the present invention;
Fig. 6 is a schematic structural diagram of a device for optimizing a recipe display based on user interaction information according to an embodiment of the present invention.
Detailed Description
For a more complete understanding of the nature and the technical content of the embodiments of the present invention, reference should be made to the following detailed description of embodiments of the invention, taken in conjunction with the accompanying drawings, which are meant to be illustrative only and not limiting of the embodiments of the invention.
Fig. 1 is a flow chart of a recipe optimizing method based on user interaction information according to an embodiment of the present invention, as shown in fig. 1, the method includes the following steps:
step 101: and acquiring recipe information read currently by the user, facial information of the user and/or time information read by the user.
The implementation subject of the recipe optimizing method of the embodiment of the invention may be a server. Specifically, the server may receive recipe information currently read by the user, face information of the user, and time information read by the user, which are transmitted by the terminal device. The face information of the user may be picture information obtained by photographing the face of the user by the terminal device in the process of reading the recipe by the user, or may be video information obtained by recording the face of the user by the terminal device in the process of reading the recipe by the user.
In one embodiment, the recipe information currently read by the user includes at least one of the following items: page position information of a recipe currently read by a user and position information of a data embedded point of the recipe currently read by the user. For example, the page position information of the recipe currently read by the user may be page number information of the recipe currently read by the user, and position identification information of a text box, a picture and a video on the page; in the position information of the data embedded point of the recipe currently read by the user, the data embedded point mode can adopt modes such as code embedded point or visual embedded point, and the like, the behavior of the user is counted by implanting codes (code embedded point) in the recipe page or connecting the recipe page to a data access management interface (visual embedded point) of a user behavior analysis tool, and when the user clicks and plays the recipe to make a video or a dynamic picture, the counting operation of the data embedded point is triggered, so that the position information of the data embedded point of the recipe currently read by the user is acquired.
In one embodiment, the time information read by the user includes at least one of the following items: the residence time of the user on the page of the current recipe and the residence time of the user on the data embedded point of the current recipe. Here, the residence time of the user on the page of the current recipe may be counted from the page where the current recipe is displayed, until the user turns over the page, and the time length information is counted; the stay time of the user at the data embedding point of the current recipe can be from the time when the user triggers the data embedding point of the current recipe to the time when the information presentation of the data embedding point is finished, and the period of time information is counted, for example, when the user clicks the recipe to play the video (trigger the data embedding point of the current recipe) until the video playing is finished (including the user manually closes or exits the video), and the period of time can be used as the stay time of the user at the data embedding point of the current recipe.
Step 102: and generating emotion analysis information of the user based on the facial information of the user.
The server may analyze the facial information through an algorithm to generate emotion analysis information, specifically, first, the obtained facial information of the user may be classified by using a deep learning model to determine the emotion corresponding to the facial information of the user, for example, the server may train a deep learning model in advance, where the deep learning model may be obtained by using a plurality of face pictures as input and performing supervised training with the emotion of the face picture labeled in advance as standard output; for processing of face information, if the face information is carried in a picture mode, the face information can be directly used as input of the deep learning model to be classified, if the face information is carried in a picture mode, video frames in the video can be extracted in an equidistant mode, for example, video duration is 60s, each frame extraction time point can be set to be 50ms, 100ms, 150ms, 200ms and … … and the like, the position of the time point 60s of ending the video is the last frame extraction time point, after each frame extraction time point is determined, it is determined which video frames are extracted from the video as face pictures, finally, each face picture is input into the pre-trained deep learning model as input to obtain output of the deep learning model, a plurality of output results possibly containing a plurality of emotion marks are obtained through aggregation, for example, the face video of a user is input, and the obtained output is an "confused" and "dissatisfied" output result.
In one embodiment, the generating emotion analysis information of the user based on the face information of the user includes: determining emotion corresponding to the face information based on the face information; determining a recipe understanding level based on the emotion; and taking the recipe understanding grade as the emotion analysis information.
In this embodiment, the understanding levels of the recipes may be divided in advance, for example, into five levels of understanding degrees "high", "medium", "low", "very low". The expression analysis flow of the specific server may include: the face information is analyzed by an algorithm to determine the emotion expressed by the face information, e.g., the algorithm determines that the emotion expressed by the face information includes "confusion", "sadness". Next, the emotion is algorithmically mapped to a pre-divided recipe understanding level, such as: the emotion comprising "confusion" and "sad" is correspondingly understood as "low degree of understanding"; the emotion containing pleasure is corresponding to the understanding degree of high; the emotion including "happy" is corresponding to the understanding degree "high"; the emotion containing "neutrality" (e.g., approximate facile expressions) is corresponding to the degree of understanding "medium"; the emotion of "vital energy", "anger" is corresponding to the understanding degree "very low".
Step 103: and optimizing the recipe information based on the emotion analysis information and/or the time information read by the user, and outputting optimized recipe information.
Here, the recipe information is directly optimized based on the emotion analysis information, the time information read by the user, and the recipe information; alternatively, as an implementation manner, the information may be output to a background of the server, and the background of the server may optimize the recipe information based on the emotion analysis information, the time information read by the user, and the recipe information.
Specifically, the recipe can be optimized in two ways:
1. and optimizing the recipe information by using the emotion analysis information alone.
For example, two decision thresholds may be set in advance for the recipe understanding level included in the emotion analysis information, the first threshold and the second threshold, and when the recipe understanding level is determined to be lower than the first threshold, an operator may expand the recipe content corresponding to the recipe information, and may use the expanded recipe content as optimization information of the recipe; when the recipe understanding level is higher than the second threshold, the operator can reduce the recipe content corresponding to the recipe information, and the reduced recipe content is used as the optimized information of the recipe.
In this embodiment, the first threshold and the second threshold may be set by the operator, for example, the first threshold is set to "medium", and the second threshold is set to: if the data fed back by the server received by the background of the server shows that the understanding degree of the user on the recipe content is lower than the first threshold, the operator can expand the recipe content of the part, such as providing richer display content for similar recipe making step description; otherwise, if the judgment is higher than the second threshold, the user can be provided with a simplified version of recipe making guidance content, and the operator can add the updated content into the recipe database.
As an implementation manner, the embodiment of the invention supports that step information in a recipe can be replaced, namely that a single step/preset content section in the recipe is also provided with low, medium, high, higher, particularly high and other comprehension degrees, and steps with different grades are selected according to the comprehension capability of a user, such as one step is complicated, and when the comprehension capability of the user is higher than the comprehension capability of the user, a certain small step can be omitted, or a similar simplified step is selected to replace the more difficult recipe step.
2. And optimizing the recipe information by combining the time information read by the user and the emotion analysis information.
For example, if the residence time of the user on the page or the data embedded point of the current recipe is long and the expression analysis information shows that the user has a lower understanding degree of the recipe content, a more detailed recipe content is generated for the user, otherwise, if the residence time of the user on the page or the data embedded point of the current recipe is short and the expression analysis information shows that the user has a higher understanding degree of the recipe content, a simplified recipe content is generated for the user. Specifically, the stay time judgment threshold may be set according to expression analysis information, such as: firstly, regarding information contained in recipe information, a page stay time length T under a condition that a user smoothly reads the recipe can be estimated in advance, for example, a page contains 6 minutes of recipe display video, 100 words of text information can be estimated in advance to obtain that T is 7 minutes, then regarding five levels of understanding degree "high", "medium", "low" and "very low", regarding time length t=7 minutes as a reference, stay time judgment thresholds of the five levels are respectively set as follows: 6 minutes, 7 minutes, 8 minutes, 9 minutes, 10 minutes. Further illustrated below:
When expression analysis information of a user shows that the understanding degree of the user on recipe content is high, and the residence time of the user on a page or a data embedded point of a current recipe is less than 6 minutes, operators can reduce the recipe content corresponding to the recipe information, and the reduced recipe content is used as optimization information of the recipe; when the expression analysis information of the user shows that the user has a high understanding degree of the recipe content and the residence time of the user on the page or the data embedded point of the current recipe is more than 6 minutes, for example, 8.5 minutes, an operator can decide whether to optimize the recipe content or not by himself, for example, can choose not to optimize the recipe content.
For another example, when the expression analysis information of the user shows that the user has a lower understanding degree of the recipe content, and the residence time of the user on the page or the data embedded point of the current recipe is more than 9 minutes, the operator can reduce the recipe content corresponding to the recipe information, and the operator can expand the recipe content, for example, provide richer display content for similar recipe making step descriptions; when the expression analysis information of the user shows that the user's understanding degree of the recipe content is low and the residence time of the user on the page or the data embedded point of the current recipe is less than 9 minutes, for example, 7 minutes, an operator can decide whether to optimize the recipe content or not by himself, if so, the operator can choose not to optimize the recipe content.
It should be noted that, in the embodiment of the present invention, recipe optimization may be performed for each specific terminal device, or may be expanded to uniformly perform recipe optimization on a plurality of terminal devices, specifically, a server side may obtain facial information of a plurality of users for the same recipe information through a plurality of terminal devices, and determine, by using a statistical manner, an average understanding degree for a specific recipe information, so as to optimize a recipe according to the average understanding degree, and update the optimized recipe to a database for all users to download and view.
According to the embodiment of the invention, the facial information of the user is analyzed and the time information read by the user is combined, so that the recipe is optimized in time and efficiently in a targeted manner, and the user experience of reading the recipe is improved.
Fig. 2 is a flow chart of an optimization method for recipe display based on user interaction information according to an embodiment of the present invention, as shown in fig. 2, the method includes the following steps:
The implementation main body of the recipe optimizing method of the embodiment of the invention can be terminal equipment, including but not limited to mobile phones, tablet computers, notebooks and other terminal equipment. The terminal device herein may include an image collection module through which facial information of the user is collected. The recipient of the recipe information currently read by the user, the face information of the user, and the time information read by the user may be a server. Taking a terminal device as a smart phone for example, the image collection module can comprise a front-end camera of the mobile phone, when a user reads a recipe, the front-end camera can be started to collect face information of the user, and the face information of the user can be picture information obtained by photographing the face of the user in the process of reading the recipe by the user or can be video information obtained by recording the face of the user in the process of reading the recipe by the user. The smart phone can send the acquired facial information of the user together with the current reading recipe information and the reading time information of the user to the server.
In the embodiment of the invention, the recipe information currently read by the user at least comprises one of the following content items:
page position information of a recipe read by a user at present and position information of a data embedded point of the recipe read by the user at present;
the time information read by the user at least comprises one of the following content items:
the residence time of the user on the page of the current recipe and the residence time of the user on the data embedded point of the current recipe.
In the embodiment of the invention, the recipe understanding level can be determined based on at least one of the facial information of the user, the stay time of the user on the page of the current recipe and the stay time of the user on the data embedded point of the current recipe; optimizing content points with higher understanding degree urgency in recipe information according to the recipe understanding level, and updating the recipe information into a database; and outputting the updated recipe information.
Searching the recipe information matched with the understanding ability of the user for the user according to the recipe understanding level, and outputting the searched recipe information.
Specifically, the recipe can be optimized in two ways:
and optimizing the recipe information by using the emotion analysis information alone.
For example, two decision thresholds may be set in advance for the recipe understanding level included in the emotion analysis information, the first threshold and the second threshold, and when the recipe understanding level is determined to be lower than the first threshold, an operator may expand the recipe content corresponding to the recipe information, and may use the expanded recipe content as optimization information of the recipe; when the recipe understanding level is higher than the second threshold, the operator can reduce the recipe content corresponding to the recipe information, and the reduced recipe content is used as the optimized information of the recipe.
In this embodiment, the first threshold and the second threshold may be set by the operator, for example, the first threshold is set to "medium", and the second threshold is set to: if the data fed back by the server received by the background of the server shows that the understanding degree of the user on the recipe content is lower than the first threshold, the operator can expand the recipe content of the part, such as providing richer display content for similar recipe making step description; otherwise, if the judgment is higher than the second threshold, the user can be provided with a simplified version of recipe making guidance content, and the operator can add the updated content into the recipe database.
According to the embodiment of the application, the understanding level of the recipe can be determined based on the time information read by the user, and the understanding level of the user is determined according to the residence time of the user on the page or the content point, for example, the residence time of the user on the page or the data embedded point of the current recipe is short, so that the user can understand the recipe easily, the understanding level is lower, and recipe information with higher level can be recommended for the user.
And optimizing the recipe information by combining the time information read by the user and the emotion analysis information.
For example, if the residence time of the user on the page or the data embedded point of the current recipe is long and the expression analysis information shows that the user has a lower understanding degree of the recipe content, a more detailed recipe content is generated for the user, otherwise, if the residence time of the user on the page or the data embedded point of the current recipe is short and the expression analysis information shows that the user has a higher understanding degree of the recipe content, a simplified recipe content is generated for the user. Specifically, the stay time judgment threshold may be set according to expression analysis information, such as: firstly, regarding information contained in recipe information, a page stay time length T under a condition that a user smoothly reads the recipe can be estimated in advance, for example, a page contains 6 minutes of recipe display video, 100 words of text information can be estimated in advance to obtain that T is 7 minutes, then regarding five levels of understanding degree "high", "medium", "low" and "very low", regarding time length t=7 minutes as a reference, stay time judgment thresholds of the five levels are respectively set as follows: 6 minutes, 7 minutes, 8 minutes, 9 minutes, 10 minutes. Further illustrated below:
When expression analysis information of a user shows that the understanding degree of the user on recipe content is high, and the residence time of the user on a page or a data embedded point of a current recipe is less than 6 minutes, operators can reduce the recipe content corresponding to the recipe information, and the reduced recipe content is used as optimization information of the recipe; when the expression analysis information of the user shows that the user has a high understanding degree of the recipe content and the residence time of the user on the page or the data embedded point of the current recipe is more than 6 minutes, for example, 8.5 minutes, an operator can decide whether to optimize the recipe content or not by himself, for example, can choose not to optimize the recipe content.
For another example, when the expression analysis information of the user shows that the user has a lower understanding degree of the recipe content, and the residence time of the user on the page or the data embedded point of the current recipe is more than 9 minutes, the operator can reduce the recipe content corresponding to the recipe information, and the operator can expand the recipe content, for example, provide richer display content for similar recipe making step descriptions; when the expression analysis information of the user shows that the user's understanding degree of the recipe content is low and the residence time of the user on the page or the data embedded point of the current recipe is less than 9 minutes, for example, 7 minutes, an operator can decide whether to optimize the recipe content or not by himself, if so, the operator can choose not to optimize the recipe content.
It should be noted that, in the embodiment of the present invention, recipe optimization may be performed for each specific terminal device, or may be expanded to uniformly perform recipe optimization on a plurality of terminal devices, specifically, a server side may obtain facial information of a plurality of users for the same recipe information through a plurality of terminal devices, and determine, by using a statistical manner, an average understanding degree for a specific recipe information, so as to optimize a recipe according to the average understanding degree, and update the optimized recipe to a database for all users to download and view.
After the specific generation of the recipe optimization information, the terminal device may download the recipe optimization information from the database.
And 203, displaying the recipe optimization information.
In one embodiment, the display mode of the recipe optimization information at least comprises one of the following content items: video, audio, motion picture, still picture. Here, the recipe optimization information may be presented based on any information carrier of text, pictures, video, audio, etc.
In the embodiment of the invention, the terminal equipment timely feeds back the time information read by the user, the recipe information and the facial information of the user to the server, and based on the information, operators can realize targeted timely and efficient optimization of the recipes, thereby improving the user experience of reading the recipes.
Example 1
Fig. 3 is a schematic structural diagram of a system for optimizing a recipe based on user interaction information according to an embodiment of the present invention, where, as shown in fig. 3, the system includes a terminal device and a software end.
Wherein, the terminal equipment includes: a specific image collecting module, an external or self-contained auxiliary display module can be provided with a bracket for assisting reading and watching. The main function of the image collecting module is to monitor facial expression data of a user and upload the facial expression data into the cloud algorithm model, wherein the data can also comprise time point information; here, the external or self-contained auxiliary display module can be a screen display structure of the local machine or external electronic equipment with a screen, and can also be paper with relevant positioning information.
The software end comprises a cloud algorithm model and an operation background. The cloud algorithm model uses a time point as a reference, and analyzes emotion changes when a user reads the content at the time point by combining information such as facial expression data, content position data, stay time and the like of the user uploaded by the terminal equipment, so that the understanding degree of the user on the content point is judged. After receiving the data, the operation background feeds back the data to operators, and the operators optimize the recipe content according to the data information.
The specific implementation flow of the recipe optimizing system provided by the embodiment of the present invention may be implemented by referring to the flow of the recipe optimizing method, which is not described herein.
Fig. 4 is a schematic structural diagram of a recipe optimizing apparatus based on user interaction information according to an embodiment of the present invention, and as shown in fig. 4, a recipe optimizing apparatus 400 includes:
an obtaining module 401, configured to obtain recipe information currently read by a user, facial information of the user, and/or time information read by the user;
a generating module 402, configured to generate emotion analysis information of a user based on face information of the user;
an optimizing module 403, configured to optimize the recipe information based on the emotion analysis information and/or time information read by the user;
and an output module 404 for outputting the optimized recipe information.
In one embodiment, the generation module 402 includes a determination module, a generation module,
the determining module is used for determining emotion corresponding to the face information based on the face information;
the generating module is used for generating understanding parameters of the recipe information based on the emotion, wherein the understanding parameters correspond to the understanding level of the recipe information; and taking the recipe understanding grade as the emotion analysis information. .
In one embodiment, the obtaining module 401 includes at least one of the following items of recipe information that the user currently reads: page position information of a recipe currently read by a user and position information of a data embedded point of the recipe currently read by the user.
In one embodiment, the obtaining module 401 includes at least one of the following items of time information read by the user: the residence time of the user on the page of the current recipe and the residence time of the user on the data embedded point of the current recipe.
According to the embodiment of the invention, the facial information of the user is analyzed and the time information read by the user is combined, so that the recipe is optimized in time and efficiently in a targeted manner, and the user experience of reading the recipe is improved.
Those skilled in the art will appreciate that the implementation functions of the modules in the recipe optimizing apparatus 400 shown in fig. 4 can be understood with reference to the relevant description of the recipe optimizing method. The functions of the modules in the recipe optimizing apparatus 400 shown in fig. 4 may be implemented by a program running on a processor or by specific logic circuits.
Fig. 5 is a schematic structural diagram of a recipe optimizing apparatus based on user interaction information according to an embodiment of the present invention, and as shown in fig. 5, a recipe optimizing apparatus 500 includes:
A sending module 501, configured to send recipe information currently read by a user, facial information of the user, and/or time information read by the user;
a receiving module 502, configured to receive recipe optimization information obtained based on recipe information currently read by the user and face information of the user, and/or time information read by the user;
and the display module 503 is configured to output the recipe optimization information.
The recipe information currently read by the user at least comprises one of the following content items:
page position information of a recipe read by a user at present and position information of a data embedded point of the recipe read by the user at present;
the time information read by the user at least comprises one of the following content items:
the residence time of the user on the page of the current recipe and the residence time of the user on the data embedded point of the current recipe.
On the basis of the apparatus for recipe presentation optimization based on user interaction information shown in fig. 5, the apparatus further includes:
a determining module (not shown in fig. 5) for determining a recipe understanding level based on at least one of the user's facial information, a user's residence time in a page of a current recipe, a user's residence time in a data burial point of the current recipe;
An optimization updating module (not shown in fig. 5) is configured to re-determine a new understanding level for the recipe information, optimize corresponding content points in the recipe information according to the new understanding level, and update the recipe information to a database.
The determining module is further configured to determine whether the understanding parameter of the optimized recipe information is smaller than a preset value, stop optimizing when the understanding parameter is smaller than the optimizing value, and trigger the displaying module 503 to display the updated recipe information.
On the basis of the apparatus for recipe optimization based on user interaction information shown in fig. 5, the apparatus further comprises:
a search module (not shown in fig. 5) for determining a new understanding level for the user according to the recipe understanding level, searching recipe information corresponding to the new understanding level;
the display module 503 is further configured to display the searched recipe information.
In one embodiment, in the display module 503, the display manner of the recipe optimization information includes at least one of the following items: video, moving picture, still picture.
In the embodiment of the invention, the terminal equipment timely feeds back the time information read by the user, the recipe information and the facial information of the user to the server, and based on the information, operators can realize targeted timely and efficient optimization of the recipes, thereby improving the user experience of reading the recipes.
Those skilled in the art will appreciate that the implementation functions of the modules in the recipe optimizing apparatus 500 shown in fig. 5 can be understood with reference to the relevant description of the recipe optimizing method. The functions of the modules in the recipe optimizing apparatus 500 shown in fig. 5 may be implemented by a program running on a processor or by specific logic circuits.
Fig. 6 is a schematic structural diagram of a recipe optimizing apparatus according to an embodiment of the present invention, and the recipe optimizing apparatus 600 shown in fig. 6 is provided on the terminal, and includes: at least one processor 601, memory 402, a user interface 603, at least one network interface 604. The various components in recipe optimized apparatus 600 are coupled together by bus system 605. It is understood that the bus system 605 is used to enable connected communications between these components. The bus system 605 includes a power bus, a control bus, and a status signal bus in addition to a data bus. But for clarity of illustration the various buses are labeled as bus system 605 in fig. 6.
The user interface 603 may include, among other things, a display, keyboard, mouse, trackball, click wheel, keys, buttons, touch pad, or touch screen, etc.
The memory 602 in embodiments of the present invention is used to store various types of data to support the operation of the recipe optimized apparatus 600. Examples of such data include: any computer programs for operating on recipe optimized apparatus 600, such as operating system 6021 and application 6022; the operating system 6021 contains various system programs, such as a framework layer, a core library layer, a driver layer, and the like, for implementing various basic services and processing hardware-based tasks. The application 6022 may contain various applications for implementing various application services. The program for implementing the method of the embodiment of the present invention may be included in the application 6022.
The method disclosed in the above embodiment of the present invention may be applied to the processor 601 or implemented by the processor 601. The processor 601 may be an integrated circuit chip with signal processing capabilities. In implementation, the steps of the above method may be performed by integrated logic circuits of hardware in the processor 601 or instructions in the form of software. The processor 601 may be a general purpose processor, a digital signal processor, or other programmable logic device, discrete gate or transistor logic device, discrete hardware components, or the like. Processor 601 may implement or perform the methods, steps and logic blocks disclosed in embodiments of the present invention. The general purpose processor may be a microprocessor or any conventional processor or the like. The steps of the method disclosed in the embodiment of the invention can be directly embodied in the hardware of the decoding processor or can be implemented by combining hardware and software modules in the decoding processor. The software modules may be located in a storage medium in the memory 602 and the processor 601 reads information in the memory 602 and in combination with its hardware performs the steps of the method as described above.
It is to be appreciated that the memory 602 can be either volatile memory or nonvolatile memory, and can include both volatile and nonvolatile memory. Wherein the nonvolatile Memory may be a Read Only Memory (ROM), a programmable Read Only Memory (PROM, programmable Read-Only Memory), a comment-ready programmable Read Only Memory (EPROM, erasable Programmable Read-Only Memory), an electrically comment-ready programmable Read Only Memory (EEPROM, electrically Erasable Programmable Read-Only Memory), a magnetic random access Memory (FRAM, ferromagnetic random access Memory), a Flash Memory (Flash Memory), a magnetic surface Memory, an optical disk, or a compact disk-Only (CD-ROM, compact Disc Read-Only Memory); the magnetic surface memory may be a disk memory or a tape memory. The volatile memory may be random access memory (RAM, random Access Memory), which acts as external cache memory. By way of example, and not limitation, many forms of RAM are available, such as static random access memory (SRAM, static Random Access Memory), synchronous static random access memory (SSRAM, synchronous Static Random Access Memory), dynamic random access memory (DRAM, dynamic Random Access Memory), synchronous dynamic random access memory (SDRAM, synchronous Dynamic Random Access Memory), double data rate synchronous dynamic random access memory (ddr SDRAM, double Data Rate Synchronous Dynamic Random Access Memory), enhanced synchronous dynamic random access memory (ESDRAM, enhanced Synchronous Dynamic Random Access Memory), synchronous link dynamic random access memory (SLDRAM, syncLink Dynamic Random Access Memory), direct memory bus random access memory (DRRAM, direct Rambus Random Access Memory). The memory 602 described in embodiments of the invention is intended to comprise, without being limited to, these and any other suitable types of memory.
Based on the information interaction method provided by the embodiments of the present application, the present application further provides a computer readable storage medium, referring to fig. 6, where the computer readable storage medium may include: a memory 602 for storing a computer program executable by the processor 601 of the recipe optimizing apparatus 600 to perform the steps of the method as described above. The computer readable storage medium may be FRAM, ROM, PROM, EPROM, EEPROM, flash Memory, magnetic surface Memory, optical disk, or CD-ROM.
It should be noted that: the technical schemes described in the embodiments of the present invention may be arbitrarily combined without any collision.
The foregoing description is only of the preferred embodiments of the present invention, and is not intended to limit the scope of the invention, but rather is intended to cover any equivalents of the structures or equivalent processes disclosed herein or in the alternative, which may be employed directly or indirectly in other related arts.
Claims (11)
1. A method of recipe optimization, comprising:
acquiring recipe information read currently by a user, facial information of the user corresponding to the recipe information read currently by the user, and time information read by the user corresponding to the recipe information read currently by the user; wherein the recipe information currently read by the user at least comprises one of the following items: page position information of a recipe read by a user at present and position information of a data embedded point of the recipe read by the user at present; the time information read by the user at least comprises one of the following content items: the residence time of the user on the page of the current recipe and the residence time of the user on the data embedded point of the current recipe;
Determining emotion corresponding to the face information based on the face information of the user;
generating a recipe understanding level for the recipe information based on the emotion;
taking the recipe understanding level as emotion analysis information;
and optimizing the recipe information based on the emotion analysis information and the time information read by the user, and outputting optimized recipe information.
2. A method of recipe presentation optimization comprising:
transmitting recipe information read currently by a user, facial information of the user corresponding to the recipe information read currently by the user, and time information read by the user corresponding to the recipe information read currently by the user; wherein the recipe information currently read by the user at least comprises one of the following items: page position information of a recipe read by a user at present and position information of a data embedded point of the recipe read by the user at present; the time information read by the user at least comprises one of the following content items: the residence time of the user on the page of the current recipe and the residence time of the user on the data embedded point of the current recipe;
receiving recipe optimization information obtained based on the facial information of the user corresponding to the recipe information read by the user currently and the time information read by the user; determining a recipe understanding level of the recipe information based on the facial information of the user and the time information read by the user, and optimizing the recipe information according to the recipe understanding level;
And displaying the recipe optimization information.
3. The method according to claim 2, wherein the method further comprises:
re-determining a new recipe understanding level for the recipe information, optimizing corresponding content points in the recipe information according to the new recipe understanding level, and updating the recipe information into a database;
and outputting the updated recipe information.
4. A method according to claim 3, wherein said optimizing the respective content points in the recipe information according to the new recipe understanding level comprises:
determining whether the recipe understanding level of the optimized recipe information is smaller than a preset value, stopping optimizing when the recipe understanding level is smaller than the optimized value, and outputting updated recipe information; otherwise, optimizing the corresponding content points in the recipe information again until the recipe understanding level of the optimized recipe information is smaller than a preset value.
5. A method according to claim 3, characterized in that the method further comprises:
and determining a new recipe understanding level for the user according to the recipe understanding level, searching recipe information corresponding to the new recipe understanding level, and outputting the searched recipe information.
6. A recipe optimizing apparatus, comprising:
the acquisition module is used for acquiring the current reading recipe information of the user, the facial information of the user corresponding to the current reading recipe information of the user and the reading time information of the user corresponding to the current reading recipe information of the user; wherein the recipe information currently read by the user at least comprises one of the following items: page position information of a recipe read by a user at present and position information of a data embedded point of the recipe read by the user at present; the time information read by the user at least comprises one of the following content items: the residence time of the user on the page of the current recipe and the residence time of the user on the data embedded point of the current recipe;
a determining module, configured to determine, based on face information of the user, a mood corresponding to the face information;
a generation module for generating a recipe understanding level for the recipe information based on the emotion; taking the recipe understanding level as emotion analysis information;
the optimizing module is used for optimizing the recipe information based on the emotion analysis information and the time information read by the user;
and the output module is used for outputting the optimized recipe information.
7. An apparatus for recipe presentation optimization, comprising:
the device comprises a transmitting module, a receiving module and a receiving module, wherein the transmitting module is used for transmitting recipe information read currently by a user, facial information of the user corresponding to the recipe information read currently by the user and time information read by the user corresponding to the recipe information read currently by the user; wherein the recipe information currently read by the user at least comprises one of the following items: page position information of a recipe read by a user at present and position information of a data embedded point of the recipe read by the user at present; the time information read by the user at least comprises one of the following content items: the residence time of the user on the page of the current recipe and the residence time of the user on the data embedded point of the current recipe;
the receiving module is used for receiving recipe optimization information obtained based on the facial information of the user corresponding to the recipe information read by the user currently and the time information read by the user;
a determining module, configured to determine a recipe understanding level for the recipe information based on the face information of the user and time information read by the user;
the optimizing updating module is used for optimizing the recipe information according to the recipe understanding level;
And the display module is used for displaying the recipe optimization information.
8. The apparatus of claim 7, wherein the apparatus further comprises:
the optimizing updating module is further used for redefining a new recipe understanding level for the recipe information, optimizing corresponding content points in the recipe information according to the new recipe understanding level, and updating the recipe information into a database;
the display module is also used for outputting updated recipe information.
9. The apparatus of claim 8, wherein the determining module is further configured to determine whether a recipe understanding level of the optimized recipe information is less than a preset value, and stop optimizing when the recipe understanding level is less than the preset value, and trigger the display module to display updated recipe information.
10. The apparatus of claim 8, wherein the apparatus further comprises:
the searching module is used for determining a new recipe understanding level for a user according to the recipe understanding level and searching recipe information corresponding to the new recipe understanding level;
the display module is also used for outputting the searched recipe information.
11. A computer readable storage medium having stored thereon a computer program, characterized in that the computer program, when being executed by a processor, implements the method of recipe optimization as claimed in claim 1 or the steps of the method of recipe presentation optimization as claimed in any one of claims 2 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911416664.5A CN113130044B (en) | 2019-12-31 | 2019-12-31 | Recipe optimization method, recipe optimization display device and computer-readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911416664.5A CN113130044B (en) | 2019-12-31 | 2019-12-31 | Recipe optimization method, recipe optimization display device and computer-readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113130044A CN113130044A (en) | 2021-07-16 |
| CN113130044B true CN113130044B (en) | 2023-06-20 |
Family
ID=76769172
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911416664.5A Active CN113130044B (en) | 2019-12-31 | 2019-12-31 | Recipe optimization method, recipe optimization display device and computer-readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113130044B (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107978355A (en) * | 2017-10-30 | 2018-05-01 | 珠海格力电器股份有限公司 | Recipe recommendation method and device and range hood |
| CN108121744A (en) * | 2016-11-30 | 2018-06-05 | 佛山市顺德区美的电热电器制造有限公司 | Recipe method for pushing and recipe supplying system |
| CN108648802A (en) * | 2018-05-15 | 2018-10-12 | 四川斐讯信息技术有限公司 | A kind of recipe recommendation method and system |
| US10360254B1 (en) * | 2016-03-24 | 2019-07-23 | Massachusetts Mutual Life Insurance Company | Intelligent and context aware reading systems |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2008269588A (en) * | 2007-03-29 | 2008-11-06 | Matsushita Electric Ind Co Ltd | Recognition device, recognition method, and recognition program |
-
2019
- 2019-12-31 CN CN201911416664.5A patent/CN113130044B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10360254B1 (en) * | 2016-03-24 | 2019-07-23 | Massachusetts Mutual Life Insurance Company | Intelligent and context aware reading systems |
| CN108121744A (en) * | 2016-11-30 | 2018-06-05 | 佛山市顺德区美的电热电器制造有限公司 | Recipe method for pushing and recipe supplying system |
| CN107978355A (en) * | 2017-10-30 | 2018-05-01 | 珠海格力电器股份有限公司 | Recipe recommendation method and device and range hood |
| CN108648802A (en) * | 2018-05-15 | 2018-10-12 | 四川斐讯信息技术有限公司 | A kind of recipe recommendation method and system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113130044A (en) | 2021-07-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109325097B (en) | Voice guide method and device, electronic equipment and storage medium | |
| CN106155686B (en) | Interface generation method, device and system | |
| EP2980758B1 (en) | Method and device for providing image | |
| US8655889B2 (en) | Autonomous mobile blogging | |
| US20180085928A1 (en) | Robot, robot control method, and robot system | |
| CN110598576A (en) | Sign language interaction method and device and computer medium | |
| CN104035995B (en) | Group's label generating method and device | |
| CN105659325B (en) | Visual media item modification based on correlation | |
| CN110719525A (en) | Bullet screen expression package generation method, electronic equipment and readable storage medium | |
| CN109871807B (en) | Face image processing method and device | |
| CN109257645A (en) | Video cover generation method and device | |
| KR20090097891A (en) | Controlling a document based on user behavioral signals detected from a 3d captured image stream | |
| CN105009113A (en) | Queryless search based on context | |
| CN106325228B (en) | Method and device for generating control data of robot | |
| CN109254669A (en) | A kind of expression picture input method, device, electronic equipment and system | |
| CN111258435A (en) | Multimedia resource commenting method and device, electronic equipment and storage medium | |
| CN111158924B (en) | Content sharing method and device, electronic equipment and readable storage medium | |
| US20180349686A1 (en) | Method For Pushing Picture, Mobile Terminal, And Storage Medium | |
| US20190251355A1 (en) | Method and electronic device for generating text comment about content | |
| KR102301231B1 (en) | Method and device for providing image | |
| CN111008267B (en) | Intelligent dialogue method and related equipment | |
| CN110728981A (en) | Interactive function execution method and device, electronic equipment and storage medium | |
| CN113130044B (en) | Recipe optimization method, recipe optimization display device and computer-readable storage medium | |
| CN117352132A (en) | Psychological coaching method, device, equipment and storage medium | |
| CN116974676A (en) | Page content sending method, device and equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |