CN113130044A - Recipe optimization method, optimized display method, device and computer-readable storage medium - Google Patents
Recipe optimization method, optimized display method, device and computer-readable storage medium Download PDFInfo
- Publication number
- CN113130044A CN113130044A CN201911416664.5A CN201911416664A CN113130044A CN 113130044 A CN113130044 A CN 113130044A CN 201911416664 A CN201911416664 A CN 201911416664A CN 113130044 A CN113130044 A CN 113130044A
- Authority
- CN
- China
- Prior art keywords
- recipe
- information
- user
- understanding
- read
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H20/00—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance
- G16H20/60—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to nutrition control, e.g. diets
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/174—Facial expression recognition
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Nutrition Science (AREA)
- Epidemiology (AREA)
- Medical Informatics (AREA)
- Primary Health Care (AREA)
- Public Health (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses a recipe optimization method, a recipe display optimization method, a device and a computer readable storage medium, wherein the recipe optimization method comprises the following steps: acquiring current recipe information read by a user, face information of the user and/or time information read by the user; generating emotion analysis information of the user based on the face information of the user; optimizing the recipe information based on the emotion analysis information and/or the time information read by the user, and outputting optimized recipe information.
Description
Technical Field
The invention relates to an intelligent household appliance technology, in particular to a recipe optimization method based on user interaction information, a recipe optimization display method and device and a computer readable storage medium.
Background
At present, the related application of recipe making guidance is unidirectional output, and whether the content of the recipe meets the real requirement of a user cannot be determined. In the prior art, a comment area is added in a recipe detail page to provide a platform for a user, the user proposes content which is not understood in the production process through comments, and an operator needs to pay attention to comment information all the time to determine the recipe content which needs to be optimized, so that the time cost which needs to be paid is high, and the implementation efficiency is low.
Disclosure of Invention
To solve the foregoing technical problem, embodiments of the present invention provide a method, an apparatus, and a computer-readable storage medium for recipe optimization based on user interaction information.
The method for optimizing the recipe provided by the embodiment of the invention comprises the following steps:
acquiring current recipe information read by a user, face information of the user and/or time information read by the user;
generating emotion analysis information of the user based on the face information of the user;
optimizing the recipe information based on the emotion analysis information and/or the time information read by the user, and outputting optimized recipe information.
As one implementation, the generating emotion analysis information of the user based on the face information of the user includes:
determining an emotion corresponding to the face information based on the face information;
generating an understanding parameter of the recipe information based on the emotion, the understanding parameter corresponding to an understanding level of the recipe information;
and taking the recipe understanding grade corresponding to the understanding parameter as the emotion analysis information.
As an implementation manner, the recipe information currently read by the user includes at least one of the following items:
the method comprises the steps of obtaining page position information of a recipe currently read by a user and position information of a data buried point of the recipe currently read by the user;
the time information read by the user at least comprises one of the following items:
the dwell time of the user on the page of the current recipe and the dwell time of the user on the data embedding point of the current recipe.
The embodiment of the invention also provides a recipe display optimization method, which comprises the following steps:
sending the current recipe information read by the user, the face information of the user and/or the reading time information of the user;
receiving recipe optimization information obtained based on the face information of the user corresponding to the recipe information read by the user currently and/or the time information read by the user;
and displaying the recipe optimization information.
As an implementation manner, the recipe information currently read by the user includes at least one of the following items:
the method comprises the steps of obtaining page position information of a recipe currently read by a user and position information of a data buried point of the recipe currently read by the user;
the time information read by the user at least comprises one of the following items:
the dwell time of the user on the page of the current recipe and the dwell time of the user on the data embedding point of the current recipe.
As an implementation, the method further comprises:
determining an understanding parameter of the recipe information based on at least one of the face information of the user, the staying time of the user on a page of the current recipe, and the staying time of the user on a data buried point of the current recipe, wherein the understanding parameter corresponds to a recipe understanding grade of the recipe information;
re-determining a new understanding level for the recipe information, optimizing corresponding content points in the recipe information according to the new understanding level, and updating the recipe information into a database;
and outputting the updated recipe information.
As an implementation manner, optimizing the corresponding content points in the recipe information according to the new understanding level includes:
determining whether the understanding parameter of the optimized recipe information is smaller than a preset value or not, stopping optimization when the understanding parameter is smaller than the optimized value, and outputting updated recipe information; otherwise, optimizing the corresponding content points in the recipe information again until the understanding parameters of the optimized recipe information are smaller than the preset value.
As an implementation, the method further comprises:
and determining a new understanding level for the user according to the recipe understanding level, searching the recipe information corresponding to the new understanding level, and outputting the searched recipe information.
The embodiment of the invention also provides a device for optimizing recipes, which comprises the following components:
the acquisition module is used for acquiring the current recipe information read by the user, the face information of the user and/or the reading time information of the user;
the generating module is used for generating emotion analysis information of the user based on the face information of the user;
the optimization module is used for optimizing the recipe information based on the emotion analysis information and/or the time information read by the user;
and the output module is used for outputting the optimized recipe information.
The generating module includes, as one implementation manner, a determining module, a generating module,
the determining module is used for determining the emotion corresponding to the face information based on the face information;
the generation module is used for generating an understanding parameter of the recipe information based on the emotion, and the understanding parameter corresponds to an understanding level of the recipe information; and taking the recipe understanding grade as the emotion analysis information.
As an implementation manner, in the obtaining module, the recipe information currently read by the user includes at least one of the following items:
the method comprises the steps of obtaining page position information of a recipe currently read by a user and position information of a data buried point of the recipe currently read by the user;
in the acquisition module, the time information read by the user at least comprises one of the following content items:
the dwell time of the user on the page of the current recipe and the dwell time of the user on the data embedding point of the current recipe.
The embodiment of the invention also provides a device for recipe display optimization, which comprises:
the sending module is used for sending the current recipe information read by the user and/or the time information read by the user;
the receiving module is used for receiving recipe optimization information obtained based on the face information of the user corresponding to the recipe information read by the user currently and/or the time information read by the user;
and the display module is used for displaying the recipe optimization information.
As an implementation manner, the recipe information currently read by the user includes at least one of the following items:
the method comprises the steps of obtaining page position information of a recipe currently read by a user and position information of a data buried point of the recipe currently read by the user;
the time information read by the user at least comprises one of the following items:
the dwell time of the user on the page of the current recipe and the dwell time of the user on the data embedding point of the current recipe.
As an implementation, the apparatus further comprises:
a determining module, configured to determine an understanding parameter of the recipe information based on at least one of the facial information of the user, a staying time of the user on a page of a current recipe, and a staying time of the user on a data buried point of the current recipe, where the understanding parameter corresponds to a recipe understanding level of the recipe information;
the optimization updating module is used for determining a new understanding level for the recipe information again, optimizing corresponding content points in the recipe information according to the new understanding level and updating the recipe information into a database;
the display module is also used for outputting the updated recipe information.
As an implementation manner, the determining module is further configured to determine whether an understanding parameter of the optimized recipe information is smaller than a preset value, and stop the optimization when the understanding parameter is smaller than an optimized value, and trigger the displaying module to display the updated recipe information.
As an implementation, the apparatus further comprises:
the search module is used for determining a new understanding grade for the user according to the recipe understanding grade and searching the recipe information corresponding to the new understanding grade;
the display module is also used for outputting the searched recipe information.
Embodiments of the present invention further provide a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the steps of the aforementioned method based on recipe optimization and recipe display optimization.
According to the technical scheme of the embodiment of the invention, the face information of the user is analyzed and the time information read by the user is combined, so that the recipe is optimized timely and efficiently in a targeted manner, and the user experience of reading the recipe is improved.
Drawings
The accompanying drawings generally illustrate, by way of example and not by way of limitation, various embodiments discussed herein;
fig. 1 is a schematic flowchart of a recipe optimization method based on user interaction information according to an embodiment of the present invention;
fig. 2 is a schematic flowchart of a recipe display optimization method based on user interaction information according to an embodiment of the present invention;
fig. 3 is a schematic structural diagram of a system for recipe optimization based on user interaction information according to an embodiment of the present invention;
fig. 4 is a schematic structural diagram of an apparatus for recipe optimization based on user interaction information according to an embodiment of the present invention;
fig. 5 is a schematic structural diagram of an apparatus for recipe display optimization based on user interaction information according to an embodiment of the present invention;
fig. 6 is a schematic structural diagram of an apparatus for recipe display optimization based on user interaction information according to an embodiment of the present invention.
Detailed Description
So that the manner in which the features and aspects of the embodiments of the present invention can be understood in detail, a more particular description of the embodiments of the invention, briefly summarized above, may be had by reference to the embodiments, some of which are illustrated in the appended drawings.
Fig. 1 is a schematic flowchart of a method for optimizing a recipe based on user interaction information according to an embodiment of the present invention, as shown in fig. 1, the method includes the following steps:
step 101: acquiring the current recipe information read by the user, the face information of the user and/or the reading time information of the user.
The implementation subject of the recipe optimization method of the embodiment of the present invention may be a server. Specifically, the server may receive recipe information currently read by the user, face information of the user, and time information read by the user, which are transmitted by the terminal device. The face information of the user may be picture information obtained by photographing the face of the user by the terminal device in the process of reading the recipe by the user, or video information obtained by recording the face of the user by the terminal device in the process of reading the recipe by the user.
In one embodiment, the recipe information currently read by the user includes at least one of the following items: the method comprises the following steps of obtaining the page position information of the current recipe read by the user and the position information of the data buried point of the current recipe read by the user. For example, the page position information of the recipe currently read by the user may be page number information of the recipe currently read by the user, and position identification information of a text box, a picture, and a video on the page; in the position information of the data buried point of the recipe currently read by the user, the data buried point mode can be a code buried point mode or a visual buried point mode, the user behavior is counted by embedding codes (code buried points) in a recipe page or connecting the recipe page with a data access management interface (visual buried points) of a user behavior analysis tool, and when the user clicks and plays a recipe to make a video or a dynamic picture, the counting operation of the data buried point is triggered, so that the required position information of the data buried point of the recipe currently read by the user is obtained.
In one embodiment, the time information read by the user includes at least one of the following items: the dwell time of the user on the page of the current recipe and the dwell time of the user on the data embedding point of the current recipe. Here, the staying time of the user on the page of the current recipe may be counted from the beginning of displaying the page of the current recipe until the page turning operation of the user is ended, and the period of time information is counted; the staying time of the user at the data burying point of the current recipe can be counted from the data burying point of the current recipe triggered by the user until the information display of the data burying point is finished, for example, when the user clicks the recipe to play the video (the data burying point of the current recipe is triggered) until the video is played (including the user manually closing or quitting the video), the staying time can be used as the staying time of the user at the data burying point of the current recipe.
Step 102: generating emotion analysis information of the user based on the face information of the user.
The server can analyze the facial information through an algorithm to generate emotion analysis information, specifically, firstly, a deep learning model can be used to classify the acquired facial information of the user to judge the emotion corresponding to the facial information of the user, for example, the server can train a deep learning model in advance, the deep learning model can adopt a plurality of facial pictures as input, and the emotion of the pre-labeled facial pictures is used as standard output to perform supervised training to obtain the emotion analysis information; for the processing of the face information, if the face information is carried in a picture manner, the face information can be directly classified as the input of the aforementioned deep learning model, and if the video information of the face information is carried in an equally spaced manner, the video frames in the video can be extracted, for example, the video duration is 60s, the frame extracting time points can be respectively set to be 50ms, 100ms, 150ms, 200ms and … … in sequence, the position of the time point 60s at which the video ends is the last frame extracting time point, after each frame extracting time point is determined, which video frames are extracted from the video are determined as face pictures, the last face pictures are respectively input into the depth learning model trained in advance as the input, the output of the depth learning model is obtained, and finally, a plurality of output results possibly comprising a plurality of "emotion" labels are obtained in a summary manner, if a user's face video is input, the output is the output result of ' puzzles ' and ' discontents '.
In one embodiment, the generating emotion analysis information of the user based on the face information of the user includes: determining an emotion corresponding to the face information based on the face information; determining a recipe understanding level based on the mood; and taking the recipe understanding grade as the emotion analysis information.
In this embodiment, the recipe understanding level may be divided in advance, for example, into five levels of the understanding degree "high", "higher", "middle", "lower", and "very low". The expression analysis process of the specific server may include: the facial information is analyzed by an algorithm to determine the emotion expressed by the facial information, for example, the determination of the emotion expressed by the facial information by the algorithm involves "confusion" or "worries". Next, emotions are algorithmically mapped to pre-partitioned recipe understanding levels, such as: the emotion including "confusion" or "worry" corresponds to the degree of understanding "lower"; the emotion including "pleasure" corresponds to the degree of understanding "higher"; the emotion including "happy" is corresponded to the degree of understanding "high"; an emotion comprising "neutral" (e.g., approximately facial blankness) is referred to as the degree of understanding "medium"; the emotion of "anger" corresponds to the degree of understanding "very low".
Step 103: optimizing the recipe information based on the emotion analysis information and/or the time information read by the user, and outputting optimized recipe information.
Here, the recipe information is directly optimized based on the emotion analysis information, the time information read by the user, and the recipe information; or, as an implementation manner, the information may be output to a background of the server, and the background of the server optimizes the recipe information based on the emotion analysis information, the time information read by the user, and the recipe information.
In particular, the recipe can be optimized in two ways:
and optimizing the recipe information by independently utilizing the emotion analysis information.
For example, two determination threshold values, namely a first threshold value and a second threshold value, may be set in advance for the recipe understanding level included in the emotion analysis information, and when it is determined that the recipe understanding level is lower than the first threshold value, the operator may expand the recipe content corresponding to the recipe information, and may use the expanded recipe content as the optimization information of the recipe; when the recipe understanding level is higher than the second threshold, the operator may reduce the recipe content corresponding to the recipe information, and use the reduced recipe content as the optimization information of the recipe.
In this embodiment, the first threshold and the second threshold may be set by an operator, for example, the first threshold is set as "medium", and the second threshold is set as: if the food recipe content is higher, when the background of the server receives data fed back by the server and shows that the understanding degree of the user on the food recipe content is lower, the judgment is lower than a first threshold value, and an operator can expand the food recipe content according to the part of the food recipe content, for example, richer display content is provided for similar food recipe making step descriptions; on the contrary, if the judgment is higher than the second threshold, the user can be provided with a simplified recipe making guidance content, and the operator can add the updated content to the recipe database.
As an implementation manner, the embodiment of the present invention supports that step information in a recipe can be replaced, a single step/preset content segment in the recipe also has low, medium, high, and particularly high understanding degrees, and steps of different levels are selected according to the user's understanding ability, such as making a dish, a certain step is relatively complex, and when the understanding level is higher than the user's understanding ability, a certain small step can be omitted, or similar simplified steps are selected, and a difficult recipe step is replaced.
And secondly, optimizing the recipe information by combining the reading time information and the emotion analysis information of the user.
For example, if the stay time of the user on the page or the data burying point of the current recipe is long and the expression analysis information shows that the user has a low understanding degree of the recipe content, more detailed recipe content is generated for the user, and conversely, if the stay time of the user on the page or the data burying point of the current recipe is short and the expression analysis information shows that the user has a high understanding degree of the recipe content, simplified recipe content is generated for the user. Specifically, the dwell time determination threshold may be set according to the expression analysis information, such as: first, the length T of the stay time of the page when the user reads smoothly can be estimated in advance for the information included in the recipe information, for example, the page includes a recipe display video of 6 minutes, and the text information of 100 words can be estimated in advance to obtain T of 7 minutes, and then, for five levels of the understanding degree "high", "higher", "medium", "lower", and "very low", the stay time judgment thresholds of the five levels are set respectively based on the understanding degree "higher" corresponding to the time length T being 7 minutes: 6 minutes, 7 minutes, 8 minutes, 9 minutes, 10 minutes. The following is further exemplified:
when the expression analysis information of the user shows that the understanding degree of the user on the recipe content is high and the stay time of the user on the current recipe page or data burying point is less than 6 minutes, the operator can reduce the recipe content corresponding to the recipe information and take the reduced recipe content as the optimization information of the recipe; when the expression analysis information of the user shows that the user has a high understanding degree on the recipe content, and the stay time of the user on the current recipe page or data burying point is longer than 6 minutes, for example, 8.5 minutes, the operator can decide whether to optimize the recipe content, and if so, the operator can choose not to optimize the recipe content.
For another example, when the expression analysis information of the user shows that the user has a low understanding degree on the recipe content, and the stay time of the user on the current recipe page or data burying point is longer than 9 minutes, the operator can reduce the recipe content corresponding to the recipe information, and the operator can expand the recipe content, for example, provide richer display content for similar recipe making step descriptions; when the expression analysis information of the user shows that the degree of understanding of the user on the recipe content is low, and the stay time of the user on the current recipe page or data buried point is less than 9 minutes, for example, 7 minutes, the operator can decide whether to optimize the recipe content, and if so, the operator can choose not to optimize the recipe content.
It should be noted that, in the embodiment of the present invention, recipe optimization may be performed on each specific terminal device, or the recipe optimization may be expanded to uniformly perform recipe optimization on a plurality of terminal devices, and specifically, the server may obtain, through the plurality of terminal devices, facial information of a plurality of users for the same recipe information, and determine an average understanding degree for a specific recipe information in a statistical manner, so as to optimize the recipe according to the average understanding degree, and update the optimized recipe to the database, so that all the users can download and read the optimized recipe.
According to the embodiment of the invention, the face information of the user is analyzed and the time information read by the user is combined, so that the recipe is timely and efficiently optimized in a targeted manner, and the user experience of reading the recipe is improved.
Fig. 2 is a schematic flowchart of a method for optimizing recipe display based on user interaction information according to an embodiment of the present invention, and as shown in fig. 2, the method includes the following steps:
The implementation subject of the recipe optimization method in the embodiment of the present invention may be a terminal device, including but not limited to a mobile phone, a tablet computer, a notebook computer, and other terminal devices. The terminal device herein may include an image collection module by which face information of a user is collected. The recipient of the recipe information currently read by the user, the face information of the user, and the time information read by the user may be a server. The terminal device is taken as an example of a smart phone, the image collection module can comprise a front camera of the smart phone, when a user reads recipes, the front camera can be opened to collect facial information of the user, the facial information of the user can be picture information obtained by photographing the face of the user in the recipe reading process of the user, and can also be video information obtained by recording the face of the user in the recipe reading process of the user. The smart phone can send the collected face information of the user, the currently read recipe information and the time information read by the user to the server.
In an embodiment of the present invention, the recipe information currently read by the user at least includes one of the following content items:
the method comprises the steps of obtaining page position information of a recipe currently read by a user and position information of a data buried point of the recipe currently read by the user;
the time information read by the user at least comprises one of the following items:
the dwell time of the user on the page of the current recipe and the dwell time of the user on the data embedding point of the current recipe.
In the embodiment of the invention, the recipe understanding level can be determined based on at least one of the facial information of the user, the stay time of the user on the page of the current recipe and the stay time of the user on the data buried point of the current recipe; optimizing content points with higher understanding degree urgency in the recipe information according to the recipe understanding level, and updating the recipe information to a database; and outputting the updated recipe information.
And searching the recipe information matched with the user understanding ability for the user according to the recipe understanding grade, and outputting the searched recipe information.
In particular, the recipe can be optimized in two ways:
and optimizing the recipe information by solely using the emotion analysis information.
For example, two determination threshold values, namely a first threshold value and a second threshold value, may be set in advance for the recipe understanding level included in the emotion analysis information, and when it is determined that the recipe understanding level is lower than the first threshold value, the operator may expand the recipe content corresponding to the recipe information, and may use the expanded recipe content as the optimization information of the recipe; when the recipe understanding level is higher than the second threshold, the operator may reduce the recipe content corresponding to the recipe information, and use the reduced recipe content as the optimization information of the recipe.
In this embodiment, the first threshold and the second threshold may be set by an operator, for example, the first threshold is set as "medium", and the second threshold is set as: if the food recipe content is higher, when the background of the server receives data fed back by the server and shows that the understanding degree of the user on the food recipe content is lower, the judgment is lower than a first threshold value, and an operator can expand the food recipe content according to the part of the food recipe content, for example, richer display content is provided for similar food recipe making step descriptions; on the contrary, if the judgment is higher than the second threshold, the user can be provided with a simplified recipe making guidance content, and the operator can add the updated content to the recipe database.
The method and the device for determining the food recipe understanding level can also determine the food recipe understanding level based on the time information read by the user, and determine the understanding level of the user according to the staying time of the user on the page or the content point, for example, the staying time of the user on the page or the data burying point of the current food recipe is short, which indicates that the user understands the food recipe easily, and the understanding level is 'lower', and some food recipe information with higher levels can be recommended to the user.
And optimizing the recipe information by combining the reading time information and the emotion analysis information of the user.
For example, if the stay time of the user on the page or the data burying point of the current recipe is long and the expression analysis information shows that the user has a low understanding degree of the recipe content, more detailed recipe content is generated for the user, and conversely, if the stay time of the user on the page or the data burying point of the current recipe is short and the expression analysis information shows that the user has a high understanding degree of the recipe content, simplified recipe content is generated for the user. Specifically, the dwell time determination threshold may be set according to the expression analysis information, such as: first, the length T of the stay time of the page when the user reads smoothly can be estimated in advance for the information included in the recipe information, for example, the page includes a recipe display video of 6 minutes, and the text information of 100 words can be estimated in advance to obtain T of 7 minutes, and then, for five levels of the understanding degree "high", "higher", "medium", "lower", and "very low", the stay time judgment thresholds of the five levels are set respectively based on the understanding degree "higher" corresponding to the time length T being 7 minutes: 6 minutes, 7 minutes, 8 minutes, 9 minutes, 10 minutes. The following is further exemplified:
when the expression analysis information of the user shows that the understanding degree of the user on the recipe content is high and the stay time of the user on the current recipe page or data burying point is less than 6 minutes, the operator can reduce the recipe content corresponding to the recipe information and take the reduced recipe content as the optimization information of the recipe; when the expression analysis information of the user shows that the user has a high understanding degree on the recipe content, and the stay time of the user on the current recipe page or data burying point is longer than 6 minutes, for example, 8.5 minutes, the operator can decide whether to optimize the recipe content, and if so, the operator can choose not to optimize the recipe content.
For another example, when the expression analysis information of the user shows that the user has a low understanding degree on the recipe content, and the stay time of the user on the current recipe page or data burying point is longer than 9 minutes, the operator can reduce the recipe content corresponding to the recipe information, and the operator can expand the recipe content, for example, provide richer display content for similar recipe making step descriptions; when the expression analysis information of the user shows that the degree of understanding of the user on the recipe content is low, and the stay time of the user on the current recipe page or data buried point is less than 9 minutes, for example, 7 minutes, the operator can decide whether to optimize the recipe content, and if so, the operator can choose not to optimize the recipe content.
It should be noted that, in the embodiment of the present invention, recipe optimization may be performed on each specific terminal device, or the recipe optimization may be expanded to uniformly perform recipe optimization on a plurality of terminal devices, and specifically, the server may obtain, through the plurality of terminal devices, facial information of a plurality of users for the same recipe information, and determine an average understanding degree for a specific recipe information in a statistical manner, so as to optimize the recipe according to the average understanding degree, and update the optimized recipe to the database, so that all the users can download and read the optimized recipe.
Here, after the specific generation of the recipe optimization information, the terminal device may download the recipe optimization information from the database.
And step 203, displaying the recipe optimization information.
In one embodiment, the recipe optimization information is presented in a manner that includes at least one of the following items: video, audio, moving pictures, still pictures. Here, the recipe optimization information may be presented based on any information carrier, such as text, pictures, video, audio, etc.
In the embodiment of the invention, the terminal equipment feeds back the time information read by the user, the recipe information and the facial information of the user to the server side in time, and based on the information, operators can realize targeted optimization of recipes in time and efficiently, thereby improving the user experience of reading recipes.
Example one
Fig. 3 is a schematic structural diagram of a system for optimizing recipes based on user interaction information according to an embodiment of the present invention, and as shown in fig. 3, the system includes a terminal device and a software end.
Wherein, terminal equipment includes: a specific image collection module, an external or self-contained auxiliary display module can be provided with a support for assisting reading and watching. The image collection module is mainly used for monitoring facial expression data of a user and uploading the facial expression data to the cloud algorithm model, wherein the data can also comprise time point information; here, the external or self-contained auxiliary display module may be a screen display structure provided in the machine, or an external electronic device with a screen, or a piece of paper with related positioning information.
The software end comprises a cloud algorithm model and an operation background. The cloud algorithm model analyzes emotion changes of the user when the user reads the content at the time point by taking the time point as a reference and combining information such as facial expression data, content position data and stay time of the user uploaded by the terminal device, so that the understanding degree of the user on the content point is judged. And after receiving the data, the operation background feeds the data back to the operation personnel, and the operation personnel optimizes the recipe content according to the data information.
The specific implementation process of the recipe optimization system provided by the embodiment of the present invention can be implemented by referring to the process of the recipe optimization method, which is not described herein again.
Fig. 4 is a schematic structural diagram of an apparatus for optimizing recipes based on user interaction information according to an embodiment of the present invention, and as shown in fig. 4, the apparatus 400 for optimizing recipes includes:
an obtaining module 401, configured to obtain recipe information read by a user currently, face information of the user, and/or time information read by the user;
a generating module 402, configured to generate emotion analysis information of a user based on the facial information of the user;
an optimizing module 403, configured to optimize the recipe information based on the emotion analysis information and/or the time information read by the user;
an output module 404 for outputting the optimized recipe information.
In one embodiment, the generating module 402 includes at least one of a determining module, a generating module,
the determining module is used for determining the emotion corresponding to the face information based on the face information;
the generation module is used for generating an understanding parameter of the recipe information based on the emotion, and the understanding parameter corresponds to an understanding level of the recipe information; and taking the recipe understanding grade as the emotion analysis information. .
In one embodiment, in the obtaining module 401, the recipe information currently read by the user includes at least one of the following items: the method comprises the following steps of obtaining the page position information of the current recipe read by the user and the position information of the data buried point of the current recipe read by the user.
In one embodiment, in the obtaining module 401, the time information read by the user includes at least one of the following items: the dwell time of the user on the page of the current recipe and the dwell time of the user on the data embedding point of the current recipe.
The embodiment of the invention analyzes the facial information of the user and combines the reading time information of the user to realize targeted timely and efficient optimization of the recipe, thereby improving the user experience of reading the recipe.
Those skilled in the art will appreciate that the functions implemented by the modules in the recipe optimization apparatus 400 shown in fig. 4 can be understood by referring to the description related to the recipe optimization method. The functions of the modules in the recipe optimizing apparatus 400 shown in fig. 4 may be implemented by a program running on a processor, or may be implemented by specific logic circuits.
Fig. 5 is a schematic structural diagram of an apparatus for optimizing recipes based on user interaction information according to an embodiment of the present invention, and as shown in fig. 5, the apparatus 500 for optimizing recipes includes:
a sending module 501, configured to send recipe information read by a user currently and facial information of the user, and/or time information read by the user;
a receiving module 502, configured to receive recipe optimization information obtained based on the recipe information currently read by the user and the facial information of the user, and/or the time information read by the user;
a display module 503, configured to output the recipe optimization information.
The recipe information currently read by the user at least comprises one of the following items:
the method comprises the steps of obtaining page position information of a recipe currently read by a user and position information of a data buried point of the recipe currently read by the user;
the time information read by the user at least comprises one of the following items:
the dwell time of the user on the page of the current recipe and the dwell time of the user on the data embedding point of the current recipe.
On the basis of the apparatus for optimizing recipe presentation based on user interaction information shown in fig. 5, the apparatus further includes:
a determining module (not shown in fig. 5) for determining a recipe understanding level based on at least one of facial information of the user, a dwell time of the user on a page of the current recipe, a dwell time of the user on a data sink of the current recipe;
and an optimization updating module (not shown in fig. 5) configured to re-determine a new understanding level for the recipe information, optimize a corresponding content point in the recipe information according to the new understanding level, and update the recipe information to the database.
The determining module is further configured to determine whether an understanding parameter of the optimized recipe information is smaller than a preset value, and stop the optimization when the understanding parameter is smaller than the optimized value, and trigger the displaying module 503 to display the updated recipe information.
On the basis of the apparatus for recipe optimization based on user interaction information shown in fig. 5, the apparatus further comprises:
a searching module (not shown in fig. 5) for determining a new understanding level for the user according to the recipe understanding level, and searching the recipe information corresponding to the new understanding level;
the displaying module 503 is further configured to display the searched recipe information.
In one embodiment, in the presentation module 503, the manner of presenting the recipe optimization information includes at least one of the following items: video, moving pictures, still pictures.
In the embodiment of the invention, the terminal equipment feeds back the time information read by the user, the recipe information and the facial information of the user to the server side in time, and based on the information, operators can realize targeted optimization of recipes in time and efficiently, thereby improving the user experience of reading recipes.
Those skilled in the art will appreciate that the functions implemented by the modules in the recipe optimization apparatus 500 shown in fig. 5 can be understood by referring to the description related to the recipe optimization method. The functions of the modules in the recipe optimizing apparatus 500 shown in fig. 5 may be implemented by a program running on a processor, or may be implemented by specific logic circuits.
Fig. 6 is a schematic structural diagram of a recipe optimizing apparatus according to an embodiment of the present invention, and the recipe optimizing apparatus 600 shown in fig. 6 is disposed on the terminal and includes: at least one processor 601, memory 402, user interface 603, at least one network interface 604. The various components in the recipe optimizing apparatus 600 are coupled together by a bus system 605. It is understood that the bus system 605 is used to enable communications among the components. The bus system 605 includes a power bus, a control bus, and a status signal bus in addition to a data bus. For clarity of illustration, however, the various buses are labeled as bus system 605 in fig. 6.
The user interface 603 may include, among other things, a display, a keyboard, a mouse, a trackball, a click wheel, a key, a button, a touch pad, or a touch screen.
The memory 602 in embodiments of the present invention is used to store various types of data to support the operation of the apparatus 600 for recipe optimization. Examples of such data include: any computer programs for operating on the apparatus 600 for recipe optimization, such as an operating system 6021 and application programs 6022; the operating system 6021 includes various system programs, such as a framework layer, a core library layer, a driver layer, and the like, for implementing various basic services and processing hardware-based tasks. The application programs 6022 may include various application programs for implementing various application services. A program implementing the method of an embodiment of the invention can be included in the application program 6022.
The method disclosed by the above-mentioned embodiment of the present invention can be applied to the processor 601, or implemented by the processor 601. The processor 601 may be an integrated circuit chip having signal processing capabilities. In implementation, the steps of the above method may be performed by integrated logic circuits of hardware or instructions in the form of software in the processor 601. The processor 601 described above may be a general purpose processor, a digital signal processor, or other programmable logic device, discrete gate or transistor logic device, discrete hardware components, or the like. Processor 601 may implement or perform the methods, steps, and logic blocks disclosed in embodiments of the present invention. A general purpose processor may be a microprocessor or any conventional processor or the like. The steps of the method disclosed by the embodiment of the invention can be directly implemented by a hardware decoding processor, or can be implemented by combining hardware and software modules in the decoding processor. The software modules may be located in a storage medium located in the memory 602, and the processor 601 reads the information in the memory 602 and performs the steps of the aforementioned methods in conjunction with its hardware.
It will be appreciated that the memory 602 can be either volatile memory or nonvolatile memory, and can include both volatile and nonvolatile memory. The nonvolatile Memory may be a Read Only Memory (ROM), a Programmable Read Only Memory (PROM), an Erasable Programmable Read-Only Memory (EPROM), an Electrically Erasable Programmable Read-Only Memory (EEPROM), a magnetic random access Memory (FRAM), a ferromagnetic access Memory (Flash Memory), a magnetic surface Memory, an optical Disc, or a Compact Disc Read-Only Memory (CD-ROM); the magnetic surface storage may be disk storage or tape storage. Volatile Memory can be Random Access Memory (RAM), which acts as external cache Memory. By way of illustration and not limitation, many forms of RAM are available, such as Static Random Access Memory (SRAM), Synchronous Static Random Access Memory (SSRAM), Dynamic Random Access Memory (DRAM), Synchronous Dynamic Random Access Memory (SDRAM), Double Data Rate Synchronous Dynamic Random Access Memory (DDRSDRAM), Enhanced Synchronous Dynamic Random Access Memory (ESDRAM), Enhanced Synchronous Dynamic Random Access Memory (Enhanced DRAM), Synchronous Dynamic Random Access Memory (SLDRAM), Direct Memory (DRmb Access), and Random Access Memory (DRAM). The memory 602 described in connection with the embodiments of the invention is intended to comprise, without being limited to, these and any other suitable types of memory.
Based on the information interaction method provided in the embodiments of the present application, the present application further provides a computer-readable storage medium, as shown in fig. 6, where the computer-readable storage medium may include: a memory 602 for storing a computer program executable by the processor 601 of the apparatus 600 for recipe optimization to perform the steps of the method as described above. The computer readable storage medium may be Memory such as FRAM, ROM, PROM, EPROM, EEPROM, Flash Memory, magnetic surface Memory, optical disk, or CD-ROM.
It should be noted that: the technical schemes described in the embodiments of the present invention can be combined arbitrarily without conflict.
The above description is only a preferred embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes, which are made by using the contents of the present specification and the accompanying drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.
Claims (17)
1. A method of recipe optimization, comprising:
acquiring current recipe information read by a user, face information of the user and/or time information read by the user;
generating emotion analysis information of the user based on the face information of the user;
optimizing the recipe information based on the emotion analysis information and/or the time information read by the user, and outputting optimized recipe information.
2. The method of claim 1, wherein generating emotion analysis information for a user based on the facial information of the user comprises:
determining an emotion corresponding to the face information based on the face information;
generating an understanding parameter of the recipe information based on the emotion, the understanding parameter corresponding to an understanding level of the recipe information;
and taking the recipe understanding grade corresponding to the understanding parameter as the emotion analysis information.
3. The method according to claim 1 or 2, wherein the recipe information currently read by the user comprises at least one of the following items:
the method comprises the steps of obtaining page position information of a recipe currently read by a user and position information of a data buried point of the recipe currently read by the user;
the time information read by the user at least comprises one of the following items:
the dwell time of the user on the page of the current recipe and the dwell time of the user on the data embedding point of the current recipe.
4. A method of recipe display optimization, comprising:
sending the current recipe information read by the user, the face information of the user and/or the reading time information of the user;
receiving recipe optimization information obtained based on the face information of the user corresponding to the recipe information read by the user currently and/or the time information read by the user;
and displaying the recipe optimization information.
5. The method according to claim 4, wherein the recipe information currently read by the user includes at least one of:
the method comprises the steps of obtaining page position information of a recipe currently read by a user and position information of a data buried point of the recipe currently read by the user;
the time information read by the user at least comprises one of the following items:
the dwell time of the user on the page of the current recipe and the dwell time of the user on the data embedding point of the current recipe.
6. The method of claim 5, further comprising:
determining an understanding parameter of the recipe information based on at least one of the face information of the user, the staying time of the user on a page of the current recipe, and the staying time of the user on a data buried point of the current recipe, wherein the understanding parameter corresponds to a recipe understanding grade of the recipe information;
re-determining a new understanding level for the recipe information, optimizing corresponding content points in the recipe information according to the new understanding level, and updating the recipe information into a database;
and outputting the updated recipe information.
7. The method of claim 6, wherein optimizing the corresponding content points in the recipe information according to the new level of understanding comprises:
determining whether the understanding parameter of the optimized recipe information is smaller than a preset value or not, stopping optimization when the understanding parameter is smaller than the optimized value, and outputting updated recipe information; otherwise, optimizing the corresponding content points in the recipe information again until the understanding parameters of the optimized recipe information are smaller than the preset value.
8. The method of claim 6, further comprising:
and determining a new understanding level for the user according to the recipe understanding level, searching the recipe information corresponding to the new understanding level, and outputting the searched recipe information.
9. An apparatus for recipe optimization, comprising:
the acquisition module is used for acquiring the current recipe information read by the user, the face information of the user and/or the reading time information of the user;
the generating module is used for generating emotion analysis information of the user based on the face information of the user;
the optimization module is used for optimizing the recipe information based on the emotion analysis information and/or the time information read by the user;
and the output module is used for outputting the optimized recipe information.
10. The apparatus of claim 9, wherein the generating module comprises a determining module, a generating module,
the determining module is used for determining the emotion corresponding to the face information based on the face information;
the generation module is used for generating an understanding parameter of the recipe information based on the emotion, and the understanding parameter corresponds to an understanding level of the recipe information; and taking the recipe understanding grade as the emotion analysis information.
11. The apparatus for recipe optimization according to claim 9 or 10, wherein the recipe information currently read by the user in the obtaining module comprises at least one of the following items:
the method comprises the steps of obtaining page position information of a recipe currently read by a user and position information of a data buried point of the recipe currently read by the user;
in the acquisition module, the time information read by the user at least comprises one of the following content items:
the dwell time of the user on the page of the current recipe and the dwell time of the user on the data embedding point of the current recipe.
12. An apparatus for recipe display optimization, comprising:
the sending module is used for sending the current recipe information read by the user and/or the time information read by the user;
the receiving module is used for receiving recipe optimization information obtained based on the face information of the user corresponding to the recipe information read by the user currently and/or the time information read by the user;
and the display module is used for displaying the recipe optimization information.
13. The apparatus of claim 12, wherein the recipe information currently read by the user comprises at least one of:
the method comprises the steps of obtaining page position information of a recipe currently read by a user and position information of a data buried point of the recipe currently read by the user;
the time information read by the user at least comprises one of the following items:
the dwell time of the user on the page of the current recipe and the dwell time of the user on the data embedding point of the current recipe.
14. The apparatus of claim 13, further comprising:
a determining module, configured to determine an understanding parameter of the recipe information based on at least one of the facial information of the user, a staying time of the user on a page of a current recipe, and a staying time of the user on a data buried point of the current recipe, where the understanding parameter corresponds to a recipe understanding level of the recipe information;
the optimization updating module is used for determining a new understanding level for the recipe information again, optimizing corresponding content points in the recipe information according to the new understanding level and updating the recipe information into a database;
the display module is also used for outputting the updated recipe information.
15. The apparatus according to claim 14, wherein the determining module is further configured to determine whether an understanding parameter of the optimized recipe information is smaller than a preset value, and stop the optimization when the understanding parameter is smaller than an optimized value, so as to trigger the displaying module to display the updated recipe information.
16. The apparatus of claim 14, further comprising:
the search module is used for determining a new understanding grade for the user according to the recipe understanding grade and searching the recipe information corresponding to the new understanding grade;
the display module is also used for outputting the searched recipe information.
17. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the method for recipe optimization according to one of the claims 1 to 3 or the steps of the method for recipe presentation optimization according to one of the claims 4 to 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911416664.5A CN113130044B (en) | 2019-12-31 | 2019-12-31 | Recipe optimization method, recipe optimization display device and computer-readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911416664.5A CN113130044B (en) | 2019-12-31 | 2019-12-31 | Recipe optimization method, recipe optimization display device and computer-readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113130044A true CN113130044A (en) | 2021-07-16 |
| CN113130044B CN113130044B (en) | 2023-06-20 |
Family
ID=76769172
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911416664.5A Active CN113130044B (en) | 2019-12-31 | 2019-12-31 | Recipe optimization method, recipe optimization display device and computer-readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113130044B (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080240519A1 (en) * | 2007-03-29 | 2008-10-02 | Sachio Nagamitsu | Recognition device, recognition method, and computer-readable recording medium recorded with recognition program |
| CN107978355A (en) * | 2017-10-30 | 2018-05-01 | 珠海格力电器股份有限公司 | Recipe recommendation method, apparatus and smoke exhaust ventilator |
| CN108121744A (en) * | 2016-11-30 | 2018-06-05 | 佛山市顺德区美的电热电器制造有限公司 | Recipe method for pushing and recipe supplying system |
| CN108648802A (en) * | 2018-05-15 | 2018-10-12 | 四川斐讯信息技术有限公司 | A kind of recipe recommendation method and system |
| US10360254B1 (en) * | 2016-03-24 | 2019-07-23 | Massachusetts Mutual Life Insurance Company | Intelligent and context aware reading systems |
-
2019
- 2019-12-31 CN CN201911416664.5A patent/CN113130044B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080240519A1 (en) * | 2007-03-29 | 2008-10-02 | Sachio Nagamitsu | Recognition device, recognition method, and computer-readable recording medium recorded with recognition program |
| US10360254B1 (en) * | 2016-03-24 | 2019-07-23 | Massachusetts Mutual Life Insurance Company | Intelligent and context aware reading systems |
| CN108121744A (en) * | 2016-11-30 | 2018-06-05 | 佛山市顺德区美的电热电器制造有限公司 | Recipe method for pushing and recipe supplying system |
| CN107978355A (en) * | 2017-10-30 | 2018-05-01 | 珠海格力电器股份有限公司 | Recipe recommendation method, apparatus and smoke exhaust ventilator |
| CN108648802A (en) * | 2018-05-15 | 2018-10-12 | 四川斐讯信息技术有限公司 | A kind of recipe recommendation method and system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113130044B (en) | 2023-06-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10341461B2 (en) | System and method for automatically recreating personal media through fusion of multimodal features | |
| CN103513890B (en) | A kind of exchange method based on picture, device and server | |
| US20190392866A1 (en) | Video summarization and collaboration systems and methods | |
| CN109635155B (en) | Method and device for pushing video to user, electronic equipment and storage medium | |
| US20160104508A1 (en) | Video editing using contextual data and content discovery using clusters | |
| CN109416805A (en) | The method and system of presentation for the media collection with automatic advertising | |
| CN109492152B (en) | Method, device, computer equipment and storage medium for pushing custom content | |
| CN105009113A (en) | Queryless search based on context | |
| CN109275047B (en) | Video information processing method and device, electronic equipment and storage medium | |
| CN110225398B (en) | Multimedia object playing method, device and equipment and computer storage medium | |
| CN108780654A (en) | Generate the mobile thumbnail for video | |
| CN113641859B (en) | Script generation method, system, computer storage medium and computer program product | |
| CN111158924B (en) | Content sharing method and device, electronic equipment and readable storage medium | |
| CN111277898A (en) | Content pushing method and device | |
| CN111144076B (en) | Social information publishing method and device | |
| CN113411674A (en) | Video playing control method and device, electronic equipment and storage medium | |
| CN113660526B (en) | Script generation method, system, computer storage medium and computer program product | |
| US20220028425A1 (en) | System and Method to Customizing Video | |
| CN113207039B (en) | Video processing method and device, electronic equipment and storage medium | |
| CN116974676A (en) | Page content sending method, device and equipment | |
| CN113130044A (en) | Recipe optimization method, optimized display method, device and computer-readable storage medium | |
| JP2020004410A (en) | Method for facilitating media-based content share, computer program and computing device | |
| CN112328152B (en) | Method and device for controlling playing of media file, electronic equipment and storage medium | |
| KR101721231B1 (en) | 4D media manufacture methods of MPEG-V standard base that use media platform | |
| CN111698563A (en) | Content sending method and device based on AI virtual anchor and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |