CN111802963A - Cleaning equipment and interesting information playing method and device - Google Patents
Cleaning equipment and interesting information playing method and device Download PDFInfo
- Publication number
- CN111802963A CN111802963A CN202010665078.0A CN202010665078A CN111802963A CN 111802963 A CN111802963 A CN 111802963A CN 202010665078 A CN202010665078 A CN 202010665078A CN 111802963 A CN111802963 A CN 111802963A
- Authority
- CN
- China
- Prior art keywords
- information
- face
- playing
- image
- image information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- A—HUMAN NECESSITIES
- A47—FURNITURE; DOMESTIC ARTICLES OR APPLIANCES; COFFEE MILLS; SPICE MILLS; SUCTION CLEANERS IN GENERAL
- A47L—DOMESTIC WASHING OR CLEANING; SUCTION CLEANERS IN GENERAL
- A47L11/00—Machines for cleaning floors, carpets, furniture, walls, or wall coverings
- A47L11/24—Floor-sweeping machines, motor-driven
-
- A—HUMAN NECESSITIES
- A47—FURNITURE; DOMESTIC ARTICLES OR APPLIANCES; COFFEE MILLS; SPICE MILLS; SUCTION CLEANERS IN GENERAL
- A47L—DOMESTIC WASHING OR CLEANING; SUCTION CLEANERS IN GENERAL
- A47L11/00—Machines for cleaning floors, carpets, furniture, walls, or wall coverings
- A47L11/40—Parts or details of machines not provided for in groups A47L11/02 - A47L11/38, or not restricted to one of these groups, e.g. handles, arrangements of switches, skirts, buffers, levers
-
- A—HUMAN NECESSITIES
- A47—FURNITURE; DOMESTIC ARTICLES OR APPLIANCES; COFFEE MILLS; SPICE MILLS; SUCTION CLEANERS IN GENERAL
- A47L—DOMESTIC WASHING OR CLEANING; SUCTION CLEANERS IN GENERAL
- A47L11/00—Machines for cleaning floors, carpets, furniture, walls, or wall coverings
- A47L11/40—Parts or details of machines not provided for in groups A47L11/02 - A47L11/38, or not restricted to one of these groups, e.g. handles, arrangements of switches, skirts, buffers, levers
- A47L11/4002—Installations of electric equipment
-
- A—HUMAN NECESSITIES
- A47—FURNITURE; DOMESTIC ARTICLES OR APPLIANCES; COFFEE MILLS; SPICE MILLS; SUCTION CLEANERS IN GENERAL
- A47L—DOMESTIC WASHING OR CLEANING; SUCTION CLEANERS IN GENERAL
- A47L11/00—Machines for cleaning floors, carpets, furniture, walls, or wall coverings
- A47L11/40—Parts or details of machines not provided for in groups A47L11/02 - A47L11/38, or not restricted to one of these groups, e.g. handles, arrangements of switches, skirts, buffers, levers
- A47L11/4011—Regulation of the cleaning machine by electric means; Control systems and remote control systems therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/953—Querying, e.g. by the use of web search engines
- G06F16/9535—Search customisation based on user profiles and personalisation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/172—Classification, e.g. identification
-
- A—HUMAN NECESSITIES
- A47—FURNITURE; DOMESTIC ARTICLES OR APPLIANCES; COFFEE MILLS; SPICE MILLS; SUCTION CLEANERS IN GENERAL
- A47L—DOMESTIC WASHING OR CLEANING; SUCTION CLEANERS IN GENERAL
- A47L2201/00—Robotic cleaning machines, i.e. with automatic control of the travelling movement or the cleaning operation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/178—Human faces, e.g. facial parts, sketches or expressions estimating age from face image; using age information for improving recognition
Abstract
The invention is suitable for the technical field of intelligent electrical appliances, and provides cleaning equipment and a method and a device for playing interesting information, wherein the method comprises the following steps: acquiring image information around the cleaning device; adopting a face recognition algorithm to recognize whether the image information contains face information: and if the image information is identified to contain the face information, playing interesting information related to the age type of the face information on the cleaning equipment. The interesting information playing method provided by the invention judges whether a person is present and the age type of the face by carrying out face recognition on the image information around the cleaning equipment, and then plays the interesting information related to the age type on the cleaning equipment, thereby realizing the interactive experience of the cleaning equipment and a user.
Description
Technical Field
The invention belongs to the technical field of intelligent electric appliances, and particularly relates to a cleaning device and a method and a device for playing interesting information.
Background
At present, intelligent electrical appliances are more and more popular in families. For example, a sweeping robot is one of the intelligent electric products commonly used by modern families. The sweeping robot can select a reasonable sweeping path according to the position relation of indoor objects so as to realize the function of intelligent sweeping. However, in practical use, it is found that the sweeping robot usually executes a sweeping task without people indoors and is in a standby state when people are indoors, so that a user is in an idle state when at home and cannot interact with people, and therefore the sweeping robot is single in function and cannot bring human-computer interaction experience to the user.
Disclosure of Invention
The embodiment of the invention provides cleaning equipment and a method and a device for playing interesting information, and aims to solve the problem that a sweeping robot in the prior art is lack of interaction with a user in terms of functions.
In a first aspect, the present invention provides a method for playing information of interest, applied to a cleaning device, the method at least comprising: s1: acquiring image information around the cleaning device; s2: adopting a face recognition algorithm to recognize whether the image information contains face information: s3: if the image information is identified to contain face information, playing interesting information related to the age type to which the face information belongs on the cleaning equipment; s4: if it is recognized that the image information does not include face information, the process returns to S1.
Preferably, the acquiring of the image information around the cleaning device includes: acquiring first image information based on a first image acquisition module on the cleaning equipment; the identifying whether the image information contains face information by adopting a face identification algorithm comprises the following steps: adopting a first face recognition algorithm to recognize whether the first image information contains portrait information: if the first image information contains portrait information, acquiring second image information based on a second image acquisition module on the cleaning equipment; and otherwise, returning to the step of acquiring the first image information based on the first image acquisition module on the cleaning equipment.
Preferably, after the step of acquiring the second image information by the second image acquisition module on the cleaning device, the method further comprises: identifying whether the second image information contains face information or not by adopting a second face identification algorithm; if the second image information contains face information, playing interesting information related to the age type to which the face information belongs on the cleaning equipment; and otherwise, returning to the step of acquiring the first image information based on the first image acquisition module on the cleaning equipment.
Preferably, after the image information is identified to include face information, the method further includes: and acquiring a classification label of the age type of the face information, or identifying the age type of the face information by using a second face identification algorithm.
Preferably, if it is recognized that the image information contains face information, playing information of interest related to an age type to which the face information belongs on the cleaning device includes: if the image information is identified to contain face information, the number of the face information is identified: when the number of the face information is one, playing interesting information related to the age type to which the face information belongs on the cleaning device, and returning to S1; and when the number of the face information is at least two, setting and playing the related interesting information according to the priorities of the age types corresponding to the at least two different pieces of face information.
Preferably, before playing information of interest related to an age type to which the face information belongs on the cleaning device, the method further includes: judging whether the age type of the face information is consistent with the age type of the current playing basis: if the age type of the face information is consistent with the age type of the current playing basis, returning to the step S1; and if the age type to which the face information belongs is not consistent with the age type according to which the face information is currently played, setting and playing related interesting information according to priorities of different age types.
Preferably, the playing of the information of interest on the cleaning device, which is related to the age type to which the face information belongs, includes at least one of:
playing audio information associated with the age type stored locally at the cleaning device;
and playing audio information which is acquired by the cleaning equipment through a network and is associated with the age type.
In a second aspect, the present invention provides an information playback apparatus of interest, for use with a cleaning device, comprising:
an image acquisition module configured to acquire image information around the cleaning device;
an image recognition module configured to recognize whether the image information contains face information by adopting a face recognition algorithm:
an information playing module configured to play, on the cleaning device, information of interest related to an age type to which the face information belongs if it is recognized that the face information is included in the image information;
and the circulation detection module is configured to return to the step of acquiring the image information around the cleaning equipment if the image information is identified to contain no human face information.
In a third aspect, the present invention provides a cleaning apparatus comprising: at least one image acquisition module; at least one speaker; the processor is respectively connected with the loudspeaker and the image acquisition module; a memory storing a computer program operable on the processor, the processor implementing the steps of the method according to any one of the first aspect when executing the computer program.
Preferably, the cleaning apparatus comprises a sweeping robot.
Compared with the prior art, the embodiment of the invention has the following beneficial effects: the interesting information playing method provided by the invention judges whether a person is present and the age type of the face by carrying out face recognition on the image information around the cleaning equipment, and then plays the interesting information related to the age type on the cleaning equipment, thereby realizing the interactive experience of the cleaning equipment and a user.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed for the embodiments or the prior art descriptions will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings without creative efforts.
FIG. 1 is a schematic diagram of a cleaning apparatus to which the information playing method or the information playing apparatus of interest of the present invention can be applied;
fig. 2 is a flowchart of a method for playing interesting information according to an embodiment of the present invention;
fig. 3 is a flowchart illustrating a step S21 shown in fig. 1 according to a second embodiment of the present invention;
fig. 4 is a flowchart after step S321 shown in fig. 3 according to a third embodiment of the present invention;
fig. 5 is a flowchart illustrating a detailed process of step S221 shown in fig. 2 according to a fourth embodiment of the present invention;
fig. 6 is a flowchart illustrating a detailed process of step S221 shown in fig. 2 according to a fourth embodiment of the present invention;
fig. 7 is a schematic structural diagram of an interesting information playing apparatus provided in the present invention.
Detailed Description
In the following description, for purposes of explanation and not limitation, specific details are set forth, such as particular system structures, techniques, etc. in order to provide a thorough understanding of the embodiments of the invention. It will be apparent, however, to one skilled in the art that the present invention may be practiced in other embodiments that depart from these specific details. In other instances, detailed descriptions of well-known systems, devices, circuits, and methods are omitted so as not to obscure the description of the present invention with unnecessary detail.
In embodiments of the present application, an interesting information playing method and an interesting information playing apparatus are provided, and in a possible implementation manner, some embodiments of the interesting information playing method or the interesting information playing apparatus of the present application may be applied, but are not limited, to a cleaning device as shown in fig. 1.
As shown in fig. 1, the cleaning apparatus 01 may include an image capturing module 11, a speaker 12, a memory 14, and a processor 13, the image capturing module 11 and the speaker 12 are respectively connected to the processor 13, the memory 14 stores a computer program executable on the processor 13, and the processor 13 executes the computer program to implement the necessary steps of the method for playing information of interest or the necessary functions of the device for playing information of interest.
Specifically, the image capturing module 11 may be a camera. For example, the camera may include any one of a monocular camera, a binocular camera, and the like. For example, the monocular camera or the binocular camera may be used to collect first image information around the cleaning device, and in addition, in some cameras integrated with an artificial intelligence chip, the monocular camera or the binocular camera may also be used to perform face recognition on the collected first image information, for example, to recognize whether the collected first image information contains portrait information.
Specifically, the image capturing module 11 may also be a structured light module, and the structured light module may be used to capture second image information around the cleaning device, that is, the structured light module may generate and receive a structured light image and generate a 3D image. Typically, the structured light module is integrated with an artificial intelligence chip that contains algorithms for image recognition of the generated 3D image. For example, the structured light module can be used for directly acquiring second image information around the cleaning equipment and identifying the face information contained in the second image information.
Of course, the camera and the structured light module can be arranged on the cleaning equipment to collect image information with different qualities respectively for identification. In addition, since the structured light module is a well-established product in the field of artificial intelligence, it is not described herein.
It should be understood that the number of the image capturing modules, the speaker, the memory and the processor in the cleaning device shown in fig. 1 may be one or more, and the application is not limited thereto.
Fig. 2 is a flowchart of an interesting information playing method according to an embodiment of the present invention, where the interesting information playing method can be applied to the cleaning apparatus shown in fig. 1. Generally, the cleaning device may be embodied as a sweeping robot.
As shown in fig. 2, the method for playing interesting information provided in this embodiment at least includes the following steps:
in step S21, image information of the surroundings of the cleaning apparatus is acquired.
Specifically, the image information may be first image information acquired by a camera in the application scene shown in fig. 1, second image information acquired by the structured light module, or both.
And step S22, adopting a face recognition algorithm to recognize whether the image information contains face information.
Specifically, the face recognition algorithm can quickly recognize and determine whether the image information collected by the cleaning equipment contains a face and features related to the face when the face exists. In the present application, when there is a face, features related to the face are the age type to which the recognized face information belongs.
Step S221, if the image information is identified to contain face information, playing interesting information related to the age type of the face information on the cleaning equipment.
In connection with the last step S22, the age type according to which the cleaning device plays the information of interest is an identification classification of the face information in the image information. When the image information acquired by the cleaning equipment is identified whether to contain the face information by adopting a face identification algorithm, the age type of the face information can be identified together, and certainly, the age type of the face information can be identified after the face information is determined to contain the face information.
That is, identifying whether the image information contains the face information and identifying the age type of the face information may be implemented by a face recognition algorithm, or may be implemented by respective face recognition algorithms. Whichever of the foregoing implementations is employed, the face recognition algorithms employed therein are conventional in the art.
For example, assuming that a face recognition algorithm for determining the age type of face information is to be implemented, first, classification labels of the age types may be set in advance, for example, the face may be classified into several different age types, such as an infant, a child, a young person, and an old person. Images containing all of the different age types described above were then collected as training samples and validation samples. Finally, the training sample and the verification sample are used for training a target algorithm model (the existing model can be adopted), and the expected face recognition algorithm capable of determining the face age type can be obtained.
For this reason, in the above step S221 of this embodiment, the determining the age type to which the face information belongs may specifically include:
as an alternative example, when the face information is recognized by using a face recognition algorithm, the result of the recognition by the face recognition algorithm may include the result of the age type recognition on the face information. For this purpose, before playing information of interest related to an age type to which the face information belongs on the cleaning device, the method may further include: and acquiring the age type of the face information.
In an alternative example two, the image information may be identified by using a face identification algorithm, and when it is determined that the image information contains face information, the image information is identified by using an age type identification algorithm of the face information, so as to obtain an age type to which the face information belongs. For this purpose, before playing information of interest related to an age type to which the face information belongs on the cleaning device, the method may further include: and identifying the age type of the face information by using an age type identification algorithm.
Specifically, the information of interest played by the cleaning device is in a mapping association relationship with the age type, or is in a mapping association relationship determined through algorithm identification, that is, after the age type of the face information is determined, the information of interest in mapping association with the age type can be played.
In step S222, if it is recognized that the image information does not include the face information, the step of acquiring the image information around the cleaning device is returned.
The method for playing the information of interest provided by the embodiment judges whether a person is present and the age type of the face by performing face recognition on the image information around the cleaning device, and then plays the information of interest associated with the age type on the cleaning device, thereby realizing the interactive experience between the cleaning device and the user.
Fig. 3 is a specific flowchart of step S21 shown in fig. 1 according to a second embodiment of the present invention, so as to bring a better user experience, and further improve the efficiency of the cleaning device in recognizing the face information.
As shown in fig. 3, in step S21 shown in fig. 2, that is, acquiring image information around the cleaning device, the method may further include:
step S31, acquiring first image information based on a first image acquisition module on the cleaning device.
Specifically, the first image collecting module may adopt a camera in the cleaning device shown in fig. 1, and the first image information is 2D image information. Therefore, the image information around the cleaning equipment can be rapidly acquired, and whether the portrait exists around the cleaning equipment can be conveniently and rapidly identified.
Referring to fig. 3 again, based on the step S31, in step S22 of fig. 2, the method may further include:
step S32, identifying whether the first image information includes portrait information by using a first face recognition algorithm.
Step S321, if the first image information is identified to contain portrait information, acquiring second image information based on a second image acquisition module on the cleaning equipment.
Specifically, the second image capturing module may be a structured light module in the cleaning apparatus shown in fig. 1, and correspondingly, the second image information is a 3D image generated by the structured light module according to the generated and received structured light image.
It is not easy to think that, this embodiment lets cleaning equipment gather first image information and second image information respectively and whether there is face information around discerning, and its beneficial effect lies in: if the first image information around the cleaning equipment is obtained singly through a common camera, and the first image information may have the conditions of incompleteness or low quality of face images, the content in the first image information may not be identified accurately by a face identification algorithm, however, the requirement on the quality of images is not high when the images exist in the image information is identified, so that whether the images exist around the cleaning equipment is judged quickly through the first image information, and then the face conditions around the cleaning equipment under the condition that the images exist are determined through the second image information, so that the efficiency and the accuracy of identifying the face information around the cleaning equipment by the cleaning equipment can be improved.
Step S322, if the first image information is identified not to contain the portrait information, returning to the step of acquiring the first image information based on the first image acquisition module on the cleaning equipment.
Fig. 4 is a flowchart after step S321 shown in fig. 3 according to a third embodiment of the present invention, and with reference to fig. 4, after step S321 in fig. 3, the method may further include the following steps:
and step S41, adopting a second face recognition algorithm to recognize whether the second image information contains face information.
Based on the step S41, the steps S221 and 222 shown in fig. 2 may specifically include:
step S421, if the second image information is identified to contain face information, playing interesting information related to the age type to which the face information belongs on the cleaning equipment;
step S422, if it is recognized that the second image information does not include the face information, the step of acquiring the first image information based on the first image acquisition module on the cleaning device is returned.
It should be understood that the second face recognition algorithm in the present embodiment and the first face recognition algorithm described above can be implemented by using existing algorithms or existing technical means. For example, in products such as the existing camera module and the structured light module, a face recognition algorithm is integrated or customization of the face recognition algorithm can be supported, and the contribution of the application to the prior art is not in improvement of the face recognition algorithm, so that the details are not repeated.
Fig. 5 is a specific flowchart of step S221 shown in fig. 2 according to a fourth embodiment of the present invention, and in order to bring a better use experience to a user, a treatment scheme for different pieces of face information around the cleaning device may be further optimized.
As shown in fig. 5, step S221 shown in fig. 2 may further include:
in step S51, if it is recognized that the image information contains face information, the number of different face information is recognized.
After the face information is identified, the step of identifying the number of different pieces of face information is further added, so that the cleaning equipment can make more reasonable playing selection under the situation of different numbers of pieces of face information.
And step S521, when the number of the face information is one, playing interesting information related to the age type of the face information on the cleaning equipment, and returning to the step of acquiring the image information around the cleaning equipment.
In a scene that the number of the face information is one, namely only one person is around the cleaning equipment, at the moment, the situation that the number of people is increased can exist, so that the cleaning equipment can continuously keep obtaining and identifying the surrounding image information while playing the information of interest, so that more reasonable playing selection can be made when different face information exists subsequently, and better using experience is brought to a user.
In step S522, when the number of the face information is at least two, the related information of interest is played according to the priority of the age type corresponding to at least two different face information.
In a scenario where the amount of face information is at least two, i.e. when there are at least two people around the cleaning device, the age types of these different people may or may not be the same. In order to avoid the unpleasant experience of crowdsourcing, the present embodiment allows the cleaning device to play relevant information of interest based on the priority setting and no longer continues to identify image information around the cleaning device.
Fig. 6 is a specific flowchart of step S221 shown in fig. 2 according to a fourth embodiment of the present invention, and in order to bring a better use experience to a user, a disposal scheme of the cleaning device when face information of different age types is recognized may be further optimized.
As shown in fig. 6, before the step S221 shown in fig. 2, that is, before the step of playing the information of interest related to the age type to which the face information belongs on the cleaning device, the method may further include:
step S61, determining whether the age type to which the face information belongs is consistent with the age type according to which the cleaning device is currently playing:
step S621, if the age type to which the face information belongs is consistent with the age type according to which the cleaning device is currently played, returning to the step of acquiring the image information around the cleaning device.
In a scene, when people around the cleaning device exist differently, if the age types of the people face information are consistent, the cleaning device does not change the currently played content, so that the playing of the information of interest is not interrupted when people come and go.
In step S622, if the age type to which the face information belongs is not consistent with the age type according to which the cleaning device plays, the cleaning device plays the related information of interest according to the priority setting for different age types.
In the scenario, at least people of at least two different age categories are present around the cleaning device, then the cleaning device is caused to change the information of interest for playback based on the age category priority setting. Obviously, the larger the number of different age types, the more people around the cleaning device, and in this case, in order to avoid the unpleasant experience of being strange, the present embodiment allows the cleaning device to change the playing of the information of interest only once and stop recognizing the surrounding images again.
Furthermore, besides changing the playing of the information of interest by the cleaning device, the function of directly closing the playing of the information of interest by the cleaning device may be provided, or the function of closing the playing of the information of interest may be provided when the age type to which the face information belongs is inconsistent with the age type according to which the cleaning device plays the information of interest once is changed and played.
Specifically, the information of interest related to the age type to which the face information belongs may be played on the cleaning device in any one of the following manners:
in a first mode, playing audio information which is stored locally in the cleaning equipment and is associated with the age type;
and playing audio information which is acquired by the cleaning equipment through a network and is associated with the age type.
Fig. 7 is a schematic structural diagram of an interesting information playing device provided by the present invention, and in practical applications, the interesting information playing device of the present invention can be installed and applied in the cleaning apparatus shown in fig. 1.
As shown in fig. 7, the information playing apparatus of interest 07 includes an image acquisition module 71, an image recognition module 72, an information playing module 73, and a loop detection module 74, wherein the image acquisition module 71 is configured to acquire image information around the cleaning device; the image recognition module 72 is configured to recognize whether the image information contains face information using a face recognition algorithm: the information playing module 73 is configured to play, if it is recognized that the image information contains face information, information of interest related to an age type to which the face information belongs on the cleaning apparatus; the loop detection module 74 is configured to return to the step of acquiring image information of the surroundings of the cleaning device if it is recognized that the image information does not contain face information.
In an embodiment, the image obtaining module specifically includes: the cleaning device comprises a first image acquisition unit, a second image acquisition unit and a control unit, wherein the first image acquisition unit is configured to acquire first image information based on a first image acquisition module on the cleaning device;
based on the first image obtaining unit, the image recognizing module may specifically include:
a first image recognition unit configured to recognize whether the first image information contains portrait information using a first face recognition algorithm:
a second image acquisition unit configured to acquire second image information based on a second image acquisition module on the cleaning device if it is recognized that the first image information includes portrait information;
and the first circulation detection unit is configured to return to the step of acquiring the first image information based on the first image acquisition module on the cleaning equipment if the first image information is identified to contain no portrait information.
On the basis of the embodiment of the first image recognition unit, the method may further include:
a second image recognition unit configured to employ a second face recognition algorithm to recognize whether the second image information contains face information;
therefore, the information playing module may specifically include:
a first information playing unit configured to play, on the cleaning device, information of interest related to an age type to which the face information belongs if it is recognized that the face information is included in the second image information;
meanwhile, the circulation detection module may specifically include:
and the second circulation detection unit is configured to return to the step of acquiring the first image information based on the first image acquisition module on the cleaning equipment if the second image information is identified to contain no face information.
In an embodiment, the information playing apparatus of interest may further include: an age type obtaining module configured to obtain a classification label of an age type of the face information, or a step of recognizing the age type of the face information using a second face recognition algorithm.
In an embodiment, the information playing module may specifically include:
a face number recognition unit configured to recognize the number of different face information if it is recognized that the face information is included in the image information:
a second information playing unit configured to play, if the number of different pieces of face information is unique, information of interest related to an age type to which the face information belongs on the cleaning apparatus and return to the step of acquiring image information around the cleaning apparatus;
a third information playing unit configured to play the related information of interest according to a priority setting for an age type corresponding to the different face information if the number of the different face information is not unique.
In an embodiment, the information playing module may further specifically include:
an age type comparison unit configured to determine whether the age type to which the face information belongs is consistent with an age type according to which the face information is currently played:
a third loop detection unit configured to return to the step of acquiring image information around the cleaning device if the age type to which the face information belongs is consistent with the age type according to which the face information is currently played;
a fourth information playing unit configured to set playing-related information of interest according to priorities for different age types if an age type to which the face information belongs is not identical to an age type according to which the face information is currently played.
In an embodiment, the information playing module may further specifically include:
a local playing unit configured to play audio information associated with the age type stored locally at the cleaning device;
a network playing unit configured to play audio information associated with the age type acquired by the cleaning device through a network.
Since the present embodiment and the embodiment shown in fig. 2 are the same inventive concept, specific technical features and technical effects that are the same for both embodiments are specifically the same, and therefore, the detailed description of the information playing apparatus of interest is omitted here.
In the above embodiments, the descriptions of the respective embodiments have respective emphasis, and reference may be made to the related descriptions of other embodiments for parts that are not described or illustrated in a certain embodiment.
Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
In the embodiments provided in the present invention, it should be understood that the disclosed apparatus/terminal device and method may be implemented in other ways. For example, the above-described embodiments of the apparatus/terminal device are merely illustrative, and for example, the division of the modules or units is only one logical division, and there may be other divisions when actually implemented, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated modules/units, if implemented in the form of software functional units and sold or used as separate products, may be stored in a computer readable storage medium. Based on such understanding, all or part of the flow of the method according to the embodiments of the present invention may also be implemented by a computer program, which may be stored in a computer-readable storage medium, and when the computer program is executed by a processor, the steps of the method embodiments may be implemented. Wherein the computer program comprises computer program code, which may be in the form of source code, object code, an executable file or some intermediate form, etc. The computer-readable medium may include: any entity or device capable of carrying the computer program code, recording medium, usb disk, removable hard disk, magnetic disk, optical disk, computer Memory, Read-Only Memory (ROM), Random Access Memory (RAM), electrical carrier wave signals, telecommunications signals, software distribution medium, and the like. It should be noted that the computer readable medium may contain content that is subject to appropriate increase or decrease as required by legislation and patent practice in jurisdictions, for example, in some jurisdictions, computer readable media does not include electrical carrier signals and telecommunications signals as is required by legislation and patent practice.
The above-mentioned embodiments are only used for illustrating the technical solutions of the present invention, and not for limiting the same; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; such modifications and substitutions do not substantially depart from the spirit and scope of the embodiments of the present invention, and are intended to be included within the scope of the present invention.
Claims (10)
1. An interesting information playing method applied to a cleaning device is characterized by at least comprising the following steps:
s1: acquiring image information around the cleaning device;
s2: adopting a face recognition algorithm to recognize whether the image information contains face information:
s3: if the image information is identified to contain face information, playing interesting information related to the age type to which the face information belongs on the cleaning equipment;
s4: if it is recognized that the image information does not include face information, the process returns to S1.
2. The method for playing information of interest according to claim 1, wherein the acquiring image information of the surrounding of the cleaning device comprises:
acquiring first image information based on a first image acquisition module on the cleaning equipment; the identifying whether the image information contains face information by adopting a face identification algorithm comprises the following steps:
adopting a first face recognition algorithm to recognize whether the first image information contains portrait information:
if the first image information contains portrait information, acquiring second image information based on a second image acquisition module on the cleaning equipment;
and otherwise, returning to the step of acquiring the first image information based on the first image acquisition module on the cleaning equipment.
3. The method for playing information of interest according to claim 2, wherein after the second image information is acquired by the second image capturing module on the cleaning device, the method further comprises:
identifying whether the second image information contains face information or not by adopting a second face identification algorithm;
if the second image information contains face information, playing interesting information related to the age type to which the face information belongs on the cleaning equipment;
and otherwise, returning to the step of acquiring the first image information based on the first image acquisition module on the cleaning equipment.
4. The method of playing information of interest according to claim 3, further comprising, after the step of if the image information is recognized to include face information, the step of: and acquiring a classification label of the age type of the face information, or identifying the age type of the face information by using a second face identification algorithm.
5. The method for playing information of interest according to claim 1, wherein if it is recognized that the image information contains face information, playing information of interest related to an age type to which the face information belongs on the cleaning device includes:
if the image information is identified to contain face information, the number of the face information is identified:
when the number of the face information is one, playing interesting information related to the age type to which the face information belongs on the cleaning device, and returning to S1;
and when the number of the face information is at least two, setting and playing the related interesting information according to the priorities of the age types corresponding to the at least two different pieces of face information.
6. The method of playing information of interest according to claim 1, further comprising, before playing information of interest related to an age type to which the face information belongs on the cleaning device:
judging whether the age type of the face information is consistent with the age type of the current playing basis:
if the age type of the face information is consistent with the age type of the current playing basis, returning to the step S1;
and if the age type to which the face information belongs is not consistent with the age type according to which the face information is currently played, setting and playing related interesting information according to priorities of different age types.
7. The method for playing information of interest according to any one of claims 1 to 6, wherein the playing of the information of interest on the cleaning device, which is related to the age type to which the face information belongs, includes at least one of:
playing audio information associated with the age type stored locally at the cleaning device;
and playing audio information which is acquired by the cleaning equipment through a network and is associated with the age type.
8. An information playing device of interest, applied to a cleaning device, comprising:
an image acquisition module configured to acquire image information around the cleaning device;
an image recognition module configured to recognize whether the image information contains face information by adopting a face recognition algorithm:
an information playing module configured to play, on the cleaning device, information of interest related to an age type to which the face information belongs if it is recognized that the face information is included in the image information;
and the circulation detection module is configured to return to acquire the image information around the cleaning equipment if the image information is identified to contain no human face information.
9. A cleaning apparatus, comprising:
at least one image acquisition module;
at least one speaker;
the processor is respectively connected with the loudspeaker and the image acquisition module;
a memory storing a computer program operable on the processor to perform the steps of the method according to any one of claims 1 to 7 when the computer program is executed by the processor.
10. The cleaning apparatus defined in claim 9, wherein the cleaning apparatus comprises a sweeping robot.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010665078.0A CN111802963B (en) | 2020-07-10 | 2020-07-10 | Cleaning equipment and interesting information playing method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010665078.0A CN111802963B (en) | 2020-07-10 | 2020-07-10 | Cleaning equipment and interesting information playing method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111802963A true CN111802963A (en) | 2020-10-23 |
| CN111802963B CN111802963B (en) | 2022-01-11 |
Family
ID=72842181
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010665078.0A Active CN111802963B (en) | 2020-07-10 | 2020-07-10 | Cleaning equipment and interesting information playing method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111802963B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113679300A (en) * | 2021-09-13 | 2021-11-23 | 李侃 | Electronic book recommendation method and device for floor sweeping robot |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106570491A (en) * | 2016-11-11 | 2017-04-19 | 华南智能机器人创新研究院 | Robot intelligent interaction method and intelligent robot |
| US20170286753A1 (en) * | 2016-04-01 | 2017-10-05 | Hon Hai Precision Industry Co., Ltd. | Method for identifying age based on facial feature |
| CN107801096A (en) * | 2017-10-30 | 2018-03-13 | 广东欧珀移动通信有限公司 | Control method, device, terminal device and the storage medium of video playback |
| CN108170401A (en) * | 2018-02-26 | 2018-06-15 | 域通全球成都科技有限责任公司 | A kind of audio frequency broadcast system based on recognition of face |
| CN108521618A (en) * | 2018-03-13 | 2018-09-11 | 深圳市沃特沃德股份有限公司 | Audio frequency playing method and device |
| CN110216681A (en) * | 2019-07-23 | 2019-09-10 | 广东佳奇科技教育股份有限公司 | A kind of intelligent robot analysis and Control system based on big data |
| CN110532421A (en) * | 2019-08-30 | 2019-12-03 | 的卢技术有限公司 | A kind of gender based on people, the music recommended method and system of mood and age |
| CN110647651A (en) * | 2019-09-19 | 2020-01-03 | 曹玲 | Expression recognition music recommendation system based on convolutional neural network |
| CN110738078A (en) * | 2018-07-19 | 2020-01-31 | 青岛海信移动通信技术股份有限公司 | face recognition method and terminal equipment |
| CN210047411U (en) * | 2019-02-25 | 2020-02-11 | 浙江吉利汽车研究院有限公司 | Vehicle-mounted entertainment system based on age bracket |
| CN111050105A (en) * | 2019-12-14 | 2020-04-21 | 中国科学院深圳先进技术研究院 | Video playing method and device, toy robot and readable storage medium |
-
2020
- 2020-07-10 CN CN202010665078.0A patent/CN111802963B/en active Active
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20170286753A1 (en) * | 2016-04-01 | 2017-10-05 | Hon Hai Precision Industry Co., Ltd. | Method for identifying age based on facial feature |
| CN106570491A (en) * | 2016-11-11 | 2017-04-19 | 华南智能机器人创新研究院 | Robot intelligent interaction method and intelligent robot |
| CN107801096A (en) * | 2017-10-30 | 2018-03-13 | 广东欧珀移动通信有限公司 | Control method, device, terminal device and the storage medium of video playback |
| CN108170401A (en) * | 2018-02-26 | 2018-06-15 | 域通全球成都科技有限责任公司 | A kind of audio frequency broadcast system based on recognition of face |
| CN108521618A (en) * | 2018-03-13 | 2018-09-11 | 深圳市沃特沃德股份有限公司 | Audio frequency playing method and device |
| CN110738078A (en) * | 2018-07-19 | 2020-01-31 | 青岛海信移动通信技术股份有限公司 | face recognition method and terminal equipment |
| CN210047411U (en) * | 2019-02-25 | 2020-02-11 | 浙江吉利汽车研究院有限公司 | Vehicle-mounted entertainment system based on age bracket |
| CN110216681A (en) * | 2019-07-23 | 2019-09-10 | 广东佳奇科技教育股份有限公司 | A kind of intelligent robot analysis and Control system based on big data |
| CN110532421A (en) * | 2019-08-30 | 2019-12-03 | 的卢技术有限公司 | A kind of gender based on people, the music recommended method and system of mood and age |
| CN110647651A (en) * | 2019-09-19 | 2020-01-03 | 曹玲 | Expression recognition music recommendation system based on convolutional neural network |
| CN111050105A (en) * | 2019-12-14 | 2020-04-21 | 中国科学院深圳先进技术研究院 | Video playing method and device, toy robot and readable storage medium |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113679300A (en) * | 2021-09-13 | 2021-11-23 | 李侃 | Electronic book recommendation method and device for floor sweeping robot |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111802963B (en) | 2022-01-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Das et al. | Toyota smarthome: Real-world activities of daily living | |
| CN105451029B (en) | A kind of processing method and processing device of video image | |
| CN110996153B (en) | Scene recognition-based sound and picture quality enhancement method and system and display | |
| CN109413563A (en) | The sound effect treatment method and Related product of video | |
| TW201719333A (en) | A voice controlling system and method | |
| CN103747346A (en) | Multimedia video playing control method and multimedia video player | |
| CN101877060A (en) | Messaging device and method and program | |
| CN102214304A (en) | Information processing apparatus, information processing method and program | |
| CN102016877A (en) | Methods for capturing depth data of a scene and applying computer actions | |
| CN111802963B (en) | Cleaning equipment and interesting information playing method and device | |
| CN111144344B (en) | Method, device, equipment and storage medium for determining person age | |
| CN112286364A (en) | Man-machine interaction method and device | |
| CN110839175A (en) | Interaction method based on smart television, storage medium and smart television | |
| CN110989390A (en) | Smart home control method and device | |
| CN111814695A (en) | Cleaning equipment and audio information playing method and device | |
| CN110970019A (en) | Control method and device of intelligent home system | |
| CN112597910B (en) | Method and device for monitoring character activities by using sweeping robot | |
| CN110933501B (en) | Child eye protection method for TV device, TV device with child eye protection function and system | |
| CN113934926A (en) | Recommendation method and device for interactive scene and electronic equipment | |
| CN108766486A (en) | A kind of control method, device and electronic equipment | |
| CN109151183A (en) | A kind of audio-visual application program automatic closing method, device and mobile terminal | |
| CN115862682B (en) | Sound detection method and related equipment | |
| CN113286199A (en) | Program recommendation method, television and storage medium | |
| CN115174947A (en) | Live video extraction method and device, storage medium and electronic equipment | |
| CN117742168A (en) | Intelligent home system control method and device based on user intention analysis |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CP01 | Change in the name or title of a patent holder |
Address after: 7-605, 6th floor, building 1, yard a, Guanghua Road, Chaoyang District, Beijing 100026 Patentee after: Beijing dog vacuum cleaner Group Co.,Ltd. Address before: 7-605, 6th floor, building 1, yard a, Guanghua Road, Chaoyang District, Beijing 100026 Patentee before: PUPPY ELECTRONIC APPLIANCES INTERNET TECHNOLOGY (BEIJING) Co.,Ltd. |
|
| CP01 | Change in the name or title of a patent holder |