CN114488752A - Holographic projection method, device, equipment and medium based on sweeper platform - Google Patents
Holographic projection method, device, equipment and medium based on sweeper platform Download PDFInfo
- Publication number
- CN114488752A CN114488752A CN202210081450.2A CN202210081450A CN114488752A CN 114488752 A CN114488752 A CN 114488752A CN 202210081450 A CN202210081450 A CN 202210081450A CN 114488752 A CN114488752 A CN 114488752A
- Authority
- CN
- China
- Prior art keywords
- user
- sweeper
- instruction
- preset
- common user
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 241001417527 Pempheridae Species 0.000 title claims abstract description 86
- 238000000034 method Methods 0.000 title claims abstract description 51
- 210000001747 pupil Anatomy 0.000 claims description 28
- 238000004140 cleaning Methods 0.000 claims description 16
- 238000004590 computer program Methods 0.000 claims description 12
- 238000010408 sweeping Methods 0.000 claims description 12
- 230000003321 amplification Effects 0.000 claims description 10
- 238000003199 nucleic acid amplification method Methods 0.000 claims description 10
- 230000002159 abnormal effect Effects 0.000 claims description 9
- 239000003550 marker Substances 0.000 claims description 8
- 230000003993 interaction Effects 0.000 abstract description 9
- 238000007689 inspection Methods 0.000 abstract description 2
- 230000006870 function Effects 0.000 description 12
- 230000008569 process Effects 0.000 description 11
- 230000009471 action Effects 0.000 description 6
- 230000004397 blinking Effects 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 230000033001 locomotion Effects 0.000 description 3
- 238000010586 diagram Methods 0.000 description 2
- 230000004424 eye movement Effects 0.000 description 2
- 230000033764 rhythmic process Effects 0.000 description 2
- 230000001360 synchronised effect Effects 0.000 description 2
- 239000003086 colorant Substances 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 239000000428 dust Substances 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000004418 eye rotation Effects 0.000 description 1
- 230000009191 jumping Effects 0.000 description 1
- 208000011977 language disease Diseases 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 208000029257 vision disease Diseases 0.000 description 1
- 230000002618 waking effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
- G03H1/22—Processes or apparatus for obtaining an optical image from holograms
-
- A—HUMAN NECESSITIES
- A47—FURNITURE; DOMESTIC ARTICLES OR APPLIANCES; COFFEE MILLS; SPICE MILLS; SUCTION CLEANERS IN GENERAL
- A47L—DOMESTIC WASHING OR CLEANING; SUCTION CLEANERS IN GENERAL
- A47L11/00—Machines for cleaning floors, carpets, furniture, walls, or wall coverings
- A47L11/24—Floor-sweeping machines, motor-driven
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/08—Projecting images onto non-planar surfaces, e.g. geodetic screens
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The application discloses holographic projection method based on sweeper platform, device, equipment and medium, user's accessible is preset the mode and is carried out human-computer interaction with the sweeper, the video of sweeper work, reappear such as video recording clean the inspection etc. and can neglect the region that does not clean at its clean in-process to the sweeper sign based on holographic projection technique, so that the sweeper carries out the degree of depth and cleans, through set up the holographic projection module on the sweeper, give the powerful human-computer interaction function of sweeper, make its function perfect more and diversified, aim at solving the problem that the current sweeper can only project and can not carry out human-computer interaction and lead to user experience to feel poor.
Description
Technical Field
The disclosure relates to the technical field of intelligent home projection, in particular to a holographic projection method, a device, equipment and a medium based on a sweeper platform.
Background
As early as 1947, hungarian physicist danis-gabor invented holographic projection technology. The first three-dimensional object was recorded in 1962 by the science of soviet union, philips. With the development of the technology, stereoscopic images can be stably projected at present.
The existing sweeping robot is single in function, most of sweeping robots only have a sweeping function, a few sweeping robots have a plane projection function, but the plane projection can only project a video, and the sweeping robot does not have a man-machine interaction function with a holographic projection function.
Disclosure of Invention
The application provides a holographic projection method, a holographic projection device, equipment and a medium based on a sweeper platform, and the holographic projection module is arranged on the sweeper, so that the sweeper is endowed with a strong human-computer interaction function, the function of the sweeper is more perfect and diversified, and the problem that the user experience is poor due to the fact that the existing sweeper can only project and cannot perform human-computer interaction is solved.
In order to achieve the above-mentioned problem, in a first aspect, the present application provides a holographic projection method based on a sweeper platform, including:
acquiring a first demand instruction of a common user;
extracting first keyword information according to the first requirement instruction of the common user;
matching the first keyword information with words in a preset work word bank;
when the first keyword information is matched with words in the preset work word bank, obtaining a work video matched with the first keyword information;
projecting and playing the working video based on holographic projection to generate a first projection image;
after projection playing, obtaining the marking characteristics of the common user by using a preset mode;
obtaining a marker region based on the marker feature in combination with the projection image;
and controlling the sweeper to perform deep cleaning on the marked area.
Preferably, when the preset mode is a gesture recognition mode, the step of obtaining the mark feature of the frequently-used user by using the preset mode includes:
acquiring and analyzing a first gesture instruction of the common user;
when the first gesture instruction of the common user is matched with a preset gesture awakening instruction, awakening the gesture recognition mode;
continuing to track and identify second gesture instructions of the frequently-used user;
and analyzing the second gesture instruction to generate the marking characteristics of the common user.
Preferably, when the preset mode is a pupil identification mode, the step of obtaining the mark feature of the user by using the preset mode includes:
acquiring and analyzing a first pupil instruction of the common user;
when the first pupil instruction of the common user is matched with a preset pupil awakening instruction, awakening the pupil identification mode;
continuing to track and identify a second pupil instruction of the frequent user;
and analyzing the second pupil instruction to generate the mark characteristics of the common user.
Preferably, when the preset mode is a voice recognition mode, the step of obtaining the mark feature of the user by using the preset mode includes:
acquiring a first voice instruction sent by the common user;
when the first voice instruction of the common user is matched with a preset voice awakening instruction, awakening the voice recognition mode;
acquiring a second voice instruction sent by the common user;
extracting keyword information contained in the voice instruction based on voice recognition;
and analyzing the keyword information to generate the marking characteristics of the common user.
Preferably, after the step of obtaining a labeled region based on the labeled feature and in combination with the projection image, the method further includes:
acquiring an amplification instruction of the common user;
and amplifying the marked area by preset times according to the amplification instruction.
Preferably, after the step of extracting the first keyword information according to the first requirement instruction of the frequently-used user, the method includes:
matching the first keyword information with words in a preset entertainment word stock;
when the first keyword information is matched with words in a preset entertainment word stock, acquiring media content matched with the first keyword information;
and performing projection playing on the media content based on holographic projection to generate a second projection image.
Preferably, after the step of projecting and playing the media content based on the holographic projection and generating the second projection image, the method further includes:
acquiring a second demand instruction of the common user;
extracting second keyword information in the second demand instruction according to the second demand instruction;
acquiring second media content matched with the second keyword information;
and projecting and playing the second media content.
Preferably, after the step of projecting and playing the media content based on the holographic projection and generating the second projection image, the method further includes:
acquiring a self-photographing instruction of the common user;
locking and shooting the common user according to the self-shooting instruction to generate a self-shooting video;
and projecting and playing the self-timer video and the media content together to generate a third projection image.
Preferably, before the step of obtaining the first requirement instruction of the common user, the method includes:
acquiring first sign information of a current user;
comparing and identifying the first sign information with at least one sign information in a preset sign library;
when the first sign information is consistent with the sign information in the preset sign library in comparison, judging that the current user is a common user;
when the first sign information is inconsistent with the sign information in the preset sign library, judging that the current user is an abnormal user;
recording and storing the physical sign information of the abnormal user and generating alarm information;
and sending the sign information of the abnormal user and the alarm information to a preset user side.
The present disclosure also provides a holographic projection device based on sweeper platform, wherein, include:
the first instruction acquisition module is used for acquiring a first requirement instruction of a common user;
the first keyword acquisition module is used for extracting first keyword information according to a first requirement instruction of the common user;
the matching module is used for matching the first keyword information with words in a preset work word bank;
the work video acquisition module is used for acquiring a work video matched with the first keyword information when the first keyword information is matched with the words in the preset work word bank;
the first projection module is used for projecting and playing the working video based on holographic projection to generate a first projection image;
the mark characteristic acquisition module is used for acquiring the mark characteristics of the common user by using a preset mode after projection playing;
a marking region acquisition module, configured to obtain a marking region based on the marking feature in combination with the projection image;
and the cleaning module is used for controlling the sweeper to perform deep cleaning on the marked area.
The present disclosure also provides a computer device, which includes a memory and a processor, where the memory stores a computer program, and the processor implements the steps of any one of the above holographic projection methods based on a sweeper platform when executing the computer program.
The present disclosure also provides a computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, implements the steps of a sweeper platform-based holographic projection method as set forth in any one of the above.
The utility model discloses a holographic projection method, device, equipment and medium based on sweeper platform, the user can carry out human-computer interaction with the sweeper through the mode that predetermines, the video of sweeper work, reappear such as video recording clean the inspection etc. and can neglect the region that does not clean to the sweeper sign cleaning process based on holographic projection technique, so that the sweeper carries out the degree of depth and cleans, through set up the holographic projection module on the sweeper, give the strong human-computer interaction function of sweeper, make its function perfect more and diversified, aim at solving the problem that the current sweeper can only project and can not carry out human-computer interaction and lead to user experience to feel poor.
Drawings
Fig. 1 is a schematic flow chart of a holographic projection method based on a sweeper platform according to an embodiment;
fig. 2 is a schematic structural view of a holographic projection device based on a sweeper platform according to an embodiment;
FIG. 3 is a block diagram illustrating a computer device according to an embodiment.
The objects, features, and advantages of the present disclosure will be further explained with reference to the accompanying drawings.
Detailed Description
In order to make the objects, technical solutions and advantages of the present disclosure more clearly understood, the present disclosure is further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the disclosure and are not intended to limit the disclosure.
As used herein, the singular forms "a", "an", "the" and "the" include plural referents unless the content clearly dictates otherwise. It will be further understood that the terms "comprises" and/or "comprising," when used in this specification, specify the presence of stated features, integers, steps, operations, elements, units, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, units, components, and/or groups thereof. It will be understood that when an element is referred to as being "connected" or "coupled" to another element, it can be directly connected or coupled to the other element or intervening elements may also be present. Further, "connected" or "coupled" as used herein may include wirelessly connected or wirelessly coupled. As used herein, the term "and/or" includes all or any element and all combinations of one or more of the associated listed items.
It will be understood by those within the art that, unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this disclosure belongs. It will be further understood that terms, such as those defined in commonly used dictionaries, should be interpreted as having a meaning that is consistent with their meaning in the context of the prior art and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein.
Referring to fig. 1, a schematic flow chart of a holographic projection method based on a sweeper platform disclosed in the present disclosure includes:
s1: acquiring a first demand instruction of a common user;
s2: extracting first keyword information according to the first requirement instruction of the common user;
s3: matching the first keyword information with words in a preset work word bank;
s4: when the first keyword information is matched with words in the preset work word bank, obtaining a work video matched with the first keyword information;
s5: projecting and playing the working video based on holographic projection to generate a first projection image;
s6: after projection playing, obtaining the marking characteristics of the common user by using a preset mode;
s7: obtaining a marker region based on the marker feature in combination with the projection image;
s8: and controlling the sweeper to perform deep cleaning on the marked area.
As described in the foregoing steps S1-S5, a preset lexicon is preset in the memory of the sweeper, the words in the preset lexicon include an entertainment lexicon and a work lexicon, wherein the entertainment lexicon includes various entertainment words such as words related to games, words related to music, words related to videos, words related to fitness and sports, words related to dances, and the like, the work lexicon is preset with words related to daily work of the sweeper, such as "dust", "cleaning", "monitoring", "lighting", and words related to corresponding rooms and furniture, and the preset lexicon can be added by user' S own input, and can also be automatically updated and supplemented based on a communication network; if the user sends an instruction to check the cleaning video of the room A at present when the user returns, the cleaning machine can extract the room A and the cleaning video as key words, extract the cleaning video of the room A at present and project the cleaning video based on holographic projection to form a projection video;
as described in step S6, after the sweeping video of the room a is projected, the sweeping machine records whether the user marks the projected image, for example, when the user checks the video, it is found that there is residual stain under the sofa of the room a and the stain is not cleaned, the user can mark the residual stain through a gesture recognition mode, a voice recognition mode or a pupil recognition mode, the sweeping machine detects whether the user raises his/her hand to identify the sofa of the room a in the frame selection of the projected image, or sends a command through voice to indicate that the sofa of the room a needs to be swept again under the sofa, the sweeping machine identifies the sofa of the room a in the frame selection of the projected image based on the voice recognition, or uses the pupil recognition to, for example, stop the eyes for a predetermined time to frame the area, and wake up the input key through a specific eye movement such as three times of continuous upward turning of the eyes or 3 continuous blinking of the eyes, and so on other operations A disc, where a logo or the like is entered by eye rotation or blinking.
As described in the above steps S7-S8, after the user identifier is identified, the sweeper marks the position of "below the sofa in room a" in the built-in map according to the information identified by the user in the projection image frame, and when the sweeper is idle, the automatic navigation system performs sweeping in the past by using the holographic projection technology, so that the user experience when using the sweeper can be greatly improved.
In an embodiment, when the preset mode is a gesture recognition mode, the step of obtaining the mark feature of the frequently-used user by using the preset mode includes:
acquiring and analyzing a first gesture instruction of the common user;
when the first gesture instruction of the common user is matched with a preset gesture awakening instruction, awakening the gesture recognition mode;
continuing to track and identify second gesture instructions of the frequently-used user;
and analyzing the second gesture instruction to generate the marking characteristics of the common user.
As described above, when the gesture recognition mode is used, firstly, the user needs to make a preset wake-up gesture to wake up and control the sweeper, for example, two hands continuously clap hands for 3 times, and the like, a specific wake-up gesture can be set by the user himself, after the sweeper is woken up, the gesture recognition module of the sweeper can continuously track the gesture of the user unless the user makes a preset close gesture to close the mode, in the process, the user can designate any position of the sweeper in the displayed projected image to perform operations such as amplification, sliding or identification through lifting up the gesture, and the use of people who are not good at operating intelligent products is facilitated.
In an embodiment, when the preset mode is a pupil identification mode, the step of obtaining the mark feature of the user by using the preset mode includes:
acquiring and analyzing a first pupil instruction of the common user;
when the first pupil instruction of the common user is matched with a preset pupil awakening instruction, awakening the pupil identification mode;
continuing to track and identify a second pupil instruction of the frequent user;
and analyzing the second pupil instruction to generate the mark characteristics of the common user.
As described above, similarly, when the pupil recognition mode is used, firstly, the user needs to make a preset eye motion to wake up and control the sweeper, for example, the eyes continuously turn upwards for 3 times or blink for 3 times, and the specific wake-up motion can be set by the user himself, after waking up, the gesture recognition module of the sweeper can continuously track the gesture of the user unless the user makes a preset closing motion to close the sweeper, and in the process, the user can designate any position in the display projection image of the sweeper to perform operations such as amplification, sliding or identification through blinking, flipping to the eyes in a certain direction, and the like, so that the user can conveniently use the sweeper by people with language disorder.
In an embodiment, when the preset mode is a voice recognition mode, the step of obtaining the mark feature of the user by using the preset mode includes:
acquiring a first voice instruction sent by the common user;
when the first voice instruction of the common user is matched with a preset voice awakening instruction, awakening the voice recognition mode;
acquiring a second voice instruction sent by the common user;
extracting keyword information contained in the voice instruction based on voice recognition;
and analyzing the keyword information to generate the marking characteristics of the common user.
As described above, similarly, when the user starts the voice recognition mode, the user also needs to send a wake-up password such as "start the voice control mode" to the sweeper for wake-up operation, when the sweeper acquires the password of "start the voice control mode", the voice control mode is started and a response is made, after wake-up, the voice recognition module of the sweeper continuously recognizes the voice command sent by the user and makes related operation according to the voice command, unless the user sends a preset close password to close the mode, during this process, the sweeper recognizes that the user sends "the voice needs to be cleaned again below the sofa of the room a" based on voice recognition, and marks such as "needs to be cleaned again" in the sofa of the room a in the built-in map, and the user can also send a corresponding operation password to the sweeper to control the sweeper to enlarge or slide the projected image and the like, is convenient for people with visual disorder to use.
In one embodiment, after the step of obtaining a labeled region based on the labeled feature and in combination with the projection image, the method further comprises:
acquiring an amplification instruction of the common user;
and amplifying the marked area by preset times according to the amplification instruction.
As described above, when a user needs to carefully check a video at a certain position, the user can send an amplification instruction to the sweeper through a gesture instruction based on the gesture recognition mode or through eye movement based on the through hole recognition mode or through a voice password, and the sweeper amplifies a region designated by the user in a projected image according to the amplification instruction of the user, so that the user can clearly check the indoor conditions, and meanwhile, the user can search for lost articles through the amplified marked region.
In an embodiment, after the step of extracting the first keyword information according to the first requirement instruction of the frequently-used user, the method includes:
matching the first keyword information with words in a preset entertainment word stock;
when the first keyword information is matched with words in a preset entertainment word stock, acquiring media content matched with the first keyword information;
and performing projection playing on the media content based on holographic projection to generate a second projection image.
As described above, when the user goes home and does not issue a command to check the sanitary environment of the home, the sweeper may also be used as a multimedia device, for example, after the user goes home, if the command "play a song of B (B is the name of singer)", the sweeper may extract "B" and "song" as keywords, and match "B" and "song" with terms in an entertainment lexicon preset in the sweeper, wherein the entertainment lexicon includes various entertainment terms such as terms of game-related categories, terms of music, terms of video, terms of fitness and sports, terms of dance and the like, or connects to the cloud through WIFI, retrieves the song of "B" for playing, and if the command "i want to play XX game", then searches for "XX game", or if the command "want to yoga", then searches for "yoga" related video and projects it by using the holographic projection module, similarly, the user can operate the projected image picture through the gesture recognition mode, the voice recognition mode and the gesture recognition mode, so that the user can be personally on the scene, and the experience of the user is greatly improved.
In a real-time example, after the step of projecting and playing the media content based on the holographic projection and generating the second projection image, the method further includes:
acquiring a second demand instruction of the common user;
extracting second keyword information in the second demand instruction according to the second demand instruction;
acquiring second media content matched with the second keyword information;
and projecting and playing the second media content.
As described above, for example, in the process of listening to songs, playing games, or yoga, the sweeper can search out relevant videos or music according to the instruction by sending out relevant instructions to the sweeper, and play the videos or music, for example, when the user has a game, some music with a faster rhythm can be played again by the sweeper, and some pictures with color jumps can be played during yoga or exercise, so as to add some atmosphere feelings.
In a real-time example, after the step of projecting and playing the media content based on the holographic projection and generating the second projection image, the method further includes:
acquiring a self-photographing instruction of the common user;
locking and shooting the common user according to the self-shooting instruction to generate a self-shooting video;
and projecting and playing the self-timer video and the media content together to generate a third projection image.
As mentioned above, if the user is in yoga or when dancing, the user can send an instruction to the sweeper, some dance or yoga teaching videos which want to learn are played, meanwhile, the built-in camera of the sweeper can be used for shooting the picture action video of the user for yoga or dancing, and the picture action video of the user for yoga or dancing is synchronously projected with the teaching videos, so that the user can visually see whether the action of the user is in place or not and the action in the teaching videos, and the user is helped to better provide the exercise efficiency of the user.
In one embodiment, the step of obtaining the first requirement instruction of the frequently-used user is preceded by:
acquiring first sign information of a current user;
comparing and identifying the first sign information with at least one sign information in a preset sign library;
when the first sign information is consistent with the sign information in the preset sign library in comparison, judging that the current user is a common user;
when the first sign information is inconsistent with the sign information in the preset sign library, judging that the current user is an abnormal user;
recording and storing the physical sign information of the abnormal user and generating alarm information;
and sending the sign information of the abnormal user and the alarm information to a preset user side.
As described above, when a person enters a room, the physical sign of the user is firstly identified through pupil identification or voice identification photographing comparison, wherein the physical sign information of the user comprises the tone of the user, or the face texture or the pupil texture of the user, the obtained physical sign of the user is compared with the physical sign information in a preset user physical sign library, whether the person who returns is a common user is confirmed, if yes, the common user is served, if not, the physical sign of the person who comes in is shot, alarm information is generated, the physical sign and the alarm information of the person who comes in are sent to a bound user to confirm whether a stranger intrudes in, and an APP in a mobile phone of the user has alarm bell and vibration prompt functions, so that the user can confirm whether the alarm is needed in the first time, and the safety and anti-theft effect can be achieved.
Referring to fig. 2, a holographic projection device based on a platform of a sweeper in the present embodiment includes:
a first instruction obtaining module 100, configured to obtain a first requirement instruction of a frequently-used user;
the first keyword obtaining module 200 is configured to extract first keyword information according to a first requirement instruction of the frequently-used user;
the matching module 300 is used for matching the first keyword information with words in a preset work word bank;
a work video acquiring module 400, configured to acquire a work video matching the first keyword information when the first keyword information matches a word in the preset work thesaurus;
the first projection module 500 is configured to project and play the working video based on holographic projection to generate a first projection image;
a mark feature obtaining module 600, configured to obtain, after the projection is played, a mark feature of the frequently-used user by using a preset mode;
a labeled region acquiring module 700, configured to acquire a labeled region based on the labeled feature in combination with the projection image;
a cleaning module 800 for controlling the sweeper to perform deep cleaning of the marked area
Referring to fig. 3, a computer device, which may be a server and whose internal structure may be as shown in fig. 3, is also provided in the embodiments of the present disclosure. The computer device includes a processor, a memory, a network interface, and a database connected by a system bus. Wherein the computer designed processor is used to provide computational and control capabilities. The memory of the computer device comprises a nonvolatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program, and a database. The internal memory provides an environment for the operation of an operating system and computer programs in the non-volatile storage medium. The database of the computer equipment is used for storing holographic projection data and the like based on the platform of the sweeper. The network interface of the computer device is used for communicating with an external terminal through a network connection. The computer program is executed by a processor to implement a holographic projection method based on a sweeper platform.
Those skilled in the art will appreciate that the architecture shown in fig. 3 is merely a block diagram of some of the structures associated with the disclosed aspects and is not intended to limit the scope of the present disclosure as applied to computer devices.
An embodiment of the present disclosure also provides a computer-readable storage medium on which a computer program is stored, where the computer program, when executed by a processor, implements a holographic projection method based on a sweeper platform. It is to be understood that the computer-readable storage medium in the present embodiment may be a volatile-readable storage medium or a non-volatile-readable storage medium.
In summary, the holographic projection method, apparatus, device and medium based on the sweeper platform provided in the embodiments of the present disclosure can utilize the function of holographic projection to project the whole room image through the sweeper, and can mark the required sweeping area in the room image by using the pupil recognition module, the gesture recognition module or the voice recognition module, so that the sweeper can automatically sweep according to the marked point, and meanwhile, the sweeper is further provided with more entertainment functions, so that some pictures with jumping colors and music with fast rhythm can be played when playing games, or the user projects a fitness video through the sweeper, and the sweeper locks the front of the user through the pupil recognition module, so that the user's actions can be recorded at any time, and the user can learn and check or correct his/her actions at any time, which is very powerful.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by hardware instructions of a computer program, which can be stored in a non-volatile computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. Any reference to memory, storage, database, or other medium provided by the disclosure and used in the embodiments may include non-volatile and/or volatile memory, among others. Non-volatile memory can include read-only memory (ROM), Programmable ROM (PROM), Electrically Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), double-rate SDRAM (SSRSDRAM), Enhanced SDRAM (ESDRAM), synchronous link (Synchlink) DRAM (SLDRAM), Rambus Direct RAM (RDRAM), direct bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, apparatus, article, or method that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, apparatus, article, or method. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, apparatus, article, or method that includes the element.
The above description is only a preferred embodiment of the present disclosure, and not intended to limit the scope of the present disclosure, and all modifications of equivalent structures and equivalent processes, which are made by using the contents of the present disclosure and the accompanying drawings, or directly or indirectly applied to other related technical fields, are also included in the scope of the present disclosure.
Claims (10)
1. A holographic projection method based on a sweeper platform is characterized by comprising the following steps:
acquiring a first demand instruction of a common user;
extracting first keyword information according to the first requirement instruction of the common user;
matching the first keyword information with words in a preset work word bank;
when the first keyword information is matched with words in the preset work word bank, obtaining a work video matched with the first keyword information;
projecting and playing the working video based on holographic projection to generate a first projection image;
after projection playing, obtaining the marking characteristics of the common user by using a preset mode;
obtaining a marker region based on the marker feature in combination with the projection image;
and controlling the sweeper to perform deep cleaning on the marked area.
2. The holographic projection method based on the sweeper platform of claim 1, wherein when the preset mode is a gesture recognition mode, the obtaining the mark characteristics of the common user by using the preset mode comprises:
acquiring and analyzing a first gesture instruction of the common user;
when the first gesture instruction of the common user is matched with a preset gesture awakening instruction, awakening the gesture recognition mode;
continuing to track and identify second gesture instructions of the frequently-used user;
and analyzing the second gesture instruction to generate the marking characteristics of the common user.
3. The holographic projection method based on the sweeper platform of claim 1, wherein when the preset mode is a pupil identification mode, the obtaining the marking characteristics of the user by using the preset mode comprises:
acquiring and analyzing a first pupil instruction of the common user;
when the first pupil instruction of the common user is matched with a preset pupil awakening instruction, awakening the pupil identification mode;
continuing to track and identify a second pupil instruction of the frequent user;
and analyzing the second pupil instruction to generate the mark characteristics of the common user.
4. The holographic projection method based on the sweeper platform of claim 1, wherein when the preset mode is a voice recognition mode, the obtaining the marking characteristics of the user by using the preset mode comprises:
acquiring a first voice instruction sent by the common user;
when the first voice instruction of the common user is matched with a preset voice awakening instruction, awakening the voice recognition mode;
acquiring a second voice instruction sent by the common user;
extracting keyword information contained in the voice instruction based on voice recognition;
and analyzing the keyword information to generate the marking characteristics of the common user.
5. The sweeper platform-based holographic projection method of claim 1, wherein after the step of obtaining a marker area in combination with the projected image based on the marker feature, further comprising:
acquiring an amplification instruction of the common user;
and amplifying the marked area by preset times according to the amplification instruction.
6. The holographic projection method based on the sweeper platform as claimed in claim 1, wherein the step of extracting the first keyword information according to the first requirement instruction of the common user is followed by:
matching the first keyword information with words in a preset entertainment word stock;
when the first keyword information is matched with words in a preset entertainment word stock, acquiring media content matched with the first keyword information;
and performing projection playing on the media content based on holographic projection to generate a second projection image.
7. The holographic projection method based on the sweeper platform as claimed in claim 1, wherein the step of obtaining the first demand instruction of the general user is preceded by:
acquiring first sign information of a current user;
comparing and identifying the first sign information with at least one sign information in a preset sign library;
when the first sign information is consistent with the sign information in the preset sign library in comparison, judging that the current user is a common user;
when the first sign information is inconsistent with the sign information in the preset sign library, judging that the current user is an abnormal user;
recording and storing the physical sign information of the abnormal user and generating alarm information;
and sending the sign information of the abnormal user and the alarm information to a preset user side.
8. The utility model provides a holographic projection arrangement based on quick-witted platform of sweeping floor which characterized in that includes:
the first instruction acquisition module is used for acquiring a first requirement instruction of a common user;
the first keyword acquisition module is used for extracting first keyword information according to a first requirement instruction of the common user;
the matching module is used for matching the first keyword information with words in a preset work word bank;
the work video acquisition module is used for acquiring a work video matched with the first keyword information when the first keyword information is matched with the words in the preset work word bank;
the first projection module is used for projecting and playing the working video based on holographic projection to generate a first projection image;
the mark characteristic acquisition module is used for acquiring the mark characteristics of the common user by using a preset mode after projection playing;
a marking region acquisition module, configured to obtain a marking region based on the marking feature in combination with the projection image;
and the cleaning module is used for controlling the sweeper to perform deep cleaning on the marked area.
9. A computer device comprising a memory and a processor, the memory having stored therein a computer program, wherein the processor when executing the computer program implements the steps of the sweeper platform based holographic projection method of any of claims 1 to 7.
10. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the sweeper platform based holographic projection method of any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210081450.2A CN114488752A (en) | 2022-01-24 | 2022-01-24 | Holographic projection method, device, equipment and medium based on sweeper platform |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210081450.2A CN114488752A (en) | 2022-01-24 | 2022-01-24 | Holographic projection method, device, equipment and medium based on sweeper platform |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114488752A true CN114488752A (en) | 2022-05-13 |
Family
ID=81473920
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210081450.2A Pending CN114488752A (en) | 2022-01-24 | 2022-01-24 | Holographic projection method, device, equipment and medium based on sweeper platform |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114488752A (en) |
Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103792944A (en) * | 2014-02-26 | 2014-05-14 | 曾光 | Internet-of-Things multimedia purification and dust collection intelligent robot |
| CN105639818A (en) * | 2016-04-11 | 2016-06-08 | 中国建筑东北设计研究院有限公司 | Intelligent safety helmet based on augmented reality, space scanning and gesture recognition technologies |
| CN106709937A (en) * | 2016-12-21 | 2017-05-24 | 四川以太原力科技有限公司 | Method for controlling floor mopping robot |
| CN206726170U (en) * | 2017-05-09 | 2017-12-08 | 山东师范大学 | A kind of interactive hologram equipment |
| CN108919959A (en) * | 2018-07-23 | 2018-11-30 | 奇瑞汽车股份有限公司 | Vehicle man machine's exchange method and system |
| CN109199240A (en) * | 2018-07-24 | 2019-01-15 | 上海斐讯数据通信技术有限公司 | A kind of sweeping robot control method and system based on gesture control |
| CN109391759A (en) * | 2018-10-12 | 2019-02-26 | 东莞市凯木金电子科技有限公司 | A kind of infrared identification camera module of sweeper |
| CN110446999A (en) * | 2017-03-23 | 2019-11-12 | 谷歌有限责任公司 | Ocular signal enhancing control |
| CN110794691A (en) * | 2018-08-03 | 2020-02-14 | 青岛海尔空调器有限总公司 | Method and device for controlling intelligent household electrical appliance and computer storage medium |
| CN111367271A (en) * | 2018-12-26 | 2020-07-03 | 珠海市一微半导体有限公司 | Planning method, system and chip for cleaning path of robot |
| CN111427456A (en) * | 2020-06-09 | 2020-07-17 | 杭州翔毅科技有限公司 | Real-time interaction method, device and equipment based on holographic imaging and storage medium |
| CN111931579A (en) * | 2020-07-09 | 2020-11-13 | 上海交通大学 | Automatic driving assistance system and method using eye tracking and gesture recognition technology |
| CN112773262A (en) * | 2019-11-08 | 2021-05-11 | 珠海市一微半导体有限公司 | Security control method based on sweeping robot, sweeping robot and chip |
-
2022
- 2022-01-24 CN CN202210081450.2A patent/CN114488752A/en active Pending
Patent Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103792944A (en) * | 2014-02-26 | 2014-05-14 | 曾光 | Internet-of-Things multimedia purification and dust collection intelligent robot |
| CN105639818A (en) * | 2016-04-11 | 2016-06-08 | 中国建筑东北设计研究院有限公司 | Intelligent safety helmet based on augmented reality, space scanning and gesture recognition technologies |
| CN106709937A (en) * | 2016-12-21 | 2017-05-24 | 四川以太原力科技有限公司 | Method for controlling floor mopping robot |
| CN110446999A (en) * | 2017-03-23 | 2019-11-12 | 谷歌有限责任公司 | Ocular signal enhancing control |
| CN206726170U (en) * | 2017-05-09 | 2017-12-08 | 山东师范大学 | A kind of interactive hologram equipment |
| CN108919959A (en) * | 2018-07-23 | 2018-11-30 | 奇瑞汽车股份有限公司 | Vehicle man machine's exchange method and system |
| CN109199240A (en) * | 2018-07-24 | 2019-01-15 | 上海斐讯数据通信技术有限公司 | A kind of sweeping robot control method and system based on gesture control |
| CN110794691A (en) * | 2018-08-03 | 2020-02-14 | 青岛海尔空调器有限总公司 | Method and device for controlling intelligent household electrical appliance and computer storage medium |
| CN109391759A (en) * | 2018-10-12 | 2019-02-26 | 东莞市凯木金电子科技有限公司 | A kind of infrared identification camera module of sweeper |
| CN111367271A (en) * | 2018-12-26 | 2020-07-03 | 珠海市一微半导体有限公司 | Planning method, system and chip for cleaning path of robot |
| CN112773262A (en) * | 2019-11-08 | 2021-05-11 | 珠海市一微半导体有限公司 | Security control method based on sweeping robot, sweeping robot and chip |
| CN111427456A (en) * | 2020-06-09 | 2020-07-17 | 杭州翔毅科技有限公司 | Real-time interaction method, device and equipment based on holographic imaging and storage medium |
| CN111931579A (en) * | 2020-07-09 | 2020-11-13 | 上海交通大学 | Automatic driving assistance system and method using eye tracking and gesture recognition technology |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10650815B2 (en) | Voice interaction device, voice interaction method, voice interaction program, and robot | |
| CN108075892B (en) | Voice processing method, device and equipment | |
| JP7325668B2 (en) | Scene-aware video dialogue | |
| CN107977834B (en) | Data object interaction method and device in virtual reality/augmented reality space environment | |
| CN106648082A (en) | Intelligent service device capable of simulating human interactions and method | |
| CN106020448B (en) | Man-machine interaction method and system based on intelligent terminal | |
| CN101506828A (en) | Media identification | |
| TW201003539A (en) | Method, apparatus and computer program product for providing gesture analysis | |
| CN1210679C (en) | Information recording device and method, measuring device and method, information processing device, method and system, and information providing medium | |
| CN108335747A (en) | Cognitive training system | |
| WO2017181609A1 (en) | Interface jump management method and device | |
| KR20200097637A (en) | Simulation sandbox system | |
| CN109240786A (en) | A kind of subject replacement method and electronic equipment | |
| CN107274731A (en) | Towards children's study method, facility for study and storage medium | |
| Cante et al. | The cultural-aesthetic specificities of all-male moving-image pornography | |
| CN107371052A (en) | Apparatus control method and device | |
| CN112528768A (en) | Action processing method and device in video, electronic equipment and storage medium | |
| CN104965589A (en) | Human living body detection method and device based on human brain intelligence and man-machine interaction | |
| CN105797374A (en) | Method for giving out corresponding voice in following way by being matched with face expressions and terminal | |
| CN114859749B (en) | Intelligent home management method and system based on Internet of things | |
| CN110427099A (en) | Information recording method, device, system, electronic equipment and information acquisition method | |
| WO2020215776A1 (en) | Multimedia data processing method and apparatus | |
| JP2014023745A (en) | Dance teaching device | |
| CN106571087A (en) | Teaching system with memory function, and teaching method | |
| CN110324650A (en) | Method, apparatus, electronic equipment and the storage medium of Data Matching |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |