CN112764529A - System and method for wall surface radar projection interaction - Google Patents

System and method for wall surface radar projection interaction Download PDF

Info

Publication number
CN112764529A
CN112764529A CN202011614034.1A CN202011614034A CN112764529A CN 112764529 A CN112764529 A CN 112764529A CN 202011614034 A CN202011614034 A CN 202011614034A CN 112764529 A CN112764529 A CN 112764529A
Authority
CN
China
Prior art keywords
multimedia controller
wall surface
radar
projector
projection image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202011614034.1A
Other languages
Chinese (zh)
Inventor
艾元平
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangzhou Desheng Photoelectric Technology Inc
Original Assignee
Guangzhou Desheng Photoelectric Technology Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangzhou Desheng Photoelectric Technology Inc filed Critical Guangzhou Desheng Photoelectric Technology Inc
Priority to CN202011614034.1A priority Critical patent/CN112764529A/en
Publication of CN112764529A publication Critical patent/CN112764529A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/02—Systems using reflection of radio waves, e.g. primary radar systems; Analogous systems
    • G01S13/04—Systems determining presence of a target
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09F—DISPLAYING; ADVERTISING; SIGNS; LABELS OR NAME-PLATES; SEALS
    • G09F19/00—Advertising or display means not otherwise provided for
    • G09F19/12—Advertising or display means not otherwise provided for using special optical effects
    • G09F19/18—Advertising or display means not otherwise provided for using special optical effects involving the use of optical projection means, e.g. projection of images on clouds
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09F—DISPLAYING; ADVERTISING; SIGNS; LABELS OR NAME-PLATES; SEALS
    • G09F27/00—Combined visual and audible advertising or displaying, e.g. for public address
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/12—Picture reproducers
    • H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
    • H04N9/3179—Video signal processing therefor
    • H—ELECTRICITY
    • H05—ELECTRIC TECHNIQUES NOT OTHERWISE PROVIDED FOR
    • H05B—ELECTRIC HEATING; ELECTRIC LIGHT SOURCES NOT OTHERWISE PROVIDED FOR; CIRCUIT ARRANGEMENTS FOR ELECTRIC LIGHT SOURCES, IN GENERAL
    • H05B45/00—Circuit arrangements for operating light-emitting diodes [LED]
    • H05B45/30—Driver circuits
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09F—DISPLAYING; ADVERTISING; SIGNS; LABELS OR NAME-PLATES; SEALS
    • G09F27/00—Combined visual and audible advertising or displaying, e.g. for public address
    • G09F2027/001—Comprising a presence or proximity detector

Abstract

The invention discloses a system for wall surface radar projection interaction, which comprises a projector, radar equipment, camera equipment and a multimedia controller, wherein the projector is connected with the multimedia controller; the projector is used for projecting the display image onto the wall surface; the radar device is used for generating a radar signal and sending the radar signal to the multimedia controller when people are detected in the front area of the wall surface, so that the multimedia controller controls the camera shooting device to start and the projector to project an initial projection image onto the wall surface; the camera equipment is used for recording video in the front area of the wall surface, generating a video signal and sending the video signal to the multimedia controller, so that the multimedia controller obtains a current projection image according to the video signal matching and sends the current projection image to the projector and projects the current projection image onto the wall surface. The invention can realize the interaction between people and the system on the wall surface. The invention also provides a method for the wall surface radar projection interaction.

Description

System and method for wall surface radar projection interaction
Technical Field
The invention relates to the field of projection, in particular to a system and a method for wall surface radar projection interaction.
Background
At present, along with the development of multi-media, projection interactive system is a neotype amusement mode, for example convert ground into interactive ground through projection or LED ceramic tile screen etc. utilize equipment such as camera to catch people's action simultaneously, then the analysis action combines data and interactive system that the analysis was come out to realize interactive experience. However, at present, for some places with limited floor space, such as some small-space stores, a display platform cannot be arranged, and interaction with a user cannot be realized.
Disclosure of Invention
In order to overcome the defects of the prior art, an object of the present invention is to provide a system for radar projection interaction on a wall surface, which can achieve the effect of projection interaction with people on the wall surface.
The second objective of the present invention is to provide a method for wall radar projection interaction, which can achieve the effect of projection interaction with human on the wall.
One of the purposes of the invention is realized by adopting the following technical scheme:
a system for wall radar projection interaction comprises a projector, radar equipment, camera equipment and a multimedia controller; the projector, the radar equipment and the camera equipment are respectively and electrically connected with the multimedia controller; the projector is used for projecting the display image onto the wall surface; the radar equipment is used for generating a radar signal and sending the radar signal to the multimedia controller when people are detected in the front area of the wall surface, so that the multimedia controller controls the camera equipment to start and the projector to project an initial projection image onto the wall surface;
the camera equipment is used for recording video in the front area of the wall surface, generating a video signal and sending the video signal to the multimedia controller, so that the multimedia controller obtains a current projection image according to the video signal in a matching mode, sends the current projection image to the projector and projects the current projection image onto the wall surface.
Furthermore, the system also comprises sound equipment, wherein the sound equipment is electrically connected with the multimedia controller; when the multimedia controller sends the current projection image to the projector, the multimedia controller also controls the sound equipment to play corresponding sound effect sound.
Further, the LED lamp strip is also included; the LED lamp strip is electrically connected with the multimedia controller; when the multimedia controller sends the display image to the projector, the multimedia controller generates a control instruction and sends the control instruction to the LED lamp strip, so that the LED lamp strip displays corresponding light.
Further, the multimedia controller firstly extracts key frames of the video signals, then extracts human actions through image processing, converts the human actions into effective click events, and then matches preset data of the system according to the effective click events to obtain current projection images; the system presets data as a matching relationship between the effective click event and the display image.
The system further comprises an external input device, the external input device and the multimedia controller are used for sending an external input signal to the multimedia controller, so that the multimedia controller can obtain a current projection image according to the external input signal and send the current projection image to the projector and project the current projection image onto a wall surface.
The second purpose of the invention is realized by adopting the following technical scheme:
a method for wall radar projection interaction for use in a system for wall radar projection interaction as employed in one of the objects of the present invention, the method for wall radar projection interaction comprising:
an initialization step: the system initialization starts the radar equipment through the multimedia controller;
a scanning step: acquiring a radar signal of the radar equipment through a multimedia controller; when people are scanned in the front area of the wall surface, the radar equipment generates a radar signal;
the processing steps are as follows: obtaining an initial projection image according to the radar signal through a multimedia controller, and sending the initial projection image to a projector, so that the projector projects the initial projection image onto a wall surface;
a detection step: receiving a video signal sent by the camera equipment in real time through a multimedia controller; the camera equipment is used for recording a video in a front area of the wall surface in real time and generating a video signal;
a projection step: and processing the video signal through the multimedia controller to obtain human body action, matching according to the human body action to obtain a current projection image and sending the current projection image to the projector, so that the projector projects the current projection image onto the wall surface.
Further, the projecting step includes: converting the human body action into an effective click event through a multimedia controller, and matching the effective click event from preset system data to obtain a current projection image; the system preset data is the corresponding relation between the effective click event and the projection image; the human body action comprises human hand action, human head action and human body action.
Further, the projecting step further comprises: when sending the current projection image to the projector through the multimedia controller, send sound signal to sound equipment, and then control sound equipment broadcast and correspond the sound audio.
Further, the detecting step further comprises: acquiring an external input signal of external input equipment in real time through a multimedia controller;
the projecting step further comprises: and identifying and matching according to the external input signal to obtain a current projection image, and sending the current projection image to a projector and projecting the current projection image to the wall surface.
Further, the projecting step further comprises: when the multimedia controller sends the current projection image to the projector, a control instruction is generated and sent to the LED lamp belt to control the working state of the LED lamp belt.
Compared with the prior art, the invention has the beneficial effects that:
the invention realizes the projection of the believed image on the wall surface according to the human body action by arranging the radar signal and the camera equipment, realizes the interaction between the system and the human body, enhances the interestingness and entertainment and can attract more attention.
Drawings
FIG. 1 is a block diagram of a system for wall radar projection interaction according to the present invention;
fig. 2 is a flowchart of a method for wall surface radar projection interaction according to the present invention.
Detailed Description
The present invention will be further described with reference to the accompanying drawings and the detailed description, and it should be noted that any combination of the embodiments or technical features described below can be used to form a new embodiment without conflict.
Example one
The invention provides a preferred embodiment, and provides a system for wall surface radar projection interaction, which comprises a projector, a radar device, a camera device and a multimedia controller, as shown in fig. 1.
The projector, the radar equipment, the sound equipment and the camera equipment are respectively connected with the multimedia controller.
Preferably, the projector is adapted to project the projected image onto the wall surface to be displayed to attract attention of a person in an area in front of the wall surface. The projector can select a corresponding mounting position according to an actual projection mode, such as mounting in a front area, a top or a back of a projection wall surface. By projecting the display image onto the wall surface, people in the area in front of the wall surface can visually feel the change of the display image, and the interestingness and the interactivity are enhanced. In addition, the system is widely used, such as being mounted on a wall surface at a doorway of a store to attract a standing stay.
Preferably, the radar device is configured to detect whether a person is present in an area in front of the wall surface. The radar equipment can be installed on the ground or the top of the front area of the wall surface or installed on the wall surface and the like, and is used for detecting whether people exist in the front area of the wall surface or not, and the installation position can be adjusted according to the actual situation. For example, when a person enters a specific area, i.e., a detection area of the radar device, the radar device generates a radar signal and transmits the radar signal to the multimedia controller, so that the multimedia controller controls the start of the projector and the camera device. The starting of the projector and the camera equipment is realized in a wake-up mode, so that the energy consumption of the system can be saved, and the service life of the equipment can be prolonged.
Meanwhile, the multimedia controller also sends the initial projection image to the projector, and the initial projection image is projected to the wall surface through the projector, so that the attention of people is attracted, and people can stay in a standing position. The initial projection image can be a video picture of an operation step of the equipment, and the use method of the projection interaction system is displayed to a person, so that the person can operate according to the use method. In addition, the initial projected image may be some other attractive image frame to attract attention.
Preferably, the image pickup apparatus records an area in front of the wall surface and transmits the generated video signal to the multimedia controller. Wherein the video signal comprises human motion.
After the multimedia control receives the video signal, the video signal is processed and then recognized to obtain the action of a person, then the current projection image is recognized according to the action matching of the person, and the current projection image is projected to the wall surface through the projector. Further, the human motion is human hand motion. Such as a right hand swipe, a left hand swipe, a down hand swipe, or an up hand swipe. Of course, the human action may also be other actions, such as a head action, etc.
When the multimedia controller processes the video signal, for example, the motion of a person is identified by image processing means such as keyword extraction, preprocessing and feature extraction.
Preferably, the system further comprises an external input device. The external input equipment is electrically connected with the multimedia controller. When the multimedia controller receives an external input signal of the external input equipment, the current projection image is identified according to the external input signal and is sent to the projector to be projected onto the wall surface. More specifically, the external input devices include a handle, a keyboard, a mouse, and other interactive devices. And the interactive equipment is arranged, and equipment can be carried out according to the projection scene content of the projection interactive system. For example, for an interactive game of a mouse, the interactive device may be a hammer or other interactive device. Through setting up external input device, can realize the real interaction of people with the system, strengthen recreational and interesting greatly, more appealing attention.
Preferably, the multimedia controller converts the input signal or the human action into an effective click event, and obtains the current projection image by matching the preset data of the system according to the effective click event. The system preset data is a matching relation between the effective click event and the projection image. The matching relationship can be set by an engineer, and is specifically set according to different scene rules.
Preferably, the present embodiment further comprises an audio device. The sound equipment is electrically connected with the multimedia controller; when the multimedia controller sends the current projection image to the projector, the multimedia controller also controls the sound equipment to play corresponding sound effect sound. For example, when the multimedia controller sends the current projection image to the projector, the multimedia controller sends a corresponding control instruction to the sound equipment, so that the sound equipment plays a corresponding sound effect, and the experience of people is increased in the sense of hearing.
Preferably, the present embodiment further comprises a LED strip. The LED lamp area and the multimedia controller are electrically connected. And the LED lamp strip is controlled to emit light through the multimedia controller. When the multimedia controller sends the projection image to the projector, a control instruction is sent to the LED lamp belt, so that the LED lamp belt is controlled to emit light rays corresponding to color, brightness and the like, the visual perception of a person on the spot is increased, and the person can have a sense of being personally on the scene.
Example two
Based on the first embodiment, the invention further provides a method for wall surface radar projection interaction, as shown in fig. 2, the method comprises the following steps:
step S1, system initialization starts the radar device through the multimedia controller.
Step S2, scanning whether a person exists in a front area of the wall surface in real time through radar equipment, and if yes, executing step S3; if not, step S2 is executed.
And step S3, generating a radar signal through the radar equipment and sending the radar signal to the multimedia controller.
And step S4, receiving the radar signal of the radar device through the multimedia controller and starting the camera device and the projector.
When a person enters the display platform, the camera equipment is started to start the video and the projector is started to project images, so that energy consumption is saved.
Preferably, the step S4 further includes the multimedia controller further generating and sending the initial projected image to the projector, so that the projector projects the initial projected image onto the wall surface.
By displaying the initial projection image on the wall surface, the interestingness is improved, the attention is attracted, and the interactivity is enhanced. Preferably, the initial projection image may be the method of using the system, or may be some other picture with strong attractiveness.
This embodiment scans the place ahead region of wall through radar equipment and whether someone, and it detects more accurately, and to the system moreover, data processing is convenient simpler.
And step S5, recording the front area of the wall surface in real time through the camera equipment and generating a video signal.
And step S6, receiving the video signal through the multimedia controller, obtaining the action of a person according to the video signal, obtaining the current projection image according to the action matching of the person, and sending the current projection image to the projector, so that the projector projects the current projection image onto the wall surface.
Preferably, the step S6 further includes converting the human body motion into an effective click event by the multimedia controller, and obtaining the current projection image by matching from the preset system data according to the effective click event; the system presets data as a corresponding relation between the effective click event and the projected image.
Preferably, the embodiment further includes step S7, sending a sound signal to the audio device through the multimedia controller, and further controlling the audio device to play corresponding sound effects. By setting the corresponding sound effect, interactivity can be increased from the auditory sense.
Preferably, step S6 further includes: when the multimedia controller sends the current projection image to the projector, a control instruction is generated and sent to the LED lamp belt to control the working state of the LED lamp belt. Through setting up LED lamp area, the light effect is formed to the current projection image of cooperation, more can increase the on-the-spot experience of being personally on the scene.
Preferably, step S5 further includes: and acquiring an external input signal of the external input equipment in real time through the multimedia controller. Correspondingly, step S6 further includes: and identifying and matching according to the external input signal to obtain a current projection image, and sending the current projection image to a projector and projecting the current projection image to the wall surface.
The above embodiments are only preferred embodiments of the present invention, and the protection scope of the present invention is not limited thereby, and any insubstantial changes and substitutions made by those skilled in the art based on the present invention are within the protection scope of the present invention.

Claims (10)

1. A system for wall radar projection interaction is characterized by comprising a projector, radar equipment, camera equipment and a multimedia controller; the projector, the radar equipment and the camera equipment are respectively and electrically connected with the multimedia controller; the projector is used for projecting the display image onto the wall surface; the radar equipment is used for generating a radar signal and sending the radar signal to the multimedia controller when people are detected in the front area of the wall surface, so that the multimedia controller controls the camera equipment to start and the projector to project an initial projection image onto the wall surface;
the camera equipment is used for recording video in the front area of the wall surface, generating a video signal and sending the video signal to the multimedia controller, so that the multimedia controller obtains a current projection image according to the video signal in a matching mode, sends the current projection image to the projector and projects the current projection image onto the wall surface.
2. The system of claim 1, further comprising audio equipment, wherein the audio equipment is electrically connected to the multimedia controller; when the multimedia controller sends the current projection image to the projector, the multimedia controller also controls the sound equipment to play corresponding sound effect sound.
3. The system for wall surface radar projection interaction of claim 1, further comprising a LED strip; the LED lamp strip is electrically connected with the multimedia controller; when the multimedia controller sends the display image to the projector, the multimedia controller generates a control instruction and sends the control instruction to the LED lamp strip, so that the LED lamp strip displays corresponding light.
4. The system for wall radar projection interaction as claimed in claim 1, wherein the multimedia controller first extracts key frames from the video signal, then extracts human actions through image processing, converts the human actions into valid click events, and then matches the valid click events with preset data of the system to obtain current projection images; the system presets data as a matching relationship between the effective click event and the display image.
5. The system of claim 1, further comprising an external input device, wherein the external input device is connected to the multimedia controller and configured to send an external input signal to the multimedia controller, so that the multimedia controller can obtain a current projected image according to the external input signal and send the current projected image to the projector and project the current projected image onto the wall surface.
6. A method for wall surface radar projection interaction, which is applied to the system for wall surface radar projection interaction according to any one of claims 1 to 5, wherein the method for wall surface radar projection interaction comprises the following steps:
an initialization step: the system initialization starts the radar equipment through the multimedia controller;
a scanning step: acquiring a radar signal of the radar equipment through a multimedia controller; when people are scanned in the front area of the wall surface, the radar equipment generates a radar signal;
the processing steps are as follows: obtaining an initial projection image according to the radar signal through a multimedia controller, and sending the initial projection image to a projector, so that the projector projects the initial projection image onto a wall surface;
a detection step: receiving a video signal sent by the camera equipment in real time through a multimedia controller; the camera equipment is used for recording a video in a front area of the wall surface in real time and generating a video signal;
a projection step: and processing the video signal through the multimedia controller to obtain human body action, matching according to the human body action to obtain a current projection image and sending the current projection image to the projector, so that the projector projects the current projection image onto the wall surface.
7. The method of claim 6, wherein the projecting step comprises: converting the human body action into an effective click event through a multimedia controller, and matching the effective click event from preset system data to obtain a current projection image; the system preset data is the corresponding relation between the effective click event and the projection image; the human body action comprises human hand action, human head action and human body action.
8. The method of claim 6, wherein the projecting step further comprises: when sending the current projection image to the projector through the multimedia controller, send sound signal to sound equipment, and then control sound equipment broadcast and correspond the sound audio.
9. The method of claim 6, wherein the detecting step further comprises: acquiring an external input signal of external input equipment in real time through a multimedia controller;
the projecting step further comprises: and identifying and matching according to the external input signal to obtain a current projection image, and sending the current projection image to a projector and projecting the current projection image to the wall surface.
10. The method of claim 6, wherein the projecting step further comprises: when the multimedia controller sends the current projection image to the projector, a control instruction is generated and sent to the LED lamp belt to control the working state of the LED lamp belt.
CN202011614034.1A 2020-12-30 2020-12-30 System and method for wall surface radar projection interaction Pending CN112764529A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011614034.1A CN112764529A (en) 2020-12-30 2020-12-30 System and method for wall surface radar projection interaction

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011614034.1A CN112764529A (en) 2020-12-30 2020-12-30 System and method for wall surface radar projection interaction

Publications (1)

Publication Number Publication Date
CN112764529A true CN112764529A (en) 2021-05-07

Family

ID=75696153

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011614034.1A Pending CN112764529A (en) 2020-12-30 2020-12-30 System and method for wall surface radar projection interaction

Country Status (1)

Country Link
CN (1) CN112764529A (en)

Similar Documents

Publication Publication Date Title
US9195305B2 (en) Recognizing user intent in motion capture system
US7616262B2 (en) Controlling ambient light as a function of a video signal
US6414672B2 (en) Information input apparatus
JP5323413B2 (en) Additional data generation system
US20120226981A1 (en) Controlling electronic devices in a multimedia system through a natural user interface
US9349179B2 (en) Location information determined from depth camera data
CN108370431B (en) Information processing apparatus, information processing method, and program
HU209795B (en) Interactive video method and apparatus
JP2006505330A (en) Video-operated interactive environment
JP2011059528A (en) Display device and control method
US20150373310A1 (en) Lighting Device
CN111176431A (en) Screen projection control method of sound box and sound box
US20230173387A1 (en) Systems and methods for training a model to determine a type of environment surrounding a user
Davis et al. A robust human-silhouette extraction technique for interactive virtual environments
US7652824B2 (en) System and/or method for combining images
CN112764529A (en) System and method for wall surface radar projection interaction
EP3940542A1 (en) Content-presentation system, output device, and information processing method
TWI744536B (en) Live streaming system and method for live streaming
JP4833067B2 (en) Video production system and video production method
KR20170050268A (en) Attention induction method of the digital signage ad viewers
CN114356090B (en) Control method, control device, computer equipment and storage medium
CN111319045A (en) Multifunctional robot and control method
CN112782683A (en) System and method for ground radar projection interaction
JP2016118816A (en) Display system, display method, and program
CN215730789U (en) Live-action intelligent simulation window system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination