WO2019205322A1

WO2019205322A1 - Interactive projection lamp control method and device, and interactive projection lamp

Info

Publication number: WO2019205322A1
Application number: PCT/CN2018/097390
Authority: WO
Inventors: 李祥艳
Original assignee: 歌尔科技有限公司
Priority date: 2018-04-24
Filing date: 2018-07-27
Publication date: 2019-10-31
Also published as: CN108549187A

Abstract

An interactive projection lamp control method, comprising: determining the distance between a projection surface reference object and an interactive projection lamp (S11); invoking a preset mapping relationship between distance and projection area, and setting the projection area corresponding to the distance as a target projection area (S12); and performing projection according to the target projection area (S13). The projection area of the projection lamp can be adjusted according to the distance between the projection surface reference object and the projection lamp, and thereby needs of different users for the projection area can be satisfied. Also provided are an interactive projection lamp control device and an interactive projection lamp having the above effects.

Description

Method, device and interactive projection lamp for controlling interactive projection lamp

The present application claims priority to Chinese Patent Application No. 201101372170.0, entitled "Control Method, Apparatus and Interactive Projection Lamp of Interactive Projection Lamp", which is filed on April 24, 2018, the Chinese Patent Office. The entire contents are incorporated herein by reference.

Technical field

The present invention relates to the field of projection display technology, and in particular, to a method and an apparatus for controlling an interactive projection lamp and an interactive projection lamp.

Background technique

A projection lamp, also known as an imaging lamp, is a new type of projection device that integrates a projector and an illuminated LED light to project images or text onto the ground or wall. The projector lamp is a lighting system designed for various types of commercial places, such as: it is widely used in special entertainment venues, exhibition halls, brand stores, hotels, hotels, bars, coffee houses, tea houses, shopping malls, etc.

Since the lamp has been fixed at the time of installation, its projected area is limited. In actual use, due to various reasons such as the environment and personal preferences, there are often cases where the projected area of the projection lamp is different. The projection area of the existing projection lamp is single and fixed, and cannot meet the needs of different users for the projected area.

Summary of the invention

The object of the present invention is to provide a method and a device for controlling an interactive projection lamp and an interactive projection lamp to solve the problem that the projection area of the existing projection lamp is single and cannot meet the needs of different users.

To solve the above technical problem, the present invention provides a method for controlling an interactive projection lamp, comprising:

Determining the distance between the projection surface reference and the interactive projection lamp;

Calling a mapping relationship between the preset distance and the projected area, and using the projected area corresponding to the distance as the target projected area;

Projection is performed in accordance with the target projected area.

Optionally, before determining the distance between the projection surface reference and the interactive projection lamp, the method further includes:

Obtaining a projection surface image of the interactive projection lamp;

A projection surface reference object is identified from the projection surface image.

Optionally, the projection surface reference object is a gesture, and the recognizing the projection surface reference object from the projection surface image comprises:

Determining whether there is a gesture intervention in the projection surface image;

If so, matching the acquired gesture image with the standard image in the preset gesture library;

If the match passes, the gesture is taken as the identified projection surface reference.

Optionally, before the determining the distance between the projection surface reference object and the interactive projection lamp, the method further includes:

Determining whether the dwell time of the gesture in the gesture image exceeds a preset threshold, and if so, performing an operation of subsequently determining a distance between the projection surface reference object and the interactive projection lamp.

Optionally, the determining the distance between the projection surface reference object and the interactive projection lamp comprises:

A distance between the projection surface reference and the interactive projection lamp is determined using a ranging sensor.

Optionally, the ranging sensor is a TOF camera;

Wherein, the TOF camera emits light, is received by the sensor after being reflected by the projection surface reference object, and determines the projection surface reference object and the interactive projection lamp by calculating a time difference or a phase difference between the emitted light and the reflected light. The distance between them.

The distance between the projection surface reference and the interactive projection lamp is measured using a binocular camera.

The invention also provides a control device for an interactive projection lamp, comprising:

a distance determining module for determining a distance between the projection surface reference object and the interactive projection lamp;

a projection area determining module, configured to invoke a mapping relationship between a preset distance and a projected area, and use a projected area corresponding to the distance as a target projected area;

An adjustment module for projecting according to the target projected area.

The invention also provides an interactive projection lamp, comprising: a projection light machine and a processor;

The processor is configured to determine a distance between the projection surface reference object and the interactive projection lamp; invoke a mapping relationship between the preset distance and the projected area, and use the projected area corresponding to the distance as the target projected area; generate a pair The projection illuminator performs a controlled drive command to adjust the projection illuminator to the target projected area.

Optionally, the method further includes: an RGB camera and a TOF camera;

Wherein the RGB camera is configured to acquire an image within a range of viewing angles, so that the processor identifies a projection surface reference object from the acquired image;

The TOF camera is configured to determine a distance between the projection surface reference object and the interactive projection lamp after the RGB camera recognizes the projection surface reference object, and send the distance to the processor.

The present invention also provides a computer readable storage medium comprising instructions which, when run on a computer, cause the computer to perform the control method of the interactive projection lamp of any of claims 1-7.

The control method of the interactive projection lamp provided by the invention determines the distance between the projection surface reference object and the interactive projection lamp; and calls the mapping relationship between the preset distance and the projected area to target the projected area corresponding to the distance Projection area; projection according to the target projection area. The projection area of the projection lamp provided by the present application can be adjusted according to the distance between the projection surface reference object and the projection lamp, which can meet the needs of different users for the projection area, and improves the user experience. In addition, after obtaining the distance data between the projection surface reference object and the interactive projection lamp, the preset mapping relationship can be directly called to quickly determine the target projection area that needs to be adjusted, thereby effectively solving the manual manual mechanical adjustment of the projection device. The problem has greatly improved the efficiency of use and saved labor costs. In addition, the present application also provides a control device for an interactive projection lamp and an interactive projection lamp having the above technical effects.

DRAWINGS

In order to more clearly illustrate the embodiments of the present invention or the prior art, the drawings used in the embodiments or the description of the prior art will be briefly described below. Obviously, the drawings in the following description are merely Some embodiments of the present invention may also be used to obtain other drawings based on these drawings without departing from the art.

1 is a flow chart of a specific implementation manner of a method for controlling an interactive projection lamp provided by the present application;

2 is a schematic diagram showing a mapping relationship between a distance and a projected area;

3 is a flow chart of another specific implementation manner of a method for controlling an interactive projection lamp provided by the present application;

4 is a flow chart of still another embodiment of a method for controlling an interactive projection lamp provided by the present application;

FIG. 5 is a schematic diagram of TOF ranging provided by the present application; FIG.

6 is a structural block diagram of a control device for an interactive projection lamp according to an embodiment of the present invention;

FIG. 7 is a structural block diagram of an interactive projection lamp according to an embodiment of the present invention.

detailed description

The present invention will be further described in detail below in conjunction with the drawings and embodiments. It is apparent that the described embodiments are only a part of the embodiments of the invention, and not all of the embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative efforts are within the scope of the present invention.

A flowchart of a specific implementation manner of a method for controlling an interactive projection lamp provided by the present application is as shown in FIG. 1 . The method is applied to an interactive projection device, and specifically includes:

Step S11: determining a distance between the projection surface reference object and the interactive projection lamp;

It should be noted that the projection surface is an area where the projection lamp projects to form an image, and may be a wall, a projection screen, or the like. In this application, the projection surface reference object is an object that plays a role in marking the projection surface, and may be an actual projection surface, such as an object such as a wall arm, a table, a curtain, or the like, or may be a user, such as a user's gesture, shape, or the like. Any object that can serve as a reference can be used herein without limitation.

Before determining the distance between the projection surface reference and the interactive projection lamp, the projection surface reference object needs to be identified. There are many ways to recognize, and in this embodiment, an image recognition method can be employed. The process can specifically include:

Obtaining a projection surface image of the interactive projection lamp;

An image capture of the projection surface of the interactive projection lamp can be performed using an RGB camera to identify whether there is a projection surface reference object from the acquired image. Taking the projection surface reference object as an example, the process of recognition is to determine whether there is gesture intervention in the projection surface image; if so, the acquired gesture image is matched with the standard image in the preset gesture library; if the matching is passed, The gesture is then used as the identified projection surface reference.

Further, in order to prevent false triggering, after the matching is passed, the method may further include: determining whether the dwell time of the gesture in the gesture image exceeds a preset threshold, and if yes, performing subsequent determination of the projection surface reference object and the interactive projection lamp The operation of the distance between. The preset threshold can be set by the user, which does not affect the implementation of the present invention.

Determining the distance between the projection surface reference and the interactive projection lamp can be determined in a number of ways. Specifically, the distance between the projection surface reference object and the interactive projection lamp can be directly measured by using the distance measuring sensor, and the distance measuring sensor can specifically adopt an ultrasonic distance measuring sensor, a laser ranging sensor, an infrared distance measuring sensor, and a 24 GHz radar sensor. Wait. The embodiment of the present application may be specifically an ultrasonic ranging sensor, which adopts an ultrasonic echo ranging principle, and uses an accurate time difference measurement technology to detect a distance between the sensor and the target, and has accurate measurement, no contact, waterproof, anti-corrosion, and the like. Low cost and other advantages. Of course, a binocular camera can also be used to measure the distance between the projection surface reference and the interactive projection lamp. The specific process of measuring the distance by using a binocular camera is known in the prior art, and will not be described herein.

As a specific implementation manner, the present application uses a TOF camera to perform ranging. Wherein, the TOF camera emits light, is received by the sensor after being reflected by the projection surface reference object, and determines the projection surface reference object and the interactive projection lamp by calculating a time difference or a phase difference between the emitted light and the reflected light. The distance between them.

Step S12: calling a mapping relationship between the preset distance and the projected area, and using the projected area corresponding to the distance as the target projected area;

The mapping relationship between the distance and the projected area in the present application may be preset, by which the projected area corresponding to the distance may be quickly determined according to the distance. The mapping relationship between the distance and the projected area can be established in advance, or can be updated in real time according to the actual situation. Referring to the schematic diagram of the mapping relationship between the distance and the projected area, the distance between the interactive projection lamp and the projection surface reference object is L, and the projection area is S. According to FIG. 2, L can be divided into a plurality of regions, each region corresponding to a corresponding projected area. Assume that the maximum projected area of the projection device is set at L/2, the projected area is increased in the 0-L/2 area, and the projected area is reduced in the L/2-L area.

Step S13: Projecting according to the target projected area.

After determining the target projected area to be adjusted to, a drive command is generated and sent to the corresponding drive device, so that the drive device performs a corresponding action, thereby controlling the interactive projection lamp to project according to the target projected area.

The control method of the interactive projection lamp provided by the invention determines the distance between the projection surface reference object and the interactive projection lamp; and calls the mapping relationship between the preset distance and the projected area to target the projected area corresponding to the distance Projection area; projection according to the target projection area. The projection area of the projection lamp provided by the present application can be adjusted according to the distance between the projection surface reference object and the projection lamp, which can meet the needs of different users for the projection area, and improves the user experience. In addition, after obtaining the distance data between the projection surface reference object and the interactive projection lamp, the preset mapping relationship can be directly called to quickly determine the target projection area to be adjusted, thereby effectively solving the manual manual mechanical adjustment of the projection device. The problem has greatly improved the efficiency of use and saved labor costs.

The method for controlling the interactive projection lamp provided by the present application is further described in detail below by taking the projection surface reference object as an example. Referring to FIG. 3, the process includes:

Step S21: Acquire a projection surface image of the interactive projection lamp;

Specifically, the camera can be used to capture the projection surface image of the interactive projection lamp. The acquired frequency can be obtained in real time, for example, once every preset time interval, or under a fixed trigger condition, for example, after the interactive lamp is powered on or the reset button is triggered.

Step S22: determining whether there is gesture intervention in the projection surface image; if yes, matching the acquired gesture image with the standard image in the preset gesture library;

Preferably, the standard image in the preset gesture library may horizontally place the captured image for the palm, such that the difference in the N depth values of the palm measured by the TOF camera is small for further processing.

Step S23: if the matching is passed, determining whether the dwell time of the gesture in the gesture image exceeds a preset threshold; if yes, determining the distance between the gesture and the interactive projection lamp;

During the gesture recognition process, the acquired gesture image is matched with the standard image, and the gesture and the interactive projection lamp are further determined only when the gesture meets the specified gesture and the time when the gesture motion stays exceeds the preset threshold. The distance between them to adjust the projected area. The preset threshold may be a value set by the user, and may be more than 3s. By judging the time that the gesture action stays, it is possible to prevent the false trigger and affect the user's use experience.

Specifically, in the case where the standard image in the preset gesture library is the horizontally placed captured image of the palm, since the palm has a certain area, the N depth values on the palm surface can be measured by the TOF camera, according to the N The depth values calculate the distance between the gesture and the interactive lamp. For example, the N depth values can be averaged and the calculated average value used as the distance between the gesture and the interactive projection lamp. It is also possible to remove the maximum and minimum values of the N depth values, and then take the average value, and use the calculated average value as the distance between the gesture and the interactive projection lamp. Of course, there are other ways of calculating, which do not affect the implementation of the present invention.

Step S24: calling a mapping relationship between the preset distance and the projected area, and using the projected area corresponding to the distance as the target projected area;

Step S25: generating a driving instruction for controlling the interactive projection lamp to control the interactive projection lamp to project according to the target projection area.

In this embodiment, the gesture recognition algorithm automatically adjusts the size of the projection area according to the gesture position at the software level, which is convenient and quick to operate, saves the user's time, improves the control efficiency, and can meet the needs of different users for the projected area. At the same time, device damage due to manual mechanical adjustment of the projected area is also avoided.

A flow chart of still another embodiment of the control method of the interactive projection lamp provided by the present application is shown in FIG. 4 . In this embodiment, a TOF camera is specifically used for ranging, and the process includes:

Step S31: After the projector is powered on, it is determined whether the local database has saved location information; if not, the default initialized projection area is displayed; if yes, the saved location information is read, and the corresponding projected area is displayed.

When the local database has no location information, an initial projected area S is set. Assuming S2, this projected area S2 is an initial projected area, independent of the distance, which can be set by default.

Step S32: detecting whether there is gesture intervention; if yes, proceeding to step S33; if not, proceeding to step S38;

Step S33: sending the acquired gesture image to the gesture recognition module;

Step S34: the gesture recognition module compares the sent image with the image in the gesture library to determine whether the specified gesture is met; if yes, proceeds to step S35; if not, proceeds to step S38;

Step S35: determining whether the time when the gesture action stays exceeds a preset threshold; if yes, proceeding to step S36; if not, proceeding to step S38;

Step S36: The distance between the depth of field module and the gesture in the interactive projector is measured by the TOF camera.

Referring to FIG. 5, the schematic diagram of the TOF ranging provided by the present application shows that the sensor emits modulated near-infrared light and reflects after the object, and the sensor calculates the distance of the captured object by calculating the time difference or phase difference between the light emission and the reflection. To generate depth information. The specific implementation process turns on the light source for the control unit on the camera and then turns it off to emit a light pulse. At the same time, the control unit turns the electronic shutter of the receiving end on and off. The charge S0 received at the receiving end is stored in the photosensitive element. The control unit then turns the light source on and off for the second time. This time the shutter is opened later, that is, when the light source is turned off. The newly received charge S1 is also stored. Because the duration of a single light pulse is very short, this process is repeated thousands of times until the exposure time. The values in the sensor are then read and the actual distance can be calculated from these values. Let the speed of the light be c, tp be the duration of the light pulse, S0 denote the charge collected by the earlier shutter, and S1 denote the charge collected by the delayed shutter, then the formula of the distance d can be expressed as:

When S1 is 0, it means that the measured minimum distance is 0; when S0 is 0, it means that the maximum measurement distance is

Step S37: Adjust the size of the projected area according to the distance, and save the gesture position information.

Step S38: Keep the current projected area unchanged.

According to the mapping relationship of FIG. 2, the acquired location information is written into the projection device by the write node according to the difference of the projected area size corresponding to the different gesture positions, and the device performs the corresponding action according to the obtained node information. That is, the purpose of automatically adjusting the projected area is achieved, and the position information of the current gesture and the current projected area are locally saved.

If there is position information after the lamp is powered on, the position information in the database can be directly read, and the corresponding projection area is automatically set, so that the projection has a "memory" function, and the cumbersome adjustment of the projection area is avoided.

The program uses the TOF camera in the depth of field module to detect the distance between the gesture and the depth of field module and the image of the gesture, and sends the captured image to the gesture recognition module, and then sets different projection areas according to different distances to realize automatic adjustment. The purpose of the projected area is to avoid artificially adjusting the height and position of the projection lamp, causing damage to the device, greatly improving the use efficiency and meeting the needs of different users.

The control device of the interactive projection lamp provided by the embodiment of the present invention is described below. The control device of the interactive projection lamp described below and the control method of the interactive projection lamp described above can be referred to each other.

FIG. 6 is a structural block diagram of a control device for an interactive projection lamp according to an embodiment of the present invention. The control device for an interactive projection lamp according to FIG. 6 may include:

a distance determining module 100, configured to determine a distance between the projection surface reference object and the interactive projection lamp;

The projected area determining module 200 is configured to invoke a mapping relationship between the preset distance and the projected area, and use the projected area corresponding to the distance as the target projected area;

The adjustment module 300 is configured to perform projection according to the target projected area.

The control device for the interactive projection lamp provided by the invention determines the distance between the projection surface reference object and the interactive projection lamp; and calls the mapping relationship between the preset distance and the projected area to target the projected area corresponding to the distance Projection area; projection according to the target projection area. The projection area of the projection lamp provided by the present application can be adjusted according to the distance between the projection surface reference object and the projection lamp, which can meet the needs of different users for the projection area, and improves the user experience. In addition, after obtaining the distance data between the projection surface reference object and the interactive projection lamp, the preset mapping relationship can be directly called to quickly determine the target projection area that needs to be adjusted, thereby effectively solving the manual manual mechanical adjustment of the projection device. The problem has greatly improved the efficiency of use and saved labor costs.

The control device of the interactive projection lamp of the present embodiment is used to implement the foregoing control method of the interactive projection lamp. Therefore, the specific implementation of the control device for the interactive projection lamp can be seen from the implementation of the control method of the interactive projection lamp in the foregoing. For example, the distance determining module 100, the projected area determining module 200, and the adjusting module 300 are respectively used to implement steps S101, S102, and S103 in the method for controlling the interactive projection lamp. Therefore, the specific implementation manner may refer to corresponding Descriptions of various partial embodiments are not described herein again.

Referring to Figure 7, the present application also provides an interactive projection lamp, comprising: a projector illuminator 1 and a processor 2;

The processor 2 is configured to determine a distance between the projection surface reference object and the interactive projection lamp; and call a mapping relationship between the preset distance and the projected area, and use the projected area corresponding to the distance as the target projected area; A drive command for controlling the projector is generated to adjust the projector 1 to the target projected area.

As an embodiment, the interactive projection lamp provided by the present application may further include: an RGB camera 3 and a TOF camera 4;

Wherein, the RGB camera 3 is configured to acquire an image within a range of viewing angles, so that the processor 2 identifies a projection surface reference object from the acquired image;

The TOF camera 4 is configured to determine a distance between the projection surface reference object and the interactive projection lamp after the RGB camera recognizes the projection surface reference object, and send the distance to the processor 2.

In particular, an RGB camera can present a three-dimensional contour of an object in a topographical representation of different colors representing different distances to identify a projected surface reference from the image. The TOF camera determines the distance between the projection surface reference and the projection lamp by optical pulse ranging. In this way, the projected area of the projection lamp can be adjusted according to the distance between the projection surface reference object and the projection lamp, which can meet the needs of different users for the projected area, and improves the user experience. In addition, after obtaining the distance data between the projection surface reference object and the interactive projection lamp, the preset mapping relationship can be directly called to quickly determine the target projection area that needs to be adjusted, thereby effectively solving the manual manual mechanical adjustment of the projection device. The problem has greatly improved the efficiency of use and saved labor costs.

The various embodiments in the specification are described in a progressive manner, and each embodiment focuses on differences from other embodiments, and the same or similar parts of the respective embodiments may be referred to each other. For the device disclosed in the embodiment, since it corresponds to the method disclosed in the embodiment, the description is relatively simple, and the relevant parts can be referred to the method part.

A person skilled in the art will further appreciate that the elements and algorithm steps of the various examples described in connection with the embodiments disclosed herein can be implemented in electronic hardware, computer software or a combination of both, in order to clearly illustrate the hardware and software. Interchangeability, the composition and steps of the various examples have been generally described in terms of function in the above description. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the solution. A person skilled in the art can use different methods for implementing the described functions for each particular application, but such implementation should not be considered to be beyond the scope of the present invention.

The steps of a method or algorithm described in connection with the embodiments disclosed herein can be implemented directly in hardware, a software module executed by a processor, or a combination of both. The software module can be placed in random access memory (RAM), memory, read only memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, removable disk, CD-ROM, or technical field. Any other form of storage medium known.

The control method, device and interactive projection lamp of the interactive projection lamp provided by the present invention are described in detail above. The principles and embodiments of the present invention have been described herein with reference to specific examples. The description of the above embodiments is only to assist in understanding the method of the present invention and its core idea. It should be noted that those skilled in the art can make various modifications and changes to the present invention without departing from the spirit and scope of the invention.

Claims

A method for controlling an interactive projection lamp, comprising:

Determining the distance between the projection surface reference and the interactive projection lamp;

Calling a mapping relationship between the preset distance and the projected area, and using the projected area corresponding to the distance as the target projected area;

Projection is performed in accordance with the target projected area.
The method of controlling an interactive projection lamp according to claim 1, wherein before determining the distance between the projection surface reference object and the interactive projection lamp, the method further comprises:

Obtaining a projection surface image of the interactive projection lamp;

A projection surface reference object is identified from the projection surface image.
The method of controlling an interactive projection lamp according to claim 2, wherein the projection surface reference object is a gesture, and the recognizing the projection surface reference object from the projection surface image comprises:

Determining whether there is a gesture intervention in the projection surface image;

If so, matching the acquired gesture image with the standard image in the preset gesture library;

If the match passes, the gesture is taken as the identified projection surface reference.
The method of controlling an interactive projection lamp according to claim 3, further comprising: before the determining the distance between the projection surface reference object and the interactive projection lamp:

Determining whether the dwell time of the gesture in the gesture image exceeds a preset threshold, and if so, performing an operation of subsequently determining a distance between the projection surface reference object and the interactive projection lamp.
The control method of the interactive projection lamp according to any one of claims 1 to 4, wherein the determining the distance between the projection surface reference object and the interactive projection lamp comprises:

A distance between the projection surface reference and the interactive projection lamp is determined using a ranging sensor.
The method of controlling an interactive projection lamp according to claim 5, wherein the distance measuring sensor is a TOF camera;

Wherein, the TOF camera emits light, is received by the sensor after being reflected by the projection surface reference object, and determines the projection surface reference object and the interactive projection lamp by calculating a time difference or a phase difference between the emitted light and the reflected light. The distance between them.
The control method of the interactive projection lamp according to any one of claims 1 to 4, wherein the determining the distance between the projection surface reference object and the interactive projection lamp comprises:

The distance between the projection surface reference and the interactive projection lamp is measured using a binocular camera.
A control device for an interactive projection lamp, comprising:

a distance determining module for determining a distance between the projection surface reference object and the interactive projection lamp;

a projection area determining module, configured to invoke a mapping relationship between a preset distance and a projected area, and use a projected area corresponding to the distance as a target projected area;

An adjustment module for projecting according to the target projected area.
An interactive projection lamp, comprising: a projection light machine and a processor;

The processor is configured to determine a distance between the projection surface reference object and the interactive projection lamp; invoke a mapping relationship between the preset distance and the projected area, and use the projected area corresponding to the distance as the target projected area; generate a pair The projection illuminator performs a controlled drive command to adjust the projection illuminator to the target projected area.
The interactive projection lamp of claim 9 further comprising: an RGB camera and a TOF camera;

Wherein the RGB camera is configured to acquire an image within a range of viewing angles, so that the processor identifies a projection surface reference object from the acquired image;

The TOF camera is configured to determine a distance between the projection surface reference object and the interactive projection lamp after the RGB camera recognizes the projection surface reference object, and send the distance to the processor.
A computer readable storage medium comprising instructions which, when run on a computer, cause the computer to perform the method of controlling the interactive projection lamp of any of claims 1-7.