CN204517950U - A kind of interactive adaptive projection shooting embedded controller - Google Patents

Abstract

The utility model discloses a kind of interactive adaptive projection shooting embedded controller, relates to contactless projection field of photography.Comprise original image information (1), human body contour outline information extraction (2), embedded controller (3), self-defined calibration module (4) and external communication interface (5), view data is input to the input of human body contour outline information extraction (2) by described original image information (1), after the extraction of human body contour outline information extraction (2), the profile information of human body is input to embedded controller (3), set point in the profile information of human body and memory is carried out fuzzy matching by embedded controller (3), thus export corresponding control signal and stable vision signal.Described embedded controller (3) provides self-defined calibration module (4) and external communication interface (5), user can operate self-defined calibration module (4) according to actual requirement and finely tune projection screen and shooting screen, external communication interface (5) provides the interface with peripheral device communication, conveniently expands the function of embedded controller (3).The utility model can provide integrated design to the intelligent interaction platform in digital home effectively, for providing optimized integration by multi-point touch on the projection screen.

Description

An Interactive Adaptive Projection Camera Embedded Controller

technical field

The invention relates to the non-contact projection camera field, in particular to an interactive self-adaptive projection camera embedded controller.

Background technique

With the development of computer network and electronic technology, the concept of digital home has been put into practical application. One of the characteristics of digital home is to realize human-computer interaction through different interconnection methods, reflecting the real intelligence. Human-computer interaction is the way of interaction between the main controller and the user. The early human-computer interaction method is mainly a combination of screen and buttons. The main controller displays the menu through the screen, and the user selects or cancels the menu on the screen according to the pressed button. This method can barely realize the function of human-computer interaction. But the operation is complex and uses a lot of resources. Later, a touch screen was used to replace the combination of the screen and the buttons, and the buttons were integrated into the screen. The user does not need to operate the buttons, but directly clicks the virtual buttons on the screen. This method is more space-saving and easier to operate. However, these human-computer interaction methods still need to borrow physical screens and use touch-type clicking operations to complete the input, so that people's needs for convenience and speed cannot be met. Therefore, there is a need for a human-computer interaction method that can use human hands as a more natural input tool. The interactive adaptive projection camera meets the needs of the development of smart home. It not only uses projection to realize the virtual screen, but also collects the user's body movements as control information through the camera to realize non-contact input and make the machine-computer interaction more convenient. , can better meet the needs of modern people.

Contents of the invention

In order to solve the above-mentioned technical problems, the purpose of the present invention is to provide an interactive self-adaptive projection camera embedded controller, which can effectively provide an integrated design for the intelligent interactive platform in the digital home, and provide The multi-touch provides the basis for implementation.

The purpose of the present invention is achieved through the following technical solutions:

An interactive adaptive projection camera embedded controller of the present invention includes original image information (1), human body contour information extraction (2), embedded controller (3), self-defined calibration module (4) and external communication Interface (5), the original image information (1) input image data to the input terminal of human body contour information extraction (2), after the extraction of human body contour information extraction (2), the human body contour information is input to the embedded The controller (3) and the embedded controller (3) perform fuzzy matching on the contour information of the human body and the setting values in the memory, thereby outputting corresponding control signals and stable video signals. The embedded controller (3) provides a custom calibration module (4) and an external communication interface (5), and the user can operate the custom calibration module (4) to fine-tune the projection screen and the camera screen according to actual requirements. The communication interface (5) provides an interface for communicating with external devices, so as to facilitate the expansion of the functions of the embedded controller (3).

Compared with the prior art, one or more embodiments of the present invention may have the following advantages:

(1) Use non-contact camera technology to capture human body movements as the input of the system, replacing traditional contact human-computer interaction methods, and realizing intelligence in the true sense.

(2) Using a projector as a visual terminal, the projection screen has a large area, and the projector and camera are integrated together, which does not take up too much physical space and is easy to move.

(3) The external communication interface is open, supporting Ethernet communication and serial communication. In addition to VGA, the video signal input method can also be through the network or serial port to ensure the versatility of the system.

Description of drawings

The accompanying drawings are used to provide a further understanding of the present invention, and constitute a part of the description, and are used together with the embodiments of the present invention to explain the present invention, and do not constitute a limitation to the present invention. In the attached picture:

Fig. 1 is a system block diagram of the present invention;

Fig. 2 is a block diagram of the human body contour information extraction system of the present invention;

Fig. 3 is a flow chart of human body contour information extraction in the present invention;

Detailed ways

The present invention will be described in further detail below with reference to the embodiments and the accompanying drawings, but the embodiments of the present invention are not limited thereto.

As shown in Figure 1, a kind of interactive adaptive projection camera embedded controller of the present invention comprises original image information (1), human body outline information extraction (2), embedded controller (3), self-defined calibration module (4) and external communication interface (5), described original image information (1) input image data to the input end of human body contour information extraction (2), after the extraction of human body contour information extraction (2), extract the human body The contour information is input to the embedded controller (3), and the embedded controller (3) fuzzily matches the contour information of the human body with the setting values in the memory, thereby outputting corresponding control signals and stable video signals. The embedded controller (3) provides a custom calibration module (4) and an external communication interface (5), and the user can operate the custom calibration module (4) to fine-tune the projection screen and the camera screen according to actual requirements. The communication interface (5) provides an interface for communicating with external devices, so as to facilitate the expansion of the functions of the embedded controller (3).

The human body contour information extraction (2) includes mean shift segmentation (21), color space conversion (22), image segmentation (23), feature extraction (24), image area adjustment (25), and noise elimination (26). The output end of the original image information (1) is connected to the input end of the mean shift segmentation (21) in the human body contour information extraction (2), and the output end of the mean shift segmentation (21) is connected to the input end of the color space conversion (22) , the output of the color space conversion (22) is connected to the input of the image segmentation (23), the output of the image segmentation (23) is connected to the input of the extraction feature (24), and the output of the extraction feature (24) is connected to the image The input end of area adjustment (25) is connected, the output end of image area adjustment (25) is connected with the input end of noise elimination (26), and the output end of noise elimination (26) is connected with the embedded controller (3) The core processor (31) is connected. And the sensitivity adjustment input end of feature extraction (24), image area adjustment (25), noise elimination (26) is connected with the output end of sensitivity processing unit (35) in the embedded controller (3) respectively.

The original image information (1) input image information to human body contour information extraction (2), sequentially undergoes mean shift segmentation (21), color space conversion (22), image segmentation (23), feature extraction (24), After image area adjustment (25) and noise elimination (26), a binarized image is obtained, and human body contour information is obtained through edge detection, which is output to the core processor (31) of the embedded controller (3) for fuzzy matching.

The embedded controller (3) includes a core processor (31), a graphics card (32), a focus calibration unit (33), a gradient calibration unit (34), a sensitivity processing unit (35), and a gravity sensor (36). The output terminals of the focus calibration unit (33), the gradient calibration unit (34), the gravity sensor (36) are connected to 3 input terminals of the core processor (31), and the input terminals of the sensitivity processing unit (35) are connected to the core processor ( 31) is connected to one input terminal, and the output terminal of the sensitivity processing unit (35) is respectively connected with the extraction feature (24), the image area adjustment (25), and the sensitivity adjustment of the noise elimination (26) in the human body contour information extraction (2) The input terminals are connected, and the core processor (31) is connected with the external communication interface (5) through a bidirectional interface capable of input and output.

Described core processor (31) adopts the embedded processor Armcore EVB C21 of Allwinner dual-core A20, and core processor (31) outputs video signal by graphics card (32). The core processor (31) obtains the offset situation of the distance horizontal plane of the current embedded controller (3) through the gravity sensor (36); the control gradient calibration unit (34) carries out gradient correction to the projection information projected onto the screen; The calibration unit (33) can complete the self-adjustment of the focal length of the projection lens, so that the projection signal can be clearly displayed; the core processor (31) adjusts the extraction feature ( 24), image area adjustment (25), image processing threshold for noise removal (26), dynamically correcting the extraction effect of human body contour information.

Described external communication interface (5) comprises adopting the VGA interface with high resolution, adopts the serial communication interface of RS232 communication agreement, adopts the R45 ethernet interface of IEEE 802.15.3 network agreement.

The self-defined calibration module (4) includes a field of view alignment calibration unit (41), an environmental color difference calibration unit (42), and an environmental brightness calibration unit (43). The output terminals of the field of view alignment calibration unit (41), the ambient color difference calibration unit (42), and the ambient brightness calibration unit (43) are respectively connected to the input terminals of the core processor (31) of the embedded controller (3).

The alignment calibration unit (41) of the field of view is used to input the alignment signal of the camera area and the projection area to the core processor (31) of the embedded controller (3); the ambient color difference calibration unit (42) is used to provide The core processor (31) of the embedded controller (3) inputs the color calibration signal of projection video information; Brightness adjustment signal.

As shown in Figure 2, it is a block diagram of the human body contour information extraction system of the present invention, the original image information (1) input image information to the human body contour information extraction (2), sequentially through mean value shift segmentation (21), color space conversion (22) ), image segmentation (23), feature extraction (24), image area adjustment (25), and noise removal (26) to obtain a binary image, obtain human body contour information through edge detection, and output to the embedded controller (3) The core processor (31) performs fuzzy matching.

The embedded controller (3) includes a core processor (31), a graphics card (32), a focus calibration unit (33), a gradient calibration unit (34), a sensitivity processing unit (35), and a gravity sensor (36). The output terminals of the focus calibration unit (33), the gradient calibration unit (34), the gravity sensor (36) are connected to 3 input terminals of the core processor (31), and the input terminals of the sensitivity processing unit (35) are connected to the core processor ( 31) is connected to one input terminal, and the output terminal of the sensitivity processing unit (35) is respectively connected with the extraction feature (24), the image area adjustment (25), and the sensitivity adjustment of the noise elimination (26) in the human body contour information extraction (2) The input terminals are connected, and the core processor (31) is connected with the external communication interface (5) through a bidirectional interface capable of input and output.

As shown in FIG. 3 , it is a flow chart of human body contour information extraction in the present invention, and the system is powered on to detect whether the camera is turned on. If opening the camera fails, re-detect the insertion of the camera. If it is opened successfully, set the camera to workable mode. Load a piece of original image information, perform mean shift segmentation on the image, perform color space conversion on the obtained segmented image, convert the RGB color space into HSV color space, separate the information of each channel of H, S, and V separately, and obtain from each channel In the signal, find out the human skin color area mixed with red and purple. Subsequently, the processed image information is eliminated from the influence of noise, including filtering out areas with too high or too low saturation and too high or too low brightness to obtain a binarized image. Finally, the contour information of the human body is extracted from the binarized image, and handed over to the embedded controller (3) for fuzzy matching. If it is the same as the gesture stored in the memory, the corresponding control signal will be output. If the matching fails, the original image information will be discarded, and the next original image information will be read from the camera.

Work process of the present invention comprises:

(1) input the video signal to be projected and displayed by the VGA interface of the external communication interface (5);

(2) Obtain the original image information (1) from the camera, and convert the image information into a bmp format, pass it into the human body contour information extraction (2), and finally output the contour information of the human body;

(3) Carry out fuzzy matching between the contour information of the human body and the preset value in the memory, if the matching is successful, perform the set operation, if the matching fails, discard the contour information of the human body, and obtain the original image from the camera again;

(4) The embedded controller (3) obtains the offset situation of the distance horizontal plane of the current embedded controller (3) according to the gravity sensor (36), controls the gradient calibration unit (34) to carry out the gradient to the projection information projected onto the screen correction, and the focus calibration unit (33) can complete the self-adjustment of the focal length of the projection lens, so that the projection signal can be displayed clearly;

(5) adjust the image processing threshold of the extraction feature (24), image area adjustment (25), and noise elimination (26) in the human body contour information extraction (2) through the sensitivity processing unit (35), and dynamically correct the extraction of the human body contour information Effect;

(6) to the core processor (31) of embedded controller (3) input the alignment signal of imaging area and projection area, environment color difference calibration unit (42) is used for to the core processor of embedded controller (3) (31) Input the color calibration signal of the projected video information, and the ambient brightness calibration unit (43) is used to input the brightness adjustment signal of the projection to the core processor (31) of the embedded controller (3);

(7) The high-resolution VGA interface of the external communication interface (5), the serial communication interface of the RS232 communication protocol, and the R45 Ethernet interface of the IEEE 802.15.3 network protocol can all be used as input sources of video signals.

Although the embodiments disclosed in the present invention are as above, the described content is only an embodiment adopted for the convenience of understanding the present invention, and is not intended to limit the present invention. Anyone skilled in the technical field to which the present invention belongs can make any modifications and changes in the form and details of the implementation without departing from the spirit and scope disclosed by the present invention, but the patent protection scope of the present invention, The scope defined by the appended claims must still prevail.

Claims (5)

1. an interactive adaptive projection shooting embedded controller, it is characterized in that comprising original image information (1), human body contour outline information extraction (2), embedded controller (3), self-defined calibration module (4) and external communication interface (5), view data is input to the input of human body contour outline information extraction (2) by described original image information (1), after the extraction of human body contour outline information extraction (2), the profile information of human body is input to embedded controller (3), set point in the profile information of human body and memory is carried out fuzzy matching by embedded controller (3), thus export corresponding control signal and stable vision signal, described embedded controller (3) provides self-defined calibration module (4) and external communication interface (5), user can operate self-defined calibration module (4) according to actual requirement and finely tune projection screen and shooting screen, external communication interface (5) provides the interface with peripheral device communication, conveniently expands the function of embedded controller (3).

2. a kind of interactive adaptive projection shooting embedded controller according to claim 1, it is characterized in that, described human body contour outline information extraction (2) comprises mean shift segmentation (21), color space conversion (22), Iamge Segmentation (23), extraction feature (24), image-region adjustment (25), stress release treatment (26), the output of original image information (1) is connected with the input of the mean shift segmentation (21) in human body contour outline information extraction (2), the output of mean shift segmentation (21) is connected with the input of color space conversion (22), the output of color space conversion (22) is connected with the input of Iamge Segmentation (23), the output of Iamge Segmentation (23) is connected with the input extracting feature (24), the output extracting feature (24) adjusts (25) input with image-region is connected, the output of image-region adjustment (25) is connected with the input of stress release treatment (26), the output of stress release treatment (26) is connected with the core processor (31) in described embedded controller (3), and extract feature (24), image-region adjustment (25), stress release treatment (26) adjustment of sensitivity input be connected with the output of the sensitivity processing unit (35) in embedded controller (3) respectively,

Image information is input to human body contour outline information extraction (2) by described original image information (1), binary image is obtained after (26) successively through mean shift segmentation (21), color space conversion (22), Iamge Segmentation (23), extraction feature (24), image-region adjustment (25), stress release treatment, obtain human body contour outline information by rim detection, the core processor (31) outputting to embedded controller (3) carries out fuzzy matching.

3. a kind of interactive adaptive projection shooting embedded controller according to claim 1, it is characterized in that, described embedded controller (3) comprises core processor (31), video card (32), focus alignment unit (33), gradient alignment unit (34), sensitivity processing unit (35), gravity sensor (36), focus alignment unit (33), gradient alignment unit (34), the output of gravity sensor (36) is connected with 3 inputs of core processor (31), the input of sensitivity processing unit (35) is connected with 1 input of core processor (31), the output of sensitivity processing unit (35) respectively with the extraction feature (24) in human body contour outline information extraction (2), image-region adjustment (25), the adjustment of sensitivity input of stress release treatment (26) is connected, by can the bidirectional interface of input and output be connected between core processor (31) with external communication interface (5),

Described core processor (31) adopts the flush bonding processor Armcore EVB C21 of full will double-core A20, and core processor (31) is by video card (32) outputting video signal; Core processor (31) obtains the drift condition of the distance horizontal plane of current embedded controller (3) by gravity sensor (36); Control gradient alignment unit (34) and gradient calibration is carried out to the projection information projected on screen; And focus alignment unit (33) can complete the self-adjusting to projecting lens focal length, can clearly show to reach projection signal; The image procossing threshold value that core processor (31) regulates the extraction feature (24) in human body profile information extraction (2) by sensitivity processing unit (35), image-region adjusts (25), stress release treatment (26), the extraction effect of dynamic corrections human body contour outline information.

4. a kind of interactive adaptive projection shooting embedded controller according to claim 1, it is characterized in that, described external communication interface (5) comprises employing and has high-resolution USB interface, adopt the serial communication interface of RS232 communication protocol, adopt the R45 Ethernet interface of IEEE 802.15.3 procotol.

5. a kind of interactive adaptive projection shooting embedded controller according to claim 1, it is characterized in that, described self-defined calibration module (4) comprises the ken and aims at alignment unit (41), environment aberration alignment unit (42), ambient brightness alignment unit (43); The output of ken aligning alignment unit (41), environment aberration alignment unit (42), ambient brightness alignment unit (43) is connected with the input of the core processor (31) of embedded controller (3) respectively;

The described ken aims at alignment unit (41) for inputting the registration signal of camera watch region and view field to the core processor (31) of embedded controller (3); Environment aberration alignment unit (42) is for the color calibration signal of core processor (31) the input projection video information to embedded controller (3); Ambient brightness alignment unit (43) is for the brightness regulated signal of core processor (31) the input projection to embedded controller (3).