WO2016188316A1

WO2016188316A1 - Control method, control device, projector and computer-readable storage medium

Info

Publication number: WO2016188316A1
Application number: PCT/CN2016/081435
Authority: WO
Inventors: 徐源源
Original assignee: 中兴通讯股份有限公司
Priority date: 2016-01-21
Filing date: 2016-05-09
Publication date: 2016-12-01
Also published as: CN106993146A

Abstract

A control method and device, a projector and a computer-readable storage medium. The method comprising: photographing an image of a projection picture, acquiring a hotspot area corresponding to a controllable object in the projection picture, processing the image, so as to recognize whether a light spot exists in the hotspot area, and generating a control command corresponding to the controllable object when the light spot exists in the hotspot area.

Description

Control method, control device, projector and computer readable storage medium

Technical field

The present application relates to, but is not limited to, the field of projection technology, and in particular, to a control method, apparatus, projector, and computer readable storage medium.

Background technique

For many occasions where the projector is used for presentations (such as business presentations), the presenter may need to stand in front of the screen for presentations, and the mouse cannot be used to move the cursor to indicate the projected image. The presenter may also use a laser pointer to indicate the projected picture. However, in these occasions, the presenter may still need to control certain objects in the projected picture (such as virtual play keys). In this case, the presenter still needs to return to the seat to operate the mouse, which is inconvenient to use.

Some related laser pens can also control objects in the projected picture. However, to achieve such control, it usually requires very complicated signal and/or data processing, and may require complicated laser pen operation, and may even require additional lasers. The accessories of the pen, etc., result in an increase in the cost of the laser pointer or projection system.

Summary of the invention

The following is an overview of the topics detailed in this document. This Summary is not intended to limit the scope of the claims. A control method comprising:

Take a picture of the projected picture.

Obtaining a hotspot area corresponding to the controllable object in the projected picture.

The image is processed to identify if there is a spot in the hot spot area.

A control command corresponding to the controllable object is generated when the spot exists in the hot spot area.

Optionally, the projection picture is formed by the projector for spatially optically modulating current page data of the presentation file.

Obtaining a hotspot area corresponding to the controllable object in the projection screen includes:

The hotspot area is obtained by analyzing the current page data.

Optionally, the controlling method further includes: identifying the hotspot area by processing the image before acquiring the hotspot area corresponding to the controllable object in the projected picture.

Optionally, the control method further includes:

Determining whether the projected picture is stable and processing the image when the projected picture is stable.

Optionally, the determining whether the projected picture is stable comprises: determining whether the projected picture is stable by analyzing the current page data.

Optionally, the determining whether the projected image is stable further comprises: determining whether the projected image is stable by analyzing the image.

Optionally, the control method further includes:

After taking the image of the projected picture, check if the trapezoidal calibration function has been activated.

The hot spot region is corrected using a trapezoidal calibration algorithm when the trapezoidal calibration function has been initiated.

Optionally,

The generating a control command corresponding to the controllable object when the spot is present in the hotspot area includes:

Determining whether the presence time of the spot in the hot spot area exceeds a predetermined time;

The control command is generated when the spot is present in the hot spot area for more than the predetermined time.

A control device, the control device comprising:

a shooting module configured to take an image of a projected image;

Obtaining a module, configured to acquire a hotspot area corresponding to the controllable object in the projection screen;

a processing module configured to process the image to identify whether there is a spot in the hot spot; and

And a command module configured to generate a control command corresponding to the controllable object when the spot exists in the hot spot area.

Optionally, the projection picture is formed by spatially modulating the current page data of the presentation file by the projector;

The obtaining, by the acquiring module, the hotspot area corresponding to the controllable object in the projection screen includes:

The hotspot area is obtained by analyzing the current page data.

Optionally, the processing module is further configured to: identify the hotspot area by processing the image before acquiring the hotspot area corresponding to the controllable object in the projected picture.

Optionally, the control device further includes:

a determining module, configured to determine whether the projection screen is stable;

The processing module is further configured to process the image when the projected image is stable.

Optionally, determining, by the determining module, whether the projected image is stable comprises: determining whether the projected image is stable by analyzing the current page data.

Optionally, determining, by the determining module, whether the projected image is stable further comprises: determining whether the projected image is stable by analyzing the image.

Optionally, the shooting module further includes:

The detection submodule is configured to detect whether the trapezoidal calibration function has been activated after the image of the projection screen is captured;

The calibration sub-module is configured to correct the hot spot region using a trapezoidal calibration algorithm when the trapezoidal calibration function has been initiated.

Optionally, the command module generates a control command corresponding to the controllable object when the spot is present in the hotspot area, including:

A projector includes the control device.

A computer readable storage medium storing computer executable instructions that, when executed by a processor, implement the described control method.

In the solution of the embodiment of the present invention, after the hot spot area is obtained, it is determined whether a spot of the control object is generated by determining whether the hot spot area has a light spot. In this way, the projector can respond to the control commands, thereby achieving the purpose of the laser pointer controlling the projector. The presenter can control the controllable objects in the projection screen without operating the mouse before returning to the seat, and the operation is convenient. In addition, the laser pointer does not need to be modified, and the controllable object in the projected picture can be controlled by a common, conventional laser pointer. The acquisition of the hotspot area and the processing of the signal and/or data involved in determining whether the spot is present in the hot spot are relatively simple, thereby reducing the cost of the projector, the laser pen and the projection system as a whole.

BRIEF abstract

FIG. 1 is a schematic flow chart of a control method according to an embodiment of the present invention.

2 is a schematic diagram of functional blocks of a control device according to an embodiment of the present invention.

Figure 3 is a schematic illustration of a projector in accordance with an embodiment of the present invention.

Figure 4 is a diagram showing the operation of an embodiment of the present invention.

5a, 5b are two other working principle diagrams of an embodiment of the present invention.

FIG. 6 is a schematic flow chart of a control method according to another embodiment of the present invention.

Figure 7 is a block diagram showing the functional blocks of a control device according to another embodiment of the present invention.

FIG. 8 is a schematic flow chart of a control method according to still another embodiment of the present invention.

Figure 9 is a block diagram showing the functional blocks of a control device according to still another embodiment of the present invention.

Embodiments of the invention

Embodiments of the present invention will be described below with reference to the accompanying drawings. It should be noted that, in the case of no conflict, the features in the embodiments and the embodiments in the present application may be arbitrarily combined with each other.

Referring to FIG. 1, a control method according to an embodiment of the present invention may be used to control a projector, and the method includes steps S101-S104:

S101. Take an image of the projected picture.

S102. Acquire a hotspot area corresponding to the controllable object in the projection screen.

S103. Process the image to identify whether there is a spot in the hot spot area.

S104 generates a control command corresponding to the controllable object when there is a spot in the hot spot area.

Referring to FIG. 2, the control device 10 of the embodiment of the present invention includes a photographing module 11, an obtaining module 12, a processing module 13, and a command module 14.

The control method of the embodiment of the present invention may be implemented by the control device 10 of the embodiment of the present invention. For example, the step S101 may be implemented by the imaging module 11, the step S102 may be implemented by the acquiring module 12, and the step S103 may be implemented by the processing module 13, and the step S104 is performed. This can be implemented by the command module 14.

That is to say, the photographing module 11 can be set to take an image of a projected picture. The acquisition module 12 can be configured to acquire hotspot regions in the projected image. The processing module 13 can be arranged to process the image to identify the presence or absence of a spot within the hotspot area. The command module 14 can be configured to generate a control command corresponding to the controllable object when there is a spot in the hotspot area.

It should be noted that the hot spot area refers to the area where the controllable object is located in the image of the projected picture.

Referring to FIG. 3, the control method of the embodiment of the present invention and the control device 10 of the embodiment of the present invention can be applied to the projector 100 of the embodiment of the present invention, and the hot spot area is obtained, and the hot spot area is determined by processing the image to determine whether a spot is present in the hot spot area. Whether to generate control commands for controllable objects.

As such, the projector 100 can respond to control commands to achieve the purpose of the laser pointer 200 controlling the projector 100. In this way, the presenter can control the controllable objects in the projected picture without operating the mouse before returning to the seat, and the operation is convenient.

In addition, the laser pointer 200 does not need to be modified, and an ordinary and conventional laser pointer can be used. Controls the controllable objects in the projected image.

Furthermore, the acquisition of the hotspot area and the signal and/or data processing involved in determining whether the hot spot has a spot in the hot spot are relatively simple, so that the projector 100, the laser pen 200 and the projection system (including the projector 100 and the laser) can be reduced overall. The cost of pen 200).

Referring to FIG. 3, optionally, the projector 100 reads the presentation file and performs spatial light modulation (SLM) on the current page data of the presentation file to be projected into the projection screen 102.

The SLM may be based on a liquid crystal display (LCD) panel modulation, or may be based on liquid crystal on silicon (LCoS) panel modulation, or based on a digital mirror device (DMD). Modulation.

Projector 100 can be an LCD, LCoS, or digital light processing (DLP) projector.

Of course, the projector 100 is not limited to the embodiment, and other suitable projectors may be employed as needed in other embodiments.

The control device 10 may be a component of the projector 100 and mounted inside the projector 100.

Of course, in other embodiments, the control device 10 can also be disposed separately from the projector 100, and is not limited to the embodiment.

The projector 100 includes a housing 101 and a projection lens 103. The projection lens 103 is exposed from the front side of the casing 101 and is provided to project a projection screen 102.

The photographing module 11 can be disposed on the outer casing 101 and also the front side of the sub-housing 101 is exposed, and thus, the photographing module 11 can capture an image of the projected screen 102.

The obtaining module 12 can obtain the hotspot area by analyzing the current page data. For example, in the current page data, the attributes of the controllable object (such as a button or a hyperlink address, etc.) are different from the attributes of the uncontrollable object (such as text or picture). The obtaining module 12 can identify the controllable object by reading the attributes of the object to determine the area of the controllable object in the projected picture 102, that is, the hotspot area corresponding to the object.

Referring to FIG. 4, for example, the current page data includes three play buttons 1022, and the attribute of the play button 1022 in the current page data is a controllable object. Therefore, the acquisition module 12 can recognize the three play buttons 1022, and then determine the corresponding Hotspot area 1024.

Of course, the acquisition of the hotspot area is not limited to the embodiment. In other embodiments, the hotspot area in the current projected picture may also be obtained by analyzing the image, for example, creating a style library of the controllable object, and then finding and identifying by pattern recognition. The hotspot area corresponding to the style in the style library.

Optionally, obtaining the hotspot area in the current projected picture by analyzing the image includes: using the pattern recognition technology, respectively, the plurality of object images included in the image and one or more of the pre-built controllable object style library Comparing the object patterns, an area of the plurality of object images in which the same object image as any one of the one or more object patterns is located is determined as a hot spot area.

For example, the created style library includes a style of a play button (for example, a forward triangle mark in a circular area), and then a hotspot area corresponding to the style of the play button is obtained by image processing.

It should be understood that the controllable object is not limited to the play button, but may also be a return button, a forward button, a pause button, and a hyperlink address.

Referring to FIG. 5a, during the demonstration, the presenter can use the laser pointer 200 to project a spot 1026 on the projected picture 102 to indicate the current presentation position or to indicate an emphasis or the like.

Referring to FIG. 5b, in the process of indicating, if the spot 1026 is projected on the hot spot area 1024, it is determined that the presenter wants to operate the controllable object corresponding to the hot spot area 1024. Thus, the command module 14 generates control commands corresponding to the controllable objects. For example, a play command of a play button, a return command of a return button, a forward command of a forward button, and an open command of a hyperlink address.

Referring to FIG. 6, optionally, the control method further includes:

Determine whether the projection screen is stable and enter the processing step when the projection screen is stable.

Referring to FIG. 7 , optionally, the control device 10 a further includes a determination module 15 . Step S101 can be implemented by the determination module 15, that is, the determination module 15 is configured to determine whether the projection screen is stable, and notify the processing module 13 to process the image when stable.

It can be understood that if the projection screen 102 is unstable, for example, in a page switching state, on the one hand, the image of the projection screen 102 may be unclear, and it is impossible to accurately determine whether there is a spot in the hot spot area. In addition, when the projection screen 102 is unstable, the presenter generally does not want to control the controllable objects in the projection screen 102.

Therefore, it is necessary to wait for the projection screen 102 to stabilize before processing the image. In this way, the amount of calculation can be saved. In addition, the accuracy of controllable object control can be provided.

It can be understood that whether the projected picture 102 is stable can be determined by analyzing the current page data.

Determining whether the projected picture is stable by analyzing the current page data includes: analyzing whether the current page data changes, determining that the projected picture is stable when the current page data has not changed; and when the current page data is When the change occurs, it is determined that the projected picture is unstable.

For example, if the current page data has not changed, it can be determined that the projection screen 102 is stable, and if the current page data changes, it can be determined that the page switching state is in progress, and the projection screen 102 is unstable.

In other embodiments, it is also possible to determine whether the projected picture 102 is stable by analyzing the image.

Determining whether the projected picture is stable by analyzing the image comprises: analyzing whether the image changes within a preset time, and determining that the projected picture is stable when the image does not change within a preset time; When the image changes within a preset time, it is determined that the projected picture is unstable.

If the image is stable, it can be judged that the projection screen 102 is stable, otherwise, the projection screen 102 is unstable.

Referring to FIG. 8, optionally, the control method further includes steps S201-S202:

S201. After capturing the image of the projection screen, detect whether the trapezoidal calibration function has been activated.

S202: Correct the hotspot area by using a trapezoidal calibration algorithm when the trapezoidal calibration function is started.

Referring to FIG. 9 , the imaging module 11 further includes a detection sub-module 111 and a calibration sub-module 112 . Step S201 can be implemented by the detection sub-module 111, and step S201 can be implemented by the correction module 112. That is, the detection sub-module 111 is set to recognize whether the trapezoidal calibration function has been activated, and the correction sub-module 112 is set to correct the hotspot region using the trapezoidal calibration algorithm when the trapezoidal calibration function has been activated.

It can be understood that the shooting module 11 may start the trapezoidal calibration function in order to accommodate the viewer's viewing angle. Thus, the projected image in the image is not a regular rectangle, but a quadrilateral with a chamfer angle, so the chamfering image algorithm needs to be further synchronized to ensure The accuracy of image recognition.

Optionally, generating a control command corresponding to the controllable object when the spot is present in the hotspot area includes steps S301-S302:

S301. Determine whether the presence time of the spot in the hot spot area exceeds a predetermined time.

S302. When the spot is in the hot spot area for more than the predetermined time, the control command is generated.

The command module 14 is arranged to complete the above steps S301-S302.

The predetermined time can be set by the user, for example, 3 seconds. This is mainly to increase the threshold of the trigger control command and prevent misoperation.

Those of ordinary skill in the art will appreciate that all or a portion of the steps of the above-described embodiments can be implemented using a computer program flow, which can be stored in a computer readable storage medium. The computer program is executed on a corresponding hardware platform (eg, system, device, device, device, etc.), and when executed, includes one or a combination of the steps of the method embodiments.

Alternatively, all or part of the steps of the above embodiments may also be implemented by using an integrated circuit. These steps may be separately fabricated into individual integrated circuit modules, or multiple modules or steps may be fabricated into a single integrated circuit module. achieve.

The devices/function modules/functional units in the above embodiments may be implemented by a general-purpose computing device, which may be centralized on a single computing device or distributed over a network of multiple computing devices.

When the device/function module/functional unit in the above embodiment is implemented in the form of a software function module and sold or used as a stand-alone product, it can be stored in a computer readable storage medium. The above mentioned computer readable storage medium may be a read only memory, a magnetic disk or an optical disk or the like.

In the description of the embodiments of the present invention, it is to be understood that the terms "center", "longitudinal", "lateral", "length", "width", "thickness", "upper", "lower", "previous" "," "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside", "outside", "clockwise", "counterclockwise", etc. The orientation or positional relationship is based on the orientation or positional relationship shown in the drawings, and is merely for the convenience of describing the embodiments and the simplified description of the present invention, and does not indicate or imply that the device or component referred to has a specific orientation, The orientation configuration and operation are therefore not to be construed as limiting the embodiments of the invention. Moreover, the terms "first" and "second" are used for descriptive purposes only and are not to be construed as indicating or implying a relative importance or implicitly indicating the number of technical features indicated. Thus, features defining "first" or "second" may include one or more of the described features either explicitly or implicitly. In the description of the embodiments of the present invention, the meaning of "a plurality" is two or more unless specifically defined otherwise.

In the description of the embodiments of the present invention, it should be noted that the terms "installation", "connected", and "connected" should be understood broadly, and may be a fixed connection, for example, or They are detachable or integrally connected; they can be mechanically connected, they can be electrically connected or can communicate with each other; they can be connected directly or indirectly through an intermediate medium, which can be internal or two components of two components. Interaction relationship. For those skilled in the art, the specific meanings of the above terms in the embodiments of the present invention can be understood on a case-by-case basis.

In the embodiments of the present invention, the first feature "on" or "under" the second feature may include direct contact of the first and second features, and may also include The first and second features are not in direct contact but are contacted by additional features between them. Moreover, the first feature "above", "above" and "above" the second feature includes the first feature directly above and above the second feature, or merely indicating that the first feature level is higher than the second feature. The first feature "below", "below" and "below" the second feature includes the first feature directly above and above the second feature, or merely the first feature level being less than the second feature.

The following disclosure provides many different embodiments or examples for implementing different structures of embodiments of the present invention. In order to simplify the disclosure of embodiments of the present invention, the components and arrangements of specific examples are described below. Of course, they are merely examples and are not intended to limit the invention. In addition, the embodiments of the present invention may repeat reference numerals and/or reference letters in different examples, which are for the purpose of simplicity and clarity, and do not in themselves indicate the relationship between the various embodiments and/or arrangements discussed. . Moreover, embodiments of the present invention provide examples of various specific processes and materials, but one of ordinary skill in the art will recognize the use of other processes and/or the use of other materials.

In the description of the present specification, the description with reference to the terms "one embodiment", "some embodiments", "illustrative embodiment", "example", "specific example" or "some examples", etc. Particular features, structures, materials or features described in the manner or examples are included in at least one embodiment or example of the invention. In the present specification, the schematic representation of the above terms does not necessarily mean the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in a suitable manner in any one or more embodiments or examples.

Any process or method description in the flowcharts or otherwise described herein may be understood to represent a module, segment or portion of code that includes one or more executable instructions for implementing the steps of a particular logical function or process. And the scope of the preferred embodiments of the invention includes additional implementations, in which the functions may be performed in a substantially simultaneous manner or in an opposite order depending on the functions involved, in the order shown or discussed. It will be understood by those skilled in the art to which the embodiments of the present invention pertain.

One of ordinary skill in the art can understand that all or part of the steps carried by the method of implementing the above embodiments can be completed by a program to instruct related hardware, and the program can be stored in a computer readable storage medium. When executed, one or a combination of the steps of the method embodiments is included. In addition, each functional unit in each embodiment of the present invention may be integrated into one processing module, or each unit may exist physically separately, or two or more units may be integrated into one module. The above integrated modules can be implemented in the form of hardware or soft. The form of the functional module is implemented. The integrated modules, if implemented in the form of software functional modules and sold or used as stand-alone products, may also be stored in a computer readable storage medium. The above mentioned storage medium may be a read only memory, a magnetic disk or an optical disk or the like. Although the embodiments of the present invention have been shown and described, it is understood that the above-described embodiments are illustrative and are not to be construed as limiting the scope of the invention. The embodiments are subject to variations, modifications, substitutions and variations.

Industrial applicability

Claims

A control method includes:

Taking an image of the projected picture;

Obtaining a hotspot area corresponding to the controllable object in the projection screen;

Processing the image to identify whether there is a spot in the hot spot area;

A control command corresponding to the controllable object is generated when the spot exists in the hot spot area.
The control method according to claim 1, wherein the projection picture is formed by spatially modulating the current page data of the presentation file by the projector;

The obtaining the hotspot area corresponding to the controllable object in the projection screen comprises:

The hotspot area is obtained by analyzing the current page data.
The control method according to claim 1, further comprising: identifying the hot spot area by processing the image before acquiring a hot spot area corresponding to the controllable object in the projected picture.
The control method according to claim 2, wherein the control method further comprises:

Determining whether the projected picture is stable and processing the image when the projected picture is stable.
The control method according to claim 4, wherein

The determining whether the projection picture is stable comprises:

Whether the projected picture is stable is determined by analyzing the current page data.
The control method according to claim 5, wherein the determining whether the projection picture is stable further comprises: determining whether the projection picture is stable by analyzing the image.
The control method according to claim 1, further comprising: detecting whether a trapezoidal calibration function has been activated after capturing an image of the projected image;

The hot spot region is corrected using a trapezoidal calibration algorithm when the trapezoidal calibration function has been initiated.
The control method according to claim 1, wherein

The generating a control command corresponding to the controllable object when the spot is present in the hotspot area includes:

Determining whether the presence time of the spot in the hot spot area exceeds a predetermined time;

Generating the light spot when the presence of the spot in the hot spot region exceeds the predetermined time control commands.
A control device, the control device comprising:

a shooting module configured to take an image of a projected image;

Obtaining a module, configured to acquire a hotspot area corresponding to the controllable object in the projection screen;

a processing module configured to process the image to identify whether there is a spot in the hot spot area;

And a command module configured to generate a control command corresponding to the controllable object when the spot exists in the hot spot area.
The control device according to claim 9, wherein the projection picture is formed by spatially modulating and temporally modulating current page data of the presentation file by the projector;

The obtaining, by the acquiring module, the hotspot area corresponding to the controllable object in the projection screen includes:

The hotspot area is obtained by analyzing the current page data.
The control device according to claim 9, wherein the processing module is further configured to: identify the hot spot region by processing the image before acquiring a hot spot region corresponding to the controllable object in the projection screen.
The control device of claim 9, the control device further comprising:

a determining module, configured to determine whether the projection screen is stable;

The processing module is further configured to process the image when the projected image is stable.
The control device according to claim 12, wherein

The determining, by the determining module, whether the projected image is stable comprises: determining whether the projected image is stable by analyzing the current page data.
The control device according to claim 13, wherein the determining module determining whether the projection picture is stable further comprises: determining whether the projection picture is stable by analyzing the image.
The control device of claim 9, wherein the photographing module further comprises:

The detection sub-module is configured to detect whether the trapezoidal calibration function has been activated after the image of the projection screen is captured;

The calibration sub-module is configured to correct the hot spot region using a trapezoidal calibration algorithm when the trapezoidal calibration function has been initiated.
The control device according to claim 9, wherein the command module generates a control command corresponding to the controllable object when the spot is present in the hot spot region, comprising: determining that the spot is Whether the existence time of the hot spot area exceeds a predetermined time;

The control command is generated when the spot is present in the hot spot area for more than the predetermined time.
A projector comprising a control device according to any of claims 9-16.
A computer readable storage medium storing computer executable instructions that, when executed by a processor, implement the control method of any one of claims 1-8.