JP4377247B2 - Projector projection control system and projector projection control method - Google Patents

Description

  The present invention relates to a display device for displaying and reproducing a screen output of a television or a computer on a monitor and a control method thereof, and particularly in an environment where a projector is projected on a street or the like, so that a projector can be appropriately projected onto an area designated by a user. The present invention relates to a system and method for controlling the orientation and zoom of a projector.

  As a technology related to an information display terminal on a street that can be used freely by a user, Patent Document 1 (“an electric bulletin board system having a street display device”) describes a system that can display characters and figures input by a user on a street terminal. Has been. However, in this system, it is not possible to know where the content is displayed. Therefore, when the display screen is large, it may be displayed at an unexpected position.

  In such a display system in a public environment, it is effective to allow a user to specify a display area such as a position, size, and shape to be displayed in advance and display the specific display area. It is also predicted that multiple users will use it simultaneously. For this reason, it is necessary to provide a wide specification area for the user to specify a display area, such as a touch panel, or a display area such as a display or a projector.

  If multiple users use information display terminals, this can be achieved by installing multiple computers in advance. However, securing the installation location and measures against computer theft are necessary. The content cannot be viewed in a movable space such as “in that position”. In addition, it is not suitable for situations in which a plurality of users who are present on the spot view, share, or exchange contents.

On the other hand, as a display control technique using a projector, for example, there is a technique described in Patent Document 2 (“video projector apparatus”). With the technique described in Patent Document 2, it is possible to automatically adjust the position of the zoom lens of the projector and to enlarge or reduce the display screen size simply by inputting a desired screen size.
JP 2003-15567 A JP-A-5-323451

  When displaying information in any area specified by the user, it is possible to detect the area specified by the user using a display with a touch panel and display it in that area, but the size of the touch panel display is limited (currently There is a problem that even if these are used side by side, the economic cost becomes very high.

  If a touch sensor is installed on the screen projected by the projector, the same function as a display with a touch panel can be realized, and the enlargement of the screen area can be realized relatively easily. However, there is a problem that the display accuracy per screen size becomes rough if it is projected so as to be usable in a wide range.

  An object of the present invention is to solve the above-mentioned problems by providing means capable of projecting a projector as narrowly as possible in an area designated by a user.

  In order to solve the above-described problems, the present invention is characterized in that a region designated by a user is detected, the direction and size of the projection are controlled so that the projector projects only on that portion, and the content is displayed. In addition, even when the area is expanded / reduced, newly used by another user, or terminated, the user's operation instruction for the area is detected constantly or periodically, and the necessary area as the display area It is characterized by controlling only so that only the part is extracted.

  FIG. 1 is a diagram illustrating detection of a user-specified area by a sensor, and FIG. 2 is a diagram illustrating detection of a user-specified area by a camera. In order to detect the user-designated area 3, for example, as shown in FIG. 1, an optical touch sensor 2 is installed in the projectable range 4 of the projector, and the movement of a finger or the like that designates the user's area is performed. There is a way to detect.

  In addition, as shown in FIG. 2, a camera 6 that can overlook the projectable range 4 of the projector can be installed, and an area designated by the user can be detected by the camera 6. In this case, it is possible to detect the movement of the finger that specifies the user's area based on the shape of the user's finger or the color of the skin. However, if the user uses the pointing marker of the specified color, the user can specify the user efficiently. The area 3 can be detected. Further, in order to accurately measure the position of the area, it is necessary to associate the detection position by the camera 6 with the position designated by the user, that is, the position to be projected by the projector 1 in advance.

  FIG. 3 is a diagram showing a projection range of the projector. The position and shape of the user designated area 3 detected by the method shown in FIG. 1 or FIG. 2 are acquired, and the projector is maximized in the minimum area including the user designated area 3 as shown in FIG. The projection size 5 of the projector 1 is calculated to determine the projection range 5 of the projector.

  In addition, when the number of projectors 1 is one, the projectable range 4 of the projector is limited. It is possible to widen the projectable range 4 of the projector. Moreover, it is not necessary to project anything when the user is not using it at all.

  According to the present invention, it is possible to secure a user use display area for a wide range with one or a small number of projectors. It is also possible to improve the display accuracy of the projected content.

  In particular, when displaying information in an arbitrary area specified by the user in a public space such as a street by projecting it to the required position with a minimum size using a projector, the display location, especially the available space. It becomes possible to realize a system that can eliminate the restrictions and increase the degree of freedom of installation at a low cost.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. FIG. 4 is a diagram showing a configuration example of the projector projection control system according to the embodiment of the present invention. Here, an example using a plurality of projectors 1 will be described.

  The projector projection control system includes an area input unit 10, a specified area acquisition unit 21, a projector selection unit 22, a projection size conversion unit 23, a projection position conversion unit 24, a content determination unit 25, a content acquisition unit 26, a projection data generation unit 27, A projector projection data storage unit 28, a content DB (database) 29, a projection device control unit 30, and a plurality of projectors 1 are included. Here, the designated area acquisition unit 21, the projector selection unit 22, the projection size conversion unit 23, the projection position conversion unit 24, the content determination unit 25, the content acquisition unit 26, and the projection data generation unit 27 are executed by a software program in the computer 20. Can be realized.

  The area input unit 10 is a means for detecting an operation of designating a position and a shape where the user wants to display content. Specifically, for example, by installing an optical touch sensor around the screen, it is possible to detect an operation within the screen range. It is also possible to detect a region designated by the user by installing a camera overlooking the screen and computer-processing the user's motion video captured by the camera. The user specified area information acquired by the area input unit 10 includes at least position information for specifying a position specified by the user and shape information of the specified area.

  The designated area acquisition unit 21 holds user specified area information acquired from the area input unit 10. FIG. 5 is a diagram illustrating an example of designation of a user designated area. FIG. 6 is a diagram illustrating an example of user-specified area information. For example, as shown in FIG. 5, when an area is designated by the user, the absolute coordinates (X, Y) are acquired at regular time intervals. By holding the acquired absolute coordinates (X, Y) as user-specified area information as shown in FIG. 6, it is possible to hold information on the position and shape of the user-specified area. Here, when there are a plurality of touch sensors or cameras, in order to know which touch sensor or camera has detected the user-specified area, the ID of the touch sensor or camera is acquired at the same time and the ID is held. It is necessary to keep.

  When projecting using a plurality of projectors 1, the projector selection unit 22 selects which projector 1 should project with respect to the position of the user designated area held as the user designated area information.

  FIG. 7 is a diagram illustrating an installation example of a touch sensor and a plurality of projectors. For example, assuming that the user-specified area information shown in FIG. 6 is acquired by the touch sensor 2 when projection is possible with two projectors 1 (projector A1a and projector B1b) as shown in FIG. Since the region is in a rectangular range of upper left coordinates (117, 165) -lower right coordinates (334, 405), the projector A1a capable of projecting the range is selected as a projector to be used for projection.

  The projection size conversion unit 23 designates a projection size to be projected by the projector 1 selected by the projector selection unit 22. This projection size should be as narrow as possible, including the user-specified area. In general, when the projection area is small, the display accuracy is improved, and when the projection area is large, the display accuracy is deteriorated. Therefore, the display accuracy can be improved by displaying the projection size as narrow as possible.

  In order to make the projection size variable, the projector 1 is equipped with an optical zoom function similar to the zoom function of the camera, or a lens control device or a projection surface capable of optical processing similar to that of the projector 1. An environment in which 1 can be moved vertically is necessary. If it is impossible to zoom to the narrowest projection size even with such an environment, the zoom is made to the extent possible.

  FIG. 8 is a diagram illustrating the relationship between the projection distance and the zoom magnification (projection magnification). FIG. 9 is a diagram showing a correlation image between the projection distance and the zoom magnification. In FIG. 8A, the distance (projection distance) from the projector 1 to the projection plane is D1, and in FIG. 8B, the distance (projection distance) from the projector 1 to the projection plane is D2. These distances D1 and D2 are measured in each coordinate system at the time of installation. When the projection area R of the projector is determined from the user-specified area, the projection according to the size of the projection area R of the projector can be performed by setting the zoom of the projector 1 according to the projection distance. 9, the projection area of the projector is determined by the relationship between the distances a1, a2,... From the projector 1 to the screen and the zoom magnifications b1, b2,. By changing the distance and appropriately controlling the projection magnification, the projection size can be made variable.

  The projection position conversion unit 24 projects the projection direction in which the user-specified area held by the user-specified area information and the projection area of the projector overlap, that is, the position coordinates of the projection area of the projector, and the user in the projection area at the zoom magnification. Determine the position coordinates of the specified area.

  FIG. 10 is a diagram illustrating an example of coordinate conversion of the projection position. Here, it is assumed that the projector 1 can zoom back and project up to a projector projectable region S that is equal to the maximum detectable range of the sensor. Originally, for example, in FIG. 10, it is desirable to be able to zoom in to the projection area (desired projection area H) which is the smallest square area including the user-specified area U. However, if the minimum area that the projector 1 can project is up to the projector projection minimum area M, the projector projection possible area S is zoomed in to x times (for example, 1.5 times) in order to display the desired projection area H. In this coordinate system, the projector projection minimum area M is projected at a square position of Sm0 (280, 220) -Sm1 (1080, 820). Here, assuming that the projection size of the projector 1 is 800 × 600, Sm0 that is the upper left coordinate of the projector projection minimum area M is represented by M0 (0, 0) in the coordinate system M of the projector projection minimum area M, Similarly, when Sm1 which is the lower right coordinate of the projector projection minimum region M is represented by the coordinate system M, M1 (800, 600) is obtained.

If a point Su1 in the user-designated area U is Su1 (460, 380) in the coordinate system of the projector projectable area S, this point is
Su1 (460,380) -M0 (0,0)
= Su1 (460,380) -Sm0 (280,220)
= Mu1 (180, 160)
It is expressed. Therefore, the point Su1 of the user designated area U corresponds to the point Mu1 (180, 160) of the coordinate system M of the projector projection minimum area M for the projector 1.

  In this way, the user designated area U is converted into the coordinate system of the projector 1. It is assumed that the information on the coordinate system relating to the sensor and projector projection described above is input in advance into the projector projection data storage unit 28 as projector projection data when the apparatus is installed.

  The content determination unit 25 determines the content to be displayed in the user designated area from the content DB 29. The content may be determined by any method, for example, a form in which the content associated with information such as the shape and size of the specified area is determined, or the content is selected for each user. Such a form may be sufficient. As a form in which content is selected for each user, there are, for example, a method of registering a content ID in advance for each user, a method of selecting from a menu, and a method of allowing a user to input a URL (Uniform Resource Locator).

  The content acquisition unit 26 acquires the content determined by the content determination unit 25. The contents may be acquired in advance or may be acquired remotely via a network or the like.

  The projection data generation unit 27 determines the user specified area converted by the projection size conversion unit 23, and generates projection data for displaying the content acquired by the content acquisition unit 26 in the area.

  The projection device control unit 30 sets the projector 1 designated by the projector selection unit 22 as a projection device, and the projector size and the projection position designated by the projection size conversion unit 23 and the projection position conversion unit 24 are set. 1 is controlled by optical setting or physical movement, and projection data including the content generated by the projection data generation unit 27 is output to the projector 1.

  FIG. 11 is a diagram illustrating an example of physical movement of the projector. As a method for physically moving the projector 1, for example, as shown in FIG. 11, there is a method in which a rail 8 is laid on the ceiling 7 and the projector 1 is moved by the rail 8. Further, the focus of the projector 1 is adjusted as needed.

  As a method of displaying the rectangle of the area designated by the user, a method can be used in which the same rectangular window is created on the software by a computer, contents are displayed in the window, and the projector 1 projects it. In other words, the maximum values in the vertical and horizontal directions of the area specified by the user are measured, and the range that falls within the square with the measured maximum values in the vertical and horizontal directions as the length of each side is determined as the display area size. Content to be displayed with the displayed display area size is generated and projected by the projector 1. Alternatively, there is also a method of using a device controlled so as to optically block the projection between the projector 1 and the screen.

  With the above configuration, the projector 1 can project onto an area designated by the user.

  FIG. 12 is a flowchart of the projector projection control process in the embodiment of the present invention. Here, an example of projector projection control when there is a region change will be described.

  First, it is determined whether there is an input for designating a display area from the user (step S10). If there is an input, the designated area information is acquired (step S11). Here, the display area designation input can be detected by a touch sensor or a camera as described above. The designated area information includes at least position information for specifying a position designated by the user and shape information of the designated area.

  If there are a plurality of projectors 1 (step S12), the projector 1 that can project to the designated area is selected (step S13).

  Next, the minimum projection size necessary for projecting onto the designated area is determined for the area that can be projected by the projector 1 by the method described above (step S14). Further, the projection position of the projector onto which the content is projected is determined so as to overlap the designated area (step S15).

  Next, the content to be displayed is acquired (step S16). The content may be an application such as a video, still image, or Web, and may be stored or acquired via a network. These contents may be selected using the attribute information of the designated area, or may be selected by a user identified by some means.

  The content acquired in step S16 is converted so as to have the projection size determined in step S14 to generate projection data (step S17), and the projector 1 is projected so as to be projected to the projection position determined in step S15. Control is performed (step S18), and content is projected by the projector 1 (step S19).

  In the present embodiment, the user can perform area operations such as area expansion, area reduction, area movement, and addition of a new area while the content is projected. FIG. 13 is a diagram illustrating an example of a region operation by the user. For example, as shown in FIG. 13, the region operation refers to a user's operation for instructing a change of a region that has already been designated and content is projected.

  FIG. 13A is a diagram illustrating an example of area expansion. For example, when the user's action is a one-stroke writing that starts from within the existing area and ends within the existing area, the area indicated by the one-stroke writing is added to the existing area as shown in FIG.

  FIG. 13B shows an example of area reduction. For example, when the user's action starts from outside the existing area, and passes through the area and ends outside the area, the area indicated by the single stroke is displayed as shown in FIG. 13B. Delete from the existing area and shrink the area.

  FIG. 13C illustrates an example of area movement. For example, when the user's action is a single stroke that starts from the inside of the existing area and ends outside the existing area, as shown in FIG. 13C, the position of the start point of the single stroke is the end point of the stroke. Move the corresponding area to the position.

  FIG. 13D is a diagram showing an example of adding a new area. For example, when the user's action starts from the outside of the existing area and is a single stroke that does not pass through the area, the area drawn by a single stroke is set as the new area as shown in FIG. At this time, when the projection onto the new area is performed by the projector 1 different from the projector 1 in the existing area, content different from the existing area is displayed in the new area. When the projector 1 in the existing area projects onto the new area, the content is displayed in the minimum area including both the existing area and the new area.

  FIG. 14 shows an example in which a single projector projects onto an existing area and a new area. It is assumed that a new user designated area 3b is added to the existing user designated area 3a by the user's area operation. When the projector 1 that projects onto the existing user designated area 3a and the projector 1 that projects onto the new user designated area 3b are the same, as shown in FIG. 14, the minimum area including both areas is projected by the projector. A range 5 is set, and content is projected onto the area.

  As a means for detecting the user's action for performing the region operation as described above, a means for detecting the display area designation input in step S10 may be used, or another means may be prepared. When the operation of the user's area operation is detected (step S20), the process returns to step S11, the designated area information changed in step S11 is acquired, and the processes in steps S12 to S19 are executed on the changed designated area information. To do.

  Any method can be applied to the end of the display (step S21). For example, it may be timed out when a certain time has elapsed, or may be ended by a user instruction operation.

  As described above, the projector can be projected onto the area designated by the user.

It is a figure which shows the detection of the user designation | designated area | region by a sensor. It is a figure which shows the detection of the user designation | designated area | region by a camera. It is a figure which shows the projection range of a projector. It is a figure which shows the structural example of the projector projection control system which concerns on embodiment of this invention. It is a figure which shows the example of designation | designated of a user designation | designated area | region. It is a figure which shows the example of user designation area information. It is a figure which shows the example of installation of a touch sensor and a some projector. It is a figure which shows the relationship between a projection distance and zoom magnification. It is a figure which shows the correlation image of a projection distance and zoom magnification. It is a figure which shows the example of the coordinate transformation of a projection position. It is a figure which shows the example of the physical movement of a projector. It is a projector projection control processing flowchart in an embodiment of the invention. It is a figure which shows the example of area | region operation. It is a figure which shows the example in the case of projecting with an existing area | region and a new area | region with one projector.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Projector 2 Touch sensor 3 User specification area | region 4 Projectable range 5 Projector projection range 6 Camera 7 Ceiling 8 Rail 10 Area input part 20 Computer 21 Specification area acquisition part 22 Projector selection part 23 Projection size conversion part 24 Projection position conversion 24 Unit 25 content determination unit 26 content acquisition unit 27 projection data generation unit 28 projector projection data storage unit 29 content DB
30 Projector control unit

Claims (8)

A projector projection control system for displaying content on a region arbitrarily designated by a user using a projector,
A specified area acquisition means for acquiring information of an area specified by the user;
Conversion means for determining the projection position or projection size of the projector and converting the coordinates of the projection range in order to display the content so as to overlap with the designated area;
Projection data generation means for generating content to be displayed in the designated area based on the projection position or projection size determined by the conversion means;
A projector projection control system comprising: a projection device control means for controlling an optical projection magnification in accordance with the projection position or the projection size. A projector projection control system for displaying content on a region arbitrarily designated by a user using a projector,
A specified area acquisition means for acquiring information of an area specified by the user;
Conversion means for determining the projection position or projection size of the projector and converting the coordinates of the projection range in order to display the content so as to overlap with the designated area;
Projection data generation means for generating content to be displayed in the designated area based on the projection position or projection size determined by the conversion means;
Projector control means for controlling the projection direction of the projector and the distance to the screen in accordance with the projection position or the projection size by physical movement of the projector up / down, left / right or front / rear movement or rotation. A projector projection control system characterized by the above. The projector projection control system according to claim 1 or 2,
The projector projection control system further comprising projector selection means for selecting a projector for displaying content in the designated area from a plurality of projectors installed. In the projector projection control system according to any one of claims 1 to 3,
The designated area acquisition means detects an area increase operation, a reduction operation or a move operation, or a new area addition operation for the specified area, acquires information of a newly specified area by the operation,
The projector projection control system, wherein the conversion means performs a conversion process of coordinates of a projection range in response to a change in the designated area. A projector projection control method for displaying content with a projector in a region arbitrarily designated by a user,
A specified area acquisition process for acquiring information of the area specified by the user;
A conversion process for determining the projection position or projection size of the projector and converting the coordinates of the projection range in order to display the content so as to overlap the designated area;
A projection data generation process for generating content to be displayed in the designated area based on the projection position or projection size determined by the conversion process;
And a projection device control process for controlling an optical projection magnification in accordance with the projection position or the projection size. A projector projection control method for displaying content with a projector in a region arbitrarily designated by a user,
A specified area acquisition process for acquiring information of the area specified by the user;
A conversion process for determining the projection position or projection size of the projector and converting the coordinates of the projection range in order to display the content so as to overlap the designated area;
A projection data generation process for generating content to be displayed in the designated area based on the projection position or projection size determined by the conversion process;
A projection device control process for controlling a projection direction of the projector and a distance to the screen according to the projection position or the projection size by a physical movement of vertical or horizontal movement or rotation of the projector. A projector projection control method characterized by the above. In the projector projection control method according to claim 5 or 6,
A projector projection control method comprising: a projector selection step of selecting a projector that displays content in the designated area from a plurality of projectors installed. In the projector projection control method according to any one of claims 5 to 7,
In the designated area acquisition process, an area increase operation, a reduction operation or a move operation for the specified area, or an operation for adding a new area is detected, and information on a newly specified area is acquired by the operation.
The projector projection control method characterized in that, in the conversion process, a coordinate conversion process of a projection range is performed in response to a change in the designated area.

Images