JP2018180125A - Image projection device, image projection method and image projection program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To project a projection object in full scale.SOLUTION: An information processing device projects projection object data including a projection object on a projection surface to acquire projection data projected on the projection surface. Then, the information processing device calculates a ratio between the actual size of the projection object and the actual size of the projection object included in the projection data on the basis of information on the actual size of the projection object. After that, the information processing device performs re-projection on the projection surface in full scale according to the ratio calculated in this way.SELECTED DRAWING: Figure 2

Description

  The present invention relates to an image projection apparatus, an image projection method, and an image projection program.

  2. Description of the Related Art Conventionally, meetings and the like have been conducted by projecting images such as data and photographs using a projector in a company or the like, and classes using the projector have also been performed at educational sites. For example, as a method of conveying the size of the projection object with a photograph, it is generally used to take a picture at the same time as the projection object using a one-yen coin or a cigarette box as an index, and to transmit the size contrast relatively. It is.

  In the relative transmission method, the size in which the student images the index may be different for each student, and in recent years, it has been practiced to project the projection target object which is the object in full scale. For example, the screen size of the projector on the projection plane is determined by the number of pixels, the number of pixels of the actual size of the projection object is determined, and the projection target is projected with the size of the number of pixels. The technology to display on is known.

Unexamined-Japanese-Patent No. 2004-280271

  However, in the above technology, since the actual size of the projection object is determined and projected according to the size of the screen of the projector, it is difficult to project the projection object in the full size when the size of the screen of the projector can not be acquired.

  For example, when the aspect ratio of the screen of the projector to be projected is different from the aspect ratio of the projection surface such as a wall, displaying the shorter side in the vertical or horizontal direction of the screen of the projector over the entire projection surface The side of the wall projects from the projection plane. For this reason, the size of the screen of the projector can not be acquired, and the projection target can not be displayed in full size. Alternatively, even if both ends of the screen of the projector are cut, the size of the screen of the projector can not be acquired.

  In one aspect, it is an object of the present invention to provide an image projection apparatus, an image projection method, and an image projection program capable of projecting a projection target in full size.

  In the first scheme, the image projection apparatus has an acquisition unit that projects projection target data including a projection target object onto a projection plane to acquire projection data projected onto the projection plane. The image projection apparatus has a calculation unit that calculates a ratio between the actual size of the projection object and the actual size of the projection object included in the projection data, based on the information on the actual size of the projection object. The image projection apparatus has a projection unit which reprojects on the projection plane in full scale according to the ratio.

  In one aspect, the projection object can be projected at full scale.

FIG. 1 is a diagram illustrating an example of an entire configuration of a system according to a first embodiment. FIG. 2 is a functional block diagram of the functional configuration of the information processing apparatus according to the first embodiment. FIG. 3 is a diagram showing an example of information stored in the projection image DB. FIG. 4 is a diagram showing an example of information stored in the distance information DB. FIG. 5 is a diagram for explaining from acquisition of the size of the projection image to reprojection. FIG. 6 is a flowchart showing the flow of processing. FIG. 7 is a view for explaining an example of a full size projection. FIG. 8 is a diagram showing an example of a hardware configuration.

  Hereinafter, embodiments of an image projection apparatus, an image projection method, and an image projection program disclosed in the present application will be described in detail based on the drawings. The present invention is not limited by this embodiment.

[overall structure]
FIG. 1 is a diagram illustrating an example of an entire configuration of a system according to a first embodiment. As shown in FIG. 1, this system includes a projector 1, a screen 2, and an information processing apparatus 10. In the present embodiment, the projector 1 and the information processing apparatus 10 are connected by wire or wireless, but the present invention is not limited to this. The projector 1 is incorporated in the information processing apparatus 10 May be Similarly, in the present embodiment, although an example in which the information processing apparatus 10 incorporates a camera will be described, the present invention is not limited to this, and an external camera connected by wire or wireless can be used. Further, in the present embodiment, image data is described as an example of a projection target, but the present invention is not limited to this and may be a moving image or a video.

  The information processing apparatus 10 is an example of an image projection apparatus that projects an image or the like on the screen 2 using the projector 1 that is a projector. For example, the information processing apparatus 10 reads chicken image data A stored in an internal hard disk or the like, and projects the image data A onto the projection plane P of the screen 2 via the projector 1.

  For example, the information processing apparatus 10 projects the image data A on the projection plane P, and images the projection data Q with a camera. Subsequently, the information processing device 10 calculates the size of the chicken image data J included in the image data A and the size of the chicken image data N included in the projection data Q. On the other hand, the information processing apparatus 10 calculates the actual size of the chicken corresponding to the image data N from the ratio of the actual size of the chicken and the size of the stored image data J. Then, the information processing apparatus 10 recalculates, on the projection plane P, new image data obtained by enlarging or reducing the image data A so that the actual size becomes larger on the projection surface by calculating the ratio on the actual size and using the ratio. Do.

  That is, the information processing apparatus 10 calculates the size of the projected object by photographing the projected object with a camera equipped with a device capable of acquiring the distance to the object, and compares the size of the projected object with the actual size of the object Then, the projection source data is scaled at that ratio and projected again. Therefore, the information processing apparatus 10 can project the projection target at full scale.

[Function configuration]
FIG. 2 is a functional block diagram of the functional configuration of the information processing apparatus 10 according to the first embodiment. As illustrated in FIG. 2, the information processing apparatus 10 includes a communication unit 11, an imaging unit 12, a storage unit 20, and a control unit 30.

  The communication unit 11 is a processing unit that controls communication of another device, and is, for example, a communication interface. For example, the communication unit 11 receives, for example, image data to be projected from a management terminal or the like, and stores the image data in the storage unit 20.

  The imaging unit 12 is a processing unit that images an object (projection data) projected on a projection plane, and is, for example, a camera. For example, the imaging unit 12 can capture projection data and measure the distance to the projection data.

  The storage unit 20 is an example of a storage device that stores programs, data, and the like, and is, for example, a memory, a hard disk, or the like. The storage unit 20 stores a projection image DB 21 and a distance information DB 22.

  The projection image DB 21 is a database storing information on image data to be projected. FIG. 3 is a diagram showing an example of information stored in the projection image DB 21. As shown in FIG. As shown in FIG. 3, the projection image DB 21 stores “image data, distance to an object”. The “image data” is information for specifying the image data of the projection target, and the “distance to the target” indicates the distance when the imaging target is imaged in order to generate the image data. In the example of FIG. 3, the photograph A is an image captured at a distance of 300 cm, and the photograph 2 is an image captured at a distance of 100 cm.

  The distance information DB 22 is a database that stores the ratio of one pixel in the projection distance. FIG. 4 is a diagram showing an example of information stored in the distance information DB 22. As shown in FIG. As shown in FIG. 4, the distance information DB 22 stores “distance, pixel, coefficient” in association with one another. The "distance" is the projection distance to the projection plane, the "pixel" is the reference number of pixels, and the "factor" is a correction factor based on the distance. In the example of FIG. 4, when the distance to the projection plane is 100 cm, it is shown that the actual size can be calculated by multiplying the projection data by 0.363 per pixel.

  Here, a specific example of the calculation of the coefficient will be described. For example, the unit scale (coefficient) indicates the actual size equivalent to one pixel (pixel) from the distance to the subject, the size of the imaging device, and the focal length of the lens. Calculation formula “distance to subject [mm] × sensor size [ The size of the subject in the collation image is calculated by calculating mm]) / focal length [mm]. Here, the size of the imaging device is either vertical or horizontal, and the focal length is, for example, a value converted to a lens focal length in 35 mm format in a still camera. According to this calculation formula, the actual size [mm] of the subject in the direction (vertical or horizontal) of the substituted image sensor size is specified. The actual size corresponding to one pixel is calculated by dividing the subject size calculated in this way by the image size (number of pixels) in the direction (vertical or horizontal) of the imaging size used in the calculation.

  In addition, it is also possible to use a ranging sensor or the like in which a focal length (Focal Length) and a pixel size (Pixel size) of one pixel are specified. Specifically, by using the focal length: target object distance = pixel size: target object pixel size, the target object pixel size, that is, the above coefficient is “(target object distance / focal distance) × pixel size” It can be calculated by

  The control unit 30 is a processing unit that controls the entire information processing apparatus 10, and is, for example, a processor. The control unit 30 includes a projection execution unit 31, an acquisition unit 32, an actual size calculation unit 33, a size change unit 34, and a reprojection execution unit 35. The projection execution unit 31, the acquisition unit 32, the actual size calculation unit 33, the size change unit 34, and the reprojection execution unit 35 are an example of an electronic circuit included in the processor and an example of a process executed by the processor.

  The projection execution unit 31 is a processing unit that projects image data to be projected. Specifically, the projection execution unit 31 displays a list of image data to be projected on a display or the like, and outputs the selected image data A to the projector 1. The projector 1 projects the input image data on the screen 2.

  The acquisition unit 32 is a processing unit that acquires an image of projection data on the projection plane P. Specifically, when the projection execution unit 31 projects the image data A, the acquisition unit 32 transmits an imaging instruction of the projection data Q projected on the projection plane P to the imaging unit 12. Then, the acquisition unit 32 acquires the image data of the projection data Q captured by the imaging unit 12 and outputs the image data to the actual size calculation unit 33.

  The actual size calculation unit 33 is a processing unit that calculates the actual size of the chicken J included in the image data A to be projected and the actual size of the chicken N included in the projection data Q. For example, with regard to the image data A, the actual size calculation unit 33 detects the outline of the chicken J, which is a projection target object included in the image data A, by known image analysis. Subsequently, the actual size calculation unit 33 detects the top and bottom of the outline, and obtains the number of pixels which is the height of the projection target of the projection target (chicken J). Here, it is assumed that the actual size calculation unit 33 calculates 46 pixels. Then, the actual size calculation unit 33 specifies the distance “300 cm” when imaging the image data A with reference to the projection image DB 21, and further, referring to the distance information DB 22, the coefficient “1. Identify "090". After that, the actual size calculation unit 33 calculates 46 pixels × 1.090 = 50 cm as the actual size of the chicken J that is the projection object included in the image data A.

  Similarly for the projection data Q, the actual size calculation unit 33 detects the outline of the chicken N, which is a projection object, included in the projection data Q, by known image analysis. Subsequently, the actual size calculation unit 33 detects the top and bottom of the outline, and obtains the number of pixels which is the height of the projection target of the projection target (chicken N). Here, it is assumed that the actual size calculation unit 33 calculates as 275 pixels. Furthermore, the actual size calculation unit 33 acquires the distance “100 cm” to the projection plane from the imaging unit 12. Then, the actual size calculation unit 33 refers to the projection image DB 21 to identify the distance “100 cm” when imaging the projection data Q, and further refers to the distance information DB 22 to refer to the coefficient “0. Identify "363". After that, the actual size calculation unit 33 calculates 275 pixels × 0.363 = 100 cm as the actual size of the chicken N which is the projection object included in the projection data Q.

  Then, the actual size calculation unit 33 outputs the actual size value “50 cm” of the chicken J based on the image data A to be projected and the actual size value “100 cm” of the chicken N based on the projection data Q to the size changing unit 34.

  The size changing unit 34 is a processing unit that enlarges or reduces the image data to be projected according to the actual size ratio. In the above example, the size changing unit 34 determines that 50 cm of chicken is projected at 100 cm, and calculates 50/100 = 1/2 as a ratio. As a result, the size changing unit 34 generates image data in which the size of the image data A to be projected is halved and outputs the generated image data to the reprojection execution unit 35. That is, the size changing unit 34 generates image data for reprojection such that the size of the chicken J in the image data A to be projected is reduced to half.

  The reprojection execution unit 35 is a processing unit that projects the projection target image data output from the size change unit 34. Specifically, the re-projection execution unit 35 outputs, to the projector 1, image data for re-projection in which the size of the image data A itself to be projected is halved. The projector 1 projects the input image data for reprojection on the screen 2.

  FIG. 5 is a diagram for explaining from acquisition of the size of the projection image to reprojection. As shown in FIG. 5, when projecting the image data A, the information processing apparatus 10 captures the projection data Q. Subsequently, the information processing apparatus 10 calculates the size (number of pixels = 46) of the chicken J for the projection target included in the image data A, and the size (number of pixels = 275) of the chicken N included in the projection data Q. Calculate).

  The information processing apparatus 10 then measures the actual size (50 cm) of the chicken J when imaging the chicken J from the size (number of pixels = 46) of the chicken J to be projected and the coefficient (1.090) based on the distance at the time of imaging. Calculate). Similarly, the information processing apparatus 10 calculates the actual size (100 cm) of the chicken N from the size (number of pixels = 275) of the projected chicken N and the coefficient (0.363) based on the distance at the time of imaging.

  Thereafter, the information processing apparatus 10 calculates the ratio (1/2) between the actual dimensions, and the image data A2 for reprojection so that the number of pixels (46) of the chicken J of the image data A becomes 1/2. Generate (23 pixels) and reproject.

  In this manner, the information processing apparatus 10 once projects the image data to be projected, and estimates what size the actual chicken is projected. Then, the information processing apparatus 10 does not change the screen size of the projector 1, but changes the size of the image data to be projected and reprojects.

[Flow of processing]
FIG. 6 is a flowchart showing the flow of processing. As shown in FIG. 6, when the start of the projection process is instructed (S101: Yes), the projection execution unit 31 displays a list of projection target images (S102) and accepts selection of the projection target images (S103). ).

  Subsequently, the projection execution unit 31 projects the selected projection target image (S104). Thereafter, the acquisition unit 32 captures an image of the projection plane (S105), and extracts a projection image from the captured image (S106).

  Then, the actual size calculation unit 33 extracts the outline of the projection object from each of the image to be projected and the projection image (S107). Subsequently, the actual size calculation unit 33 extracts the size (number of pixels) of each of the projection objects (S108).

  After that, the actual size calculation unit 33 estimates the actual size of each of the projection objects using the number of images and the coefficient based on the distance (S109), and calculates the ratio between the actual sizes (S110). Then, the actual size calculation unit 33 generates an image for reprojection in which the size of the projection target image is changed according to the ratio (S111), and reprojects the image for reprojection after the size change (S112).

[Another example]
FIG. 7 is a view for explaining an example of a full size projection. In addition, although it demonstrates using the example of a numerical value as an example here, it does not limit an Example.

  As shown in FIG. 7, the information processing apparatus 10 projects an image of an elephant selected by the user. Subsequently, the information processing apparatus 10 captures a projected image which has been projected by a camera or the like. Then, after the information processing apparatus 10 identifies the outline of the elephant that is the projection target from the projection image, the information processing apparatus 10 detects the top and bottom of the outline and determines the number of pixels that is the height of the projection 138).

  Further, the information processing apparatus 10 specifies a portion corresponding to the contour line from the image of the elephant to be projected. Then, the information processing apparatus 10 detects the top and the bottom of the outline and specifies the number of pixels (55) which is the height of the projection target.

  Thereafter, the information processing apparatus 10 uses the coefficient (1.817 mm) corresponding to the distance (500 cm) when the projection target image is captured, to obtain the actual size (55 × 1.817) of the projection object (elephant) before projection. = 100 cm) is calculated.

  Similarly, the information processing apparatus 10 uses the coefficient (0.363 mm) corresponding to the distance (100 cm) to the screen 2 when capturing the projection image, and measures the actual size (138 × 0.363 = 50 cm) is calculated.

  Thus, the information processing apparatus 10 calculates the actual size ratio (100/50 = 2). Thereafter, the information processing apparatus 10 generates an image for reprojection in which the image to be projected is enlarged so that the size of the projection object to be projected is doubled, and executes reprojection.

[effect]
As described above, the information processing apparatus 10 can display the projection object to be projected in full size on the entire projection surface. Further, even if the entire projection object can not be displayed as in the case of an elephant, a part of the projection object can be displayed in full size. The information processing apparatus 10 can share an image of a size on the side of viewing the display in full size. The information processing apparatus 10 can project the actual size without depending on the type and the performance of the external display device, and without changing the setting and the position of the external display device. The information processing apparatus 10 can project the actual size without depending on the display place. The information processing apparatus 10 can specify the size to be displayed by numerical values.

  Although the embodiments of the present invention have been described above, the present invention may be implemented in various different modes other than the above-described embodiments. Therefore, different embodiments will be described below.

[Calculation of actual size value]
In the first embodiment, the image data to be projected is associated with a distance at the time of imaging and managed, and an example of calculating the actual size using the number of pixels and a coefficient corresponding to the distance has been described. It is not a thing. For example, it is possible to manage image data to be projected and actual size values in association with each other. In addition, although the example of calculating the ratio of the actual size of the projection object in the image has been described in the first embodiment, the actual size and the ratio can also be calculated using the size of the image data itself.

  In addition to managing variables and the like corresponding to distances with a DB, they can also be provided by a manager or the like, and fixed variables can be used by predetermining the distances at the time of imaging and the distances at the time of projection. .

[Size change]
For example, by changing the number of pixels of the projection target data, the information processing apparatus 10 can change the size of the projection target data and reproject the image to the full size. Further, the information processing apparatus 10 can change the size of the data to be projected and reproject the image to full size by enlarging or reducing the data to be projected by using the optical zoom of the projector 1.

[system]
The processing procedures, control procedures, specific names, and information including various data and parameters shown in the above documents and drawings can be arbitrarily changed unless otherwise specified.

  Further, each component of each device illustrated is functionally conceptual, and does not necessarily have to be physically configured as illustrated. That is, the specific form of distribution and integration of each device is not limited to the illustrated one. That is, all or part of them can be configured to be functionally or physically dispersed and integrated in arbitrary units in accordance with various loads, usage conditions, and the like. Furthermore, all or any part of each processing function performed in each device may be realized by a CPU and a program analyzed and executed by the CPU, or may be realized as wired logic hardware.

[Hardware configuration]
FIG. 8 is a diagram showing an example of a hardware configuration. As shown in FIG. 8, the information processing apparatus 10 includes a communication interface 10a, a camera 10b, a hard disk drive (HDD) 10c, a memory 10d, and a processor (central processing unit) 10e.

  The communication interface 10 a is a network interface card that controls communication of another device, a short distance wireless interface, or the like. The camera 10 b is a camera for imaging a projection plane, and can also calculate the distance to the projection plane. The HDD 10 c is a storage device that stores various types of information.

  Examples of the memory 10 d include a random access memory (RAM) such as a synchronous dynamic random access memory (SDRAM), a read only memory (ROM), and a flash memory. Examples of the processor 10 e include a central processing unit (CPU), a digital signal processor (DSP), a field programmable gate array (FPGA), and a programmable logic device (PLD).

  The information processing apparatus 10 also operates as an information processing apparatus that executes an image projection method by reading and executing a program. That is, the information processing apparatus 10 executes a program that executes the same function as the projection execution unit 31, the acquisition unit 32, the actual size calculation unit 33, the size change unit 34, and the reprojection execution unit 35. As a result, the information processing apparatus 10 can execute a process of executing the same function as the projection execution unit 31, the acquisition unit 32, the actual size calculation unit 33, the size change unit 34, and the reprojection execution unit 35. The program referred to in the other embodiments is not limited to being executed by the information processing apparatus 10. For example, when the other computer or server executes the program, or when they cooperate to execute the program, the present invention can be applied similarly.

  This program can be distributed via a network such as the Internet. The program is recorded on a computer-readable recording medium such as a hard disk, a flexible disk (FD), a CD-ROM, a MO (Magneto-Optical disk), a DVD (Digital Versatile Disc), etc. It can be executed by being read out.

  The following appendices are further disclosed regarding the embodiment including the above-described Examples 1 and 2.

(Supplementary Note 1) An acquisition unit that projects projection target data including a projection target object onto a projection surface to acquire projection data projected onto the projection surface;
A calculator configured to calculate a ratio between the actual size of the projection object and the actual size of the projection object included in the projection data, based on the information on the actual size of the projection object;
An image projection apparatus comprising: a projection unit which reprojects on the projection plane in full scale according to the ratio.

(Supplementary Note 2) The calculation unit may use the conversion coefficient corresponding to the imaging distance when the projection object is imaged to generate the projection object data, and the size of the projection object in the projection object data. The actual size of the projection object is calculated, and the actual size of the projection object is calculated from the conversion coefficient corresponding to the projection distance when the projection data is imaged and the size of the projection target portion in the projection data. The image projector according to appendix 1, characterized in that

(Supplementary Note 3) A projection image storage unit that associates and stores the projection target data and the imaging distance,
And a distance information storage unit for storing the projection distance and a conversion coefficient per pixel in association with each other,
The calculation unit refers to the projection image storage unit and the distance information storage unit, acquires the imaging distance and the conversion coefficient corresponding to the projection target data, and calculates the actual size of the projection target The image projection apparatus according to claim 2, further comprising: calculating the actual size of the projection object by acquiring the projection distance corresponding to the projection data and the conversion coefficient.

(Supplementary Note 4) The image projection according to Supplementary Note 1, wherein the projection unit reprojects reprojection data in which the number of pixels of the projection target data is enlarged or reduced according to the ratio on the projection plane. apparatus.

(Supplementary Note 5) The projection unit is characterized in that the projection target data is reprojected on the projection plane in real size by changing an optical zoom of a projection device that projects the projection target data according to the ratio. The image projector according to appendix 1.

(Supplementary Note 6)
Projecting projection target data including a projection target object onto a projection plane to obtain projection data projected onto the projection plane;
The ratio of the actual size of the projection object to the actual size of the projection object included in the projection data is calculated based on the information on the actual size of the projection object,
An image projection method comprising the step of re-projecting on the projection surface according to the ratio.

(Supplementary Note 7)
Projecting projection target data including a projection target object onto a projection plane to obtain projection data projected onto the projection plane;
The ratio of the actual size of the projection object to the actual size of the projection object included in the projection data is calculated based on the information on the actual size of the projection object,
An image projection program characterized by executing a process of reprojecting on a projection surface in actual size according to the ratio.

Reference Signs List 1 projector 2 screen 10 information processing apparatus 11 communication unit 12 imaging unit 20 storage unit 21 projected image DB
22 Distance information DB
30 control unit 31 projection execution unit 32 acquisition unit 33 actual size calculation unit 34 size change unit 35 reprojection execution unit

Claims (5)

An acquisition unit that projects projection target data including a projection target object onto a projection plane to acquire projection data projected onto the projection plane;
A calculator configured to calculate a ratio between the actual size of the projection object and the actual size of the projection object included in the projection data, based on the information on the actual size of the projection object;
An image projection apparatus comprising: a projection unit which reprojects on the projection plane in full scale according to the ratio.   The calculation unit is configured to generate the projection target object from a conversion coefficient corresponding to an imaging distance when the projection target object is imaged and generating the projection target data and the size of the projection target object in the projection target data. A real size is calculated, and the real size of the projection object is calculated from the conversion coefficient corresponding to the projection distance when the projection data is captured and the size of the projection target portion in the projection data. An image projector according to item 1. A projection image storage unit that stores the projection target data and the imaging distance in association with each other;
And a distance information storage unit for storing the projection distance and a conversion coefficient per pixel in association with each other,
The calculation unit refers to the projection image storage unit and the distance information storage unit, acquires the imaging distance and the conversion coefficient corresponding to the projection target data, and calculates the actual size of the projection target The image projection apparatus according to claim 2, wherein the actual size of the projection target is calculated by acquiring the projection distance and the conversion coefficient corresponding to the projection data. The computer is
Projecting projection target data including a projection target object onto a projection plane to obtain projection data projected onto the projection plane;
The ratio of the actual size of the projection object to the actual size of the projection object included in the projection data is calculated based on the information on the actual size of the projection object,
An image projection method comprising the step of re-projecting on the projection surface according to the ratio. On the computer
Projecting projection target data including a projection target object onto a projection plane to obtain projection data projected onto the projection plane;
The ratio of the actual size of the projection object to the actual size of the projection object included in the projection data is calculated based on the information on the actual size of the projection object,
An image projection program characterized by executing a process of reprojecting on a projection surface in actual size according to the ratio.

Images