JP4665949B2 - Display control device, information terminal device, display control program - Google Patents

Description

  The present invention relates to a display control device, an information terminal device, and a display control program that project an image on a screen or the like.

  In general, at the time of presentation, a projector system is used to project a material on a screen or the like. Recently, as a projector system, a projection type projector that projects a screen on a personal computer (PC) onto a screen as it is is widely used. When this projection type projector is used, the displayed screen can be projected onto the screen simply by displaying the material created by the presentation software on the screen on the PC.

  Usually, in a projector system, it is necessary to adjust an area (light projection area) for projecting an image on a screen in accordance with the size of the screen. In the conventional projector system, it is necessary to manually move the installation position and the light projecting direction (vertical and horizontal direction) or repeatedly perform operations for enlarging / reducing the light projecting area. .

  As described above, in the conventional projector system, in order to adjust the light projecting area with respect to the screen, the installation position and the light projecting direction (vertical and horizontal direction) are moved, and operations for enlarging / reducing the light projecting area are repeated. It took a lot of time to set up because it was very time-consuming.

  The present invention has been made in view of the above problems, and provides a display control device, an information terminal device, and a display control program capable of easily setting a light projection area for projecting an image on a screen. Objective.

The present invention provides a display control apparatus for projecting an image onto a projection surface, pattern projection means for projecting a mark indicating an area on which the image is projected onto the projection surface, and projection by the pattern projection means Photographing means for photographing an image including the marked mark, image acquisition means for obtaining an image photographed by the photographing means,
Recognition means for recognizing the mark from the image acquired by said image acquiring means, anda adjusting means for adjusting the area, the marks are provided at four corners corresponding to the area, the adjusting means The area is enlarged and the area is adjusted so that the recognition means can detect whether the marks provided at the four corners of the area have disappeared and the recognition means can recognize all the marks. And

The pattern projecting means projects the mark with invisible light.

The image processing apparatus further includes a changing unit that changes a direction in which an image is projected onto the projection surface and an area size according to the adjustment by the adjusting unit, and the adjusting unit changes the image according to the position of the mark. A horizontal / vertical movement amount and an enlargement / reduction amount for changing the current area are calculated so that the area for projecting the image becomes a predetermined position on the projection surface, and the changing means is configured to adjust the adjustment. The image projection direction and the area size are changed in accordance with the horizontal / vertical movement amount and enlargement / reduction amount calculated by the means.

The present invention is an information terminal device that outputs display data of the image to the projection device for projecting an image on the projection plane, and capturing the projection target surface, an image on the projection surface an image obtaining unit for obtaining the image including the mark provided on the four corners of the area indicating the area to be projected, a recognition means for recognizing the mark from the image acquired by said image acquiring means, wherein the expanding the area Change control for changing an area on which an image is projected by the projection device so that the recognition unit can detect whether or not the marks provided at the four corners of the area have disappeared and the recognition unit can recognize all the marks. Means.
The present invention is also a display control program for controlling an apparatus for projecting an image onto a projection surface, wherein the computer projects an area onto the projection surface photographed by photographing means. Image acquisition means for acquiring images including marks provided at the four corners of the area shown, recognition means for recognizing marks from the images acquired by the image acquisition means, and enlargement of the area to increase the four corners of the area The recognizing unit detects whether or not the mark provided in the image has disappeared, and the recognizing unit functions as an adjusting unit that adjusts an area for projecting an image so that the mark can be recognized entirely. .

As described above, according to the present invention, a specific shape pattern indicating an area on which an image is projected is projected onto the projection surface, and the specific shape pattern is recognized from the image including the projected specific shape pattern. Thus, the area can be adjusted, so that the projection area can be easily set without preparing a dedicated screen.

  Further, by projecting a specific shape pattern with invisible light, it is possible to prevent an unnecessary image from being shown in a presentation or the like used only for area adjustment.

Embodiments of the present invention will be described below with reference to the drawings.
FIG. 1 is a diagram showing a configuration of a projector system according to the first embodiment of the present invention. The projector system shown in FIG. 1 includes a projector 1 (with a digital camera 2 mounted), an information terminal device 3, and a dedicated screen 4.

  The projector 1 receives display data (for example, analog RGB signal, composite video signal) from the information terminal device 3, and projects an image corresponding to the display data onto the dedicated screen 4. In the first embodiment, the projector 1 An area for projecting an image (hereinafter referred to as a light projecting area) is automatically generated based on a pattern having a specific shape (a black frame 4a shown in FIG. 3) representing an area on which the image previously attached to the dedicated screen 4 is to be projected. To adjust (projection direction, area size).

  FIG. 2 shows an external configuration of the projector 1. 2A is a diagram viewed from the side of the projector 1, and FIG. 2B is a diagram viewed from the front of the projector 1.

  In the projector 1 according to the first embodiment, a holding unit 1e for holding the light projecting unit 1b via the turntable 1c is installed on the main body 1a. The turntable 1c is a mechanism for enabling the light projecting direction by the light projecting unit 1b held by the holding unit 1e to be changed in the horizontal direction. The holding unit 1e is provided with a rotating shaft 1d, and the light projecting direction by the light projecting unit 1b by the rotating shaft 1d, that is, the direction of the projection lens 1f provided at the end of the light projecting unit 1b is vertical. It is attached so that it can be changed. Further, the digital camera 2 is attached in the vicinity of the light projecting unit 1b where the projection lens 1f is provided. The digital camera 2 is capable of photographing a range wider than the light projection area (dedicated screen 4) by the projector 1, and has a function of photographing and outputting an image projected by the projector 1. In the first embodiment, it is assumed that an image photographed by the digital camera 2 is output to the information terminal device 3.

  The information terminal device 3 outputs image display data to the projector 1 that projects an image on the dedicated screen 4 and acquires an image photographed by the digital camera 2 attached to the projector 1 to obtain a dedicated image. The projector 4 has a function of performing control for automatically adjusting the light projection area by the projector 1 on the basis of a specific shape pattern (a black frame 4a shown in FIG. 3) previously attached to the screen 4. The information terminal device 3 acquires an image obtained by photographing with the digital camera 2, recognizes a specific shape pattern from the acquired image, and determines the projector 1 according to the position of the recognized specific shape pattern. The light projecting section 1b is moved vertically and horizontally, and the light projecting area is adjusted by enlarging or reducing the size of the light projecting area.

  The dedicated screen 4 (projection surface) projects an image by the projector 1, and in the first embodiment, a specific shape pattern indicating a light projection area on which the projector 1 projects an image is attached in advance. FIG. 3 shows an example of the dedicated screen 4 in the first embodiment. For example, a black frame 4 a is provided along the vicinity of the frame of the dedicated screen 4. The black frame 4 a is recorded in the image by photographing with the digital camera 2 attached to the projector 1.

FIG. 4 is a block diagram showing a functional configuration of the projector 1.
In the projector 1, each part is controlled by the microcomputer system 10.

  In the microcomputer system 10, the AC voltage input from the AC outlet 17 is converted into a DC voltage by the active filter 11, and the DC power is generated by the main power supply circuit 12 and supplied with power. From the main power supply circuit 12, in addition to the microcomputer system 10, a circuit power supply is supplied to a power supply terminal of each circuit via a circuit power switch 13. For example, power is supplied to a motor control circuit 34 that controls motors 34a and 34b (for example, stepping motors) for rotating the rotary table 1c and the rotary shaft 1d, and the digital camera 2 (not shown). . The main power supply circuit 12 also supplies the lamp power supply 15 via the lamp power switch 14 to be used for lighting the lamp 16.

  The circuit power switch 13 and the lamp power switch 14 are on / off controlled by the microcomputer system 10. When the lamp power switch 14 is turned on, a voltage is applied to the lamp 16 and the lamp 16 is lit. When the circuit power switch 13 is turned on, power is supplied to each circuit, and the presence / absence of a video signal can be determined. When adjusting the light projection area, the circuit power switch 13 is turned on, so that the projection direction by the light projection unit 1b can be changed by the motors 34a and 34b, and the digital camera 2 can take a picture.

  The projector 1 has an analog RBG input terminal 18 for inputting an analog RBG signal from the information terminal apparatus 3, an AV input terminal 19 for inputting a composite video signal from a VCR, a DVD, etc., and the information terminal apparatus 3 And a control terminal 35 for inputting / outputting a control signal to / from the control terminal.

  The analog RBG signal input to the analog RBG input terminal 18 is sent to the first input terminal of the input changeover switch 22. The composite video signal input to the AV input terminal 19 is separated into a luminance signal and a color signal by the Y / C separation circuit 20 and input to the video decoder 21.

  The microcomputer system 10 receives the presence / absence of a signal, a color system, and the like from the video decoder 21 and transmits control data corresponding thereto to the video decoder 21. The video decoder 21 converts the input signal into an RBG signal and outputs it. The RBG signal from the video decoder 21 is sent to the second input terminal of the input changeover switch 22. The input changeover switch 22 is controlled by the microcomputer system 10.

  The signal selected by the input selector switch 22 is sent to the A / D converter 23. The VCO 24 generates a sampling frequency corresponding to the input signal based on the control data from the microcomputer system 10 and outputs the sampling frequency to the A / D converter 23. The A / D converter 23 samples the input signal in synchronization with the sampling frequency input from the VCO 24 and outputs the obtained digital signal to the signal processing gate array 25.

  The DRAM 33 stores on-screen display data for performing display other than video signals, that is, so-called on-screen display.

  The signal processing gate array 25 switches between the video data input from the A / D converter 23 and the on-screen display data stored in the DRAM 33 and sends the data to the D / A converter 26.

  The digital signal input to the D / A converter 26 is converted into an analog signal and input to the color signal driver 27. Based on the control data received from the microcomputer system 10, the color signal driver 27 performs color signal correction such as brightness and DC curve conversion according to panel characteristics. The signal output from the color signal driver 27 is sent to the sample and hold circuit 28, and sampling for output to the liquid crystal panels 29, 30, and 31 is performed.

  For example, batch writing is performed on the liquid crystal panels 29, 30, and 31 in units of 6 dots, and the sample and hold circuit 28 performs data capture and batch output for 6 dots. Corresponding data is sent from the sample and hold circuit 28 to the RGB liquid crystal panels 29, 30 and 31.

  The timing controller 32 performs timing control of the sample and hold 28 and the liquid crystal panels 29, 30, and 31 based on the control data received from the microcomputer system 10.

  The microcomputer system 10 stores a startup program, a control program, a projection area adjustment program, a memory for temporarily storing various data, and an operation state and a setting state of the projector 1 as needed. A memory is provided for storage. When the adjustment of the projection area is executed, the microcomputer system 10 starts the projection area adjustment program in accordance with the control signal from the information terminal device 3 input via the control terminal 35, and controls the motor control circuit 34. Execute control.

  FIG. 5 is a block diagram showing the configuration of the digital camera 2 in the first embodiment. In FIG. 5, a lens 41 optically photographs a subject and forms an image on the CCD 42. The CCD 42 is a device having a Mos structure that transfers charges in an array. The CCD 42 is driven by a timing generator (TG) 43 and a vertical driver 44, and outputs a photoelectric conversion output for one screen every fixed period. The timing generator 43 and the vertical driver 44 generate timing signals necessary for reading from the CCD 42. The sample and hold circuit (S / H) 45 samples the time-series analog signal read from the CCD 42 at a frequency suitable for the resolution of the CCD 42. The A / D converter 46 converts the sampled signal into a digital signal.

  The color process circuit 47 performs color process processing for generating luminance and color difference multiplexed signals (hereinafter referred to as YUV signals) from the output of the A / D converter 46. In the color process processing, it is converted into R, G, B data, and further converted into digital luminance and color difference multiplexed signals (Y, Cb, Cr data).

  The DMA controller 48 performs direct memory transfer (DMA) in which data transfer between the color process circuit 47 and the DRAM 50 via the DRAM interface 49 is performed without the intervention of the CPU 51. The DMA controller 48 once writes the Y, Cb, Cr data output of the color process circuit 47 into the buffer inside the DMA controller 48 using the synchronization signal, memory write enable, and clock output of the color process circuit 47, and the DRAM. DMA transfer is performed to the DRAM 50 via the interface (DRAM I / F) 49. The DRAM interface 49 is a signal interface between the DRAM 50 and the DMA controller 48 and a signal interface between the DRAM 50 and the bus. The DRAM 50 stores image data (Y, Cb, Cr data) DMA-transferred from the DMA controller 48 via the DRAM interface 49.

  The CPU 51 executes a predetermined program recorded in the program ROM 60 to centrally control the operation of the camera, and includes execution buttons such as a main switch, a recording / playback mode switching switch, a function selection key, and a shutter key. An operation unit 56 is connected. In the recording mode, the mode program is loaded from the program ROM 60 into the internal RAM of the CPU 51 and executed in the reproduction mode. After completing the DMA transfer of the image data to the DRAM 50, the CPU 51 reads the image data from the DRAM 50 via the DRAM interface 49 and writes it to the VRAM 53 via the VRAM controller 52. In a recording and saving state in which the shutter key is pressed, the CPU 51 divides the image data for one frame written in the DRAM 50 through the DRAM interface 49 for each MCU block composed of 16 × 16 pixels. And the MCU block of the image to be added is inserted and sent to the JPEG processing unit 57. The image data sent to the JPEG processing unit 57 is compressed through processes such as DCT conversion, quantization, and encoding. The CPU 51 adds header information to the compressed image data and writes it to the flash memory 58, which is a nonvolatile memory.

  In addition to the instruction from the operation unit 56, the CPU 51 switches to the recording mode in accordance with a control signal input from the information terminal device 3 via the communication connection interface 59 when adjusting the projection area by the projector 1. The image data is recorded in the same manner as in the recording and saving state in which switching and the shutter key are pressed.

  The VRAM controller 52 controls the data transfer between the VRAM 53 and the bus, and the data transfer between the VRAM 53 and the digital video encoder 54. This is the part that controls the reading from. The VRAM 53 is a so-called video RAM, and when a preview image is written, the preview image is sent to the display device 55 via the digital video encoder 54 and displayed. Note that the video RAM may be a type of video RAM that has two ports for writing and reading, and can perform writing and reading of images simultaneously in parallel. The digital video encoder 54 periodically reads image data (Y, Cb, Cr data) from the VRAM 53 via the VRAM controller 52, generates a video signal based on the image data, and outputs the video signal to the display device 55. . As a result, an image based on the image information currently fetched from the CCD 42 is displayed on the display device 55 in the recording mode.

  The display device 55 is a small liquid crystal panel of about several inches attached to the back side of the camera body, for example, having a pixel number of 279 × 220.

  The digital camera 2 is used only for adjusting the light projection area by the projector 1, and image data captured by the digital camera 2 is transmitted to the information terminal device 3 via the communication connection interface 59. The VRAM controller 52, the VRAM 53, the digital video encoder 54, and the display device 55 are unnecessary if the display unit is configured to display.

  The JPEG processing unit 57 is a part that performs JPEG compression and expansion. JPEG compression parameters are given from the CPU 51 each time compression processing is performed. The JPEG processing unit 57 is preferably realized by dedicated hardware in terms of processing speed, but can also be performed by the CPU 51 in software.

  The flash memory 58 can electrically rewrite the contents of all rewritable read-only memories (PROMs) by electrically erasing the contents of all bits (or blocks).

  The communication connection interface (I / F) 59 is connected to the information terminal device 3 via a communication cable, and transmits and receives control signals, image data signals, and the like to and from the information terminal device 3.

  The LED 61 and the distance sensor 62 are for realizing an autofocus (autofocus) function. When focusing, infrared light is projected from the LED 61, and the distance is detected by determining the incident angle of the infrared light reflected from the subject in the center of the screen by the distance sensor 62, and according to the detection result of the distance sensor 62 The focus adjustment control is performed on the optical system (not shown). Note that the data on the distance to the subject detected by the autofocus function is also used in the light projection area adjustment process.

  FIG. 6 is a block diagram showing a configuration of the information terminal device 3 according to the first embodiment.

  As shown in FIG. 6, the information terminal device 3 includes a CPU 70, an input unit 71, a display unit 72, a communication control unit 73, a RAM 74, a ROM 75, an external storage memory 76, and a video signal output unit 77. Connected and configured.

  The CPU 70 controls the entire apparatus. The CPU 70 activates various programs stored in the RAM 74 or the ROM 75 in accordance with a key operation signal from the input unit 71, and implements various functions according to the programs. The CPU 70 can read a program recorded in the storage medium of the external storage memory 76, store it in the RAM 74, and execute it. When adjusting the projection area in the projector 1, the CPU 70 reads out the projector control program 76 a recorded in the external storage memory 76 in accordance with an instruction input from the input unit 71, stores it in the RAM 74, and starts it. Thus, the light projection area adjustment process for adjusting the light projection area in the projector 1 is executed. In addition, when a presentation is executed, the CPU 70 executes an application program for presentation in the same manner.

  The input unit 71 inputs instructions and data for defining the operation of the apparatus, and is configured by a pointing device such as a keyboard and a mouse.

  The display unit 72 displays a screen according to the execution of various processes. When performing automatic adjustment of the projection area in the projector 1, the display unit 72 displays images taken by the digital camera 2 attached to the projector 1. When displaying a processing screen for adjusting the projection area using this image and making a presentation using the projector 1, a presentation screen is displayed under the control of the presentation application.

The communication control unit 73 is a unit for performing communication via a communication line, and is connected to the projector 1 via, for example, a communication cable.
The RAM 74 stores various data as needed in addition to a system program for controlling the entire apparatus and a control processing program corresponding to various functions. The projector control program 76a is stored and executed by the CPU 70, whereby a light projection area adjustment process for automatically adjusting the light projection area of the projector 1 is executed.

The ROM 75 stores a control program and the like.
The external storage memory 76 has a storage medium, and executes saving, reading, and the like of programs (OS, applications), data (files), and the like on the storage medium. The storage medium is composed of a magnetic or optical storage medium or a semiconductor memory. The storage medium is fixedly provided in the external storage memory 76 or is detachably mounted. Further, the program, data, and the like stored in the storage medium may be configured to be received from other devices connected via the communication line via the communication control unit 73 and stored, and further, communication lines, etc. A storage device provided with a storage medium may be provided on the other device side connected via the computer, and a program and data stored in the storage medium may be used via a communication line. The external storage memory 76 reads programs, data, and the like stored in the storage medium in response to a request from the CPU 70. The read program, data, and the like are stored in the RAM 74. In the first embodiment, a projector control program 76a for executing the projection area adjustment process and an application program for presentation are stored.

  The video signal output unit 77 outputs screen display data displayed by the display unit 72, and is connected to the projector 1 via a video signal cable.

Next, the operation for adjusting the light projection area of the projector 1 in the first embodiment will be described with reference to the flowcharts shown in FIGS.
FIG. 7 is a flowchart for explaining the operation of the light projection area adjustment process executed by the information terminal device 3 for adjusting the light projection area of the projector 1.

  The information terminal device 3 starts the projector area adjustment process by starting the projector control program 76a. First, the information terminal device 3 causes the digital camera 2 attached to the light projecting unit 1b of the projector 1 to capture an image in a range including the entire dedicated screen 4 (step A1). Note that the digital camera 2 may be controlled from the information terminal device 3 to perform shooting, or may be executed by operating the operation unit 56 provided in the digital camera 2.

  The information terminal device 3 acquires image data of an image taken by the digital camera 2 through the communication control unit 73, records it in the RAM 74, and causes the display unit 72 to display it.

  The CPU 70 of the information terminal device 3 recognizes whether or not the entire shape pattern representing the black frame 4 a is included from the image taken by the digital camera 2. Here, for example, recognition is performed by collating a reference pattern registered in advance with the shape of the black frame 4a with a pattern included in the image (step A2).

  If the entire shape pattern representing the black frame 4a is not included in the image, the information terminal device 3 adjusts the shooting direction so that the entire black frame 4a can be shot (step A3). For example, the information terminal device 3 drives the motors 34 a and 34 b by the motor control circuit 34 through the microcomputer system 10 of the projector 1, and changes the shooting direction by the digital camera 2 by rotating the rotating base 1 c and the rotating shaft 1 d. . Since the digital camera 2 is configured to be able to capture a wider range than the dedicated screen 4, it is unlikely that the shape pattern of the black frame 4a is included in the captured image, but a part is included. If not, adjust the shooting direction so that the whole image is included. Here, since the adjustment is made only so that the shape pattern of the black frame 4a can be imaged, the position of a part of the shape pattern of the black frame 4a included in the image, for example, in the four-divided area of the image Change the shooting direction slightly.

  Then, the information terminal device 3 causes the digital camera 2 to perform imaging again, acquires image data obtained by the imaging, and executes similar processing.

  Here, when the entire shape pattern representing the black frame 4a is included from the image photographed by the digital camera 2, the information terminal device 3 projects the projection area according to the position of the shape pattern representing the black frame 4a in the image. A light projection area moving process for moving the light is executed (step A4).

FIG. 8 shows a flowchart of the light projection area movement process.
First, the information terminal device 3 has the center coordinates of the image photographed by the digital camera 2 and the position (the coordinates of the four corners) of the shape pattern (dedicated screen 4 captured by the camera) representing the black frame 4a included in the image. Is obtained (steps B1 and B2).

  FIG. 12 shows an example of an image captured by the digital camera 2. For example, if the shooting range by the digital camera 2 is represented by the coordinate positions of (a1, b1) (a1, b2) (a2, b1) (a2, b2), the center position (a, b) of this shooting range is ( (A2-a1) / 2, (b1-b2) / 2). Further, the position of the shape pattern (dedicated screen 4 captured by the camera) representing the black frame 4a included in the image is represented by (X1, Y1) (X1, Y2) (X2, Y1) (X2, Y2).

  Next, based on the position (X1, Y1) (X1, Y2) (X2, Y1) (X2, Y2) of the shape pattern representing the black frame 4a, the information terminal device 3 determines the center position (x , Y) is obtained as ((X2-X1) / 2, (Y1-Y2) / 2) (step B3).

  The information terminal device 3 calculates a movement amount for moving the center position (x, y) of the shape pattern to the center position (a, b) of the imaging range (step B4).

FIG. 9 shows a flowchart of processing for calculating the movement amount.
First, the information terminal device 3 measures the distance between the digital camera 2 and the dedicated screen 4 (step C1). For example, the information terminal device 3 uses the autofocus function of the LED 61 and the distance sensor 62 provided in the digital camera 2 and acquires the data of the distance detected by the distance sensor 62, so that the digital camera 2 and the dedicated screen are used. Find the distance to 4.

  The information terminal device 3 calculates the amount of movement in the X direction and the amount of movement in the Y direction using data on the distance between the digital camera 2 and the dedicated screen 4 (steps C2 and C3).

For example, the movement amount in the X direction is calculated as follows.
FIG. 13 shows the relationship between the projector 1 (light projecting unit 1b) and the dedicated screen 4. In FIG. 13, the distance between the center of the projection lens 1f located in the light projecting portion of the projector and the dedicated screen 4 is L0, the center of the dedicated screen 4 in the light projecting portion 1b (the center position of the photographing range by the digital camera 2 (a , B)) and the center of the black frame 4a (corresponding to the center position (x, y) of the shape pattern) in the X coordinate axis direction is β (horizontal change angle with respect to the light projecting portion 1b).

The amount of movement in the x-coordinate direction in the image taken by the projector 1 is x−a = [(x2−x1) / 2− (a2−a1) / 2] = Lx.
Here, the amount of movement Lx in the x-coordinate direction in the image is converted into a length x on the dedicated screen 4. That is, assuming that the horizontal length of the dedicated screen 4 (black frame 4a) is L1, since L1: (x2-x1) = x: Lx, x = (L1 · Lx) / (x2-x1) Become.
Therefore, the horizontal movement angle of the projector 1 with respect to the light projecting unit 1b can be obtained from the relationship of tan β = (x / Lo).

The amount of movement in the Y direction is calculated as follows.
Here, the distance between the center of the projection lens 1f and the dedicated screen 4 is L0, the center of the dedicated screen 4 in the light projecting unit 1b (corresponding to the center position (a, b) of the photographing range by the digital camera 2), and the black frame 4a. Is defined as α (change angle in the vertical direction with respect to the light projecting portion 1b).

The amount of movement in the y-coordinate direction in the image shot by the projector 1 is y−b = [(y2−y1) / 2− (b2−b1) / 2] = Ly.
Here, the movement amount Ly in the y-coordinate direction in the image is converted into the length y on the dedicated screen 4. That is, assuming that the vertical length of the dedicated screen 4 (black frame 4a) is L2, L2: (y2-y1) = y: Ly, and therefore y = L2 · Ly / (y2-y1).
Therefore, the vertical movement angle of the projector 1 with respect to the light projecting unit 1b can be obtained from the relationship of tan α = (y / Lo).

  When the movement amount is thus calculated (step B4), the information terminal device 3 calculates the rotation amount of the motors 34a and 34b according to the movement amount (step B6) if the movement amount is not "0" (step B5). .

FIG. 10 shows a flowchart of processing for calculating the rotation amounts of the motors 34a and 34b.
The information terminal device 3 calculates the amount of rotation of the motor 34a that rotates the turntable 1c in the horizontal direction by multiplying the amount of movement (β) in the x-coordinate direction (horizontal direction) calculated by the movement amount calculation process ( Step D1) similarly calculates the amount of rotation of the motor 34b that rotates in the vertical direction of the rotating shaft 1d by multiplying the amount of movement (α) in the y-coordinate direction (vertical direction) by a constant (step D2).

  For example, if the movement amount and the rotation amount are in a relationship of 1: 1, the rotation amounts in the horizontal direction and the vertical direction are β and α, respectively. If there is a relationship of 1: 2, the rotation amounts in the horizontal direction and the vertical direction are 2β and 2α respectively.

  Note that data indicating the relationship between the movement amount and the rotation amount may be tabulated and recorded in advance in a memory, and the rotation amount corresponding to the movement amount may be obtained by referring to this table.

  When the information terminal device 3 obtains the rotation amounts of the motors 34a and 34b, the information terminal device 3 moves the projector 1 in the direction of the light projecting unit 1b, that is, the position of the light projection area based on the rotation amount (step B7). That is, the information terminal device 3 rotates the rotary table 1c and the rotary shaft 1d by rotating the motors 34a and 34b by the calculated amounts of rotation by the motor control circuit 34 through the microcomputer system 10 of the projector 1, thereby throwing the projection. The direction (projection direction) of the light projection area by the light unit 1 b is moved to the center position of the dedicated screen 4.

  FIG. 14 shows an example of an image captured by the digital camera 2 when the projection area is moved. As shown in FIG. 14, the shape pattern representing the black frame 4 a of the dedicated screen 4 is moved to the center of the image, and it can be seen that the projection direction by the light projecting unit 1 b faces the center of the dedicated screen 4.

  Next, the information terminal device 3 executes an enlargement amount calculation process for calculating an enlargement amount for enlarging the current projection area in accordance with the size of the dedicated screen 4 (step A5). Here, it is assumed that the light projection area by the projector 1 is set to a size sufficiently smaller than the size of the dedicated screen 4 in the initial state before the light projection area adjustment.

FIG. 11 shows a flowchart of the enlargement amount calculation process.
First, the information terminal device 3 causes the projector 1 to project an image in the current projection area (step F1), and the dedicated screen 4 at this time is captured by the digital camera 2 to acquire image data (step F2).

  When the information terminal device 3 acquires the image data obtained by photographing with the digital camera 2, the information terminal device 3 detects the end face (current projection area) of the image projected on the dedicated screen 4 (step F3).

  FIG. 15 shows an example of an image captured by the digital camera 2 when the image is projected. As shown in FIG. 15, it can be seen that there is a current projection area in the center of the shape pattern representing the black frame 4 a of the dedicated screen 4.

  Here, the position of the shape pattern representing the black frame 4a is (X1, Y1) (X1, Y2) (X2, Y1) (X2, Y2), and the current position of the light projection area is the coordinate position (C1, C1) of the four corners. D1) (C1, D2) (C2, D1) (C2, D2).

  The information terminal device 3 calculates the amount of enlargement My in the vertical direction and the amount of enlargement Mx in the horizontal direction with respect to the current projection area from the relationship between the position of the shape pattern representing the black frame 4a and the position of the current projection area. (Steps F4 and F5). That is, the vertical expansion amount My is calculated as My = (Y1-Y2) / (D1-D2), and the horizontal expansion amount Mx is calculated as Mx = (X1-X2) / (C1-C2). can do.

  When the vertical enlargement amount Mx and the horizontal enlargement amount My are calculated by the enlargement amount calculation process, the information terminal device 3 enlarges the current projection area size according to the enlargement amount Mx and the enlargement amount My. (Step A6). That is, the projection area is enlarged to the size of the black frame 4a of the dedicated screen 4.

  In the above description, the projection area by the projector 1 is set to a sufficiently small size with respect to the size of the dedicated screen 4 in the initial state, and is enlarged according to the enlargement amount calculated by the enlargement amount calculation process. Although the size is adjusted to the size of the dedicated screen 4, conversely, the size of the light projecting area may be adjusted by reducing the current light projecting area (initial state). That is, the projection area is larger than the dedicated screen 4 in the initial state, and a reduction amount is calculated according to the size of the dedicated screen 4, and the size of the current projection area is reduced according to the reduction amount. To do.

  In this way, in the projector system of the first embodiment, the dedicated screen 4 provided with the black frame 4a is prepared, the screen area is photographed by the digital camera 2 mounted on the projector 1, and the image obtained by this photographing is obtained. Based on the projection direction, the projection direction and the size of the projection area can be automatically adjusted. Accordingly, it is not necessary to determine the installation location of the projector 1 by matching the image to be projected (projection area) with the screen, so that the installation time can be shortened. Further, since the dedicated screen 4 is used, the area serving as a reference for adjusting the position and size of the projection area can be easily recognized as the shape pattern of the black frame 4a, so that the processing efficiency can be improved.

  In the description of the first embodiment, the dedicated screen 4 is provided with a black frame 4a in advance and indicates an area to be a light projecting area. For example, as shown in FIG. 16, the four corners have a predetermined shape. By marking using this mark, it is possible to indicate an area to be a light projection area in the same manner as the black frame 4a. In this case, in addition to the triangular mark shown in FIG. 16, other shapes of marks may be used, and not only the four corners but also the positions of the four sides may be marked.

  Furthermore, it is also possible to use a dedicated screen 4 with a frame or marking using special ink that reflects only light of a specific wavelength (for example, infrared rays). In this case, it is assumed that a digital camera 2 (or an image sensor) that captures only light with a special wavelength (for example, infrared rays) is used. Thereby, it is possible to prevent an unnecessary image from being shown in a presentation or the like used only for area adjustment.

Next, a second embodiment of the present invention will be described.
In the first embodiment, the dedicated screen 4 is provided with a black frame 4a indicating an area to be a light projection area in advance. In the second embodiment, a mark indicating an area to be a light projection area is projected on the screen. Then, the position and size of the projection area are adjusted based on the marking position.

  FIG. 17 is a diagram showing a configuration of a projector system according to the second embodiment of the present invention. The projector system shown in FIG. 17 includes a projector 5 (with the digital camera 2 mounted), an information terminal device 3, and a screen 6.

The projector 5 receives display data (for example, analog RGB signal, composite video signal) from the information terminal device 3 and projects an image corresponding to the display data onto the screen 6. In the second embodiment, the projector 5 The projection is projected in accordance with the projection area to project the light, and the projection area is automatically adjusted based on the marking.

  Note that the projector 5 of the second embodiment is provided with a mechanism that can change the direction of the light projecting area in the horizontal direction and the vertical direction as in the first embodiment (the appearance configuration is shown in the figure). 2). The digital camera 2 attached to the projector 5 (light projecting unit) has the same configuration as that of the first embodiment, and detailed description thereof is omitted.

The information terminal device 3 outputs image display data to the projector 5 that projects an image on the screen 6 and acquires an image photographed by the digital camera 2 attached to the projector 5. The projector 5 has a function of performing control for automatically adjusting the light projection area by the projector 5 based on the marking projected by. The information terminal device 3 acquires an image obtained by photographing with the digital camera 2, recognizes a specific shape pattern representing the marking from the acquired image, and according to the position of the recognized specific shape pattern. Then, the direction of the light projecting unit of the projector 5 is moved vertically and horizontally, and the light projecting area is adjusted by enlarging or reducing the size of the light projecting area.
An image is projected on the screen 6 (projected surface) by the projector 5 , and in the second embodiment, any marking or the like is not performed in advance.

  FIG. 18 is a block diagram illustrating a functional configuration of the projector 5 according to the second embodiment. Since most of the projector 5 has the same configuration as the projector 1 in the first embodiment, the description of the common portion is omitted, and only the different components are described.

  The projector 5 is further provided with a control circuit 36, a mark irradiation lamp 37, and a mark irradiation lamp power switch 38.

  The control circuit 36 performs marking by projecting the mark 6 a by the mark irradiation lamp 37 based on the power supplied via the mark irradiation lamp power switch 38 under the control of the microcomputer system 10.

  The mark irradiation lamps 37 are for marking the screen 6 under the control of the control circuit 36. In the second embodiment, the mark irradiation lamps 37 are provided at the four corners of the light projection area projected by the lamp 16 and an optical system (not shown). , Each projecting a mark 6a having a predetermined shape. In the second embodiment, a triangular mark 6a is projected.

  The mark irradiation lamp power switch 38 is connected to the main power supply circuit 12 and supplies power to the control circuit 36 under the control of the microcomputer system 10.

Next, an operation for adjusting the light projection area of the projector 5 in the second embodiment will be described with reference to a flowchart.
FIG. 19 is a flowchart for explaining the operation of the light projection area adjustment process executed by the information terminal device 3 for adjusting the light projection area of the projector 5.

The information terminal device 3 starts the projector area adjustment process by starting the projector control program 76a. First, the information terminal device 3 causes the mark 6a to be projected on the screen 6 by turning on the mark irradiation lamp 37 under the control of the control circuit 36 through the microcomputer system 10 of the projector 5 (step E1). In the marking by the mark irradiation lamp 37, the mark 6a is projected at a position corresponding to the current projection area size, that is, at the four corner positions of the area.

  FIG. 20 shows an example of four marks 6a (6a1, 6a2, 6a3, 6a4) projected in accordance with the projection area. The mark 6a in the second embodiment has a triangular shape, and the marks 6a1 and 6a4 located on the left side of the light projecting area are projected so that one apex faces the left side, and are positioned on the right side of the light projecting area. Marks 6a2 and 6a3 to be projected are projected such that one vertex faces the right side. Therefore, the current position of the projection area with respect to the mark 6a can be determined depending on which of the marks 6a is arranged (vertex direction).

  Next, the information terminal device 3 causes the digital camera 2 attached to the light projecting unit 1b of the projector 5 to capture an image in a range including the entire screen 6 (step E2). Note that the digital camera 2 may be controlled from the information terminal device 3 to perform shooting, or may be executed by operating the operation unit 56 provided in the digital camera 2.

  The information terminal device 3 acquires image data of an image taken by the digital camera 2 through the communication control unit 73, records it in the RAM 74, and causes the display unit 72 to display it.

  The CPU 70 of the information terminal device 3 recognizes whether or not a screen having all the markings is taken from the image taken by the digital camera 2, that is, whether or not a shape pattern representing the four marks 6a is included (step). E3). Here, for example, it is recognized by collating a reference pattern registered in advance with the shape of the mark 6a with a pattern included in the image.

  Here, when the shape pattern representing the four marks 6a is not included in the image, the information terminal device 3 adjusts the photographing direction, that is, the projection direction so that all the marks 6a can be photographed (step E4). That is, the information terminal device 3 drives the motors 34a and 34b by the motor control circuit 34 through the microcomputer system 10 of the projector 5, and changes the photographing direction by the digital camera 2 by rotating the rotating base 1c and the rotating shaft 1d. . Normally, since the projector 5 is installed according to the screen 6, the projection area is hardly projected onto the screen 6, but the projection direction by the projector 5 is slightly deviated from the place where the screen 6 is installed. When only a part of the light area is projected on the screen 6, the whole is included by adjusting the shooting direction. Here, since adjustment is performed so that all the marks 6a can be imaged, the direction of the shape pattern of the mark 6a included in the image, for example, a mark 6a (mark 6a1 or mark 6a4 with one vertex facing left). ) Is included in the image, the shooting direction may be changed slightly to the right.

  Then, the information terminal device 3 causes the digital camera 2 to perform imaging again, acquires image data obtained by the imaging, and executes similar processing.

Here, when the shape pattern representing all the marks 6a is included from the image photographed by the digital camera 2, the information terminal device 3 enlarges the current projection area by the projector 5 by a predetermined amount and displays the image. Projecting on the screen 6 (step E5).

  FIG. 21 shows a state in which the current projection area is enlarged. By enlarging the projection area, the positions of the four marks 6a provided at the four corners are moved in accordance with the size of the projection area.

  The information terminal device 3 causes the digital camera 2 to capture an image of the range including the entire screen 6, acquires this image, and recognizes whether all the four marks 6a have disappeared (step E6).

  When all of the four marks 6a are not erased, the information terminal device 3 identifies whether one or more marks 6a are erased (step E7). Here, when one or more marks 6a are disappeared, the information terminal device 3 uses the projector 5 so that all the four marks 6a are photographed by the digital camera 2 in accordance with the disappeared marks 6a. The projection area (shooting direction) is changed (step E8). That is, the information terminal device 3 drives the motors 34a and 34b by the motor control circuit 34 through the microcomputer system 10 of the projector 5, and changes the photographing direction by the digital camera 2 by rotating the rotating base 1c and the rotating shaft 1d. .

  FIG. 22 shows a state where the light projection area is moved. In the example shown in FIG. 22, when the right mark 6a2 and 6a3 protrudes from the frame of the screen 6 as a result of enlarging the projection area, when this state is photographed by the digital camera 2, the markink disappears from the image. appear. In this case, the information terminal device 3 moves all the marks 6a on the screen 6 by moving the projection area in the left direction.

Next, in the same manner as described above, the information terminal device 3 again enlarges the current projection area by the projector 5 by a predetermined amount and projects an image on the screen 6 (step E5). Thereafter, the same processing is executed.

  Thus, when it is recognized that all the four marks 6a have disappeared as a result of enlarging the current projection area by a predetermined amount, the information terminal device 3 ends the adjustment of the projection area (step E6).

  FIG. 23 shows an example of a situation in which all of the four marks 6a disappear when the projection area is enlarged by a predetermined amount. As shown in FIG. 23, each of the marks 6a1, 6a2, 6a3, and 6a4 is located at the end (four corners) of the area 6 of the screen and disappears by further enlargement. Means that the area of the screen 6 is full. Therefore, by adjusting the projection area adjustment process in this situation, the adjustment of the projection area according to the size of the screen 6 is completed.

  The information terminal device 3 can project an image on the entire screen 6 as shown in FIG. 24 when an image is projected by the projector 5 in the projection area that has been adjusted by the projection area adjustment process. Since the marking is not necessary after the projection area adjustment processing is completed, the mark 6a is not projected on the screen 6 so that the image in the projection area is not hindered.

In this way, in the projector system of the second embodiment, the mark 6a used to identify the area of the screen 6 is projected by the projector 5, so that the installation location of the screen 6 and its location can be obtained without preparing a dedicated screen. According to the size, the projection direction and the size of the projection area can be automatically adjusted. Accordingly, it is not necessary to determine the installation location of the projector 5 by matching the image to be projected (projection area) with the screen, so that the installation time can be shortened. Further, since the marking for adjusting the projection area and the function of separately outputting the image to be projected onto the projection area are provided, unnecessary marking can be prevented from being projected onto the screen 6.

  In the second embodiment, the triangular mark 6a is used. However, a mark having another shape may be used. In addition to providing the four corners, the positions of the four sides may be marked. The number can be other than four. Further, a frame may be projected instead of the mark.

  Furthermore, marking may be performed by projecting a mark or a frame with light of a specific wavelength (for example, infrared rays). In this case, it is assumed that the digital camera 2 (or image sensor) that captures only light with a special wavelength (for example, infrared rays) is used. It is possible to prevent an unnecessary image from being shown in a presentation or the like used only for area adjustment.

In the first and second embodiments described above , the projection areas of the projectors 1 and 5 are adjusted under the control of the information terminal device 3, but the processing by the information terminal device 3 described above is executed. By installing the function to the projectors 1 and 5 , the projectors 1 and 5 can adjust the projection area independently by the control of the microcomputer system 10. That is, in the projectors 1 and 5 , the process of the flowchart shown in FIGS. 7 to 11 (light projection area adjustment process) is performed in the first embodiment, and the process of the flowchart shown in FIG. Execute. For this purpose, a projector control program for executing a light projection area adjustment process is stored in the microcomputer system 10 of the projectors 1 and 5 . In this case, the image photographed by the digital camera 2 is supplied to a processing function provided in the projectors 1 and 5 . Then, the information terminal device 3 only needs to output display data of an image to be projected on the projector to the projector in the same manner as when using a general projector.

  Further, the present invention is not limited to the above-described embodiments, and various modifications can be made without departing from the scope of the invention in the implementation stage. Further, the functions executed in the above-described embodiments may be combined as appropriate as possible. The above-described embodiments include various stages of the invention, and various inventions can be extracted by appropriately combining a plurality of disclosed constituent elements. For example, even if several constituent requirements are deleted from all the constituent requirements shown in the embodiment, an effect can be obtained, so that a configuration from which the constituent requirements are deleted can be extracted as an invention.

  The processing described in each of the above-described embodiments is a display control program that can be executed by a computer, such as a magnetic disk (flexible disk, hard disk, etc.), an optical disk (CD-ROM, DVD, etc.), and a semiconductor memory. It can be written on a recording medium and provided to various apparatuses. It is also possible to transmit to a variety of devices by transmitting via a communication medium. A computer for controlling a projector (photographing device) (including one installed in the projector) reads a display control program recorded on a recording medium or receives a display control program via a communication medium. The processing described above is executed by controlling the operation by the program.

1 is a diagram showing a configuration of a projector system according to a first embodiment of the present invention. FIG. 3 is a diagram showing an external configuration of the projector. The figure which shows an example of the exclusive screen 4 in 1st Embodiment. FIG. 2 is a block diagram illustrating a functional configuration of the projector 1 according to the first embodiment. FIG. 2 is a block diagram showing a configuration of a digital camera 52 in the first embodiment. The block diagram which shows the structure of the information terminal device 3 concerning 1st Embodiment. The flowchart for demonstrating operation | movement of the light projection area adjustment process performed by the information terminal device 3 for adjusting the light projection area of the projector 1 in 1st Embodiment. The flowchart of the light projection area movement process in 1st Embodiment. The flowchart of the process which calculates the movement amount in 1st Embodiment. The flowchart of the process which calculates the rotation amount of motors 34a and 34b in 1st Embodiment. The flowchart of the enlargement amount calculation process in 1st Embodiment. FIG. 4 is a diagram illustrating an example of an image captured by the digital camera 2. The figure showing the relationship between the projector 1 (light projection part 1b) and the exclusive screen 4. FIG. The figure which shows an example of the image imaged with the digital camera 2 when a light projection area is moved. The figure which shows an example of the image imaged with the digital camera 2 when an image is projected. The figure which shows the example of the other marking with respect to the exclusive screen 4 in 1st Embodiment. The figure which shows the structure of the projector system concerning 2nd Embodiment of this invention. The block diagram which shows the function structure of the projector 5 in 2nd Embodiment. The flowchart for demonstrating operation | movement of the light projection area adjustment process performed by the information terminal device 3 for adjusting the light projection area of the projector 5 in 2nd Embodiment. The figure which shows an example of the four marks 6a (6a1, 6a2, 6a3, 6a4) projected according to the light projection area. The figure which shows a mode that the present light projection area in 2nd Embodiment is expanded. The figure which shows a mode that the light projection area in 2nd Embodiment is moved. The figure which shows an example of the condition where all the four marks 6a disappear by enlarging the projection area in 2nd Embodiment by the predetermined amount. The figure which shows an example of the state by which the image was projected on the whole screen.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1,5 ... Projector 1b ... Projection part 1c ... Turntable 1d ... Rotating shaft 2 ... Digital camera 3 ... Information terminal device 4 ... Dedicated screen 4a ... Black frame 6 ... Screen 10 ... Microcomputer system 34 ... Motor control circuit 34a, 34b ... Motor 35 ... Control terminal 36 ... Control circuit 37 ... Mark irradiation lamp 38 ... Mark irradiation lamp power switch 51, 70 ... CPU
56 ... Operation unit 59 ... Communication connection interface 60 ... Program ROM
61 ... LED
62 ... Distance sensor 73 ... Communication control unit 76 ... External storage memory 76a ... Projector control program 77 ... Video signal output unit

Claims (4)

In a display control device that projects an image onto a projection surface,
Pattern projection means for projecting a mark indicating an area for projecting an image onto the projection surface;
Photographing means for photographing an image including the mark projected by the pattern projecting means ;
Image obtaining means for obtaining an image photographed by the photographing means;
Recognition means for recognizing the mark from the image acquired by said image acquiring means,
And adjusting means for adjusting the area,
Equipped with,
The mark is provided at four corners corresponding to the area,
The adjusting means enlarges the area and adjusts the area so that the recognizing means detects whether or not the marks provided at the four corners of the area disappear and the recognizing means can recognize all the marks. A display control device. The pattern projection unit, the display control device according to claim 1, wherein projecting the mark by invisible light. In an information terminal device that outputs image display data to a projection device that projects an image onto a projection surface,
By imaging the projection surface, an image obtaining unit for obtaining the image including the mark provided on the four corners of the area indicating the area for projecting an image on the projection target surface,
Recognition means for recognizing a mark from the image acquired by the image acquisition means;
An image is projected by the projection device so that the recognition means detects whether or not the marks provided at the four corners of the area have disappeared and the recognition means can recognize all the marks. An information terminal device comprising: a change control means for changing an area. A display control program for controlling a device that projects an image onto a projection surface,
Computer
Image acquisition means for acquiring an image including marks provided at four corners of the area indicating an area on which the image is projected onto the projection surface imaged by the imaging means;
Recognition means for recognizing a mark from the image acquired by the image acquisition means;
Adjustment that adjusts the area to project the image so that the recognition means can detect whether or not the marks provided at the four corners of the area have disappeared and the recognition means can recognize all the marks. A display control program for causing the device to function.

Images