JP4990639B2 - Image projection device - Google Patents

Description

  The present invention relates to an image projection apparatus and an image projection method for projecting an image on a screen or the like.

  In recent years, as this type of image projection apparatus, a hand-held projector that projects an image on a screen or the like while being held by a user's hand has been proposed. A hand-held projector is smaller than a conventional stationary projector that projects in a state where it is installed on a desk, and is excellent in portability.

  Further, since the projection can be performed with the projector held in the hand, facilities such as a desk for installing the projector become unnecessary. Therefore, users can easily carry a hand-held projector, use the hand-held projector to explain products to customers anytime and anywhere, and enjoy a photo library with friends. It can be used.

As described above, the hand-held projector has convenience that is not found in the stationary projector, but has a problem that the image quality of the projected image is deteriorated due to camera shake because the projector main body is held by hand when the image is projected. For this problem, for example, a hand-held projector device having a function of correcting camera shake has been proposed (see Patent Document 1). This apparatus corrects and projects image data and an optical axis in accordance with camera shake detected by a sensor provided in the housing. According to this apparatus, when a camera shake occurs, an image displaced in a direction that cancels the camera shake is projected, so that a phenomenon in which the projected image vibrates vertically and horizontally and becomes difficult to see can be prevented.
JP 2005-128506 A

  However, the conventional image projection apparatus as described above has the following problems. When a presentation is performed by projecting an image with a projector, it is necessary to prepare a pointing device separately to indicate the position on the image projected by the projector. In such an application, the user has to hold a laser projector or the like with one hand while holding the handheld projector with the other hand and make a presentation. As described above, when a hand-held projector is used for a presentation, both hands of the user are required, and the usability may not be good.

  On the other hand, as proposed in a stationary projector, for example, a configuration in which a cross key is provided on the projector body and a marker (mouse pointer) on the projected image is moved up, down, left, and right by a user operation input is also conceivable. However, when this configuration is applied to a hand-held projector, an intricate operation is required to operate the cross key while holding the hand-held projector. It was difficult to get a realistic feeling of operation.

  The present invention has been made in view of the above circumstances, and can project an image and specify the position on the projected image with one hand, and can appropriately and easily position the projected image with an intuitive operational feeling. An object is to provide an image projecting apparatus and an image projecting method capable of instructing.

An image projection apparatus according to the present invention includes a displacement detection unit that detects displacement of a holdable housing, a projection unit that is provided on the housing and projects a first image and a second image, and displacement of the housing. A correction value determination unit that determines a first correction value in a direction opposite to the displacement with respect to the first image, and an effective region acquisition unit that acquires effective region information representing the effective region of the first image. The correction value determining unit determines a second correction value that is smaller than the first correction value based on the effective area information, and the projection unit is configured to displace the casing. Projecting the first image onto the first projection position corrected by the first correction value at the indicated position indicated by the second projection , and correcting the second position by correcting the indicated position by the second correction value. in position, and projecting the second image.

  With this configuration, in the state in which the first image (main image, background image, and the like) and the second image (pointer of the instruction image, etc.) are projected in the direction in which the user holds the case, the user can When the body is displaced, the first image is projected at or near the original position corrected based on the displacement of the housing, and the second image is displayed at the displaced position, that is, the position newly pointed to by the user. Projected. Therefore, when the user displaces the housing of the image projection apparatus up and down, left and right at any position on the first image such as the background image projected by the image projection apparatus held by the user, It can be pointed by a second image such as a pointer. In this way, it is possible to project an image and specify the position on the projected image with one hand, and it is possible to appropriately and easily specify the position on the projected image with an intuitive operational feeling.

Further, for example, when the housing is finely displaced due to the influence of camera shake or the like, the projection position of the second image hardly changes, and when the user greatly displaces the housing, the second image The projection position substantially follows the displacement of the housing. Accordingly, since the second image is not moved finely due to camera shake or the like, the position on the projected image can be clearly indicated without being affected by camera shake or the like.

Further, the ratio of changing the projection position of the second image with respect to the displacement of the housing can be adjusted based on the effective area of the first image, that is, the size, shape, and the like. Therefore, the movement sensitivity of the second image with respect to the displacement operation of the user is changed according to the size, shape, etc. of the first image, or the second image does not move outside the effective area of the first image. It becomes possible to adjust to. Thereby, it is possible to improve the operational feeling when the position on the projected image is designated.

  According to the present invention, it is possible to perform image projection and position designation on the projected image with one hand, and image projection capable of appropriately and easily indicating the position on the projected image with an intuitive operational feeling. An apparatus and an image projection method can be provided.

  In the following embodiments, some examples of an image projection apparatus and method applied to a hand-held projector, a portable terminal device, and the like will be described.

(First embodiment)
The image projection apparatus according to the first embodiment is an example applied to a hand-held projector. FIG. 1 is a block diagram showing a main configuration of an image projection apparatus according to the first embodiment of the present invention, and FIG. 2 is a front view showing an appearance of the image projection apparatus according to the first embodiment. The image projection apparatus 10 includes a control unit 1, a display operation input unit 7, and an image memory 8. The image projection device 10 is configured to have, for example, a seal-shaped housing 25. On the side surface of the housing 25, a projection module 41, a laser light irradiation unit 42, and an operation button 7a are provided. The operation button 7a is used to turn on / off the pointer laser. Further, a string 28 is connected to the exterior portion of the image projection apparatus 10 through a hole formed in the housing 25 so that the user can suspend and hold the housing 25.

  The display operation input unit 7 includes the operation button 7a described above, and outputs an operation input signal indicating depression / release of the operation button 7a to the control unit 1.

  The control unit 1 includes a processor such as a CPU and a memory such as a ROM and a RAM, and includes a displacement detection unit 2, a correction value determination unit 3, and a projection unit 4. The displacement detection unit 2 detects the vertical and horizontal displacements of the image projected by the projection unit 4 as a rotation angle θ in the horizontal direction (yawing direction) and a rotation angle φ in the vertical direction (pitching direction). It is composed of a sensor, a gyro sensor, and the like.

  The correction value determination unit 3 corrects the projection position of the image projected by the projection unit 4 based on the displacement detection signal output from the displacement detection unit 2 in accordance with the operation input signal from the display operation input unit 7. A first correction value is calculated.

  The projection unit 4 includes a projection module 41 and a laser irradiation unit 42, and the projection module 41 and the projection module 41 according to the first correction value output from the correction value determination unit 3 and the operation input signal output from the display operation input unit 7. The laser irradiation unit 42 is driven. The projection module 41 includes a light source for projection and an optical system, and projects a first image such as a main image and a background image on a first projection position on the projection surface 9 according to the input first correction value. To do. The projection module 41 can adjust the optical axis using an apex angle variable prism or the like in the optical system, and irradiates the projection light corresponding to the input first image data while adjusting the optical axis. The first image can be projected on the screen 9.

  When the operation input signal is an ON signal indicating pressing, the laser beam irradiation unit 42 projects a second image (here, a pointer by a laser beam) such as an instruction image onto the second projection position on the projection surface 9. To do.

  The functions of the correction value determination unit 3 and the projection unit 4 are realized by a processor such as a CPU mounted on the control unit 1 executing a program stored in a memory such as a ROM.

  The image memory 8 stores first image data corresponding to the first image projected by the projection module 41. The image memory 8 may be a memory card that can be attached to and detached from the housing 25, a memory that is fixedly provided to the image projection apparatus 10, or another recording medium such as a disk, or An interface for providing image data through communication is also included as a concept.

  An operation of the image projection apparatus 10 having the above configuration will be described. FIG. 3 is a flowchart showing a correction value determination processing procedure in the correction value determination unit 3 of the first embodiment. As described above, this processing program is stored in the memory mounted on the control unit 1, and is executed by the processor of the control unit 1, whereby the correction value determination unit 3 performs the following operation.

  First, the correction value determination unit 3 receives an operation input signal output from the display operation input unit 7 (step S1). The correction value determination unit 3 determines the type of the received operation input signal (step S2). Here, when the operation input signal is an ON signal indicating that the operation button 7a is pressed, the correction value determination unit 3 receives the displacement detection signal output from the displacement detection unit 2 (step S3).

  As described above, this displacement detection signal is obtained by detecting the vertical and horizontal displacements of the image projected by the projection unit 4 as the rotation angle θ in the horizontal direction (the yawing direction) and the rotation angle φ in the vertical direction (the pitching direction). It is. In the present embodiment, in order to simplify the description, the displacement detection signal represents the horizontal rotation angle θ detected as the left and right displacement. The rotation angle θ is the horizontal direction when the optical axis of the projection module 41 is deviated from the specified position of the projection plane 9 (the optical axis position before the displacement) when the image projection apparatus 10 is displaced and rotated. This represents the amount of deviation (see FIG. 5B described later).

  The correction value determination unit 3 determines the first correction value θ1 using the rotation angle θ that is the displacement detection signal received in step S3 (step S4). Here, for the sake of simplicity, the first correction value θ1 is assumed to be equal to the rotation angle θ. However, as will be described later, the first correction value θ1 may be determined more accurately. Then, the correction value determination unit 3 outputs the determined first correction value θ1 to the projection unit 4 (step S5). Thereafter, the process returns to step S1.

  On the other hand, when the operation input signal is an OFF signal indicating separation of the operation button 7a in step S2, the correction value determination unit 3 sets the first correction value θ1 to the value 0 (step S6). Then, the correction value determination unit 3 outputs the first correction value θ1 set in step S5 to the projection unit 4. Thereafter, the process returns to step S1.

  FIG. 4 is a flowchart showing the procedure of the projection operation process in the projection unit 4. As described above, this processing program is stored in the memory mounted on the control unit 1, and is executed by the processor of the control unit 1, whereby the projection unit 4 performs the following operations.

  First, the projection unit 4 waits for the input of the first correction value θ1 output from the correction value determination unit 3 (step S11). When the first correction value θ1 is input, the projection unit 4 adjusts the optical axis of the projection module 41 as image position correction processing according to the first correction value θ1 (step S12), and the first image is displayed. Projection is performed on the projection surface 9 (step S13). In this adjustment of the optical axis, the optical axis of the projection module 41 is set to the first correction value θ1 so that the first image projected by the projection module 41 is maintained at the first projection position on the projection plane 9. Rotate (see FIG. 6A described later).

  Then, the projection unit 4 determines the type of the operation input signal output from the display operation input unit 7 (step S14). That is, when the operation input signal is an ON signal indicating that the operation button 7a has been pressed, the projection unit 4 drives the laser light irradiation unit 42 on (step S15). The pointer laser emitted from the laser light irradiation unit 42 is projected onto the projection surface 9 regardless of the rotation angle θ. Thereafter, the process returns to step S11. On the other hand, when the operation input signal is an OFF signal indicating separation of the operation button 7a in step S14, the projection unit 4 drives the laser light irradiation unit 42 to be turned off (step S16). Thereafter, the process returns to step S11. At this time, a known process such as camera shake correction may be performed in accordance with a minute displacement of the housing.

  5 and 6 are diagrams illustrating transition of an image projected by the image projection apparatus 10 according to the first embodiment. FIG. 5A shows a state where the casing 25 is placed in a normal position facing the projection plane 9 and the operation button 7a is separated. Here, it is assumed that the first image 51 projected by the projection module 41 is a rectangular image. In this case, the rectangular first image 51 projected from the projection port 41 a of the projection module 41 is projected onto the projection surface 9. 5 and 6, a cross 91 representing the position corresponding to the optical axis of the projection module 41 is shown as the center of the first image 51. Therefore, in this case, the cross 91 is located at the center of the rectangular first image 51.

  FIG. 5B shows a state in which the housing 25 is tilted to the left side in the drawing with respect to the projection plane 9 from the state of FIG. In this case, the optical axis of the projection module 41 is tilted to the left by the rotation angle θ with respect to the axis perpendicular to the projection plane 9 (the chain line in the figure). A first image 51 having a trapezoidal shape with a long side 93 on the left side and a short side 94 on the right side is projected onto the projection surface 9. In this case, a cross 91 is located at the center of the trapezoidal first image 51.

  FIG. 5C shows a state where the operation button 7a is pressed from the state of FIG. In this case, the center of the rectangular first image 51 projected by the projection module 41 overlaps with the cross 91 indicating the center position of the first image 51 (the optical axis of the projection module 41). The pointer 52 by the laser beam irradiation unit 42 is projected as an image of.

  FIG. 6A shows a state in which the casing 25 is tilted to the right side in the figure with respect to the projection plane 9 from the state in which the operation button 7a in FIG. In this case, at the time of displacement, the optical axis of the projection module 41 is inclined by the rotation angle θ with respect to an axis perpendicular to the projection plane 9 (a chain line in the figure). On the other hand, by performing the image position correction process, the optical axis of the projection module 41 is adjusted so as to be inclined by the first correction amount θ1 from the center axis (optical axis before displacement) of the projection module 41. The axis is perpendicular to the plane 9. As a result, the first image 51 having a rectangular shape in which the left side 93 and the right side 94 in the drawing are substantially the same is projected onto the projection surface 9 and the center of the first image 51 is increased. A pointer (second image) 52 is projected at a position shifted by the rotation angle θ on the right side of the character shape 91. In other words, when the user tilts the housing 25 while the operation button 7a is pressed, only the pointer that is the second image can be moved relative to the projection image that is the first image on the projection plane. .

  FIG. 6B shows a state in which the operation button 7a is separated from the state of FIG. In this case, the optical axis adjustment function of the projection module 41 is canceled. Accordingly, the optical axis of the projection module 41 returns to the state before correction, and is inclined to the right by the rotation angle θ with respect to the axis perpendicular to the projection plane 9. A first trapezoidal image 51 having a short side 93 on the left side and a long side 94 on the right side is projected onto the projection surface 9, and a cross 91 is located at the center of the first image 51 of the trapezoid. To do. Moreover, the irradiation from the laser beam irradiation unit 42 is stopped, and the pointer 52 is not projected.

  As described above, in the image projector 10 according to the first embodiment, the user holds the casing 25 and the first image and the second image (pointer) are projected on the projection surface 9. When the user displaces the casing 25 (in the above example, it is tilted by the rotation angle θ in the horizontal direction), the optical axis of the projection module 41 is adjusted so as to tilt by the first correction amount θ1 in accordance with this displacement. The first image is projected onto the projection position without any displacement. On the other hand, the second image (pointer) is projected as it is at the displaced position, that is, at the position pointed to by the user. That is, the position correction is performed so that only the second image moves on the projection plane and the projection position of the first image does not move. Here, the case of displacing in the horizontal (yawing) direction is shown, but not only in the horizontal direction, but also in the vertical (pitching) direction, or a combination of the horizontal and vertical directions. Of course, the same operation is possible. The same applies to the following embodiments.

  Therefore, the user simply projects the first image at the same time while moving the housing 25 up, down, left and right at any position on the first image projected by the image projector 10. Can be pointed by the pointer of the second image. Further, in this embodiment, only when the operation button 7a is pressed, the pointer of the second image is projected, and the position of the first image is corrected so as to be stationary. Thereby, the projection of the image and the designation of the position on the projection image can be performed with one hand, and the position on the projection image can be pointed appropriately and easily with an intuitive operational feeling.

  In the above embodiment, the operation of the user displacing the housing 25 to the left and right is an operation of rotating around the light projection port 41a of the projection module 41 for the sake of simplicity. In addition, the operation of displacing the housing 25 to the left and right is accompanied by an operation of translating the projection surface 9 in addition to the operation of rotating the light projection port 41a of the projection module 41.

  FIG. 7 is a diagram illustrating a transition of an image projected by the image projecting device 10 when the operation of displacing the housing 25 to the left and right is accompanied by an operation of translating the light projection port 41a of the projection module 41.

  FIG. 7A shows the parallel movement of the projection port 41a. The light projection port 41a is translated by a distance d from the position 4a before displacement to the position 4b after displacement. FIG. 7B shows the adjustment of the optical axis of the projection module 41 when the light projection port 41a is accompanied by a parallel movement. In this case, the first correction amount θ1a is slightly larger than the rotation angle θ. For example, a value obtained by adding a predetermined amount to the rotation angle θ can be used as the first correction amount θ1a. This predetermined amount may be, for example, a value obtained by dividing the rotation angle θ by a predetermined value. Alternatively, the direction and amount of translation may be detected, and the first correction amount may be obtained more accurately using the distance L from the light projection port 41a to the projection plane 9. This distance L may be a value set in advance as a standard projection distance, or among a plurality of values prepared in advance (for example, “standard distance mode” = 100 cm, “short distance mode” = 30 cm, etc.). From the above, it may be possible for the user to select a value, or it may be a value measured using a sensor.

  By such a position correction process, even if the displacement of the housing is accompanied by a parallel movement, a slight misalignment of the first image projected on the projection surface that may occur before and after the displacement is further increased. Can be small. In addition, the operation with such a parallel movement is the same in the following embodiments. In consideration of this, the first correction amount may be calculated accurately in the same manner.

  Further, in the examples of FIGS. 5 and 6 described above, the first image to be projected is shown as a trapezoid for easy understanding when the casing 25 of the image projection apparatus 10 is tilted. By performing the distortion correction, it is possible to project the first image in a state where it remains stationary as a rectangle.

(Second Embodiment)
The image projection apparatus according to the second embodiment is an example applied to a mobile terminal device such as a mobile phone equipped with a projector function. FIG. 8 is a block diagram showing a main configuration of an image projection apparatus according to the second embodiment of the present invention, and FIG. 9 is a perspective view showing an appearance of the image projection apparatus according to the second embodiment. The portable terminal device 100 having the function of an image projection device includes a projector control unit 101, a display operation input unit 107, an image memory 108, and a telephone function unit 120. The mobile terminal device 100 includes a housing 200 that includes a base member 260 and an upper member 250 that can be opened and closed with respect to the base member 260. FIG. 9A shows a state where the upper member 250 is closed, and FIG. 9B shows a state where the upper member 250 is opened.

  A liquid crystal display (LCD) 251 is provided on the surface of the upper member 250, and a speaker 252 is provided on the back surface thereof. Various keys necessary for a portable terminal device such as a cross key 263, an on-hook key 262, an off-hook key 261, and a microphone 264 are disposed below the front surface of the base member 260. Further, on the side surface of the base member 260, a light projection port 41a as a projector and a trigger type switch 107a are provided. When the upper member 250 is closed, the LCD 251 is positioned on the front surface of the housing, and the cross key 263 and the like can be operated while viewing the display screen of the LCD 251. When the upper member 250 is open, the speaker 252 is exposed and a call can be made by the speaker 252 and the microphone 264. At this time, since the LCD 251 is positioned so as to face away from the light projecting port 141a, it is possible to confirm on the display screen of the LCD 251 when giving a presentation using the projector function.

  The display operation input unit 107 includes the trigger type switch 107a described above, and outputs an operation input signal to the projector control unit 101 in accordance with the depression / release of the trigger type switch 107a. The display operation input unit 107 and the trigger switch 107a function as an example of a projection instruction input unit.

  The projector control unit 101 includes a processor such as a CPU and a memory such as a ROM and a RAM, and includes a displacement detection unit 102, a correction value determination unit 103, and a projection unit 104. Similar to the displacement detection unit 2 of the first embodiment described above, the displacement detection unit 102 detects the horizontal and vertical displacements of the image projected by the projection unit 104 in the horizontal direction (yawing direction) and the vertical direction (pitching). Direction) and is constituted by a rotation angle sensor, a gyro sensor, or the like.

  The correction value determination unit 103 performs a first projection in which a first image is projected by the projection unit 104 based on a displacement detection signal output from the displacement detection unit 102 in accordance with an operation input signal from the display operation input unit 107. A first correction value and a second correction value for correcting the position and the second projection position on which the second image is projected are calculated.

  The projection unit 104 includes a superimposition unit 143 together with the projection module 141 similar to the projection module 41 of the first embodiment described above, and the first correction value and the second correction value output from the correction value determination unit 103. The projection module 141 and the superimposing unit 143 are driven according to the operation input signal output from the display operation input unit 107.

  The superimposing unit 143 includes a frame memory (image memory) 143a, and the first image and the second image are superimposed while performing position correction using the input first correction value and second correction value. By storing the obtained image on the frame memory 143a, a superimposed image (composite image) is generated. The projection module 141 includes a light source for projection and an optical system, and projects a superimposed image on which the first image and the second image are superimposed on the projection surface 109. The projection module 141 emits projection light according to image data of the input superimposed image, and can project the first image and the second image on the projection surface 109. Note that, in the projection module 141 of the present embodiment, a projection module that does not have an optical axis adjustment function is used.

  The image memory 108 stores first image data corresponding to the first image projected by the projection module 141 and second image data corresponding to the second image. The image memory 108 may be a memory card that can be attached to and detached from the housing 200, a memory that is fixedly provided in the mobile terminal device 100, another recording medium such as a disk, or the like. An interface for providing image data through communication is also included as a concept.

  Note that the functions of the correction value determination unit 103 and the projection unit 104 are realized by a processor such as a CPU installed in the projector control unit 101 executing a program stored in a memory such as a ROM.

  The telephone function unit 120 includes a control unit 172, a wireless communication unit 173, an internal memory 174, an audio processing unit 175, and an image processing unit 176. An antenna 179 is connected to the wireless communication unit 173. A speaker 252 and a microphone 264 are connected to the audio processing unit 175. An LCD 251 is connected to the image processing unit 176. The control unit 172 is connected to a key operation unit 178 having various keys such as the cross key 263, the on-hook key 262, and the off-hook key 261 described above.

  The control unit 172 includes a known processor such as a CPU connected via a bus and the like, and a memory such as a ROM and a RAM, and the processor executes various control programs stored in the memory. Thereby, the control unit 172 controls each unit of the internal memory 174, the wireless communication unit 173, the sound processing unit 175, and the image processing unit 176, and transmits and receives data between these units.

  The internal memory 174 stores a control program executed by the control unit 172 and various data. The internal memory 174 stores content data such as images, music, and programs downloaded from an external information providing site, voice data recorded by an answering machine, and the like. The wireless communication unit 173 performs wireless communication by transmitting and receiving wireless signals to and from an external base station or the like via the antenna 179.

  The audio processing unit 175 encodes the audio signal input from the microphone 264 and sends it to the control unit 172, and also decodes the audio signal received by the wireless communication unit 173 and the audio signal stored in the internal memory 174. And output from the speaker 252. The image processing unit 176 processes the image data received by the wireless communication unit 173 and the image data stored in the internal memory 174 and outputs the processed image data to the LCD 251 as a display image.

  Various functions of the telephone function unit 120 are realized by a processor installed in the control unit 172 executing a program stored in a memory.

  The operation of the mobile terminal device 100 having the above configuration will be described. FIG. 10 is a flowchart illustrating a correction value determination processing procedure in the correction value determination unit 103 according to the second embodiment. As described above, this processing program is stored in the memory mounted on the projector control unit 101, and is executed by the processor of the projector control unit 101, whereby the correction value determination unit 103 performs the following operation.

  First, the correction value determination unit 103 receives an operation input signal output from the display operation input unit 107 (step S21). The correction value determination unit 103 determines the type of the received operation input signal (step S22). Here, when the operation input signal is an ON signal indicating depression of the trigger switch 107a, the correction value determination unit 103 receives the displacement detection signal output from the displacement detection unit 102 (step S23).

  As described above, this displacement detection signal is detected as the horizontal (yawing direction) rotation angle θ and the vertical direction (pitching direction) rotation angle φ as the vertical and horizontal displacements of the image projected by the projection unit 104. Signal. In the present embodiment, in order to simplify the description, the displacement detection signal represents the horizontal rotation angle θ detected as the left and right displacement.

  The correction value determination unit 103 determines the first correction value R1 according to the following equation (1) using the rotation angle θ that is the displacement detection signal received in step S23 (step S24). Here, the first correction value R1 is a value for displacing the position of the first image from the center (1/2 of the horizontal size) of the frame memory 143a when the first image is written into the frame memory 143a. (Ratio). Here, the position correction on the frame memory 143a is performed by moving the address position for storing the image data.

    R1 = tan (θ) / tan (θh) (1)

  In Equation (1), θh is an angle corresponding to ½ of the horizontal angle of view when the projection module 141 projects an image of a size that occupies the entire storage area of the frame memory 143a.

  FIG. 11 is a diagram schematically showing the relationship between the first correction value R1 and the rotation angle θ in the frame memory. In the present embodiment, when the housing 200 is rotated by the rotation angle θ, the frame memory is displayed in the opposite direction to the rotation direction by the ratio indicated by the first correction value R1 (corresponding to the rotation angle θ). A position correction process for displacement is performed. At this time, in order to correct the inclination of the optical axis of the projection module 141, for example, a process of shifting the position and distorting the shape reversely is performed so that a rectangle is trapezoidal.

  Subsequently, the correction value determining unit 103 determines the second correction value R2 (step S25). When the second correction value R2 is written in the frame memory 143a, the second image to be superimposed on the first image written at the position on the frame memory 143a corrected with the first correction value R1 is the second correction value R2. This is a value (ratio) for displacing the position of the second image from the center of the frame memory 143a. In the present embodiment, the second correction value R2 is calculated as a value obtained by dividing the first correction value R1 by a predetermined value equal to or greater than 1. In this example, the second correction value R2 is calculated from the first correction value R1, but may be calculated using the rotation angle θ. At this time, the second correction value R2 <the first correction value R1.

  The correction value determination unit 103 outputs the determined first correction value R1 and second correction value R2 to the projection unit 104 (step S26). Thereafter, the process returns to step S21.

  On the other hand, when the operation input signal is an OFF signal indicating separation of the trigger switch 107a in step S22, the correction value determination unit 103 sets the first correction value R1 to the value 0 (step S27). In this case, the first correction value R1 may not be set to the value 0, but may be set to a value in the vicinity of the value 0. The second correction value R2 is also set to a value of 0 or a value near 0, for example. Then, the correction value determination unit 103 outputs the first correction value R1 and the second correction value R2 set in step S27 to the projection unit 104 (step S26). Thereafter, the process returns to step S21.

  FIG. 12 is a flowchart showing a projection operation processing procedure in the projection unit 104. As described above, this processing program is stored in the memory mounted on the projector control unit 101, and is executed by the processor of the projector control unit 101, whereby the projection unit 104 performs the following operation.

  First, the projection unit 104 determines the type of the operation input signal (step S31). When the operation input signal is an ON signal indicating depression of the trigger switch 107a, the projection unit 104 performs position correction processing based on the input first correction value R1 and second correction value R2 by the superimposing unit 143. While performing, the superimposed image on which the first image and the second image are superimposed is written in the frame memory 143a (step S32). When the superimposed image is generated in step S32, the first image is first corrected from the position corrected on the frame memory 143a, that is, from the center of the frame memory, as shown in FIG. It is written at a position shifted to the left by the value R1. Further, the second image is written at a position shifted to the left side by a second correction value R2 having a smaller correction amount than the first correction value R1. Since the processing related to position correction on the frame memory at this time is a well-known technique, detailed description thereof is omitted here.

  Then, the projection unit 104 drives the projection module 141 to project the superimposed image written in the frame memory 143a (step S34). Thereafter, the process returns to step S31.

  On the other hand, when the operation input signal is an OFF signal indicating separation of the trigger switch 107a in step S31, the projection unit 104 stores the first image in the frame memory according to the first correction value R1 (here, value 0). Write to 143a (step S33). In step S34, the projection unit 104 drives the projection module 141 to project the first image that has not been position-corrected. Thereafter, the process returns to step S31. At this time, a known process such as camera shake correction may be performed in accordance with a minute displacement of the housing.

  FIG. 13 is a diagram illustrating a change in the rotation angle θ when the housing 200 is tilted (displaced) with respect to the projection surface 109. In an initial state such as immediately after the power is turned on, the optical axis from the projection port 141 a of the projection module 141 is at a position P 0 in the direction perpendicular to the projection plane 109. Then, when the casing 200 is rotated by the rotation angle θ1, the optical axis from the light projection port 141a moves to the position P1. Further, when the housing 200 is rotated by a large rotation angle θ2, the optical axis from the light projection port 141a moves to the position P2.

  FIG. 14 is a diagram illustrating the first and second images written in the frame memory corresponding to the rotation of the housing 200 of FIG. 13 and the projection image thereof in the mobile terminal device 100 of the second embodiment. 14A shows the case where the rotation angle θ = 0, FIG. 14B shows the case where the rotation angle θ = θ1, and FIG. 14C shows the case where the rotation angle θ = θ2. Here, it is assumed that the first image to be projected is a rectangular image.

  In the state of FIG. 14A, the center 151 of the first image 181 is positioned on the center line (address of the center position) 140 of the frame memory 143a. Similarly, the tip 152 that is the indication point of the second image (pointer image) 182 indicated by the arrow is also located on the center line 140 of the frame memory 143a. The projection is performed on the projection surface 109 in a state where the center 191 of the first image 161 and the tip 192 of the second image 162 coincide with each other.

  In the state of FIG. 14B, the center 151 of the first image 181 is shifted to the left side from the center line 140 of the frame memory 143a by the amount that the casing 200 is slightly rotated rightward by the rotation angle θ1. is there. In this case, the first image 181 has a trapezoidal shape with the short side on the right side in the drawing. At this time, since the second correction value R2 <the first correction value R1, the leading edge 152 of the second image 182 is on the left side of the center line 140 of the frame memory 143a and from the center 151 of the first image 181. Located on the right side (centerline 140 side). In the projection module 141, when a trapezoidal image on the frame memory 143 a is projected in a state where the optical axis is inclined and displaced by the rotation angle θ 1, the original rectangular image is obtained on the projection plane 109. Therefore, the first rectangular image 161 similar to that in FIG. 14A is projected on the projection surface 109, and the tip 192 of the second image 162 is on the right side from the center 191 of the first image 161. Projected out of position.

  In the state of FIG. 14C, the center 151 of the first image 181 is shifted to the left side from the center line 140 of the frame memory 143a by the amount that the housing 200 is rotated to the right by the rotation angle θ2. . Further, in this case, the first image 181 has a trapezoid that is distorted shorter on the right side in the drawing than in the case of the rotation angle θ1. At this time, since the second correction value R2 <the first correction value R1 and the difference between the second correction value R2 and the first correction value R1 increases in proportion to the first correction value R1, The leading end 152 of the second image 182 is located on the left side of the center line 140 of the frame memory 143a and on the right side (center line 140 side) far away from the center 151 of the first image 181. As a result, a rectangular first image 161 similar to that shown in FIGS. 14A and 14B is projected on the projection surface 109, and the tip 192 of the second image 162 is projected on the first image 161. Is projected to the right from the center 191 of the image.

  In the above example, the case of displacing in the horizontal (yawing) direction has been shown, but not only in the horizontal direction, but also in the vertical (pitching) direction, or a combination of the horizontal and vertical directions. Of course, the same operation is possible.

  As described above, in the mobile terminal device 100 according to the second embodiment, the user holds the casing 200 and the first image and the second image (pointer) are projected on the projection surface 109. When the user displaces the housing 200, the position of the first image is corrected to be larger than that of the second image in accordance with the displacement, and the first image is written on the frame memory and projected. As a result, the first image is projected on the projection plane so that only the second image moves.

  Accordingly, the user simply projects the first image at the same time while moving the housing 25 up, down, left and right at any position on the first image projected by the mobile terminal device 100. Can be pointed by the pointer of the second image. Further, when the housing is finely displaced due to the influence of camera shake or the like, the projection position of the second image hardly changes, and when the user greatly displaces the housing of the second image. The projection position almost follows the displacement of the housing. Accordingly, since the second image is not moved finely due to camera shake or the like, the position on the projected image can be clearly indicated without being affected by camera shake or the like. In addition, position correction processing is performed on the frame memory, and at this time, distortion due to the tilt of the optical axis of the projection module is also reversely corrected, so that the projector is tilted and projected on the projection plane by displacing the housing. It is possible to prevent the first image from being deformed from a rectangle to a trapezoid.

  In the example of FIG. 14 described above, the projection module 141 is not provided with an optical axis adjustment function, and the first correction is performed when position correction is performed on the frame memory 143a when the housing 200 of the mobile terminal device 100 is tilted. Although the shape of the image is shown to be reversely corrected to a trapezoid, the first image is shifted in its original shape, position correction processing is performed, the optical axis is adjusted, and the first image is still in a rectangular shape. It is also possible to project in such a state.

(Third embodiment)
Similar to the second embodiment, the image projection apparatus according to the third embodiment is an example applied to a mobile terminal device such as a mobile phone equipped with a projector function. FIG. 15 is a block diagram showing a main configuration of an image projection apparatus according to the third embodiment of the present invention. In addition, about the component same as 2nd Embodiment mentioned above, the description is abbreviate | omitted by attaching | subjecting the same code | symbol.

  The projector control unit 501 of the mobile terminal device 500 according to the third embodiment includes a time detection unit 106 and an effective area information extraction unit 105 as well as a displacement detection unit 102, a correction value determination unit 503, and a projection unit 104. The timer 106 measures the separation time T after the projection instruction from the trigger switch 107a and the display operation input unit 107 functioning as an example of a projection instruction input unit is turned off, and uses the time information as a correction value determination unit. The data is output to 503.

  The effective area information extraction unit 105 functions as an example of an effective area acquisition unit. The effective area information extraction unit 105 extracts an effective area in which the first image is stored on the frame memory 143a, and uses the effective area information as a correction value determination unit 503. Output to. Here, the effective area information indicates the size of the first image, the width w1 that is ½ of the horizontal size of the first image on the frame memory 143a, and the first image. It is represented by a height h1 that is ½ of the vertical size (see FIG. 19 described later).

  The operation of the mobile terminal device 500 having the above configuration will be described. FIG. 16 is a flowchart illustrating a correction value determination processing procedure in the correction value determination unit 503 of the third embodiment. This processing program is stored in a memory mounted on the projector control unit 501, and is executed by the processor of the projector control unit 501, whereby the correction value determination unit 503 performs the following operation.

  First, the correction value determination unit 503 receives an operation input signal output from the display operation input unit 107 (step S51). The correction value determination unit 503 determines the type of the received operation input signal (step S52). Here, when the operation input signal is an ON signal indicating depression of the trigger switch 107a, the correction value determination unit 503 receives a displacement detection signal output from the displacement detection unit 102 (step S53). The correction value determination unit 503 determines whether or not the rotation angle θ that is the received displacement detection signal (displacement amount) is equal to or larger than the predetermined angle θa (step S54).

  FIG. 17 is a diagram illustrating a change in the rotation angle θ when the housing 200 is tilted (displaced) with respect to the projection plane 109. In an initial state such as immediately after the power is turned on, the optical axis from the projection port 141 a of the projection module 141 is at a position P 0 in the direction perpendicular to the projection plane 109. Here, a case where the housing 200 is rotated by a small rotation angle θ1 and a case where the housing 200 is rotated by a large rotation angle θ2 are shown.

  In the present embodiment, when the rotation angle θ is less than the predetermined rotation angle θa, such as θ1, position correction of the first and second images is executed as will be described later. When the rotation angle θ is less than the predetermined angle θa in step S54, the correction value determination unit 503 receives the effective region information (width w1, height h1) from the effective region information extraction unit 105 (step S55).

  The correction value determination unit 503 determines the first correction value R1 according to the above-described equation (1) using the rotation angle θ that is the displacement detection signal received in step S53 (step S56). The first correction value R1 is a value (percentage) for displacing the position of the first image from the center (1/2 of the horizontal size) of the frame memory 143a when the first image is written in the frame memory 143a. It is. Θh is an angle corresponding to ½ of the horizontal angle of view when the projection module 141 projects an image of a size that occupies the entire storage area of the frame memory 143a.

  Further, the correction value determination unit 503 determines the second correction value R2 according to the following mathematical formula (2) using the effective area information and the rotation angle θ received in step S55 (step S57). When the second correction value R2 is written in the frame memory 143a, the second image to be superimposed on the first image written at the position on the frame memory 143a corrected with the first correction value R1 is the second correction value R2. This is a value (ratio) for displacing the position of the second image from the center of the frame memory 143a.

R2 = tan (θ × (θh−2θh1) / (θh−θh1)) / tan (θh)
(2)

  In Equation (2), θh1 is an angle corresponding to ½ of the horizontal angle of view when the first image stored in the frame memory is projected. This θh1 is calculated from the following mathematical formula (3).

    θh1 = arctan (tan (θh) × w1 / w0) (3)

  In Equation (3), w1 is a value corresponding to ½ of the horizontal size of the first image on the frame memory, and w0 is equivalent to ½ of the horizontal size of the entire frame memory. Value.

  FIG. 18 is a diagram schematically showing the relationship between the size of the entire frame memory in the frame memory and the size corresponding to the first image. As described above, on the frame memory, the length corresponding to the entire frame memory (corresponding to half the horizontal angle of view θh for projecting the entire frame memory) is set to w0, and the first image (the horizontal for projecting the first image) is set. The length corresponding to half of the angle of view (equivalent to θh1) is w1.

  The correction value determination unit 503 outputs the first correction value R1 and the second correction value R2 determined in steps S56 and S57 to the projection unit 104 (step S58). Thereafter, the process returns to step S51.

  On the other hand, when the operation input signal is an OFF signal indicating separation of the trigger switch 107a in step S52, the correction value determination unit 503 receives the separation time T as time information from the timer unit 106 (step S59). And it is discriminate | determined whether separation time T is more than predetermined time Ta (for example, 2 second) (step S60).

  When the separation time T is equal to or longer than the predetermined time Ta, the correction value determination unit 503 sets the first correction value R1 to the value 0 (step S61). In this case, the first correction value R1 may not be set to the value 0, but may be set to a value in the vicinity of the value 0. The second correction value R2 is also set to a value of 0 or a value near 0, for example. Thereafter, the correction value determination unit 503 outputs the first correction value R1 and the second correction value R2 set in step S61 (step S58), and the process returns to step S51. On the other hand, if the separation time T is less than the predetermined time Ta in step S60, the processing after step S53 is performed, and the first correction value R1 and the second correction value R2 for position correction are set in the same manner as described above.

  When the rotation angle θ is greater than or equal to the predetermined angle θa in step S54, the correction value determination unit 503 considers that the user has displaced the casing with the intention of projecting the projection image to another position. Then, the process of step S61 is performed, and the first correction value R1 and the second correction value R2 are set to a value 0 or a value in the vicinity of the value 0.

  Here, the predetermined rotation angle θa is, for example, a value calculated according to the following mathematical formula (4).

    θa = α (θh−θh1) (4)

  In Expression (4), α is a positive constant having a value of 1 or more, and is assumed to be 1.1, for example. In other words, for example, when the case is displaced in the right direction, the equation (4) greatly displaces the case so that the second image moves further to the right beyond the right end of the first image. The rotation angle θ at this time is defined as a predetermined rotation angle θa. That is, the state in which the second image has already been projected on the edge of the first image and the housing is further greatly displaced to the outside of the first image corresponds to the predetermined displacement angle θa.

  Since the projection operation process including the position correction in the projection unit 104 performed using the first correction value R1 and the second correction value R2 determined by the above procedure is the same as that in the second embodiment, The description is omitted here.

  FIG. 19 is a diagram schematically showing the relationship between the first correction value R1 and the second correction value R2 and the rotation angle θ on the frame memory. On the frame memory 143a, the position of the first image is corrected by the first correction value R1 in the direction opposite to the direction in which the casing rotates at the rotation angle θ, and the second image is positioned by the second correction value R2. It is corrected. Here, FIG. 19A shows a case where the rotation angle θ is less than the predetermined rotation angle θa, and FIG. 19B shows a case where the rotation angle θ is greater than or equal to the predetermined rotation angle θa.

  When the rotation angle θ is less than the predetermined rotation angle θa, as shown in FIG. 19A, the first image 181 and the second image (pointer) 182 have the first correction value R1 and the second correction value R1, respectively. Is written in the position (address) on the frame memory 143a whose position is corrected according to the correction value R2. On the other hand, when the rotation angle θ is equal to or larger than the predetermined rotation angle θa, as shown in FIG. 19B, the first image 181 and the second image (pointer) 182 have the first correction value R1 and the first correction value R1. Since the correction value R2 of 2 is 0, both are written in the center (address of the center position) of the frame memory 143a.

  In the present embodiment, since the first correction value R1 and the second correction value R2 are set according to the size of the first image based on the above formulas (1) and (2), When the size is small (that is, when the width w1, that is, the horizontal angle of view θh1 is small), the second correction value R2 is large, so that the second image jumps out of the first image even if the housing is large. It becomes difficult.

  Further, when the housing is displaced and the left end of the first image reaches the left end of the frame memory due to position correction (θ = θh−θh1), the second image is projected onto the right end of the first image. . Thereby, in a state where the second image is projected inside the first image, the projection image of the first image is not lost. That is, the first image is stored in the frame memory, and the end of the first image does not go out of the projectable range (out of the frame memory).

  As is clear from Equation (2), when the angle θh1 exceeds half of the angle θh, the second correction value R2 exceeds the value 1 (that is, the second image is larger than the displacement of the housing). The second image is greatly blurred due to the influence of camera shake when position correction is performed. Therefore, it is desirable that the frame memory be sufficiently large with respect to the size of the first image.

  In the above example, the case of displacing in the horizontal (yawing) direction has been shown, but not only in the horizontal direction, but also in the vertical (pitching) direction, or a combination of the horizontal and vertical directions. Of course, the same operation is possible.

  As described above, in the mobile terminal device 500 according to the third embodiment, when the rotation angle θ is less than the predetermined rotation angle θa, the ratio of changing the projection position of the second image with respect to the displacement of the housing is set to the first. Adjustment can be made based on the effective area of one image. Accordingly, the movement sensitivity of the second image with respect to the displacement operation of the user is automatically changed according to the size and shape of the first image, or the second image is not automatically moved outside the effective area of the first image. Adjustment is possible. Thereby, the operational feeling at the time of designating the position on the projection image can be improved.

  When the user performs a predetermined displacement operation, that is, when the rotation angle θ is equal to or greater than the predetermined rotation angle θa, the projection position of the first image follows the displacement of the housing without performing position correction. To do. Therefore, when it is desired to change the position where the image is projected, the user can move the projection image to a desired position by simply performing a displacement operation larger than a predetermined amount on the housing. As described above, the pointer of the second image or the projection image can be moved by a simple operation, and the projection image can be moved in accordance with the user's intention.

  It should be noted that the present invention is not limited to those shown in the above-described embodiments, and those skilled in the art can also make changes and applications based on the description in the specification and well-known techniques. Yes, included in the scope of protection.

  For example, in each of the above embodiments, when the displacement of the housing increases with the operation button 7a or the trigger switch 107a being separated, the first correction value is decreased to correct the projection position of the first image. The amount may be reduced. Further, only when the operation button 7a or the trigger switch 107a is pressed, the second image is projected and the position of the first image is corrected, and the first image is stopped only when the pointer is displayed. You may do it.

  In addition, when the position indicated by the pointer of the second image that moves by displacing the casing is outside the effective area of the first image, the second image may be deleted.

  In the third embodiment, when the trigger switch is separated, the correction value is not set to 0 (or a value near 0) for a while after the predetermined time Ta. The calculation of the correction value may be continued until the housing is displaced by a predetermined amount instead of the predetermined time.

  Further, the image projection apparatus projects an image object for instruction input such as a keyboard layout, a menu, and an icon as a part of the first image, and designates and inputs the image object with a pointer that is a second image. It is also possible to function as a pointing device that can be used.

  Further, the image projection apparatus is applied to a portable terminal device such as a hand-held projector or a mobile phone, but may be applied to various electronic devices such as a digital camera, a portable information terminal, and a notebook PC. Of course.

  The present invention has an effect that an image can be projected and a position on the projected image can be designated with one hand, and a position on the projected image can be appropriately and easily designated by an intuitive operational feeling. In a presentation or the like, the present invention is useful for an image projection apparatus and an image projection method used when a user performs an operation such as pointing a position on an image while projecting an image on a screen or the like.

1 is a block diagram showing a main configuration of an image projection apparatus according to a first embodiment of the present invention. 1 is a front view showing an appearance of an image projection apparatus according to a first embodiment. The flowchart which shows the correction value determination processing procedure in the correction value determination part of 1st Embodiment. 7 is a flowchart showing a projection operation processing procedure in the projection unit of the first embodiment. The figure which shows the transition of the image projected by the image projector of 1st Embodiment The figure which shows the transition of the image projected by the image projector of 1st Embodiment The figure which shows the transition of the image projected by the image projector in the case of accompanying a parallel movement when displacing a housing | casing to right and left in 1st Embodiment. The block diagram which shows the principal part structure of the image projector which concerns on the 2nd Embodiment of this invention. The perspective view which shows the external appearance of the image projector which concerns on 2nd Embodiment. The flowchart which shows the correction value determination processing procedure in the correction value determination part of 2nd Embodiment. The figure which shows typically the relationship between 1st correction value R1 and rotation angle (theta) in the frame memory of 2nd Embodiment. 7 is a flowchart showing a projection operation processing procedure in the projection unit of the second embodiment. The figure which shows the change of rotation angle (theta) when a housing | casing is displaced with respect to a projection surface in 2nd Embodiment. The figure which shows the 1st and 2nd image written in frame memory corresponding to rotation of a housing | casing in 2nd Embodiment, and its projection image. The block diagram which shows the principal part structure of the image projector which concerns on the 3rd Embodiment of this invention. The flowchart which shows the correction value determination processing procedure in the correction value determination part of 3rd Embodiment. The figure which shows the change of rotation angle (theta) when a housing | casing is displaced with respect to a projection surface in 3rd Embodiment. The figure which shows typically the relationship between the magnitude | size of the whole frame memory in the frame memory of 3rd Embodiment, and the magnitude | size corresponding to a 1st image. The figure which shows typically the relationship between 1st correction value R1 and 2nd correction value R2, and rotation angle (theta) on the frame memory of 3rd Embodiment.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Control part 2,102 Displacement detection part 3,103,503 Correction value determination part 4,104 Projection part 7,107 Display operation input part 7a Operation button 8 Image memory 9,109 Projection surface 10 Image projection apparatus 25,200 Case 41, 141 Projection module 42 Laser light irradiation unit 100, 500 Portable terminal device 101, 501 Projector control unit 105 Effective area information extraction unit 106 Timing unit 107a Trigger switch 108 Image memory 143 Superimposition unit 143a Frame memory (image memory)

Claims (1)

A displacement detector for detecting the displacement of the holdable housing;
A projection unit provided on the housing for projecting the first image and the second image;
And based on said displacement of the housing, the correction value determination section for determining a first correction value in the opposite direction as the displacement for said first image,
An effective area acquisition unit that acquires effective area information representing the effective area of the first image ,
The correction value determining unit determines a second correction value that is smaller than the first correction value based on the effective area information;
The projection unit projects the first image onto a first projection position obtained by correcting the designated position indicated by the displacement of the housing with the first correction value, and the designated position is set to the second position . of the second projection position corrected by the correction value, the image projecting device for projecting the second image.

Images