JP2012237938A - Projector - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a projector improved in user-friendliness.SOLUTION: Shake correction of a projection image provided on an image projecting unit is performed by image processing and shifting the projection image in a reverse direction, based on shake movement detection. A projection frame of the projection image is scaled down in a projection range to secure a shift margin, and frame flickering is prevented by shifting the frame based on the shake movement detection. When the projection frame cannot be shifted in the projection range, a shift amount of the image is reduced. The flickering of the projection image frame is alleviated by blurring the projection frame when shifting the projection image. A blurring amount is changed based on the shake movement detection. The image projecting unit is disposed at a center part in a long side direction of the image displaying unit, such that the long side direction of the rectangle image displaying unit is orthogonal to a projection optical axis. When a projection posture is detected, in which an inclination of the projection image in a horizontal direction is equal to or greater than a predetermined value, menu selection of a projection function is disabled.

Description

  The present invention relates to a projector.

  Conventionally, various projectors have been proposed for various purposes. For example, a mobile phone is provided with an image projection unit, and when a change occurs in a predetermined region including an irradiation region of light emitted from the projection unit, irradiation of light from the projection unit is stopped, and an acceleration sensor is provided. It has been proposed to perform camera shake correction when camera shake vibration is detected. (Patent Document 1) In a hand-held projector, it has also been proposed to prevent the shake of a projected image by changing the apex angle of a variable apex angle prism by an electromagnetic actuator based on a shake detection signal from a sensor. (Patent Document 2)

  Regarding camera shake correction control, although it is not a projector, in a digital camera equipped with an optical camera shake correction function, if the user intentionally performs panning or tilting operation, the camera shake correction function is not activated and panning is performed. It has been proposed to accurately determine the end of the state or the tilting state and restart the camera shake correction function. (Patent Document 3) Further, regarding a projector, it has been proposed to perform trapezoidal distortion of a tilted image by detecting a set angle of the projector. (Patent Document 4) Regarding trapezoidal distortion correction, it is determined whether the projection surface has shifted from the wall surface to the ceiling, or from the wall surface to the wall surface, etc. It has also been proposed to correct by replacing. (Patent Document 5)

JP 2010-226699 A JP 2005-128506 A JP 2009-267873 A JP 2003-283963 A Japanese Patent Laid-Open No. 2004-77545

  However, there are many problems to be further studied regarding the projector.

  In view of the above, an object of the present invention is to provide a projector that is easier to use.

  In order to achieve the above object, the present invention provides an image projecting unit, an image providing unit that provides a projected image to the image projecting unit, a blur movement detecting unit that detects a blur movement of the image projecting unit, Provided is a projector having an image processing unit that shifts an image provided by an image providing unit in a direction of correcting the detection based on detection. Thus, it is possible to perform blur correction by image processing even if there is no blur correction function in the image projection function.

  According to a specific feature of the present invention, the image processing unit further corrects the projection frame of the projection image provided by the image providing unit based on the detection of the blur movement detection unit. This makes it possible to take measures against flickering of a projected image in blur correction by image processing.

  According to a more specific feature, the image processing unit shifts the projection frame of the projection image provided by the image providing unit based on the detection by the shake movement detecting unit. As a result, blur correction can be performed for both the image and the image frame.

  According to another more specific feature, the image processing unit reduces the projection frame of the projection image provided by the image providing unit within the projection range based on the detection of the shake movement detection unit. Thereby, a room for correction of the projection frame is secured. According to a more specific feature, the image processing unit reduces the projection image provided by the image providing unit within the reduced projection frame based on the detection of the shake movement detection unit. This makes it possible to correct blurring for both the image and the image frame without missing the peripheral portion of the projected image.

  According to another more specific feature, the image processing unit reduces a shift amount of the image provided by the image providing unit when the projection frame reduced based on the detection of the shake movement detection unit cannot be shifted within the projection range. . As a result, the correction of the blur between the image and the image frame is adjusted.

  According to another specific feature of the invention, the image processing unit is configured to blur a projection frame of a projection image provided by the image providing unit. Thereby, the boundary between the bright part within the projection range and the dark part outside the projection range becomes inconspicuous, and it becomes possible to take measures against flickering of the projected image frame in blur correction by image processing.

  According to another aspect of the invention, there is provided a projector having an image projecting unit, an image providing unit that provides a projected image to the image projecting unit, and an image processing unit that blurs a projection frame of the projected image provided by the image providing unit. Provided. As a result, it becomes possible to make the boundary between the bright part within the projection range with the largest contrast difference and the dark part outside the projection range inconspicuous. According to a more specific feature, the projector includes a blur movement detection unit that detects a blur movement of the image projection unit, and the image processing unit detects a projection image provided by the image providing unit based on the detection of the blur movement detection unit. Blur the projection frame. Accordingly, it is possible to prevent the periphery of the projection image from being unnecessarily blurred when there is little blurring. According to a more specific feature, the image processing unit changes the blurring amount in the projection frame of the projection image provided by the image providing unit based on the detection by the blur movement detection unit. This makes it possible to adjust the blur appropriately for the blur.

  According to another aspect of the present invention, a rectangular image display unit, an image projection unit arranged such that the projection optical axis is in a direction orthogonal to the long side direction of the image display unit, and projection onto the image projection unit A projector having an image providing unit for providing an image is provided. Thus, when a horizontally long projection screen is projected, the image display unit can display the projection image in the largest size and monitor it.

  According to a more specific feature, the image projection unit is arranged at the center in the long side direction of the image display unit. As a result, it is possible to hold the projector in a stable posture that allows easy operation and determination of the projection position, such as holding the projector with both hands.

  According to another aspect of the present invention, an image projection unit, an image providing unit that provides a projection image to the image projection unit, a posture detection unit, and a projection by the image projection unit when the posture detection unit detects a projection inappropriate posture. There is provided a projector having a control unit that prohibits the control. As a result, it is possible to prevent annoying surroundings such as the start of projection of bright projection light due to an erroneous operation when no projection is scheduled. For example, a projector can be installed on a device that originally has another function, such as a built-in mobile phone. It is useful to incorporate. According to a specific feature, the control unit considers that the posture is not projected when the posture detection unit detects a projection posture in which the horizontal inclination of the projection image is greater than or equal to a predetermined value, and projects the image. Prohibition of projection by parts. According to another specific feature, the projector is provided with a menu display unit that displays a function option menu including a projection function, and the control unit performs projection using the function selection menu when the posture detection unit detects an inappropriate projection posture. Configured to disable selection of function selection.

  As described above, according to the present invention, it is possible to provide a useful projector that is easy to use.

It is a perspective view which shows Example 1 of the mobile phone with a projector which concerns on embodiment of this invention. Example 1 1 is a block diagram of Example 1. FIG. FIG. 6 is a projection screen diagram for explaining the basics of camera shake correction in the first embodiment. FIG. 6 is a projection screen diagram illustrating details of camera shake correction of the projection screen frame in the first embodiment. FIG. 6 is a projection screen diagram and a corresponding projection optical path schematic cross-sectional view for explaining camera shake correction when trapezoidal distortion correction is performed in the first embodiment. FIG. 6 is a projection screen diagram and a corresponding projection optical path schematic cross-sectional view for explaining the correspondence to a change in projection plane in camera shake correction when trapezoidal distortion correction is performed in the first embodiment. It is a flowchart of operation | movement of the control part in Example 1 of FIG. It is a flowchart which shows the detail of step S32 of FIG. It is a perspective view which shows Example 2 of the mobile phone with a projector which concerns on embodiment of this invention. (Example 2) It is a projection screen figure for demonstrating the camera-shake correction regarding Example 3 of the mobile phone with a projector which concerns on embodiment of this invention. (Example 3) 10 is a flowchart of the operation of a control unit in Embodiment 3. It is a flowchart which shows the detail of step S86 of FIG.

  FIG. 1 is a perspective view showing Example 1 of the projector-equipped mobile phone according to the embodiment of the present invention. FIG. 1A shows a case where the projector-equipped mobile phone 2 is held vertically and a normal operation for a telephone call or the like is performed using the numeric keypad 6 displayed on the large screen display unit 4. On the other hand, FIG. 1 (B) shows a case where the projector mobile phone 2 is held sideways with both hands and the projection screen 10 is projected from the projector unit 8 onto a wall or the like. Note that in FIG. 1A and FIG. 1B, the same portions are denoted by the same reference numerals in order to avoid duplication of description.

  Hereinafter, FIG. 1 will be described in detail. As shown in FIG. 1A, the projector-equipped mobile phone 2 is configured as a so-called smartphone having a large screen display unit 4 capable of displaying photographs, a website screen, and the like. The large screen display unit 4 also serves as a touch panel, and a GUI (graphical user interface) by touching or sliding a finger on an operation screen including various operation units such as a numeric keypad 6 to be displayed becomes possible. Yes. The operation unit 9 is a mechanical operation unit for turning on and off the main power supply. In addition, the projector-equipped mobile phone 2 is provided with a microphone 12 that picks up sound generated from the operator's mouth and a speaker 14 that transmits the sound to the operator's ear. Further, when the projector-equipped mobile phone 2 is used as a video phone, an inner camera 16 that can capture the face of the operator who is looking at the display unit 4 and is also used for taking a selfie is disposed. . Although not shown in FIG. 1, a rear main camera is provided on the back surface of the projector-equipped mobile phone 2 so that a subject monitored by the display unit 4 can be photographed.

  As shown in FIG. 1A, an ultra-small projector unit 8 is built in the left side portion of the projector-equipped mobile phone 2, and its optical axis faces the left side of FIG. As will be described later, the projector-equipped mobile phone 2 is provided with a three-axis acceleration sensor so that the attitude of the projector-equipped mobile phone 2 can be detected by detecting the gravitational acceleration direction. If the speaker 14 is in an inclined posture such that the speaker 14 comes above a predetermined angle above the microphone 12 as in the operation state in a vertical position as shown in FIG. Considering that the situation is not the case where the projection by the unit 8 is performed, the projection is prohibited even if the projection operation is mistakenly performed. This has the meaning of avoiding unnecessary power consumption while preventing operations that cause trouble to the surroundings.

  On the other hand, in the projection posture of FIG. 1 (B), the projector-equipped mobile phone 2 is held sideways, so that the acceleration sensor detects that the speaker 14 and the microphone 12 are substantially horizontal. Projector mode operation for projecting the projection screen 10 onto the wall or the like from the projector unit 8 is permitted. At this time, since the projection screen 10 may be projected above the ceiling or wall or below the floor or wall, the horizontal direction in FIG. 1B is around the line connecting the speaker 14 and the microphone 12. In any direction of 360 degrees, the projector mode operation is permitted regardless of the direction of the projection optical axis.

  Note that the projector mode is prohibited by disappearing from the menu screen options displayed on the large screen display unit 4 as long as the acceleration sensor detects that the projector-equipped mobile phone 2 is held vertically as described above. However, it is added to the menu screen choices where the horizontal holding state is detected, and the selection is permitted. When the projector mode is selected, the right-hand thumb operation unit 18 and the left-hand thumb operation unit 20 are displayed on the large screen display unit 4, and the projection screen can be selected or enlarged by a combination of both-hand thumb touch and slide operation in these parts. , Reduction, scrolling, etc. are possible. Such a thumb operation with both hands in the landscape state is suitable for a game screen operation or the like. Further, in the projector mode, the projection content 22 is displayed on the large screen display unit 4 in the horizontally long state, and the same projection content 24 is projected on the horizontally long projection screen 10. Therefore, when Example 1 is used for a presentation or the like, it is possible to explain and operate the projection screen 10 while monitoring the maximum possible horizontally long image by the large screen display unit 4.

  FIG. 2 is a block diagram of the first embodiment. The same parts are denoted by the same reference numerals as those in FIG. 1, and the description thereof is omitted unless necessary. The projector-equipped mobile phone 2 is controlled by a control unit 28 that operates according to a program stored in the storage unit 26. The storage unit 26 can also temporarily store data necessary for control by the control unit 28 and can also store various measurement data and images. Display on the display unit 4 is performed by the display driver 32 based on display data held in the display memory 30. The control is performed by the control unit 28. The display unit 4 has a display backlight 34, and the control 28 automatically adjusts the brightness of the display backlight 34 based on the ambient brightness detected by the illuminance sensor 36.

The telephone function unit 38 including the microphone 12 and the speaker 14 can be connected to a wireless telephone line by a telephone communication unit 40 under the control of the control unit 28. The speaker 14 performs not only a call but also a ring tone and various guidance and outputs the voice of the other party at the time of the videophone by volume control based on the control of the control unit 28. In addition, a dedicated speaker may be provided for outputting sounds other than the sounds that are put on the ears.
The image processing unit 42 is controlled by the control unit 28 to process images captured by the inner camera 16 and the rear main camera 44, and inputs images of these processing results to the storage unit 42.

  The projector unit 8 uses the red laser diode 46, the green laser diode 48, and the blue laser diode 50 as light sources, synthesizes each of the RGB laser beams from these using a combining prism 52, and scans the MEMS (Micro Electro Mechanical Systems) mirror unit 52. Thus, the projection screen 10 is projected onto the wall 5 or the like, and an ultra-compact projector engine without a projection lens is configured. Then, the projection controller 54 controls the projection screen 10 by synchronously controlling the emission intensity of each of the red laser diode 46, the green laser diode 48, and the blue laser diode 50 and the scanning of the MEMS mirror unit 52 based on the input display data. I'm drawing.

  Display data input to the projector unit 8 is input from the display memory 30 via the camera shake / trapezoid correction unit 56. The camera shake / trapezoid correction unit 56 performs image processing based on display data at a speed that can correspond to the scan rate for screen rewriting of the projector unit 8 (vertical scan rate if the scanning direction is horizontal), and performs camera shake in units of possible rewrite screens. A corrected image can be created. The image correction processing of the camera shake / trapezoid correction unit 56 is controlled by control of the control unit 28 based on camera shake detection by the XYZ triaxial acceleration sensor 58 and the XYZ triaxial gyro sensor 60. As a result, even if the display data held in the display memory 30 does not change, the display data corrected from the camera shake / trapezoid correction unit 56 based on the detection of the camera shake is output in units of rewritable screens. Thus, even if the projector unit 8 itself does not have a camera shake correction optical system, camera shake correction is performed by electronic image processing. If the scan rate is higher than the camera shake frequency, the correction screen may be created once in several rewrite screens without creating the camera shake correction screen for each rewrite screen. If camera shake is not detected, the creation of the correction screen is omitted, and the previous screen is used unless the display data is changed.

  FIG. 3 is a projection screen diagram for explaining the basics of camera shake correction in the first embodiment. In the following description, the same parts as those in FIG. 1 or FIG. 2 are denoted by the same reference numerals, and the description is omitted unless necessary. FIG. 3A shows a state in which no correction is made even if camera shake occurs, and the projection screen 10 and the projection content 22 therein are projected by blurring in the lower right direction of the hand holding the projector-equipped mobile phone 2. A state of movement as shown in the screen 11 and the projection content 23 is shown. Considering a model in which such blur reciprocation is repeated, as indicated by an arrow 62, the projection content is blurred at the positions 22 and 23, and the projection screen is similarly between the positions 10 and 11. It will be blurred.

  3B, on the other hand, when the projection content 22 is shifted to the lower right like the projection content 23 as shown in FIG. 3A, the projection content 23 in the projection screen 11 is blurred. Indicates a state in which the image is shifted in the opposite upper left direction by image processing, and as a result, the projection content is held at the 22 position. When the next upper left blur occurs due to the reciprocation of the blur, the projection content is shifted in the opposite lower right direction and returned to the position of the projection content 22 in FIG. As a result, the projection content 22 stays at the same position on the wall even if there is a back and forth movement. FIG. 3C shows a state in which the shift correction of the projection content by image processing as described in FIG. 3B is performed when the model of FIG. As described above, the projection content 22 remains at the same position on the wall even if the reciprocation of the blur occurs. As described above, even if the projector unit 8 itself does not have a camera shake correction optical system, the camera shake correction in the projector can be electronically performed by a simple image processing called image shift.

  However, in the case of the correction as shown in FIG. 3, as apparent from FIG. 3C, the blur of the projection content is corrected, but the projection screen is between the positions 10 and 11 indicated by the arrow 64. Will cause blurring. Usually, since the wall on which the projection is performed is dark and the projection screen 10 is bright, when the blur of the projection screen 10 occurs, the clear border of the frame of the projection screen 10 is blurred, and attention is focused on the center of the visual field. Although there is no blurring in the area, the area around the field of view may flicker and feel unsightly.

  In the first embodiment, such a point is further solved. FIG. 4 is a projection screen diagram for explaining details of frame hand-shake correction in such a projection screen. The same parts as those in FIGS. 1 to 3 are denoted by the same reference numerals, and description thereof is omitted unless necessary. In the first embodiment, as shown in FIG. 4A, a correction projection screen 66 is set at a position slightly inside the projection screen 10, and the outside of the correction projection screen 66 is set to a black background and the wall 5. It is assumed that the area has a small difference in brightness. Then, the projection content 22 is slightly reduced so that the relationship between the correction projection screen 66 and the reduced projection content 25 is similar to the relationship between the projection screen 10 and the projection content 22 in FIG.

  In FIG. 4B, when the projection screen 10 is shifted to the lower right side due to camera shake and enters the projection screen 11 state, the projection content in the projection screen 11 is shifted by image processing in the upper left direction opposite to the blur. The state held at the position of the projection content 25 is shown. As long as this is the same as FIG. 3 (B), in FIG. 4 (B), the correction projection screen is also shifted by image processing in the upper left direction opposite to the blur in the projection screen 11 for correction. The state held at the position of the projection screen 66 is shown. As a result, not only the projection content 25 but also the correction projection screen 66 can be corrected.

  4C, in contrast to FIG. 4B, when the projection screen 10 is shifted to the upper left due to camera shake when the reference is made to FIG. 4A, the projection screen 13 is displayed. 13 shows a state in which the projection content in 13 is shifted by image processing in the lower right direction opposite to the blur and held at the position of the projection content 25. Further, the correction projection screen is also shifted in the lower right direction in the projection screen 13 by image processing and held at the position of the correction projection screen 66.

  As described above, in the first embodiment, the correction projection screen 66 uses a room that can be shifted in the projection screen 10, and both the correction content and the correction projection screen are translated in the direction opposite to the deviation of the projection screen. The projection content 25 and the correction projection screen 66 remain in the same position on the wall 5 even if there is a reciprocation of blur between FIG. 4B and FIG. 4C. It will be. As described above, in the first embodiment, even if the projector unit 8 itself does not have a camera shake correction optical system, camera shake correction in the projector can be performed electronically by a simple image processing called image shift, and the projection screen The flickering of the frame portion can also be prevented.

  FIG. 5 is a projection screen diagram and a corresponding projection optical path schematic cross-sectional view for explaining camera shake correction when trapezoidal distortion correction is performed in the first embodiment. In FIG. 5, the same parts as those in FIGS. 1 to 4 are denoted by the same reference numerals, and the description thereof is omitted unless necessary. The projection screen view of FIG. 5A is the same as that of FIG. 4A, but the illustration of the wall 5 is omitted to avoid complication. Further, on the right side of the projection screen diagram of FIG. 5A, a schematic sectional view of the projection optical path corresponding to this state is shown. Note that, as a schematic cross-sectional view of the projection optical path, the orientation of the mobile phone with projector 2 with respect to the wall 5 should be illustrated, but for the sake of understanding, illustrations other than the projector unit 8 that is the main part of the projection are omitted. is doing. As is clear from the drawing, FIG. 5A shows a case where the projection optical axis 51 of the projector unit 8 is projected from the front in a state perpendicular to the wall 5.

  On the other hand, FIGS. 5B to 5E show camera shake correction when trapezoidal distortion correction is performed in a projection state in which the projection optical axis 51 is inclined upward with respect to the wall 5. A model in which camera shake occurs between the state of 5 (B) and the state of FIG. 5 (D) will be described. FIG. 5B shows the lower end of the reciprocation of the projection screen due to camera shake. When correction is not performed, trapezoidal distortion occurs in the projection screen 13 and the correction projection screen 67 as shown in FIG. The projection content 27 inside is also distorted accordingly.

  5C performs image processing for reducing the trapezoidal distortion generated on the correction projection screen 67 of FIG. 5B so that the long side of the trapezoid is the same as the short side, and on the wall 5. The correction is made so as to obtain a rectangular correction projection screen 66. With this correction, the distortion of the projection content 25 in the correction projection screen 66 is also corrected in FIG. Further, the position of the correction projection screen 66 is also translated upward from the center of the projection screen 13 as shown in FIG. 5C, and the correction projection screen 66 and the projection are projected when the projection screen 13 is lowered downward. The movement of the content 25 is corrected.

  On the other hand, FIG. 5D shows the upper end of the reciprocation of the projection screen due to camera shake, and when correction is not performed, the trapezoidal distortion of the projection screen 15 and the correction projection screen 69 is further increased as shown in FIG. The projection content 29 in the projection screen 69 is further distorted accordingly. On the other hand, FIG. 5E is different from FIG. 5C in that the long side of the trapezoid is the same as the short side with respect to the trapezoidal distortion occurring in the correction projection screen 69 of FIG. The image processing to reduce the ratio is performed, and the rectangular correction projection screen 66 is corrected on the wall 5. Similar to the case of FIG. 5C, the distortion of the projection content 25 in the correction projection screen 66 is also corrected along with such correction. Further, in the correction of FIG. 5E, the position of the correction projection screen 66 is also translated downward from the center of the projection screen 15, and the correction projection screen 66 and the projection when the projection screen 15 rises upward. The movement of the content 25 is corrected.

  In the camera shake correction between FIGS. 5C and 5E, not only the vertical translation of the correction projection screen 66 and the projection content 25 but also the correction of FIG. 5B as described above. The trapezoidal distortion correction is performed at different ratios for the expansion and contraction of the upper base and the lower base when obtaining the rectangular correction projection screen 66 from the projection screen 67 for correction and the correction projection screen 69 of FIG. In other words, in the camera shake correction at the time of the trapezoidal distortion correction shown in FIG. 5, not only the correction projection screen accompanying the camera shake and the parallel movement blur of the correction content, but also the figure caused by the change in the degree of the trapezoidal distortion accompanying the camera shake. Correction is also performed for the correction projection screen between 5 (B) and FIG.

  FIG. 6 is a projection screen diagram and a corresponding projection light path schematic cross-sectional view for explaining the correspondence to the change of the projection plane in the camera shake correction when the trapezoidal distortion correction is performed in the first embodiment. In FIG. 6, the same parts as those in FIGS. 1 to 5 are denoted by the same reference numerals, and description thereof is omitted unless necessary. The projection screen view and the projection optical path schematic cross-sectional view of FIG. 6A are the same as those of FIG. 5B and show a state where projection onto the wall 5 is being performed. On the other hand, FIGS. 5B to 5E show camera shake correction when the projection optical axis 51 is further tilted upward and projected onto the ceiling 53, and the state and diagram of FIG. A model in which camera shake occurs between the states of 6 (D) will be described.

  Specifically, FIG. 6B shows a reciprocating lower end state of the projection screen due to camera shake in the projection onto the ceiling 53 (a far end state of the ceiling 53), and when correction is not performed, as shown in FIG. A trapezoidal distortion occurs in the projection screen 17 and the correction projection screen 71, and the projection content 31 in the correction projection screen 71 is also distorted accordingly. FIG. 6C shows a rectangular correction projection screen obtained by performing image processing for expanding and contracting the upper base and the lower base of the trapezoid at different ratios for the trapezoidal distortion generated in the correction projection screen 67 of FIG. 6B. This is corrected to be 66. With this correction, the distortion of the projection content 25 in the correction projection screen 66 is also corrected in FIG. Further, the position of the correction projection screen 66 is also translated from the center of the projection screen 17 toward the upper side (near the ceiling 53) as shown in FIG. 6C, and the projection screen 17 is lowered downward (ceiling). The movement of the correction projection screen 66 and the projection content 25 accompanying the movement of the projection content 25 to the far side of 53 is corrected.

  On the other hand, FIG. 6D shows a reciprocating upper end state of the projection screen due to camera shake in the projection onto the ceiling 53 (a state of the front end of the ceiling 53). The trapezoidal distortion of the correction projection screen 73 is slightly reduced, and the distortion of the projection content 33 in the correction projection screen 73 is also slightly reduced accordingly. On the other hand, FIG. 6E shows a trapezoidal distortion occurring on the correction projection screen 73 in FIG. 6D, with the upper and lower bases of the trapezoid being different from the case of FIG. The image processing to be expanded and contracted is performed to correct the rectangular correction projection screen 66. As in the case of FIG. 6C, the distortion of the projection content 25 in the correction projection screen 66 is also corrected in accordance with such correction. Furthermore, in the correction of FIG. 6E, the position of the correction projection screen 66 is also translated from the center of the projection screen 15 downward (toward the far side of the ceiling 53), and the projection screen 19 rises upward (ceiling). The movement of the correction projection screen 66 and the projection content 25 accompanying the movement toward the front side of 51) is corrected.

  It should be noted here that the projection onto the wall 5 and the ceiling 53 are evident from the comparison between FIG. 5 (B) to FIG. 5 (E) and FIG. 6 (B) to FIG. 6 (E). In the case of projection, there is a difference in camera shake correction in the projector unit 8 in the direction in which the projection optical axis 51 increases in inclination from horizontal to vertical. First, the first difference is the difference between the inclination of the projection optical axis 51 and the shift direction of the correction projection screen 66 and the projection content 25 therein. That is, in the case of projection onto the wall 5, as can be seen from FIG. 5C and FIG. 5E, as the inclination of the projection optical axis 51 increases upward, the correction projection screen 66 and the content of projection therein Image processing is performed so that 25 is shifted from the long side of the trapezoid to the short side. On the other hand, in the case of projection onto the ceiling 53, as can be seen from FIG. 6C and FIG. 6E, the correction projection screen 66 and the projection in the middle are projected as the inclination of the projection optical axis 51 increases upward. Image processing is performed so that the content 25 is shifted from the short side to the long side of the trapezoid.

  The second difference is the difference between the inclination of the projection optical axis 51 and the expansion / contraction ratio between the upper base and the lower base of the trapezoid for correcting the trapezoidal distortion. That is, in the case of projection onto the wall 5, as can be seen from FIGS. 5B and 5D, the rectangular correction projection screen 66 is obtained as the inclination of the projection optical axis 51 increases upward. It is necessary to perform image processing to increase the expansion / contraction ratio of the upper and lower bases of the trapezoid. On the other hand, in the case of projection onto the ceiling 53, as can be seen from FIGS. 6B and 6D, the rectangular correction projection screen 66 is displayed as the inclination of the projection optical axis 51 increases upward. It is necessary to perform image processing so as to reduce the expansion / contraction ratio of the upper base and the lower base of the trapezoid to obtain. When projecting onto the floor, the tilt of the projection optical axis 51 is negative. However, considering the magnitude relationship of the absolute value of the tilt, it can be understood in accordance with the projection onto the ceiling. A description of the first and second differences is omitted.

  The switching for performing different image processing as described above can be manually switched depending on whether the projection to the wall 5 or the projection to the ceiling (or floor) is performed. If the absolute value of the detected inclination of the projection optical axis 51 exceeds a predetermined angle (for example, 45 degrees), it can be regarded that the projection is on the ceiling (or floor) and can be automatically switched.

  FIG. 7 is a flowchart of the operation of the control unit 28 in the first embodiment of FIG. Note that the flow of FIG. 7 mainly illustrates the operation of the projector, so that the operations are extracted with the focus on related functions, and the functions of general mobile phones and the like are shown in the flow of FIG. There are also operations of the control unit 28 that are not. The flow shown in FIG. 7 starts when the main power is turned on by the operation unit 3 of the projector-equipped mobile phone 2. Next, in step S4, it is checked whether or not the projector-equipped mobile phone 2 is set to the projector mode by selection from the menu. When the projector mode setting is detected, the process proceeds to step S8. As described above, when the projector-equipped mobile phone 2 is not horizontally held in the state of FIG. 1B, the projector mode is not displayed on the menu on the display unit 4, and therefore the projector mode is selected. There is no.

  If selection of the projector mode is not detected in step S2, the process proceeds to the normal function in step S6. The normal function in step S6 is a function normally provided in the mobile phone such as a call function. Even when the normal function is being executed in step S6, the projector-equipped mobile phone 2 is in the side-holding state in the state of FIG. 1B and the projector mode is displayed in the menu. It is possible to proceed to step S8 as needed.

  In step S8, a projection process is performed. In this projection processing, screen rewriting for one time according to the scan rate for screen rewriting of the projector unit 8 is executed, and projection of display data is started. In step S8, projection based on the display data transmitted from the camera shake / trapezoid correction unit 56 to the projector unit 8 is executed, and what display data is transferred from the camera shake / trapezoid correction unit 56 to the projector unit. 8 (that is, control of whether display data held in the display memory 30 is transmitted as it is or whether the display data is subjected to camera shake correction or trapezoidal distortion correction) is executed after step S10. .

  In step S10, it is checked whether or not the control unit 28 has instructed display of a new image. If yes, the process proceeds to step S12, the display memory is updated to a new image, and the process proceeds to step S14. On the other hand, if there is no instruction for a new image, the process directly proceeds to step S14. In step S14, it is checked whether or not the acceleration sensor 58 has detected that the average value of the angles of the projection optical axis 51 indicates a predetermined inclination or more. When an average inclination equal to or greater than a predetermined value is detected, the process proceeds to step S16, where image processing for correcting trapezoidal distortion corresponding to the detected average inclination angle is instructed to the camera shake / trapezoid correction unit 56, and the process proceeds to step S18. On the other hand, when the average inclination greater than the predetermined value is not detected, the process directly proceeds to step S18.

  In step S18, it is checked whether or not the camera shake correction mode is selected. If it is the camera shake correction mode, the process proceeds to step S20 to instruct the camera shake / trapezoid correction unit 56 to perform image processing for reducing the projected image frame. This corresponds to reducing the projection screen 10 and the projection content 22 in FIG. 3A to the correction projection screen 66 and the projection content 25 in FIG. Next, in step S22, it is checked whether or not a manual operation for stopping correction is performed on the touch panel. This operation is to prevent unnecessary camera shake correction when shaking the projector-equipped mobile phone 2 in order to change the projection location. For example, this operation is performed before changing the projection location. At the same time, the operation is continued while the projector-equipped mobile phone 2 is being shaken, and a new projection location is determined and the operation is released when the projector-equipped mobile phone 2 is stopped.

  When it is not detected in step S22 that the correction stop operation as described above is performed, the process proceeds to step S24, and whether or not the gyro sensor 60 and the acceleration sensor 58 detect the movement of the projector-equipped mobile phone based on hand shake or the like. To check. If the movement is detected, the process proceeds to step S26, and it is checked whether the detected movement is a continuous movement in the same direction. This check is to prevent unnecessary camera shake correction when shaking the projector-equipped mobile phone 2 in order to change the projection location. Even if this measure is not manually taken in step S22, the check is automatically performed. This is intended to stop camera shake correction.

  If it is confirmed in step S26 that the detected movement is not continuous movement in the same direction, the process proceeds to step S28 to check whether trapezoidal distortion correction is being performed. If trapezoidal distortion correction is in progress, the process proceeds to step S30, a trapezoidal shake correction process is performed, and the process proceeds to step S32. In step S30, the camera shake correction during the trapezoidal distortion correction described with reference to FIGS. 5 and 6 is in charge of correction specific to the trapezoidal distortion correction. On the other hand, if it is not detected in step S28 that trapezoidal distortion is being corrected, the process proceeds to step S32.

  In step S <b> 32, a process for correcting the camera shake of the projection content and correcting the blurring of the frame caused by the camera shake is performed. This processing is in charge of common correction among the camera shake correction described with reference to FIGS. 4 to 6 regardless of the presence or absence of trapezoidal distortion correction. Note that although steps S28 to S32 are illustrated by disassembling the steps into elements for the sake of understanding, these may be executed as a comprehensive integrated process. In the case of processing by element decomposition, step S32 may be performed before step S28 and step S30.

  When the camera shake correction / frame correction image processing in step S32 is completed, the process proceeds to step S34 to check whether the main power supply is turned off. If a correction stop operation is detected in step S22 or if continuous movement in the same direction is detected in step S26, this corresponds to the case where the projector-equipped mobile phone 2 is shaken to change the projection location. The process does not proceed to S28 and thereafter, and the camera shake correction is not performed. Instead, the process proceeds to step S36. If no movement is detected in step S24, there is no need for blur correction, and the process proceeds to step S36. In step S36, correction is performed as shown in FIGS. 4A, 5A, 5B, 5D, 6A, 6B, and 6D. Centering is performed so that the projection screen 66 and the like for the projector come to the center of the projection screen 10. This is to secure room for correction in various directions when camera shake occurs at a new projection position. In other words, for example, if camera shake correction is started from the state as shown in FIG. 4B at a new projection position, when there is a further camera shake movement to the lower right, in order to correct this, Thus, there is almost no room for shifting the correction projection screen 66 further to the upper left. On the other hand, if the correction projection screen 66 is centered in the state as shown in FIG. 4A at a new projection position, it can be shifted as shown in FIG. Even in the absence of camera shake, as in the case where the projector-equipped mobile phone 2 is being shaken, centering is performed in order to secure room for correction of camera shake in various directions that may occur in the future.

  When the centering in step S36 ends, the flow moves to step S34. If it is not detected in step S18 that the camera shake correction mode is selected, the process directly proceeds to step S34. Furthermore, when the normal function in step S6 is completed, the process proceeds to step S34. In step S36, it is checked whether the main power supply is turned off. If the main power source is kept on, the flow returns to step S4. Hereinafter, as long as the projector mode is continued, step S4 and step S8 to step S36 are repeated for each image rewriting timing to perform projection and camera shake. Continue executing correction. If the projector mode is not selected, the normal function is continued.

  FIG. 8 is a flowchart showing details of the camera shake correction / frame correction image processing in step S32 of FIG. When the flow starts, the amount of camera shake movement based on the detection results of the gyro sensor 60 and the acceleration sensor 58 is calculated in step S42. In step S44, it is checked whether the correction is the first time. If it is not the first time movement, the process proceeds to step S46 to analyze the movement tendency based on the past movement data. Based on the analysis result, in step S48, a calculation is performed to add a movement prediction to the movement amount calculated in step S42 and correct it, and the process proceeds to step S50. On the other hand, if it is the first correction, the calculation result of step S42 is directly adopted, and the process directly proceeds to step S50.

  In step S50, an image shift amount is calculated to compensate for camera shake movement. In step S52, it is checked whether the frame of the correction projection screen 66 can be shifted within the frame of the projection screen 10 based on the calculated shift amount. If the calculated shift amount exceeds the frame shift possible amount and shift is impossible, the process proceeds to step S56 to check whether the image priority mode is set. The image priority mode is a mode for correcting so as to stop the blurring of the projected content even if a slight blurring of the projection screen frame is allowed. If the image priority mode is not set, the process proceeds to step S56 to check whether the frame priority mode is set. The image priority mode is a mode for correcting so as to stop the blur of the shadow screen frame even if some blur of the projection content projection is allowed. When the setting of the image priority mode cannot be confirmed, the process proceeds to step S58, and the average of the calculation shift amount and the frame shift possible amount is adopted as the shift amount, and the process proceeds to step S60. As a result, the amount by which the calculated shift amount exceeds the frame shiftable amount is dispersed to the blurring of the projection screen frame and the blurring of the projection content, and it is alleviated that the blurring that stands out only on one side remains.

  On the other hand, if it is confirmed that the shift amount calculated in step S52 does not exceed the frame shiftable amount, or if the setting of the image priority mode is confirmed in step S54, the calculated shift amount is set as the shift amount. Adopt and move to step S60. On the other hand, when the setting of the frame priority mode is confirmed in step S56, the frame shiftable amount is adopted as the shift amount, and the process proceeds to step S60.

  In step S60, it is checked whether it is the first correction, and if it is not the first movement, the process proceeds to step S66 and the movement history is analyzed based on the past movement data. Based on this analysis result, in step S68, it is checked whether the center of the hand movement is shifted. The center of the hand movement is considered to be the projection position intended by the operator, and if this moves, the image correction for returning to the original position becomes inappropriate. If a movement center shift is detected in step S68, the process proceeds to step S70, the image processing shift amount is corrected to follow the center moved in step S70, and the process proceeds to step S72. On the other hand, when it is confirmed in step S60 that the correction is the initial correction, or if it is confirmed in step S68 that there is no movement center shift, the shift amount determined in step S58 or step S62 or step S64 is used as it is. Adopt and go directly to step S72. In step S72, the camera shake / trapezoid correction unit 56 is instructed to perform image processing for shifting the correction projection screen frame and the correction content therein based on the shift amount thus determined, and the flow is ended.

  FIG. 9 is a perspective view showing Example 2 of the projector-equipped mobile phone according to the embodiment of the present invention. In the second embodiment, the projector unit 108 can be rotated by 90 degrees and can be projected both vertically and horizontally. Since Example 2 has many parts in common with Example 1, each part is numbered in the 100s, and the corresponding parts are described in common unless the tenth and first place numbers are common. Is omitted.

  More specifically, FIG. 9A shows a case where the projector-equipped mobile phone 2 is held vertically with one hand and the projection screen 110 is projected. As is apparent from the figure, in the second embodiment, the projector unit 108 is disposed at the upper left corner in the vertically held state. In the vertically held state, the projection content 122 is displayed on the upper half of the large screen display unit 104, and the projection screen 110 can be explained and operated while monitoring this. To prevent unnecessary camera shake correction when changing the projection location in the one-handed operation of FIG. 9A, the projector-equipped mobile phone 102 is shaken while pressing the correction stop button 118. Then, the correction stop button 118 is released when the new projection location is determined and the mobile phone 102 with the projector is stopped. This restarts the camera shake correction.

  In FIG. 9B, the projector unit 108 in the state of FIG. 9A is rotated by 90 degrees as indicated by an arrow 109 to be in the horizontal holding state, and is rotated to be in the horizontal holding state. Show the state. FIG. 9B is the same as FIG. 1B except that the projector unit 108 is positioned at the upper right corner, and thus further description is omitted. Also in the second embodiment, the details of the functions described with reference to the block diagram and FIGS. 3 to 8 can be employed.

  FIG. 10 is a projection screen diagram for explaining camera shake correction related to Example 3 of the projector-equipped mobile phone according to the embodiment of the present invention. In addition, about the external appearance and block diagram of Example 3, since the thing of Example 1 can be used, illustration is abbreviate | omitted. In the camera shake correction according to the first embodiment, as shown in the projection screen diagram of FIG. 4A, the correction projection screen 66 is set at a position slightly inside the projection screen 10 and the projection content 22 is slightly reduced. Further, not only the projection content 25 but also the correction projection screen 66 is configured to perform camera shake correction. On the other hand, in the third embodiment, camera shake correction is performed only for the projection content 22 without reducing the projection screen 10 and the projection content 22. The projection screen is configured to blur the frame of the projection screen 10 as shown in FIG. 10 so that the flicker caused by the blur as shown by the arrow 64 in FIG. 3C does not stand out. In the embodiment of FIG. 10, the same reference numerals are given to the portions corresponding to those of FIGS. 3 and 4 for comparison with the first embodiment.

  More specifically, as shown in FIG. 10A, the projection screen 10 is provided with a gradation 68 that gradually darkens from the inside of the projection screen 10 toward the frame. The boundary with is blurred. FIG. 10B shows that when the projection screen 10 is shifted to the lower right due to camera shake, and the projection screen 11 is brought into a state, the projection content in the projection screen 11 is shifted by image processing in the upper left direction opposite to the blur. The state held at the position of the projection content 22 is shown. In contrast to FIG. 10B, FIG. 10C shows the projection screen 10 when the projection screen 10 is shifted to the upper left due to camera shake when the screen of FIG. 13 shows a state in which the projection content in 13 is shifted by image processing in the lower right direction opposite to blurring and held at the position of the projection content 22. As described above, in the third embodiment, the frame of the projection screen 10 moves with camera shake. However, since the boundary between the projection screen 10 and the wall 5 is blurred, the flicker caused by the boundary becomes inconspicuous. Yes. As described above, in the third embodiment, the problem of frame blur due to camera shake is reduced without reducing the projection content in order to make room for correcting the blur of the frame of the projection screen as in the first embodiment.

  FIG. 11 is a flowchart of the operation of the control unit 28 (assisted by FIG. 2) in the third embodiment of FIG. Since the flowchart of FIG. 11 has many parts in common with the flowchart of the first embodiment in FIG. 7, the same steps are denoted by the same step numbers and description thereof is omitted, and different parts are indicated by bold letters. Further, in FIG. 7, the existing steps S14 and S16 relating to the trapezoid correction and the step S20 relating to the reduction of the projected screen frame are deleted.

  The flowchart of the third embodiment in FIG. 11 differs from the flowchart of the first embodiment in FIG. 7 in the step following step S26 and the step following step S36 as shown in bold. Specifically, when it is confirmed in step S26 that a movement that is not continuous movement in the same direction is detected, the process proceeds to step S82. In other words, when camera shake is detected in the camera shake correction mode when the correction stop operation is not performed, the process proceeds from step S26 to step S82, and processing for calculating the amplitude of the reciprocating movement due to the detected camera shake is performed. Next, in step S84, the blurring amount of the projection frame (the width of the gradation 68 in FIG. 10) is determined according to the calculated movement amplitude. Specifically, the gradation is made wider as the movement amplitude is larger. After blurring the projection frame in this way, camera shake correction image processing in step S86 is performed, and the process proceeds to step S88. The camera shake correction image processing in step S86 is the same as step S32 in FIG. 7 except for the processing related to blur correction of the projection frame, and will be specifically described later.

  On the other hand, if the correction stop operation is detected in step S22, if no movement is detected in step S24, or if continuous movement in the same direction is detected in step S26, the centering of step S36 is followed by a projection frame in step S90. The process without blurring is performed, and the process proceeds to step S88. In these cases, since there is no camera shake correction, it is to prevent a region where clear projection content is displayed from being narrowed due to blurring.

  In step S88, it is checked whether panorama setting is performed. The panorama setting is a setting in which a wide range of projection image information is stored in the storage unit 26 and the display data in the display memory is rewritten according to the movement of the projector-equipped mobile phone 2 detected by the gyro sensor 60 and the acceleration sensor 58. is there. In other words, if the panning is performed by shaking the telescope, the part of the landscape that enters the telescope field of view is shifted, and the part of the landscape that enters the projection screen is shifted when the mobile phone with projector 2 is panned. This is a setting for performing a projection effect. When it is detected that panorama setting is performed, the process proceeds to step S92, panorama image panning processing is performed, and the process proceeds to step S34. The process of step S92 is a process of cutting out a part of a wide range of projection image information stored in the storage unit 26 and rewriting the display of the display memory 30 according to the detection data of the gyro sensor 60 and the acceleration sensor 58. On the other hand, if no panorama setting is detected in step S88, the process directly proceeds to step S34.

  In the flow of FIG. 11, similarly to the flow of FIG. 7, steps S4 to S36 and steps S82 to S92 are repeated unless the main power supply is detected to be off in step S34. In this repetition, when the process proceeds from step S86 to step 92 via step S88 for the first time, camera shake correction is performed, but since the next process proceeds from step S26 to step S36 upon detection of panning, the panning is substantially performed. In the middle, the image whose display content is centered is projected without blurring of the projection frame. However, even in the panorama setting, when panning is stopped, it is possible to enter step S82 from step S26, so that camera shake correction processing is performed.

  FIG. 12 is a flowchart showing details of the camera shake correction image processing in step S86 of FIG. As described above, step S86 in FIG. 11 is the same as step S32 in FIG. 7 except for the processing related to blur correction of the projection frame, and therefore the same step number is assigned to the same step and the description thereof is omitted. Only the difference from FIG. 7 will be described. In FIG. 12, the shift amount is always set as the calculation shift amount, and the process proceeds from step S50 to step S60. Step S94 is image shift image processing, and is image processing in which the relative relationship between the projection frame blurred with gradation and the projection content changes.

  The implementation of various features of the present invention is not limited to the above-described embodiments, and various modifications are possible as long as the advantages can be enjoyed. For example, in the projection frame correction according to the first embodiment, when the correction projection screen 66 is set in FIG. 4, the projection content 25 is also reduced to a similar shape, but instead the projection content 22 is reduced. Instead, a portion protruding from the correction projection screen 66 to the projection frame 10 may be cut and projected.

  In addition, the implementation of various features of the present invention is not limited to the above-described embodiments, and can be implemented in other various forms as long as the advantages can be enjoyed. For example, in the embodiment, the projector unit is built in the mobile phone, but can be implemented as a single portable projector, and can be implemented in various other portable devices such as a music player. Is also possible.

  Furthermore, various features of each embodiment are not unique to each embodiment, and can be appropriately replaced or used together. For example, the configuration in which the projection frame is blurred in the third embodiment can be used in the first embodiment. In this case, for example, it is useful when the frame priority mode described in step 56 of FIG. More specifically, when step S62 or step S58 in FIG. 8 is reached, a gradation having a width corresponding to the amount of camera shake that cannot be corrected is attached to the projection frame.

The present invention can be applied to a single portable projector, or a portable device such as a portable telephone or a portable music player with a built-in projector.

8 Image projection unit 30 Image providing unit 58, 60 Shake movement detection unit 4, 104 Image display unit 58 Posture detection unit 28 Control unit 4, 104 Menu display unit

Claims (20)

  An image projecting unit, an image providing unit that provides a projection image to the image projecting unit, a blur movement detecting unit that detects a blur movement of the image projecting unit, and a direction for correcting the blur based on the detection of the blur movement detecting unit And an image processing unit for shifting an image provided by the image providing unit.   The projector according to claim 1, wherein the image processing unit further corrects a projection frame of a projection image provided by the image providing unit based on detection by the blur movement detection unit.   The projector according to claim 2, wherein the image processing unit shifts a projection frame of a projection image provided by the image providing unit based on detection by the blur movement detection unit.   The projector according to claim 2, wherein the image processing unit reduces a projection frame of a projection image provided by the image providing unit within a projection range based on detection by the blur movement detection unit.   The projector according to claim 4, wherein the image processing unit reduces a projection image provided by the image providing unit within a reduced projection frame based on detection by the blur movement detection unit.   5. The image processing unit reduces an image shift amount provided by the image providing unit when a projection frame reduced based on detection by the blur movement detection unit cannot be shifted within a projection range. Or the projector of 5.   The projector according to claim 2, wherein the image processing unit blurs a projection frame of a projection image provided by the image providing unit.   The projector according to claim 7, wherein the image processing unit changes a blur amount in a projection frame of a projection image provided by the image providing unit based on detection by the blur movement detection unit.   9. The image projection unit according to claim 1, further comprising: a rectangular image display unit, wherein the image projection unit is arranged such that a projection optical axis thereof is in a direction orthogonal to a long side direction of the image display unit. A projector according to any one of the above.   The projector according to claim 9, wherein the image projection unit is arranged at a central portion in a long side direction of the image display unit.   The projector according to claim 1, further comprising: a posture detection unit; and a control unit that prohibits projection by the image projection unit when the posture detection unit detects an inappropriate projection posture.   The projector according to claim 11, wherein the control unit prohibits projection by the image projection unit when the posture detection unit detects a projection posture in which a horizontal inclination of the projection image is greater than or equal to a predetermined value.   A projector comprising: an image projecting unit; an image providing unit that provides a projected image to the image projecting unit; and an image processing unit that blurs a projection frame of a projected image provided by the image providing unit.   A blur movement detection unit that detects a blur movement of the image projection unit, wherein the image processing unit blurs a projection frame of a projection image provided by the image providing unit based on the detection of the blur movement detection unit; The projector according to claim 13.   The projector according to claim 14, wherein the image processing unit changes a blur amount in a projection frame of a projection image provided by the image providing unit based on detection by the blur movement detection unit.   A rectangular image display unit, an image projection unit arranged so that a projection optical axis is in a direction orthogonal to a long side direction of the image display unit, and an image providing unit that provides a projection image to the image projection unit A projector comprising:   The projector according to claim 16, wherein the image projection unit is disposed at a central portion in a long side direction of the image display unit.   An image projecting unit; an image providing unit that provides a projection image to the image projecting unit; a posture detecting unit; and a control unit that prohibits projection by the image projecting unit when the posture detecting unit detects an inappropriate projection posture. A projector comprising:   The projector according to claim 18, wherein the control unit prohibits projection by the image projection unit when the posture detection unit detects a projection posture in which a horizontal inclination of the projection image is equal to or greater than a predetermined value.   A menu display unit that displays a function option menu including a projection function, and the control unit disables selection of a projection function selection by the function selection menu when the posture detection unit detects an inappropriate projection posture. The projector according to claim 18 or 19, characterized in that