JP2011248149A - Portable electronic device and image projection unit - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a portable electronic device and an image projection unit capable of easily displaying an image with higher validity on a projection plane.SOLUTION: A housing, an image projection unit which is included in the housing and projects an image onto a projection area, and a processing unit which obtains information on a specified projection image corresponding to a first image previously arranged on the projection area and projects the specified projection image based on the obtained information from the image projection unit. The specified projection image is an image related to the image on the projection area, thereby the portable electronic device and the image projection unit can easily display the image with higher validity on a projection plane.

Description

  The present invention relates to a portable electronic device having an image projection unit that projects an image on a screen or a wall surface, and an image projection unit.

  Conventionally, as a device for projecting an image on a wall surface or a screen, there is a so-called projector. This projector is mainly a so-called stationary apparatus that is supplied with power from a commercial power source and is used in a fixed state. This stationary projector projects an image on a fixed wall or screen in a fixed state.

  In contrast, in recent years, portable projectors that are small and easy to carry have been proposed. For example, Patent Document 1 includes a projector-equipped mobile phone that includes an upper cabinet, a lower cabinet, and a hinge portion that rotatably connects the upper cabinet and the lower cabinet to each other, and is equipped with a projector having a lens and a light source. The terminal is listed.

  Moreover, as a portable electronic device having a function of projecting an image, as disclosed in Patent Document 2 to Patent Document 4, an operation key is projected by an image projection unit, and an input to the projection surface is detected by an input detection unit. A portable electronic device that can be operated is described. Patent Document 2 describes a touch panel as input detection means, and Patent Document 3 describes a detection device that detects an obstacle on an image projection area as input detection means. Japanese Patent Application Laid-Open No. H10-228688 describes using a white or printed sheet as a screen for projecting an image including operation keys.

JP 2007-96542 A JP 2003-152851 A Japanese Patent Laid-Open No. 2006-29579 JP 2005-222544 A

  As described in Patent Document 2 to Patent Document 4, by using the projected image as a part of the operation unit, the image projection unit can be effectively used. However, the image projection unit cannot be sufficiently utilized by merely utilizing the image projected by the image projection unit as a part of the operation unit.

  In addition, since the image projection unit provided in the portable electronic device has a lower resolution than the fixed image projection unit, it may be difficult to read when displayed at a high resolution such as characters.

  SUMMARY OF THE INVENTION An object of the present invention is to provide a portable electronic device and an image projection unit that can easily display a more effective image on a projection surface.

  In order to solve the above-described problems and achieve the object, a mobile electronic device according to the present invention includes a housing, an image projection unit that is provided in the housing and projects an image on a projection region, and the projection region A processing unit that acquires information of the specific projection image corresponding to the first image previously arranged in the image and projects the specific projection image from the image projection unit based on the acquired information, and the specific projection image Is an image related to the image of the projection area.

  Moreover, it is preferable that the said housing | casing has a connection mechanism connected with a support stand.

  The image projection unit further includes an imaging unit that captures an image in a direction in which the image is projected, and the processing unit determines a first image of the projection region based on the image captured by the imaging unit. Preferably, the corresponding specific projection image is projected based on the determined result.

  Further, it is preferable that the processing unit switches the specific projection image to be projected when detecting that the image of the projection area is switched based on the image captured by the imaging unit.

  The processing unit may adjust a size of the specific projection image to be projected based on an image captured by the imaging unit, and project the specific projection image at a predetermined position in the projection region. preferable.

  Moreover, it is preferable that the said process part acquires identification information from the image image | photographed by the said imaging | photography part, and determines the 1st image of a projection area | region based on the acquired identification information.

  In order to solve the above-described problems and achieve the object, an image projection unit according to the present invention is connected to the portable electronic device described above and the connection mechanism, and fixes the portable electronic device in a specific posture. A portable device comprising: a support table; a dedicated screen fixed to the support table; and disposed on the projection area; and a printed matter that is held on the dedicated screen and on which the first image is disposed. The electronic device projects an image related to the first image as the specific projection image.

  Moreover, it is preferable that the dedicated screen has a guide formed on the surface indicating the installation position of the printed matter.

  INDUSTRIAL APPLICABILITY The portable electronic device and the image projection unit according to the present invention have an effect that an image with higher effectiveness can be easily displayed on the projection surface.

FIG. 1 is a front view illustrating a schematic configuration of an embodiment of a portable electronic device according to the embodiment. FIG. 2 is a side view of the portable electronic device shown in FIG. FIG. 3 is a block diagram illustrating a schematic configuration of functions of the portable electronic device illustrated in FIGS. 1 and 2. FIG. 4 is an explanatory diagram showing a state in which an image is displayed by the projector of the portable electronic device shown in FIG. FIG. 5 is a flowchart for explaining an example of the operation of the portable electronic device. FIG. 6A is an explanatory diagram for explaining another example of the operation of the mobile electronic device. FIG. 6B is an explanatory diagram for explaining another example of the operation of the mobile electronic device. FIG. 7A is an explanatory diagram for explaining an example of the operation of the mobile electronic device. FIG. 7B is an explanatory diagram for explaining an example of the operation of the mobile electronic device. FIG. 8 is an explanatory diagram for explaining the operation of the portable electronic device. FIG. 9A is a perspective view for explaining a schematic configuration of the image projection unit. FIG. 9-2 is an explanatory diagram for explaining a schematic configuration of the portable electronic device of the image projection unit. FIG. 10A is a perspective view for explaining a schematic configuration of the dedicated screen and the support base. FIG. 10-2 is a top view for explaining a schematic configuration of the dedicated screen and the support base.

  Hereinafter, the present invention will be described in detail with reference to the drawings. The present invention is not limited to the following description. In addition, constituent elements in the following description include those that can be easily assumed by those skilled in the art, those that are substantially the same, and those in a so-called equivalent range. In the following, a cellular phone is taken as an example of a portable electronic device, but the application target of the present invention is not limited to a cellular phone. For example, a PHS (Personal Handy-phone System), a PDA, a portable navigation device, a notebook The present invention can also be applied to personal computers, game machines, and the like.

  FIG. 1 is a front view showing a schematic configuration of an embodiment of a portable electronic device according to the embodiment, and FIG. 2 is a side view of the portable electronic device shown in FIG. A portable electronic device 1 shown in FIGS. 1 and 2 is a mobile phone having a wireless communication function, an output unit, a voice acquisition unit, and an imaging unit. In the portable electronic device 1, the housing 1C is composed of a plurality of housings. Specifically, the housing 1C is configured to be openable and closable by a first housing 1CA and a second housing 1CB. That is, the portable electronic device 1 has a foldable housing. In addition, the housing | casing of the portable electronic device 1 is not limited to such a structure. For example, the casing of the portable electronic device 1 may be a sliding casing that allows one casing and the other casing to slide from each other in a state where both casings are overlapped, It may be a rotary type in which one casing is rotated around an axis along the overlapping direction, or both casings are connected via a biaxial hinge.

  1st housing | casing 1CA and 2nd housing | casing 1CB are connected by the hinge mechanism 8 which is a connection part. By connecting the first casing 1CA and the second casing 1CB with the hinge mechanism 8, the first casing 1CA and the second casing 1CB rotate together around the hinge mechanism 8 and move away from each other. And it is comprised so that it can rotate in the direction (direction shown by arrow R of FIG. 2) which mutually approaches. When the first casing 1CA and the second casing 1CB rotate in a direction away from each other, the portable electronic device 1 opens, and when the first casing 1CA and the second casing 1CB rotate in a direction approaching each other, the portable electronic device 1 opens. The device 1 is closed and folded (a state indicated by a dotted line in FIG. 2).

  The first housing 1CA is provided with a display 2 shown in FIG. 1 as a display unit. The display 2 displays a standby image when the portable electronic device 1 is waiting for reception, or displays a menu image used for assisting the operation of the portable electronic device 1. In addition, the first housing 1CA is provided with a receiver 16 that is an output unit that outputs sound when the mobile electronic device 1 is in a call.

  The second casing 1CB is provided with a plurality of operation keys 13A for inputting a telephone number of a call partner, a mail, etc., and selection and determination of a menu displayed on the display 2 and a screen. A direction and determination key 13B for easily executing scrolling and the like are provided. The operation key 13 </ b> A and the direction / decision key 13 </ b> B constitute the operation unit 13 of the mobile electronic device 1. In addition, the second casing 1CB is provided with a microphone 15 that is a voice acquisition unit that receives voice when the mobile electronic device 1 is in a call. The operation unit 13 is provided on the operation surface 1PC of the second housing 1CB shown in FIG. The surface opposite to the operation surface 1PC is the back surface 1PB of the portable electronic device 1.

  An antenna is provided inside the second housing 1CB. The antenna is a transmission / reception antenna used for wireless communication, and is used for transmission / reception of radio waves (electromagnetic waves) related to calls, electronic mails, and the like between the portable electronic device 1 and a base station. In addition, the microphone 15 is provided in the second housing 1CB. The microphone 15 is arranged on the operation surface 1PC side of the portable electronic device 1 shown in FIG.

  On the side opposite to the hinge mechanism 8 of the first housing 1CA, a projector 34 that is an image projection unit and a camera 40 that captures (acquires) an image of the surface on which the image is projected are provided. In addition, the light emission part of the projector 34 and the imaging | photography window of the camera 40 are exposed outside the 1st housing | casing 1CA. With such a configuration, the projector 34 can project an image onto the projection target. In addition, by acquiring the distance from the image projected by the camera 40, the image projected by the projector 34 can be automatically focused. Note that the size and focal length of the image to be projected can be adjusted by acquiring an image of the area where the image is projected by the camera 40.

  FIG. 3 is a block diagram illustrating a schematic configuration of functions of the portable electronic device illustrated in FIGS. 1 and 2. As shown in FIG. 3, the mobile electronic device 1 includes a processing unit 22, a storage unit 24, an external storage unit 25, a transmission / reception unit 26, an operation unit 13, an audio processing unit 30, a display unit 32, A projector 34 and a camera 40 are included. The processing unit 22 has a function of comprehensively controlling the overall operation of the mobile electronic device 1. In other words, the processing unit 22 transmits and receives various processes of the mobile electronic device 1 so as to be executed in an appropriate procedure according to the operation of the operation unit 13 and the software stored in the storage unit 24 of the mobile electronic device 1. The operations of the unit 26, the voice processing unit 30, the display unit 32, and the like are controlled.

  Various processes of the portable electronic device 1 include, for example, a voice call performed via a circuit switching network, creation and transmission / reception of an electronic mail, browsing of a Web (World Wide Web) site on the Internet, and the like. Examples of operations of the transmission / reception unit 26, the audio processing unit 30, and the display unit 32 include transmission / reception of signals by the transmission / reception unit 26, input / output of audio by the audio processing unit 30, display of images by the display unit 32, and the like. .

  The processing unit 22 executes processing based on a program (for example, an operating system program, application program, etc.) stored in the storage unit 24. The processing unit 22 is constituted by, for example, a microprocessor unit (MPU: Micro Processing Unit), and executes various processes of the portable electronic device 1 described above in accordance with procedures instructed by the software. That is, the processing unit 22 sequentially reads instruction codes from an operating system program, application program, or the like stored in the storage unit 24 and executes processing.

  The processing unit 22 has a function of executing a plurality of application programs. Examples of application programs executed by the processing unit 22 include an application program that controls driving of the projector 34 and the camera 40, an application program that reads and decodes various image files (image information) from the storage unit 24, and decoding. There are a plurality of application programs such as an application program for displaying the image obtained in this way on the display unit 32 or projecting it on the projector 34.

  In the present embodiment, the processing unit 22 includes a projector control unit 22 a that controls the operation of the projector 34, an image processing unit 22 b that generates an image to be displayed on the projector 34, an image acquired by the camera 40, and an input from the operation unit 13. A condition determination unit 22c that determines the conditions of the projection area based on the above, an attitude / position calculation unit 22d that calculates and calculates the attitude and position of the housing 1C with respect to the projection plane, and an image to be projected on the projector 34 from a plurality of image data A projection image determination unit 22e to determine and a camera control unit 22f to control the operation of the camera 40 are included. The functions of the projector control unit 22a, the image processing unit 22b, the condition determination unit 22c, the posture / position calculation unit 22d, the projection image determination unit 22e, and the camera control unit 22f are hardware configured by the processing unit 22 and the storage unit 24. The hardware resource is realized by executing a task assigned by the control unit of the processing unit 22. Here, a task is a processing unit that cannot be executed at the same time among the entire processing performed by the application software or the processing performed by the same application software.

  The storage unit 24 stores software and data used for processing in the processing unit 22, and includes a task for operating the application program for controlling the driving of the projector 34 and the camera 40, and an image processing program. The task for operating is stored. In addition to these tasks, for example, communication, downloaded voice data, software used by the processing unit 22 to control the storage unit 24, the telephone number or mail address of the communication partner, etc. are described in the storage unit 24. The address book to be managed, voice files such as dial tone and ring tone, temporary data used in the process of software, and the like are stored.

  Note that computer programs and temporary data used in the software processing process are temporarily stored in the work area assigned to the storage unit 24 by the processing unit 22. The storage unit 24 includes, for example, a nonvolatile storage device (nonvolatile semiconductor memory such as ROM: Read Only Memory, a hard disk device, etc.), and a readable / writable storage device (for example, SRAM: Static Random Access Memory, DRAM: Dynamic Random Access Memory).

  The external storage unit 25 is a storage device that includes an external memory and connection terminals, and the external memory is detachable from the housing 1C. Various software and data are stored in the external memory in the same manner as the storage unit 24. The external storage unit 25 connects the external memory and the processing unit 22 via a connection terminal, and writes and reads information to and from the external memory, similarly to the storage unit 24. In addition, since the external memory is detachable from the external storage unit 25, the external memory connected to the processing unit 22 can be exchanged. As the external memory, various storage media such as an SD card (registered trademark), a memory stick (registered trademark), smart media, and a USB memory can be used.

  The transmission / reception unit 26 has an antenna 26a, establishes a radio signal line by a CDMA (Code Division Multiple Access) method or the like with the base station via a channel assigned by the base station, and makes a telephone call with the base station. Perform communication and information communication. The operation unit 13 includes, for example, an operation key 13A to which various functions such as a power key, a call key, a numeric key, a character key, a direction key, a determination key, and a call key are assigned, and a direction and determination key 13B. The When these keys are input by a user operation, a signal corresponding to the operation content is generated. The generated signal is input to the processing unit 22 as a user instruction.

  The audio processing unit 30 executes processing of an audio signal input to the microphone 15 and an audio signal output from the receiver 16 and the speaker 17. That is, the sound processing unit 30 amplifies the sound input from the microphone 15 and executes AD conversion (Analog Digital conversion), and then performs signal processing such as encoding to convert the sound into digital sound data. Output to the processing unit 22. Further, the audio data sent from the processing unit 22 is subjected to processing such as decoding, DA conversion (Digital Analog conversion), and amplification to convert it into an analog audio signal, which is then output to the receiver 16 and the speaker 17. Here, the speaker 17 is disposed in the housing 1C of the portable electronic device 1, and outputs a ringtone, a mail transmission sound, and the like.

  The display unit 32 includes the display 2 described above, and displays a video corresponding to the video data supplied from the processing unit 22 and an image corresponding to the image data on the display panel. The display 2 is constituted by a display panel constituted by, for example, a liquid crystal display (LCD, Liquid Crystal Monitor), an organic EL (Organic Electro-Luminescence) panel, or the like. The display unit 32 may include a sub display in addition to the display 2.

  The projector 34 includes a light source and an optical system that switches whether to project the light emitted from the light source based on image data. In the present embodiment, the projector 34 includes a visible light irradiation device (visible light irradiation means) 31 that is a light source, a drawing device 35 that is an optical system, and a focus adjustment device 39. The visible light irradiation device 31 emits visible laser light. The light in the visible light region is light of 360 nm to 400 nm on the short wavelength side and light of 760 nm to 830 nm on the long wavelength side. In this embodiment, the visible light irradiation device 31 includes R (Red), G (Green), B Irradiate light of three colors (Blue).

  The drawing device 35 combines the three colors of light emitted from the visible light irradiation device 31 and irradiates the image projection target. The drawing device 35 includes a switching element that switches whether to transmit light emitted from the light source, and a mirror that performs raster scanning of the light that has passed through the switching element. The drawing device 35 changes the angle of the laser light emitted from the visible light irradiation device 31 by the mirror and causes the image projection target to scan the laser light, thereby projecting the image onto the image projection target.

  As the mirror, for example, a MEMS (Micro Electro Mechanical System) mirror is used. A MEMS mirror drives a mirror using a piezoelectric element, scans the visible light irradiated from the visible light irradiation apparatus 31, and produces | generates a visible image and an invisible image. In this case, by changing the angle of the light emitted from the light source by the mirror and scanning the light emitted from the light source over the entire surface of the image projection target, a visible image or an invisible image can be projected onto the image projection target. it can. Thus, the projector 34 is a scan-type projector. Note that the configuration of the projector 34 is not limited to that using the laser described above as a light source. For example, the projector 34 may be a projector having a configuration in which a halogen light, an LED light source, or an LD light source is used as a light source, and an LCD (Liquid Crystal Display) or DMD (Digital Micro-mirror Device) is provided in the optical system.

  The focus adjustment device 39 has a function (focus adjustment function) for forming a visible image projected from the drawing device 35 on an image projection target in accordance with a command from the projector control unit 22a. The focus adjustment device 39 includes a focus adjustment mechanism including, for example, a movable lens, and realizes the focus adjustment function by moving the lens. Further, the focus adjustment device 39 may realize the focus adjustment function by performing predetermined image processing on the image data projected by the projector 34 by the image processing unit 22b. Further, the focus adjustment device 39 may realize the focus adjustment function by a focus adjustment function and image processing.

  FIG. 4 is an explanatory diagram showing a state in which an image is displayed by the projector of the portable electronic device shown in FIG. As described above, the projector 34 is an image projection unit that projects an image, and the image projection surface is exposed to the outside of the housing 1 </ b> C of the portable electronic device 1. As shown in FIG. 4, the portable electronic device 1 projects an image from the projector 34, and as shown in FIG. The image P can be projected onto the area (projection area) PA. The operation of the projector 34 is controlled by the processing unit 22, and various images sent from the processing unit 22, such as moving images and presentation materials, are projected and displayed on the projection area PA.

  As described above, the camera 40 is an imaging mechanism that is provided near the light emitting unit of the projector 34 and acquires an image of an area including a projection area. That is, the camera 40 acquires an image in the direction in which the projector 34 emits light. The camera 40 is a shooting mechanism that takes an image with a wider angle of view than the projection angle of the image projected by the projector 34, and takes an image of an area wider than the projection area onto which the image is projected by the projector 34. can do. The portable electronic device 1 is basically configured as described above.

  Next, the image projecting operation of the projector of the portable electronic device will be described with reference to FIG. Here, FIG. 5 is a flowchart showing an example of the operation of the portable electronic device. The operation illustrated in FIG. 5 may be performed whenever the projector 34 is activated, or may be performed when an execution instruction for a mode for performing the operation illustrated in FIG. 5 is input. 5 may be processed by executing an application stored in the storage unit 24, or may be processed by executing an application stored in the external storage unit 25. That is, the program for executing the operation shown in FIG. 5 may be stored in any area. The program can be acquired by downloading from the outside, and can also be acquired by reading from the external storage unit 25. In the flowchart shown in FIG. 5, a specific printed matter is arranged in the projection area of the image of the projector 34 of the portable electronic device 1.

  First, when the activation instruction for the projector 34 is input, the processing unit 22 of the portable electronic device 1 activates the camera 40 and the projector 34 as step S12. If the camera 40 and the projector 34 are activated when the activation instruction is input, the process proceeds to step S14 as it is. Further, the startup process of the projector 34 can be performed by the projector control unit 22a, and the startup process of the camera 40 can be performed by the camera control unit 22f.

  When the processing unit 22 activates the camera 40 and the projector 34 in step S12, the operation of the camera 40 is controlled by the camera control unit 22f in step S14, and an image of the projection area (an image displayed on the projection surface) is displayed. get. When the processing unit 22 acquires the image of the projection area in step S14, the condition determination unit 22c determines the condition of the projection area in step S16. Specifically, the processing unit 22 uses the image processing unit 22b to analyze the captured image of the projection area and detect the configuration of the image displayed in the projection area. Thereafter, the processing unit 22 determines the condition of the projection region based on the configuration of the display image of the projection region detected by the processing in the image processing unit 22b.

  After determining the condition of the projection area in step S16, the processing unit 22 determines an image to be projected by the projection image determination unit 22e as step S18. Specifically, the processing unit 22 specifies the printed material placed in the projection area based on the condition (identification information) of the projection area determined in step S16 by the projection image determination unit 22e, and specifies the specified printed material. The image data corresponding to is extracted and determined as an image to be projected. Note that the image data is stored in the storage unit 24 or the external storage unit 25, and information on the printed material is stored in association with the image data corresponding to the specified printed material. Therefore, the projection image determination unit 22e can extract corresponding image data by searching the image data stored in the storage unit 24 or the external storage unit 25 using the information of the printed matter as a key.

  After determining the image to be projected in step S18, the processing unit 22 controls the operation of the projector 34 by the projector control unit 22a and projects the image determined in step S18 from the projector 34 in step S20.

  When the image is projected in step S20, the processing unit 22 determines in step S22 whether the image of the projection area has been switched, that is, whether the printed matter arranged in the projection area has been switched. This determination can be made, for example, by acquiring an image with the camera 40 and comparing the image with the previous image. The processing unit 22 switches the image in step S22 (Yes in step S22), that is, an image (printed material) different from the image (printed material) arranged in the projection region when acquired in step S14 is displayed in the projection region. If it is determined that there is, the process proceeds to step S14, and the processing from step S14 to step S20 is performed, and the image projected from the projector 34 is switched in accordance with the image in the projection area.

  If it is determined in step S22 that there is no image switching (No in step S22), the processing unit 22 determines in step S24 whether there is an instruction to end projection. If the processing unit 22 determines in step S24 that there is no termination instruction (No in step S24), the processing unit 22 proceeds to step S22 and performs the process of step S22. If it is determined in step S24 that the projection has ended (Yes in step S24), the processing unit 22 stops the camera 40 and the projector 34 and ends this processing in step S26. The camera 40 and the projector 34 can be stopped under the control of the camera control unit 22f and the projector control unit 22a, respectively.

  Next, the portable electronic device 1 will be described in more detail using a specific example. Here, FIGS. 6A and 6B are explanatory diagrams for describing another example of the operation of the portable electronic device. FIGS. 7A and 7B are explanatory diagrams for explaining an example of the operation of the portable electronic device. In addition, in FIGS. 6-1 to 7-2, the portable electronic device 1 is shown as a simple box shape. First, in the example illustrated in FIG. 6A, the printed material 100 is arranged in the projection area. Here, on the printed material 100, an image of a scene of a picture book is printed. Specifically, the printed material 100 is printed with a background image of a house, a tree, a cloud, and a text of the content.

  When the portable electronic device 1 detects that there is the printed material 100 in the projection area, that is, a scene such as a picture book or a predetermined page, by the process shown in FIG. 5, the portable electronic device 1 acquires image data corresponding to the printed material 100, As shown in FIG. 6B, the image of the person 102 is projected from the projector 34 onto the projection area. Thereby, in addition to each printed structure, the image of the person 102 can be displayed on the printed material 100. In the present embodiment, an image of a person is projected, but an object or a landscape may be projected.

  Next, in the example illustrated in FIG. 7A, the printed material 110 is arranged in the projection area. Here, the printed material 110 is a sheet of newspaper. Specifically, on the printed material 110, a newspaper name, a headline, and a sentence of each news content are printed. Further, a frame 111 is printed on the printed material 110, and the inside of the frame 111 is blank.

  When the portable electronic device 1 detects that there is the printed material 110 in the projection area, that is, which newspaper, when and which page by the processing shown in FIG. 5, the portable electronic device 1 acquires image data corresponding to the printed material 110. As shown in 7-2, the image 112 is projected from the projector 34 onto an area corresponding to the frame 111 of the printed material 110 in the projection area. Thereby, in addition to each printed structure, the image 112 can be displayed in the frame 111 on the printed material 110.

  As described above, the mobile electronic device 1 projects an image corresponding to the image in the projection area from the projector 34, that is, creates one image by superimposing the image projected from the projector 34 on the image in the projection area. Therefore, it is possible to create a simple and highly effective image.

  Here, in the case where an image is composed only of printed matter, it cannot be updated after printing, and the image cannot be moved. In addition, when projecting an image using only a projector, it is difficult to display a clear image. In addition, in order to project an easy-to-read image up to fine characters, it is necessary to mount an expensive and high-performance projector, which increases the size of the device, complicates the configuration, and increases the device cost. On the other hand, since the portable electronic device 1 projects a necessary image in accordance with the image of the printed matter in the projection area, it can have both advantages of the printed matter and the projector. For example, a high-resolution image can be displayed on a printed matter, and a part of the image can be moved by a projector, that is, a moving image can be obtained. In addition, since the image projected by the projector 34 of the portable electronic device 1 is also a part of the projection area, the load of image processing can be reduced and the power consumption can be reduced.

  In addition, as described above, since fine characters and images can be printed in advance on a printed matter, the image displayed in the projection area should be a clear and high-resolution image without increasing the performance of the projector. Can do.

  In addition, the portable electronic device 1 can display the content that is completed as one image by combining the printed material and the image projecting device, that is, by projecting the image onto the printed material. Further, the printed material and the image data can be distributed as one product or package. For example, by distributing a printed matter and an external memory storing image data as a package, the user can connect the external memory to the external storage unit 25 of the portable electronic device 1 to acquire image data, and obtain a projection area. By arranging the printed material on the image, the image stored in the external memory can be projected onto the printed material in the photographing area.

  Further, since only one of the printed material and the image data is not completed as an image, it is possible to prevent the image from being duplicated or sold without permission by managing one of the image data and the printed material. For example, by limiting the number of times image data can be acquired for a single printed matter and the number of terminals that can be acquired, or setting image data to be sent to the image data provider when acquiring image data, The use of can be restricted. Thereby, the completed image can be viewed only by a specific user.

  Here, various image processing methods can be used as a method for specifying an image (for example, a printed material) arranged in the display area from the image acquired by the mobile electronic device 1 with the camera 40. For example, the mobile electronic device 1 identifies the image of the projection area by extracting identification information such as specific characters and symbols from the image of the projection area such as a printed matter, a drawn picture, and written characters. Can do. Moreover, the portable electronic device 1 can specify an image in the projection region by performing edge detection on four sides and the like. Hereinafter, an example will be described with reference to FIG. Here, FIG. 8 is an explanatory diagram for explaining the operation of the portable electronic device. In FIG. 8, the portable electronic device 1 is shown as a simple box shape. In the example shown in FIG. 8, the printed material 120 is arranged in the projection area. The printed matter 120 is a newspaper page on which a character string 122 describing the name of the newspaper, a headline, and a sentence of each news content are printed. A two-dimensional barcode 124 is printed on the printed matter 120.

  The portable electronic device 1 can specify that the printed matter in the projection area is a newspaper by extracting the character string 122 from the image acquired by the camera 40. Note that the portable electronic device 1 can more appropriately specify the printed matter by taking into account the position information of the character string 122 in the entire projection area, that is, taking into account the layout information. In this case, the portable electronic device 1 can further specify the printed matter by obtaining information on the date of issue and the number of pages from the image. The portable electronic device 1 can also specify a printed matter by extracting the two-dimensional barcode 124 from the image acquired by the camera 40. When the two-dimensional barcode 124 is used, information on whether the printed matter is a newspaper, the date of issue, and the number of pages can be included in the two-dimensional barcode. Thereby, the portable electronic device 1 can specify the printed matter only by reading the two-dimensional barcode 124.

  As described above, the portable electronic device 1 identifies the image of the projection area, acquires an image corresponding to the identified image, and projects the image on the projection area, thereby converting the image previously arranged in the projection area. An image in which the projected images are superimposed can be displayed.

  In addition, although the portable electronic device 1 specified the image to project from the image data memorize | stored in the memory | storage part 24 or the external memory | storage part 25, this invention is not limited to this. The portable electronic device 1 may acquire an image to be projected from an external server or the like by communication via the transmission / reception unit 26. For example, if a printed material is specified as an image in the projection area, the data of the image to be projected may be acquired by accessing a database of a publisher that issues the printed material. When using a two-dimensional barcode, the URL may be included in the information of the two-dimensional barcode. Moreover, you may print URL which preserve | saved the data of the image to project on a part of printed matter.

  The mobile electronic device 1 may process an image to be projected corresponding to the image in the projection area. Further, an image processed by the portable electronic device 1 or a created image may be used as the image associated with the image of the projection area. Further, an image set in advance in association with the image of the projection area may be changed. When changing the image to be associated, the storage unit 24 or the external storage unit 25 may store the changed image plus the association data of the identification information of the image of the projection area.

  The portable electronic device 1 calculates the distance from the image data acquired by the camera 40 to the projection area (projection plane) and the positional relationship with the image of the projection area, and the image projected from the projector 34 is within the projection area. You may make it adjust a position and a magnitude | size. In addition, the portable electronic device 1 acquires an image of the projection area in a state where the image is projected by the projector 34, and adjusts the position and size of the image projected from the projector 34 in the projection area based on the acquisition result. You may do it. As described above, by adjusting the position and size of the image to be projected in the projection area, a more appropriate image can be displayed in the projection area.

  In addition, the mobile electronic device 1 causes the display unit 32 to display an image obtained by combining the image acquired by the camera 40 and the image to be projected, that is, an image displayed in the projection area (a predicted image in a projected state). It may be. Thereby, the image projected on the projection area can be confirmed on the display unit 32. Note that the portable electronic device 1 may project an image from the projector 34 after a projection permission operation is input.

  In the above-described embodiment, the user's operation becomes easier and the load can be reduced. Therefore, the camera acquires the image of the projection area, specifies the image of the projection area, and automatically determines the image to be projected. However, the present invention is not limited to this. For example, the user inputs an operation to the operation unit 13, selects an image corresponding to the image in the projection area as an image to be projected, and inputs a projection instruction for the selected image. The images projected from 34 may be overlapped so that one image is displayed in the display area. Also in this case, it is possible to display one completed image by acquiring image data created as an image associated with the image of the projection region.

  Moreover, in the said embodiment, although the portable electronic device 1 was made into the state which can move with respect to a projection area | region, this invention is not limited to this, The special screen used as a projection area | region is provided, It is good also as a unit which fixes the portable electronic device 1 to a specific position. Here, FIG. 9-1 is a perspective view for explaining a schematic configuration of the image projection unit, and FIG. 9-2 is an explanatory diagram for explaining a schematic configuration of the portable electronic device of the image projection unit. . FIG. 10-1 is a perspective view for explaining a schematic configuration of the dedicated screen and the support base, and FIG. 10-2 is a top view for explaining a schematic configuration of the dedicated screen and the support base. FIGS. 10A and 10B both show a state where the printed material is placed on a dedicated screen. An image projection unit 200 illustrated in FIG. 9A includes a portable electronic device 201, a support base 202, and a dedicated screen 204.

  As shown in FIG. 9B, the portable electronic device 201 has a rectangular parallelepiped housing 201C. Further, a connecting mechanism 220 for connecting to the support base 202 is provided on one surface of the housing 201C, and a light emitting portion of the projector 234 is provided on an end surface in the longitudinal direction of the housing 201C. Except for these points, the portable electronic device 201 is basically similar to the portable electronic device 1 in other configurations, and thus the description thereof is omitted.

  As illustrated in FIGS. 10A and 10B, the support base 202 is a support mechanism that fixes the portable electronic device 201 in a predetermined position, and includes a connection mechanism 222 that is connected to the connection mechanism 220 of the housing 201C. Yes. For example, when the connection mechanism 220 is a screw hole, the connection mechanism 222 of the support base 202 is a screw. The support base 202 is fixed to the dedicated screen 204.

  As illustrated in FIGS. 10A and 10B, the dedicated screen 204 is a plate-like member, and the surface faces the fixed position of the portable electronic device 201. As illustrated in FIG. 9A, the dedicated screen 204 projects an image output from the projector 234 of the portable electronic device 201 fixed to the support base 202. That is, the projection area 205 of the projector 234 becomes a predetermined area on the surface of the dedicated screen 204.

  The dedicated screen 204 has an installation area on the surface where the printed material 206 is installed. Further, the dedicated screen 204 has a guide display 210 formed on the surface thereof. Here, the guidance display 210 indicates a reference for the placement position of the printed material 206 placed on the surface of the dedicated screen 204. By placing the printed material 206 so that the position where the guidance display 210 is displayed is the center in one direction, the relationship between the projection region 205 and the printed material 206 becomes constant.

  The image projection unit 200 has the above-described configuration, and the printed matter 206 in the projection region 205 is fixed by fixing the portable electronic device 201 to the support base 202 and placing the printed matter 206 at a predetermined position on the dedicated screen 204. An image corresponding to the printed material 206 can be projected from the projector 234.

  Here, in the image projection unit 200, the positional relationship between the projection area and the position of the printed matter 206 (the position of the image in the photographing area) is uniquely determined. Thereby, it is possible to display an appropriate image in the projection region without adjusting the relative position. In addition, occurrence of misalignment between the image in the projection area and the image to be projected can be reduced.

  Further, since the dedicated screen 204 and the support base 202 are integrated, it is possible to reduce the possibility that light projected from the projector 234 of the portable electronic device 201 irradiates an area other than the dedicated screen 204. Thereby, the projector 234 can be used more safely.

  In the case of the image projection unit 200, since adjustment with the projection area is not necessary, when the image to be projected is selected by itself, the portable electronic device 201 may be configured not to have a camera.

  In the above embodiment, when the image of the projection area is an image of a scene such as a picture book, an example in which the image to be projected is a person, the image of the projection area is a newspaper, and the image ( As an example, a combination of an image of a projection area, that is, an image formed and arranged in advance in a projection area such as a printed material, and an image to be projected, that is, an image projected from a projector can be variously used. Can be a combination.

  First, when the image (printed material or the like) in the projection area is a newspaper image, the projected image may be a four-frame cartoon of a moving image in a blank frame of the newspaper, that is, a moving image. An image to be projected can be an advertisement. In addition, by projecting the advertisement, it is possible to change the contents of the advertisement projected by the region, the distribution location, and the contractor. In this case, the date and the target item can be acquired as identification information, and the data of the target item corresponding to the date can be projected. In addition, a novel or article corresponding to the input result can be projected by providing an area for writing age and genre on the printed material and reading the input result.

  Moreover, when the image of a projection area | region is a comic image, it is good also considering the image to project as a dialog. That is, the dialogue may be projected on the comic balloon in the projection area. Thereby, the printed matter is in a state without dialogue, and even when only the printed matter is viewed, it is possible to make a state where all contents cannot be grasped. Thereby, purchase willingness can be promoted. In addition, the user may be able to create dialogue by inputting to the operation unit or the like. Further, the input dialogue can be repeatedly displayed by storing it in association with the balloon. In addition, various lines can be applied to comics.

  Further, when the image in the projection area is a picture-story show image, the projected image may be a person or a specific object. If the projected area image is a picture-story show, the number of pages, that is, which image can be determined based on the background image. Further, only the identification information may be displayed on the image of the projection area. Also in this case, it is possible to display an appropriate image in the display area while associating the white paper on the front surface with the characters displayed on the back surface.

  Further, when the image of the projection area is a paperback book image, the projected image may be a synopsis or an illustration. In this case, text and page numbers can be used as identification information.

  If the image in the projection area is a magazine, the identification information can be the application ID, and the image to be projected can be the winning result. This allows you to know the results at the time of application. Also, the identification information can be a puzzle problem or hint, and the projected image can be a puzzle answer. In other words, the puzzle answer can be displayed by placing the problem of the magazine puzzle and the hint area in the projection area. In addition, the ranking result can be displayed in an area where only the magazine ranking and the frame are displayed.

  In addition, when the image in the projection area is a problem such as a reference book, a test, or a textbook, the projected image can be used as a correct answer, explanation, or hint. In this case, the problem number or the like is the identification information. In this case, if a problem is placed in the projection area, the correct answer may be displayed. However, whenever the time elapses or the time limit elapses, hints, correct answers, and explanations are displayed. Also good. Further, when a question in which an answer is written is placed in the projection area, the answer may be analyzed with an image acquired by a camera, and a score or rank image may be projected.

  Moreover, when the image of a projection area | region is a map, it is good also considering the image to project as target information (selected information). As a result, only necessary information can be projected, and the map can be easily used.

  Further, when the image of the projection area is a guide book image, the projected image may be sightseeing spot information, souvenir information, word-of-mouth information, store information, or translated texts in other languages. The tourist spot information is displayed corresponding to the map, the souvenir information is displayed corresponding to the store information, the word of mouth information is displayed corresponding to the image of the tourist spot, and the store information is displayed on the map. It is preferable to display corresponding to an image and to display a translated sentence in another language corresponding to a sentence in an arbitrary language.

  Moreover, when the image of a projection area | region is a cookbook image, it is good also considering the image to project as a description moving image, a procedure, and cooking history. In addition, it is preferable that the explanation moving image is displayed corresponding to the explanatory text, the procedure is displayed corresponding to the dish image or blank frame, and the history is displayed corresponding to the recipe. The history can be projected by storing the date and time when the recipe was viewed. Also, the user may input various items (cooking date, time taken, impressions) and project it as a history.

  Further, when the image in the projection area is a photo book or a photo image, the image to be projected may be taken date and time, location information, or text data associated with the image. When the image of the projection area is an image of a specialized book, an explanatory text may be projected as an image to be projected in association with a technical term.

  Moreover, when the image of a projection area | region is a signboard, it is good also considering the image to project as an advertising image. The advertisement image can be displayed differently for each portable electronic device and for each time. Further, when the image of the projection area is a road sign, the image to be projected may be construction information and traffic jam information.

  Further, when the image of the projection area is an entry area such as a notebook or a whiteboard, the image to be projected may be a symbol, a figure, or the like corresponding to the entered character. Further, when recognition information indicating a specific page is entered, an image (picture, sentence) corresponding to the identification information may be projected.

  Further, when the image of the projection area is a nameplate, the image to be projected may be used as the name. Further, when the image in the projection area is a label, the image to be projected may be price information, discount information, inventory information, production area information, or the like. As a result, the amount of information printed on the label can be reduced. Further, when displaying discount information, inventory information, etc., changing information can be displayed.

  Further, when the image of the projection area is an ID and a product code described in the slip, the image to be projected may be a product image. It is possible to easily understand visually what kind of product is purchased from the ID and product code. In addition, when the image of the projection area is a warranty, the projected image may be used as the warranty expiration date. Moreover, when the image of a projection area | region is a card | curd, it is good also as the point which has accumulated the image to project on the card | curd.

  Moreover, when the image of a projection area | region is a prescription, it is good also considering the image to project as a use history and a usage method. Thereby, use frequency etc. can be confirmed.

  In addition, when the image in the projection area is a handwritten document, the projected image may be an image that assists handwriting. For example, the address may be displayed in the address field of the postcard. Moreover, you may make it display a line in the entry column of a character. Further, a layout may be displayed. Thus, characters and pictures can be easily written by handwriting while projecting the auxiliary screen.

  Further, when the image of the projection area is the original image of the coloring book, the image to be projected may be an image of the color of each area. Thereby, the user can enjoy coloring by selecting a color. In fact, it is not painted, so you can enjoy it many times. In this case, the mobile electronic device obtains area information corresponding to the original image of the coloring book as the corresponding image, and projects the image by overwriting the color information selected by the user by controlling the mobile electronic device. Update the image data and project a colored image.

  Further, when the image in the projection area is a character displayed on a display such as electronic paper, the projected image may be a moving image. Thereby, a moving image can be displayed on the display which displays only a character, for example. Moreover, a moving image can be displayed without imposing a load on the terminal on the display display side. In this case, the portable electronic device may exchange various information through communication with the terminal on the display display side. Thereby, the area | region of the moving image to project, the area | region of the character to display, etc. can be adjusted easily.

  Further, when the image in the projection area is a moving image displayed on the display of the mobile communication terminal, the projected image may be a caption image.

  Further, when the image of the projection area is a videophone image displayed on the display of the mobile communication terminal, the projected image may be used as the call time and the call charge. Further, when the image of the projection area is a television image displayed on the display of the mobile communication terminal, the image to be projected may be information on the other party of the call such as name. The projected image is preferably displayed outside the frame (edge) of the display. Accordingly, various information can be displayed without reducing the image displayed on the display.

  Note that the above-described processing can be performed with one portable electronic device by adopting a configuration in which the casing of the portable electronic device is of two separate types, a display display is provided in one housing, and a projector unit is provided in the other housing. Can do.

  Of course, a combination in which the image of the projection area and the image to be projected are interchanged is also possible.

  As described above, the portable electronic device and the image projection unit according to the present invention are useful for a device including an apparatus capable of projecting an image, such as a projector.

DESCRIPTION OF SYMBOLS 1 Portable electronic device 1C Case 2 Display 13 Operation part 13A Operation key 13B Direction and determination key 22 Processing part 22a Projector control part 22b Image processing part 22c Condition determination part 22d Posture / position calculation part 22e Projection image determination part 22f Camera control part 24 Storage Unit 25 External Storage Unit 30 Audio Processing Unit 31 Visible Light Irradiation Device 32 Display Unit 34 Projector 35 Drawing Device 39 Focus Adjustment Device 40 Camera

Claims (8)

A housing,
An image projection unit provided in the housing for projecting an image onto a projection area;
A processing unit that acquires information of a specific projection image corresponding to a first image previously arranged in the projection area, and that projects the specific projection image from the image projection unit based on the acquired information,
The portable electronic device, wherein the specific projection image is an image related to a first image of the projection area.   The portable electronic device according to claim 1, wherein the casing has a coupling mechanism coupled to a support base. The image projection unit further includes a photographing unit that photographs an image in a direction in which the image is projected,
The processing unit determines a first image of a projection area based on an image captured by the imaging unit, and projects the corresponding specific projection image based on the determined result. The portable electronic device described.   4. The portable electronic device according to claim 3, wherein the processing unit switches a specific projection image to be projected when detecting that the image of the projection area is switched based on an image captured by the imaging unit. 5. .   The processing unit adjusts the size of the specific projection image to be projected based on the image captured by the imaging unit, and projects the specific projection image at a predetermined position in the projection region. The portable electronic device according to claim 3 or 4.   The said processing part acquires identification information from the image image | photographed by the said imaging | photography part, and determines the 1st image of a projection area | region based on the acquired identification information, The any one of Claim 3 to 5 characterized by the above-mentioned. The portable electronic device according to Item. A portable electronic device according to claim 2,
A support base connected to the connection mechanism and fixing the portable electronic device in a specific posture;
A dedicated screen fixed to the support base and disposed in the projection area;
A printed matter that is held on the dedicated screen and on which the first image is arranged,
The portable electronic device projects an image related to the first image as the specific projection image.   The image projection unit according to claim 7, wherein the dedicated screen has a guide formed on a surface thereof indicating a position where the printed material is installed.

Images