JP5646885B2 - Portable electronic device and image projection unit - Google Patents

Description

  The present invention relates to a portable electronic device having an image projection unit that projects an image on a screen or a wall surface, and an image projection unit.

  Conventionally, as a device for projecting an image on a wall surface or a screen, there is a so-called projector. This projector is mainly a so-called stationary apparatus that is supplied with power from a commercial power source and is used in a fixed state. This stationary projector projects an image on a fixed wall or screen in a fixed state.

  In contrast, in recent years, portable projectors that are small and easy to carry have been proposed. For example, Patent Document 1 includes a projector-equipped mobile phone that includes an upper cabinet, a lower cabinet, and a hinge portion that rotatably connects the upper cabinet and the lower cabinet to each other, and is equipped with a projector having a lens and a light source. The terminal is listed.

  Moreover, as a portable electronic device having a function of projecting an image, as disclosed in Patent Document 2 to Patent Document 4, an operation key is projected by an image projection unit, and an input to the projection surface is detected by an input detection unit. A portable electronic device that can be operated is described. Patent Document 2 describes a touch panel as input detection means, and Patent Document 3 describes a detection device that detects an obstacle on an image projection area as input detection means. Japanese Patent Application Laid-Open No. H10-228688 describes using a white or printed sheet as a screen for projecting an image including operation keys.

JP 2007-96542 A JP 2003-152851 A Japanese Patent Laid-Open No. 2006-29579 JP 2005-222544 A

  As described in Patent Document 2 to Patent Document 4, by using the projected image as a part of the operation unit, the image projection unit can be effectively used. However, the image projection unit cannot be sufficiently utilized by merely utilizing the image projected by the image projection unit as a part of the operation unit.

  In addition, since the image projection unit provided in the portable electronic device has a lower resolution than the fixed image projection unit, it may be difficult to read when displayed at a high resolution such as characters.

  SUMMARY OF THE INVENTION An object of the present invention is to provide a portable electronic device and an image projection unit that can easily display a more effective image on a projection surface.

In order to solve the above-described problems and achieve the object, a portable electronic device according to the present invention includes a housing, an image projection unit that is provided in the housing and projects an image on a projection region, and the housing The information acquisition unit that acquires information from an external device, and the information acquisition unit acquires information of a specific projection image corresponding to the first image that is arranged in advance in the projection region, and acquires the projection image A processing unit that projects information from the image projection unit , and a photographing unit that captures an image in a direction in which the image projection unit projects an image, and the specific projection image is related to the first image in the projection region an image which, viewed contains an image indicating that information has been updated in the first image, wherein the processing unit on the basis of the image captured by the imaging unit, determines a first image of the projection area, The specific projection image based on the determined result Is acquired by the information acquisition unit, projected, and after displaying an image obtained by combining the image captured by the imaging unit and the specific projection image, the specific projection is performed on condition that a projection permission operation has been performed. An image is projected .

  Moreover, it is preferable that the said process part acquires the information containing the presence or absence of the update of the said specific projection image from an external apparatus.

  Moreover, it is preferable that the said housing | casing has a connection mechanism connected with a support stand.

  The image projection unit further includes an imaging unit that captures an image in a direction in which the image is projected, and the processing unit determines a first image of the projection region based on the image captured by the imaging unit. It is preferable that information on the specific projection image is acquired by the information acquisition unit based on the determined result and projected.

  Moreover, it is preferable that the said process part will switch the specific projection image to project, if it detects that the 1st image of the said projection area | region switched based on the image image | photographed with the said imaging | photography part.

  Further, it is preferable that the processing unit adjusts the size of the specific projection image to be projected based on the image captured by the imaging unit, and projects the specific projection image at a predetermined position in the projection region. .

  Further, the processing unit acquires identification information from an image captured by the imaging unit, determines a first image of the projection area based on the acquired identification information, and a specific projection corresponding to the image of the projection area The image is preferably acquired by the information acquisition unit.

  In order to solve the above-described problems and achieve the object, an image projection unit according to the present invention is connected to the portable electronic device described above and the connection mechanism, and fixes the portable electronic device in a specific posture. A portable device comprising: a support table; a dedicated screen fixed to the support table; and disposed on the projection area; and a printed matter that is held on the dedicated screen and on which the first image is disposed. The electronic device projects an image related to the first image as the specific projection image.

  Moreover, it is preferable that the dedicated screen has a guide formed on the surface indicating the installation position of the printed matter.

  INDUSTRIAL APPLICABILITY The portable electronic device and the image projection unit according to the present invention have an effect that an image with higher effectiveness can be easily displayed on the projection surface.

FIG. 1 is a front view illustrating a schematic configuration of an embodiment of a portable electronic device according to the embodiment. FIG. 2 is a side view of the portable electronic device shown in FIG. FIG. 3 is a block diagram illustrating a schematic configuration of functions of the portable electronic device illustrated in FIGS. 1 and 2. FIG. 4 is an explanatory diagram showing a state in which an image is displayed by the projector of the portable electronic device shown in FIG. FIG. 5 is a flowchart for explaining an example of the operation of the portable electronic device. FIG. 6A is an explanatory diagram for explaining an example of the operation of the mobile electronic device. FIG. 6B is an explanatory diagram for explaining an example of the operation of the mobile electronic device. FIG. 7A is an explanatory diagram for explaining an example of the operation of the mobile electronic device. FIG. 7B is an explanatory diagram for explaining an example of the operation of the mobile electronic device. FIG. 8A is an explanatory diagram for explaining an example of the operation of the portable electronic device. FIG. 8-2 is an explanatory diagram for explaining an example of the operation of the mobile electronic device. FIG. 9A is an explanatory diagram for explaining an example of the operation of the mobile electronic device. FIG. 9-2 is an explanatory diagram for explaining an example of the operation of the mobile electronic device. FIG. 10A is an explanatory diagram for explaining an example of the operation of the mobile electronic device. FIG. 10B is an explanatory diagram for explaining an example of the operation of the mobile electronic device. FIG. 11 is an explanatory diagram for explaining the operation of the mobile electronic device. FIG. 12A is a perspective view for explaining a schematic configuration of the image projection unit. FIG. 12B is an explanatory diagram for explaining a schematic configuration of the portable electronic device of the image projection unit. FIG. 13A is a perspective view for explaining a schematic configuration of a dedicated screen and a support base. FIG. 13-2 is a top view for explaining a schematic configuration of the dedicated screen and the support base.

  Hereinafter, the present invention will be described in detail with reference to the drawings. The present invention is not limited to the following description. In addition, constituent elements in the following description include those that can be easily assumed by those skilled in the art, those that are substantially the same, and those in a so-called equivalent range. In the following, a cellular phone is taken as an example of a portable electronic device, but the application target of the present invention is not limited to a cellular phone. For example, a PHS (Personal Handy-phone System), a PDA, a portable navigation device, a notebook The present invention can also be applied to personal computers, game machines, and the like.

  FIG. 1 is a front view showing a schematic configuration of an embodiment of a portable electronic device according to the embodiment, and FIG. 2 is a side view of the portable electronic device shown in FIG. A portable electronic device 1 shown in FIGS. 1 and 2 is a mobile phone having a wireless communication function, an output unit, a voice acquisition unit, and an imaging unit. In the portable electronic device 1, the housing 1C is composed of a plurality of housings. Specifically, the housing 1C is configured to be openable and closable by a first housing 1CA and a second housing 1CB. That is, the portable electronic device 1 has a foldable housing. In addition, the housing | casing of the portable electronic device 1 is not limited to such a structure. For example, the casing of the portable electronic device 1 may be a sliding casing that allows one casing and the other casing to slide from each other in a state where both casings are overlapped, It may be a rotary type in which one casing is rotated around an axis along the overlapping direction, or both casings are connected via a biaxial hinge.

  1st housing | casing 1CA and 2nd housing | casing 1CB are connected by the hinge mechanism 8 which is a connection part. By connecting the first casing 1CA and the second casing 1CB with the hinge mechanism 8, the first casing 1CA and the second casing 1CB rotate together around the hinge mechanism 8 and move away from each other. And it is comprised so that it can rotate in the direction (direction shown by arrow R of FIG. 2) which mutually approaches. When the first casing 1CA and the second casing 1CB rotate in a direction away from each other, the portable electronic device 1 opens, and when the first casing 1CA and the second casing 1CB rotate in a direction approaching each other, the portable electronic device 1 opens. The device 1 is closed and folded (a state indicated by a dotted line in FIG. 2).

  The first housing 1CA is provided with a display 2 shown in FIG. 1 as a display unit. The display 2 displays a standby image when the portable electronic device 1 is waiting for reception, or displays a menu image used for assisting the operation of the portable electronic device 1. In addition, the first housing 1CA is provided with a receiver 16 that is an output unit that outputs sound when the mobile electronic device 1 is in a call.

  The second casing 1CB is provided with a plurality of operation keys 13A for inputting a telephone number of a call partner, a mail, etc., and selection and determination of a menu displayed on the display 2 and a screen. A direction and determination key 13B for easily executing scrolling and the like are provided. The operation key 13 </ b> A and the direction / decision key 13 </ b> B constitute the operation unit 13 of the mobile electronic device 1. In addition, the second casing 1CB is provided with a microphone 15 that is a voice acquisition unit that receives voice when the mobile electronic device 1 is in a call. The operation unit 13 is provided on the operation surface 1PC of the second housing 1CB shown in FIG. The surface opposite to the operation surface 1PC is the back surface 1PB of the portable electronic device 1.

  An antenna is provided inside the second housing 1CB. The antenna is a transmission / reception antenna used for wireless communication, and is used for transmission / reception of radio waves (electromagnetic waves) related to calls, electronic mails, and the like between the portable electronic device 1 and a base station. In addition, the microphone 15 is provided in the second housing 1CB. The microphone 15 is arranged on the operation surface 1PC side of the portable electronic device 1 shown in FIG.

  On the side opposite to the hinge mechanism 8 of the first housing 1CA, a projector 34 that is an image projection unit and a camera 40 that captures (acquires) an image of the surface on which the image is projected are provided. In addition, the light emission part of the projector 34 and the imaging | photography window of the camera 40 are exposed outside the 1st housing | casing 1CA. With such a configuration, the projector 34 can project an image onto the projection target. In addition, by acquiring the distance from the image projected by the camera 40, the image projected by the projector 34 can be automatically focused. Note that the size and focal length of the image to be projected can be adjusted by acquiring an image of the area where the image is projected by the camera 40.

  FIG. 3 is a block diagram illustrating a schematic configuration of functions of the portable electronic device illustrated in FIGS. 1 and 2. As shown in FIG. 3, the mobile electronic device 1 includes a processing unit 22, a storage unit 24, an external storage unit 25, a transmission / reception unit (information acquisition unit) 26, an operation unit 13, an audio processing unit 30, The display unit 32, the projector 34, and the camera 40 are included. The processing unit 22 has a function of comprehensively controlling the overall operation of the mobile electronic device 1. In other words, the processing unit 22 transmits and receives various processes of the mobile electronic device 1 so as to be executed in an appropriate procedure according to the operation of the operation unit 13 and the software stored in the storage unit 24 of the mobile electronic device 1. The operations of the unit 26, the voice processing unit 30, the display unit 32, and the like are controlled.

  Various processes of the portable electronic device 1 include, for example, a voice call performed via a circuit switching network, creation and transmission / reception of an electronic mail, browsing of a Web (World Wide Web) site on the Internet, and the like. Examples of operations of the transmission / reception unit 26, the audio processing unit 30, and the display unit 32 include transmission / reception of signals by the transmission / reception unit 26, input / output of audio by the audio processing unit 30, display of images by the display unit 32, and the like. .

  The processing unit 22 executes processing based on a program (for example, an operating system program, application program, etc.) stored in the storage unit 24. The processing unit 22 is constituted by, for example, a microprocessor unit (MPU: Micro Processing Unit), and executes various processes of the portable electronic device 1 described above in accordance with procedures instructed by the software. That is, the processing unit 22 sequentially reads instruction codes from an operating system program, application program, or the like stored in the storage unit 24 and executes processing.

  The processing unit 22 has a function of executing a plurality of application programs. Examples of application programs executed by the processing unit 22 include an application program that controls driving of the projector 34 and the camera 40, an application program that reads and decodes various image files (image information) from the storage unit 24, and decoding. There are a plurality of application programs such as an application program for displaying the image obtained in this way on the display unit 32 or projecting it on the projector 34.

  In the present embodiment, the processing unit 22 includes a projector control unit 22 a that controls the operation of the projector 34, an image processing unit 22 b that generates an image to be displayed on the projector 34, an image acquired by the camera 40, and an input from the operation unit 13. A condition determination unit 22c that determines the conditions of the projection area based on the above, an attitude / position calculation unit 22d that calculates and calculates the attitude and position of the housing 1C with respect to the projection plane, and an image to be projected on the projector 34 from a plurality of image data A projection image determination unit 22e to determine and a camera control unit 22f to control the operation of the camera 40 are included. The functions of the projector control unit 22a, the image processing unit 22b, the condition determination unit 22c, the posture / position calculation unit 22d, the projection image determination unit 22e, and the camera control unit 22f are hardware configured by the processing unit 22 and the storage unit 24. The hardware resource is realized by executing a task assigned by the control unit of the processing unit 22. Here, a task is a processing unit that cannot be executed at the same time among the entire processing performed by the application software or the processing performed by the same application software.

  The storage unit 24 stores software and data used for processing in the processing unit 22, and includes a task for operating the application program for controlling the driving of the projector 34 and the camera 40, and an image processing program. The task for operating is stored. In addition to these tasks, for example, communication, downloaded voice data, software used by the processing unit 22 to control the storage unit 24, the telephone number or mail address of the communication partner, etc. are described in the storage unit 24. The address book to be managed, voice files such as dial tone and ring tone, temporary data used in the process of software, and the like are stored.

  Note that computer programs and temporary data used in the software processing process are temporarily stored in the work area assigned to the storage unit 24 by the processing unit 22. The storage unit 24 includes, for example, a nonvolatile storage device (nonvolatile semiconductor memory such as ROM: Read Only Memory, a hard disk device, etc.), and a readable / writable storage device (for example, SRAM: Static Random Access Memory, DRAM: Dynamic Random Access Memory).

  The external storage unit 25 is a storage device that includes an external memory and connection terminals, and the external memory is detachable from the housing 1C. Various software and data are stored in the external memory in the same manner as the storage unit 24. The external storage unit 25 connects the external memory and the processing unit 22 via a connection terminal, and writes and reads information to and from the external memory, similarly to the storage unit 24. In addition, since the external memory is detachable from the external storage unit 25, the external memory connected to the processing unit 22 can be exchanged. As the external memory, various storage media such as an SD card (registered trademark), a memory stick (registered trademark), smart media, and a USB memory can be used.

  The transmission / reception unit 26 has an antenna 26a, establishes a radio signal line by a CDMA (Code Division Multiple Access) method or the like with the base station via a channel assigned by the base station, and makes a telephone call with the base station. Perform communication and information communication. The operation unit 13 includes, for example, an operation key 13A to which various functions such as a power key, a call key, a numeric key, a character key, a direction key, a determination key, and a call key are assigned, and a direction and determination key 13B. The When these keys are input by a user operation, a signal corresponding to the operation content is generated. The generated signal is input to the processing unit 22 as a user instruction. The transmitter / receiver 26 may be short-range wireless communication (Bluetooth (registered trademark), infrared communication, etc.), wireless LAN, or the like.

  The audio processing unit 30 executes processing of an audio signal input to the microphone 15 and an audio signal output from the receiver 16 and the speaker 17. That is, the sound processing unit 30 amplifies the sound input from the microphone 15 and executes AD conversion (Analog Digital conversion), and then performs signal processing such as encoding to convert the sound into digital sound data. Output to the processing unit 22. Further, the audio data sent from the processing unit 22 is subjected to processing such as decoding, DA conversion (Digital Analog conversion), and amplification to convert it into an analog audio signal, which is then output to the receiver 16 and the speaker 17. Here, the speaker 17 is disposed in the housing 1C of the portable electronic device 1, and outputs a ringtone, a mail transmission sound, and the like.

  The display unit 32 includes the display 2 described above, and displays a video corresponding to the video data supplied from the processing unit 22 and an image corresponding to the image data on the display panel. The display 2 is constituted by a display panel constituted by, for example, a liquid crystal display (LCD, Liquid Crystal Monitor), an organic EL (Organic Electro-Luminescence) panel, or the like. The display unit 32 may include a sub display in addition to the display 2.

  The projector 34 includes a light source and an optical system that switches whether to project the light emitted from the light source based on image data. In the present embodiment, the projector 34 includes a visible light irradiation device (visible light irradiation means) 31 that is a light source, a drawing device 35 that is an optical system, and a focus adjustment device 39. The visible light irradiation device 31 emits visible laser light. The light in the visible light region is light of 360 nm to 400 nm on the short wavelength side and light of 760 nm to 830 nm on the long wavelength side. In this embodiment, the visible light irradiation device 31 includes R (Red), G (Green), B Irradiate light of three colors (Blue).

  The drawing device 35 combines the three colors of light emitted from the visible light irradiation device 31 and irradiates the image projection target. The drawing device 35 includes a switching element that switches whether to transmit light emitted from the light source, and a mirror that performs raster scanning of the light that has passed through the switching element. The drawing device 35 changes the angle of the laser light emitted from the visible light irradiation device 31 by the mirror and causes the image projection target to scan the laser light, thereby projecting the image onto the image projection target.

  As the mirror, for example, a MEMS (Micro Electro Mechanical System) mirror is used. A MEMS mirror drives a mirror using a piezoelectric element, scans the visible light irradiated from the visible light irradiation apparatus 31, and produces | generates a visible image and an invisible image. In this case, by changing the angle of the light emitted from the light source by the mirror and scanning the light emitted from the light source over the entire surface of the image projection target, a visible image or an invisible image can be projected onto the image projection target. it can. Thus, the projector 34 is a scan-type projector. Note that the configuration of the projector 34 is not limited to that using the laser described above as a light source. For example, the projector 34 may be a projector having a configuration in which a halogen light, an LED light source, or an LD light source is used as a light source, and an LCD (Liquid Crystal Display) or DMD (Digital Micro-mirror Device) is provided in the optical system.

  The focus adjustment device 39 has a function (focus adjustment function) for forming a visible image projected from the drawing device 35 on an image projection target in accordance with a command from the projector control unit 22a. The focus adjustment device 39 includes a focus adjustment mechanism including, for example, a movable lens, and realizes the focus adjustment function by moving the lens. Further, the focus adjustment device 39 may realize the focus adjustment function by performing predetermined image processing on the image data projected by the projector 34 by the image processing unit 22b. Further, the focus adjustment device 39 may realize the focus adjustment function by a focus adjustment function and image processing.

  FIG. 4 is an explanatory diagram showing a state in which an image is displayed by the projector of the portable electronic device shown in FIG. As described above, the projector 34 is an image projection unit that projects an image, and the image projection surface is exposed to the outside of the housing 1 </ b> C of the portable electronic device 1. As shown in FIG. 4, the portable electronic device 1 projects an image from the projector 34, and, as shown in FIG. 4, among the image projection targets (for example, a wall surface and a screen) at a position facing the image projection surface of the projector 34 The image P can be projected onto the area (projection area) PA. The operation of the projector 34 is controlled by the processing unit 22, and various images sent from the processing unit 22, such as moving images and presentation materials, are projected and displayed on the projection area PA.

  As described above, the camera 40 is an imaging mechanism that is provided near the light emitting unit of the projector 34 and acquires an image of an area including a projection area. That is, the camera 40 acquires an image in the direction in which the projector 34 emits light. The camera 40 is a shooting mechanism that takes an image with a wider angle of view than the projection angle of the image projected by the projector 34, and takes an image of an area wider than the projection area onto which the image is projected by the projector 34. can do. The portable electronic device 1 is basically configured as described above.

  Next, the image projecting operation of the projector of the portable electronic device will be described with reference to FIG. Here, FIG. 5 is a flowchart showing an example of the operation of the portable electronic device. The operation illustrated in FIG. 5 may be performed whenever the projector 34 is activated, or may be performed when an execution instruction for a mode for performing the operation illustrated in FIG. 5 is input. 5 may be processed by executing an application stored in the storage unit 24, or may be processed by executing an application stored in the external storage unit 25. That is, the program for executing the operation shown in FIG. 5 may be stored in any area. The program can be acquired by downloading from the outside, and can also be acquired by reading from the external storage unit 25. In the flowchart shown in FIG. 5, a specific printed matter is arranged in the projection area of the image of the projector 34 of the portable electronic device 1.

  First, when the activation instruction for the projector 34 is input, the processing unit 22 of the portable electronic device 1 activates the camera 40 and the projector 34 as step S12. If the camera 40 and the projector 34 are activated when the activation instruction is input, the process proceeds to step S14 as it is. Further, the startup process of the projector 34 can be performed by the projector control unit 22a, and the startup process of the camera 40 can be performed by the camera control unit 22f.

  When the processing unit 22 activates the camera 40 and the projector 34 in step S12, the operation of the camera 40 is controlled by the camera control unit 22f in step S14, and an image of the projection area (an image displayed on the projection surface) is displayed. get. When the processing unit 22 acquires the image of the projection area in step S14, the condition determination unit 22c determines the condition of the projection area in step S16. Specifically, the processing unit 22 uses the image processing unit 22b to analyze the captured image of the projection area and detect the configuration of the image displayed in the projection area. Thereafter, the processing unit 22 determines the condition of the projection region based on the configuration of the display image of the projection region detected by the processing in the image processing unit 22b.

  When the processing unit 22 determines the condition of the projection region in step S16, the processing unit 22 acquires information from an external device (for example, a server) in step S17. Specifically, the processing unit 22 specifies the printed material placed in the projection area based on the condition (identification information) of the projection area determined in step S16, and the latest information corresponding to the specified printed material ( For example, the image data associated with the information of the printed matter, the data indicating whether or not the image data is updated, and the like are acquired from the external device by the transmission / reception unit 26 and stored in the storage unit 24 or the external storage unit 25. If the latest information corresponding to the specified printed matter is stored in the storage unit 24 or the external storage unit 25, the processing unit 22 may acquire data indicating that there is no update of the image data. There is no need to acquire image data from an external device.

  When the processing unit 22 acquires information from the external device in step S17, the projection image determination unit 22e determines an image to be projected in step S18. Specifically, the processing unit 22 extracts image data corresponding to the specified printed matter based on the information acquired in step S17 by the projection image determination unit 22e, and determines the image to be projected. Note that the image data is stored in the storage unit 24 or the external storage unit 25, and information on the printed material is stored in association with the image data corresponding to the specified printed material. Therefore, the projection image determination unit 22e can extract corresponding image data by searching the image data stored in the storage unit 24 or the external storage unit 25 using the information of the printed matter as a key.

  After determining the image to be projected in step S18, the processing unit 22 controls the operation of the projector 34 by the projector control unit 22a and projects the image determined in step S18 from the projector 34 in step S20.

  When the image is projected in step S20, the processing unit 22 determines in step S22 whether the image of the projection area has been switched, that is, whether the printed matter arranged in the projection area has been switched. This determination can be made, for example, by acquiring an image with the camera 40 and comparing the image with the previous image. The processing unit 22 switches the image in step S22 (Yes in step S22), that is, an image (printed material) different from the image (printed material) arranged in the projection region when acquired in step S14 is displayed in the projection region. If it is determined that there is, the process proceeds to step S14, and the processing from step S14 to step S20 is performed, and the image projected from the projector 34 is switched in accordance with the image in the projection area.

  If it is determined in step S22 that there is no image switching (No in step S22), the processing unit 22 determines in step S24 whether there is an instruction to end projection. If the processing unit 22 determines in step S24 that there is no termination instruction (No in step S24), the processing unit 22 proceeds to step S22 and performs the process of step S22. If it is determined in step S24 that the projection has ended (Yes in step S24), the processing unit 22 stops the camera 40 and the projector 34 and ends this processing in step S26. The camera 40 and the projector 34 can be stopped under the control of the camera control unit 22f and the projector control unit 22a, respectively.

  Next, the portable electronic device 1 will be described in more detail using a specific example. Here, FIGS. 6A and 6B are explanatory diagrams for explaining an example of the operation of the mobile electronic device. FIGS. 7A and 7B are explanatory diagrams for describing another example of the operation of the mobile electronic device. 8A and 8B are explanatory diagrams for explaining another example of the operation of the mobile electronic device. FIGS. 9A and 9B are explanatory diagrams for describing another example of the operation of the portable electronic device. 10A and 10B are explanatory diagrams for explaining another example of the operation of the mobile electronic device. In addition, in FIGS. 6-1 to 10-2, the portable electronic device 1 is shown as a simple box shape.

  First, in the example illustrated in FIG. 6A, the printed material 300 is arranged in the projection area. Here, the printed material 300 is a sheet of newspaper. Specifically, the printed material 300 is printed with a headline (“stock list”) and the closing price on the previous day of each brand. Since the stock market is opened at 9:00 am, the stock price on this page becomes old information after 9:00 am. Further, the portable electronic device 1 stores the position of each brand on the paper as layout information in the storage unit 24 or the external storage unit 25.

  When the portable electronic device 1 detects that there is a printed material 300 in the projection area, that is, a newspaper page, by the processing shown in FIG. 5, the latest information corresponding to the printed material 300, that is, the stock price of each brand of today. Is obtained from an external device (for example, a newspaper company's server), and as shown in FIG. 6B, a mark (image) that informs the brand whose stock price has fluctuated from the projector 34 to the projection area. ). For example, the mobile electronic device 1 may project red light on a brand whose stock price has risen from the previous day, or may project blue light on a brand whose stock price has fallen from the previous day. For example, the mobile electronic device 1 may project an upward arrow on a stock whose stock price has risen from the previous day, or a stock whose stock price has fallen from the previous day. A downward arrow may be projected on the screen. For example, the portable electronic device 1 may project a graph representing a gauge or price movement on a stock whose stock price has changed from the previous day. For example, the mobile electronic device 1 may project the latest stock price on a stock whose stock price has fluctuated from the previous day within a range that does not impair the visibility of characters.

  As a result, the reader can know the latest information regarding the stock price. In addition, although it demonstrated taking the stock side of a newspaper as an example here, it is not restricted to this, It can also apply to the settlement column of a quarterly report. It can also be applied to paper on which the price of financial products such as futures transactions and funds is printed.

  Next, in the example illustrated in FIG. 7A, the printed material 310 is arranged in the projection area. Here, the printed material 310 is one paper surface of a newspaper. Specifically, on the printed material 310, newspaper names, headlines, and sentences and images of the contents of each news are printed. In addition, since the sentences and images of the contents of each news are those at the time of drafting, when the reader views the sentences and images of the contents of each news, the sentences and images of the contents of each news may be updated . In addition, the mobile electronic device 1 stores the position of each news on the page as layout information in the storage unit 24 or the external storage unit 25.

  When the portable electronic device 1 detects that the printed material 310 is present in the projection area, that is, a newspaper page, by the processing shown in FIG. 5, the latest information corresponding to the printed material 310, that is, the latest content of each news item. The presence / absence of update of the text and image of each news or the content of each news or image is obtained from an external device (for example, a newspaper company server), and as shown in FIG. Projects a mark (image) that informs the content text or image update. Note that the image projected by the portable electronic device 1 may be any image as long as it is an image that informs the user of the text of the news content or the update of the image. For example, as illustrated in FIG. 7B, the mobile electronic device 1 includes a frame 311 surrounding the updated news text and image so as not to hinder the visibility of the news text and image. 312 may be projected. In addition, for example, the portable electronic device 1 may project the latest sentence or image partially overlapping the sentence or image of the content of each news printed on the paper within a range that does not impair the visibility of characters. In addition, when there is an error in the news content text or image, the mobile electronic device 1 acquires the error or the content of the error from an external device, and the news content text or image has an error. An image that informs the user of the contents of the error or error may be projected. Thereby, the reader can know the latest information about each news.

  Next, in the example illustrated in FIG. 8A, the printed material 320 is arranged in the projection area. Here, the printed matter 320 is one paper surface of a newspaper. Specifically, a headline (“TV column”) and a program guide are printed on the printed material 320. Since the program guide is the one at the time of drafting, the program guide may be updated when the reader views the program guide due to program change after drafting, extension of sports broadcasting, or the like.

  When the portable electronic device 1 detects that there is a printed matter 320 in the projection area, that is, a newspaper page, by the process shown in FIG. 5, the latest information corresponding to the printed matter 320, that is, the latest program guide is externally displayed. As shown in FIG. 8B, a mark (image) for notifying a program whose broadcast time has been changed is projected from the projector 34 to the projection area. Note that the image projected by the portable electronic device 1 may be any image as long as it is an image for informing a program whose broadcast time has been changed. For example, when there is a program whose broadcast time has been deferred, the portable electronic device 1 projects light of a predetermined color onto the program whose broadcast time has been deferred as shown in FIG. Arrows 321 and 322 may be projected. Further, for example, when there is a program whose broadcasting has been canceled, the portable electronic device 1 may project an X mark 323 on the program whose broadcasting has been canceled as shown in FIG. Thereby, the reader can know the latest information regarding the program guide. Further, the mobile electronic device 1 may project (highlight) a predetermined color of light onto a program that is currently being broadcast.

  Thereby, the reader can know the program currently broadcast. Here, a TV program guide for newspapers has been described as an example. However, the present invention is not limited to this, and can be applied to a radio program guide for newspapers. Further, the present invention can be applied to a program guide for satellite broadcasting or CATV (cable television).

  Next, in the example illustrated in FIG. 9A, the printed material 330 is arranged in the projection area. Here, the printed matter 330 is a newspaper leaflet. Specifically, the printed matter 330 is printed with a headline (“XX electric appliance”), each electric appliance, and its selling price. The sales price is the one at the time of drafting, and some consumer electronics retailers ask that it is cheaper than other companies, so when the reader sees the insert flyer by changing the selling price after the drafting, sell it The price may have been updated. Moreover, the portable electronic device 1 has memorize | stored in the memory | storage part 24 or the external memory | storage part 25 as layout information the position on the insert leaflet of the sales price of each electric appliance.

  When the portable electronic device 1 detects that there is a printed matter 330 in the projection area, that is, a folded flyer, by the process shown in FIG. 5, the latest information corresponding to the printed matter 330, that is, a change in the selling price of each electrical product. The situation or the latest sales price of each electrical appliance is acquired from an external device (for example, a home appliance mass retailer server, an advertising agency server, etc.), and as shown in FIG. Projects a mark (image) that informs the electrical appliance that has changed. For example, as shown in FIG. 9-2, the portable electronic device 1 may project a red light 331 on the sales price of an electrical appliance whose sales price has increased from the previous day, or an electrical product whose sales price has decreased from the previous day. A blue light 332 may be projected on the selling price. For example, the portable electronic device 1 projects a downward arrow 333 on an electrical product whose sales price has dropped, as shown in FIG. 9-2. Alternatively, an upward arrow 334 may be projected onto an electrical appliance whose selling stock price has risen from the previous day. In addition, for example, the portable electronic device 1 may project a gauge on an electrical appliance whose selling price has fluctuated. In addition, for example, the mobile electronic device 1 may project the latest sales price on an electrical appliance whose sales price fluctuates within a range that does not impair the visibility of characters. Thereby, the reader can know the latest information regarding the sales price of the electrical appliance.

  The mobile electronic device 1 obtains the lowest selling price of the electrical product from the server of the price comparison site, compares the lowest price with the selling price on the folded flyer, and the selling price on the folded flyer is the highest. You may make it project the image showing whether it is higher or cheaper than a low price. Thereby, the reader can know whether the selling price on the insert flyer is higher or lower than the lowest price. Moreover, the portable electronic device 1 may acquire inventory information of each electrical appliance from a server of a home appliance mass retailer and project an image representing the inventory status of each electrical appliance. Thereby, the reader can know the stock status of the desired electrical appliance.

  Next, in the example illustrated in FIG. 10A, the printed material 340 is disposed in the projection area. Here, the printed material 340 is a schedule such as a notebook. Specifically, the month (“X month”) and the day (“1 day”, “2 days”,...) Are printed on the printed material 340. In recent years, schedules have been managed on a schedule management server. In such a schedule management server, another person can enter his / her schedule. When both the schedule management server and a schedule such as a notebook are used together, there is a need for a link between the two.

  When the portable electronic device 1 detects that the printed material 340 is present in the projection area, that is, a schedule, by the processing shown in FIG. 5, the latest information corresponding to the printed material 340, that is, the schedule, As shown in FIG. 10B, the projector 34 projects (highlights) an image that illuminates the time zone in which the schedule is updated from the projector 34 to the projection area. For example, as illustrated in FIG. 10B, the mobile electronic device 1 may project the highlight lights 341 and 342 in a time zone in which the schedule is updated. Moreover, the portable electronic device 1 may acquire the content of the schedule (meeting content) from an external device and project it on the schedule. Thereby, the user can know the latest schedule. Also, the portable electronic device 1 captures an image of the printed material 340 with the camera 40, obtains a schedule handwritten on the printed material 340 by performing character recognition processing on the captured image, and acquires a schedule handwritten on the printed material 340 and the external You may project (highlight) the image which illuminates the time slot | zone which conflicts with the plan acquired from the apparatus.

  As a result, the user can know that the schedule is in conflict. Further, the mobile electronic device 1 captures an image of the printed material 340 with the camera 40, obtains a schedule handwritten on the printed material 340 by performing character recognition processing on the captured image, and externally stores the schedule handwritten on the printed material 340. It may be sent to the device. Thereby, the schedule managed by the external device can be updated.

  As described above, the mobile electronic device 1 acquires information from the external device, and projects an image corresponding to the image in the projection area from the projector 34. That is, the image projected from the projector 34 is superimposed on the image in the projection area. By creating a single image, a simple and highly effective image can be created.

  Here, in the case where an image is composed only of printed matter, it cannot be updated after printing, and the image cannot be moved. In addition, when projecting an image using only a projector, it is difficult to display a clear image. In addition, in order to project an easy-to-read image up to fine characters, it is necessary to mount an expensive and high-performance projector, which increases the size of the device, complicates the configuration, and increases the device cost. On the other hand, since the portable electronic device 1 projects a necessary image in accordance with the image of the printed matter in the projection area, it can have both advantages of the printed matter and the projector. For example, a high-resolution image can be displayed on a printed matter, and a part of the image can be moved by a projector, that is, a moving image can be obtained. In addition, since the image projected by the projector 34 of the portable electronic device 1 is also a part of the projection area, the load of image processing can be reduced and the power consumption can be reduced.

  In addition, as described above, since fine characters and images can be printed in advance on a printed matter, the image displayed in the projection area should be a clear and high-resolution image without increasing the performance of the projector. Can do.

  Here, various image processing methods can be used as a method for specifying an image (for example, a printed material) arranged in the display area from the image acquired by the mobile electronic device 1 with the camera 40. For example, the mobile electronic device 1 identifies the image of the projection area by extracting identification information such as specific characters and symbols from the image of the projection area such as a printed matter, a drawn picture, and written characters. Can do. Moreover, the portable electronic device 1 can specify an image in the projection region by performing edge detection on four sides and the like. Hereinafter, an example will be described with reference to FIG. Here, FIG. 11 is an explanatory diagram for explaining the operation of the portable electronic device. In addition, in FIG. 11, the portable electronic device 1 is shown as a simple box shape. In the example illustrated in FIG. 11, the printed material 120 is arranged in the projection area. The printed matter 120 is a newspaper page on which a character string 122 describing the name of the newspaper, a headline, and a sentence of each news content are printed. A two-dimensional barcode 124 is printed on the printed matter 120.

  The portable electronic device 1 can specify that the printed matter in the projection area is a newspaper by extracting the character string 122 from the image acquired by the camera 40. Note that the portable electronic device 1 can more appropriately specify the printed matter by taking into account the position information of the character string 122 in the entire projection area, that is, taking into account the layout information. In this case, the portable electronic device 1 can further specify the printed matter by obtaining information on the date of issue and the number of pages from the image. The mobile electronic device 1 can also specify a printed matter by extracting the two-dimensional barcode 124 from the image acquired by the camera 40. When the two-dimensional barcode 124 is used, information on whether the printed matter is a newspaper, the date of issue, and the number of pages can be included in the two-dimensional barcode. Thereby, the portable electronic device 1 can specify the printed matter only by reading the two-dimensional barcode 124. When using a two-dimensional barcode, the URL may be included in the information of the two-dimensional barcode. Moreover, you may print URL which preserve | saved the data of the image to project on a part of printed matter.

  As described above, the portable electronic device 1 identifies the image of the projection area, acquires an image corresponding to the identified image, and projects the image on the projection area, thereby converting the image previously arranged in the projection area. An image in which the projected images are superimposed can be displayed.

  The mobile electronic device 1 may process an image to be projected corresponding to the image in the projection area. Further, an image processed by the portable electronic device 1 or a created image may be used as the image associated with the image of the projection area. Further, an image set in advance in association with the image of the projection area may be changed. In addition, when changing the image to be associated, the storage unit 24 or the external storage unit 25 may store the changed image plus the association data of the identification information of the image of the projection area.

  The portable electronic device 1 calculates the distance from the image data acquired by the camera 40 to the projection area (projection plane) and the positional relationship with the image of the projection area, and the image projected from the projector 34 is within the projection area. You may make it adjust a position and a magnitude | size. In addition, the portable electronic device 1 acquires an image of the projection area in a state where the image is projected by the projector 34, and adjusts the position and size of the image projected from the projector 34 in the projection area based on the acquisition result. You may do it. As described above, by adjusting the position and size of the image to be projected in the projection area, a more appropriate image can be displayed in the projection area.

  In addition, the mobile electronic device 1 causes the display unit 32 to display an image obtained by combining the image acquired by the camera 40 and the image to be projected, that is, an image displayed in the projection area (a predicted image in a projected state). It may be. Thereby, the image projected on the projection area can be confirmed on the display unit 32. Note that the portable electronic device 1 may project an image from the projector 34 after a projection permission operation is input.

  Moreover, in the said embodiment, although the portable electronic device 1 was made into the state which can move with respect to a projection area | region, this invention is not limited to this, The special screen used as a projection area | region is provided, It is good also as a unit which fixes the portable electronic device 1 to a specific position. Here, FIG. 12-1 is a perspective view for explaining a schematic configuration of the image projection unit, and FIG. 12-2 is an explanatory diagram for explaining a schematic configuration of the portable electronic device of the image projection unit. . FIG. 13-1 is a perspective view for explaining a schematic configuration of the dedicated screen and the support base, and FIG. 13-2 is a top view for explaining a schematic configuration of the dedicated screen and the support base. 13A and 13B both show a state where the printed material is placed on the dedicated screen. An image projection unit 200 illustrated in FIG. 12A includes a portable electronic device 201, a support base 202, and a dedicated screen 204.

  As shown in FIG. 12B, the portable electronic device 201 has a rectangular parallelepiped housing 201C. Further, a connecting mechanism 220 for connecting to the support base 202 is provided on one surface of the housing 201C, and a light emitting portion of the projector 234 is provided on an end surface in the longitudinal direction of the housing 201C. Except for these points, the portable electronic device 201 is basically similar to the portable electronic device 1 in other configurations, and thus the description thereof is omitted.

  As illustrated in FIGS. 13A and 13B, the support base 202 is a support mechanism that fixes the portable electronic device 201 in a predetermined position, and a connection mechanism 222 that connects to the connection mechanism 220 of the housing 201 </ b> C is provided. Yes. For example, when the connection mechanism 220 is a screw hole, the connection mechanism 222 of the support base 202 is a screw. The support base 202 is fixed to the dedicated screen 204.

  As illustrated in FIGS. 13A and 13B, the dedicated screen 204 is a plate-like member, and the surface faces the fixed position of the portable electronic device 201. As illustrated in FIG. 12A, the dedicated screen 204 projects an image output from the projector 234 of the portable electronic device 201 fixed to the support base 202. That is, the projection area 205 of the projector 234 becomes a predetermined area on the surface of the dedicated screen 204.

  The dedicated screen 204 has an installation area on the surface where the printed material 206 is installed. Further, the dedicated screen 204 has a guide display 210 formed on the surface thereof. Here, the guidance display 210 indicates a reference for the placement position of the printed material 206 placed on the surface of the dedicated screen 204. By placing the printed material 206 so that the position where the guidance display 210 is displayed is the center in one direction, the relationship between the projection region 205 and the printed material 206 becomes constant.

  The image projection unit 200 has the above-described configuration, and the printed matter 206 in the projection region 205 is fixed by fixing the portable electronic device 201 to the support base 202 and placing the printed matter 206 at a predetermined position on the dedicated screen 204. An image corresponding to the printed material 206 can be projected from the projector 234.

  Here, in the image projection unit 200, the positional relationship between the projection area 205 and the position of the printed matter 206 (the position of the image in the photographing area) is uniquely determined. Thereby, it is possible to display an appropriate image in the projection region without adjusting the relative position. In addition, occurrence of misalignment between the image in the projection area and the image to be projected can be reduced.

  Further, since the dedicated screen 204 and the support base 202 are integrated, it is possible to reduce the possibility that light projected from the projector 234 of the portable electronic device 201 irradiates an area other than the dedicated screen 204. Thereby, the projector 234 can be used more safely.

  In the case of the image projection unit 200, since adjustment with the projection area is not necessary, when the image to be projected is selected by itself, the portable electronic device 201 may be configured not to have a camera.

  In the above embodiment, the image of the projection area is a newspaper page, the image to be projected is an image showing the stock price fluctuation status, the news content text and the image update status, and the projected image is a program broadcast. An example of an image showing the time change status, an example where the projected area image is a folded flyer, the projected image is an image showing the fluctuation status of the sales price of electrical appliances, and the projected area image is a schedule such as a notebook The table has been described as an example in which the image to be projected is an image representing the scheduled update status, but the image of the projection area, that is, the image that is formed and arranged in advance in the projection area such as a printed material, and the image to be projected, The combination with the image projected from the projector can be various combinations.

  First, when the image of the projection area (printed material, etc.) is a train or bus timetable, the portable electronic device takes into account the current time and projects an image that illuminates the next part of the train or bus (highlight) May be. Thereby, the user can know the next train or bus. In addition, when there is a schedule revision, portable electronic devices are updated by obtaining the latest schedule information from external devices (for example, railway company servers, bus company servers, publisher servers, etc.). An image that illuminates the illuminated area may be projected (highlighted). Thereby, the user can know the trains and buses that have been revised. The portable electronic device may acquire operation / delay information from an external device (for example, a server of a railway company, a server of a bus company, etc.) and project the acquired operation / delay information. Thereby, the user can know the latest operation / delay information.

  In addition, when the image of the projection area (printed material, etc.) is a sports surface of a newspaper, the portable electronic device can send information such as the score of a game and the number of medals that are not determined at the time of drafting to an external device (for example, a newspaper company server). ) And the contents of the acquired information may be projected. Thus, the reader can know information such as the score of the competition determined after the draft and the number of medals obtained.

  In addition, when the image (printed material, etc.) of the projection area is a travel guide book, the portable electronic device acquires the information updated with the tour information from an external device (for example, a publisher's server). Information may be projected. As a result, the reader can know the latest tour information. In addition, the portable electronic device acquires information such as store menu revisions and campaigns from external devices (for example, publisher servers, store servers, etc.) and informs readers of store menu revisions and campaign information. Marks and highlights may be projected. As a result, the reader can know information such as store menu revisions and campaigns.

  In addition, when the image of the projection area is a magazine, the portable electronic device leaves the music CD sales ranking and the book sales ranking ranking table blank, and the music CD sales ranking and book sales ranking information is stored in the external device. The ranking information obtained from (for example, a publisher's server) may be projected into a blank ranking table. Thereby, the reader can know the latest ranking information. Further, the portable electronic device may obtain information on the inventory status of the product from an external device (for example, a server of an online mail order shop) and project the acquired inventory status information on the product. Thereby, the reader can know the latest stock status.

  In addition, when the image of the projection area is a map, the mobile electronic device acquires information on a newly constructed road from an external device (for example, a publisher's server), and projects the newly constructed road on the map. May be. Thereby, the user can know the latest road information. The portable electronic device may acquire traffic information and construction information from an external device (for example, a highway company server, a VICS server, etc.) and project the acquired information. Thereby, the user can know the latest traffic jam information and construction information.

  In addition, when the image of the projection area is an image of a specialized book, the portable electronic device may acquire the revised contents of characters and diagrams from an external device (for example, a publisher server) and project the acquired information. Good. This allows readers to know the latest revision.

  Further, when the image of the projection area is an instruction manual, the portable electronic device may project the time (end time) required to assemble the object according to the instruction manual in real time. Thereby, the user can know the end time in advance.

  In addition, when the image of the projection area is an examination ticket, the portable electronic device may obtain information on the examination time and the congestion status from an external device (for example, a hospital server) and project the obtained information. In addition, information on the examination time and the congestion status may be projected on the examination ticket or may be projected on an arbitrary place (for example, a wall surface of the waiting room). Thereby, the user can know the latest examination time and the congestion situation.

  In addition, when the image of the projection area is an electronic bulletin board, the portable electronic device provides information on traffic congestion / construction status, evacuation route, congestion status (in-car and each station / bus stop congestion status) external device (for example, expressway company) The server, a railway company server, a bus company server, etc.) and the obtained information may be projected. Thereby, the user can know the latest traffic jam / construction status, evacuation route, and congestion status.

  As described above, the portable electronic device and the image projection unit according to the present invention are useful for a device including an apparatus capable of projecting an image, such as a projector.

DESCRIPTION OF SYMBOLS 1 Portable electronic device 1C Case 2 Display 13 Operation part 13A Operation key 13B Direction and determination key 22 Processing part 22a Projector control part 22b Image processing part 22c Condition determination part 22d Posture / position calculation part 22e Projection image determination part 22f Camera control part 24 Storage Unit 25 External Storage Unit 30 Audio Processing Unit 31 Visible Light Irradiation Device 32 Display Unit 34 Projector 35 Drawing Device 39 Focus Adjustment Device 40 Camera

Claims (8)

A housing,
An image projection unit provided in the housing for projecting an image onto a projection area;
An information acquisition unit provided in the housing for acquiring information from an external device;
A processing unit that acquires information of a specific projection image corresponding to a first image previously arranged in the projection region by the information acquisition unit, and projects the acquired projection image information from the image projection unit;
An imaging unit that captures an image in a direction in which the image projection unit projects an image;
Including
The specific projected image is an image associated with the first image of the projection area, see contains an image indicating that the information in the first image has been updated,
The processor is
The first image of the projection area is determined based on the image captured by the imaging unit, the information on the specific projection image is acquired by the information acquisition unit based on the determined result, and projected.
A portable electronic device , wherein an image obtained by combining the image photographed by the photographing unit and the specific projection image is displayed, and then the specific projection image is projected on condition that a projection permission operation is performed .   The portable electronic device according to claim 1, wherein the processing unit acquires information including whether or not the specific projection image is updated from an external device.   The portable electronic device according to claim 1, wherein the casing has a coupling mechanism coupled to a support base. 2. The mobile phone according to claim 1 , wherein the processing unit switches a specific projection image to be projected when detecting that the first image of the projection region is switched based on an image photographed by the photographing unit. Electronics. The processing unit adjusts the size of the specific projection image to be projected based on the image captured by the imaging unit, and projects the specific projection image at a predetermined position in the projection region. The portable electronic device according to any one of claims 1 to 4 . The processing unit acquires identification information from an image captured by the imaging unit, determines a first image of the projection region based on the acquired identification information, and selects a specific projection image corresponding to the image of the projection region. the portable electronic device according to claim 1, any one of 5, characterized in that obtained by the information obtaining unit. A portable electronic device according to claim 3;
A support base connected to the connection mechanism and fixing the portable electronic device in a specific posture;
A dedicated screen fixed to the support base and disposed in the projection area;
A printed matter that is held on the dedicated screen and on which the first image is arranged,
The portable electronic device projects an image related to the first image as the specific projection image. The image projection unit according to claim 7 , wherein the dedicated screen has a guide formed on a surface thereof indicating a position where the printed material is installed.

Images