JP2004120698A - Information processing terminal and method, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To easily and speedily acquire data of an optimal image to be projected. <P>SOLUTION: Based upon an image picked up in response to an instruction of a user, contents of a bar code 193 are read, and data corresponding to the bar code 193 are acquired by an information processing terminal 1. When the data corresponding to the bar code 193 are acquired, an image represented by the data is projected by the information processing terminal 1. After the user picks up an image of the bar code 193, when a surface of the information processing terminal 1 whereon a projection part is provided is turned toward a fossil sample 192, at a position of the fossil sample 192, an image of dinosaur whose body and substance are given is projected. The invention may be applied to an information processing terminal such as a personal computer provided with a projector function. <P>COPYRIGHT: (C)2004,JPO

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to an information processing terminal, a method, and a program, and more particularly, to an information processing terminal, a method, and a program that enable easy and quick acquisition of optimal image data to be projected.
[0002]
[Prior art]
In recent years, by adding a communication function with external devices to a projector used in a place such as a conference and operating a personal computer connected to the projector, a presentation can be easily made using data prepared in the personal computer. There is something that can be done (Patent Document 1).
[0003]
In addition, the projector itself is equipped with an OS (Operating System) such as Windows (registered trademark) in the same manner as a personal computer, and for example, it is possible to directly operate the projector and give a presentation using data prepared in advance. Some exist (Non-Patent Document 1).
[0004]
[Patent Document 1]
JP-A-2002-218420 (page 5, FIG. 3)
[Non-patent document 1]
"Expanding World of Windows (R) CE OS: Sony VPL-FX50 Network Projector with Built-in Windows (R) CE", [online], May 9, 2001 Edition, [Search July 3, 2002], Internet, URL < http: // www. wince. ne. jp / snap / ceSnapView. asp? PID = 218>
[0005]
[Problems to be solved by the invention]
However, the devices and the like described in the above-mentioned non-patent literature only combine the function of the projector and the function of the personal computer, and the function of the projector is simply an output that outputs the content processed by the personal computer. It only has a function as a device.
[0006]
Therefore, the user needs to select the data of the image projected by the projector and instruct the projection timing.
[0007]
The present invention has been made in view of such a situation, and enables easy and quick acquisition of optimal image data to be projected without depending on input from a user. To provide a new usage form of
[0008]
[Means for Solving the Problems]
The information processing terminal of the present invention is represented by an imaging processing unit that captures an image of a subject, an acquisition processing unit that acquires predetermined data based on an imaging result of the imaging processing unit, and data acquired by the acquisition processing unit. And first projection processing means for projecting an image.
[0009]
The image processing apparatus may further include second projection processing means for projecting a predetermined graphic image for acquiring the shape of the image receiving surface. In this case, the imaging processing means captures the image receiving surface on which the graphic image is projected by the second projection processing means, and the first projection processing means captures the image receiving surface obtained based on the imaging result by the imaging processing means. Project an image corrected in accordance with the shape of.
[0010]
Measurement processing means for measuring the distance to the image receiving surface may be further provided. In this case, the first projection processing unit projects the image when the distance to the image receiving surface measured by the measurement processing unit is within a predetermined distance.
[0011]
The image processing apparatus may further include second projection processing means for projecting a predetermined graphic image on the image receiving surface. In this case, the imaging processing unit captures the image receiving surface on which the graphic image is projected by the second projection processing unit, and the measurement processing unit determines the image receiving surface based on the size of the graphic image in the imaging result by the imaging processing unit. Measure the distance to
[0012]
An emission processing unit that emits light to the image receiving surface may be further provided. In this case, the measurement processing unit measures the distance to the image receiving surface based on the reflected wave of the light emitted by the emission processing unit.
[0013]
The information processing apparatus may further include identification information acquisition processing means for acquiring predetermined identification information based on a result of imaging by the imaging processing means. In this case, the acquisition processing unit acquires data corresponding to the identification information acquired by the identification information acquisition processing unit.
[0014]
Second projection processing means for projecting an image representing a predetermined input device, and detection processing means for detecting a user input to the image of the input device projected by the second projection processing means are further provided. Can be. In this case, the acquisition processing unit acquires data based on a user input detected by the detection processing unit, and the projection unit displays an image based on the acquired input data in an area other than the image representing the input device. .
[0015]
The imaging unit that performs imaging by the imaging processing unit and the projection unit that performs projection by the first projection processing unit may be formed on the same plane of the housing.
[0016]
An information processing method of an information processing terminal according to the present invention includes: an imaging processing step of imaging a subject; an acquisition processing step of acquiring predetermined data based on an imaging result obtained by the processing of the imaging processing step; And a projection processing step of projecting an image represented by the acquired data.
[0017]
The program of the present invention is obtained by an imaging control processing step of controlling imaging of a subject, an obtaining processing step of obtaining predetermined data based on an imaging result of the imaging control processing step, and an obtaining processing step of obtaining predetermined data. And a projection control processing step of controlling projection of an image represented by the data.
[0018]
In the information processing terminal, the method, and the program of the present invention, a subject is imaged, and predetermined data is obtained based on the imaging result. Further, an image represented by the acquired data is projected.
[0019]
BEST MODE FOR CARRYING OUT THE INVENTION
1 to 5 are perspective views showing a configuration example of an information processing terminal 1 to which the present invention has been applied.
[0020]
The housing 11 has a substantially rectangular parallelepiped shape in which the front-rear direction is slightly longer than the left-right direction. Here, the front direction of the housing 11 refers to the direction in which the surface 11b on which the projection unit 23 and the imaging unit 24 are provided (left direction in FIG. 1), and the rear direction of the housing 11 corresponds to the surface 11b. It refers to the direction (the right direction in FIG. 1) in which the facing surface 11e (FIG. 4) is formed.
[0021]
The housing 11 is sized so that the user can hold it with one hand. Therefore, when using the information processing terminal 1, the user holds the entire housing 11 with the right hand, for example, so that the surface 11e faces the user.
[0022]
An LCD (Liquid Crystal Display) 21 is provided on the upper surface 11a of the housing 11 at a position slightly forward from the center thereof, and numeric keys and operation keys 22 operated when performing various operations are provided at positions slightly backward from the center. Is provided. Since various menus and icons are appropriately displayed on the LCD 21, the user performs various operations with the operation keys 22 according to the display. Further, the same image as the image projected from the projection unit 23 can be displayed on the LCD 21.
[0023]
From a numeric keypad, for example, a general mobile phone, in which, by successively pressing the same key, the selected character is sequentially switched, and the selected character is input when instructing determination, etc. Characters are input according to the method adopted in. Of course, a keyboard having a narrow key pitch may be provided at the position of the operation key 22.
[0024]
When the user grips the housing 11 with one hand, the user's thumb is located near the operation key 22, so that the user operates the operation key 22 to operate a single-handed character as if operating a general mobile phone. Can be entered.
[0025]
Note that a touch pad 72 (FIG. 6) is superimposed on the LCD 21, and the user can also operate the LCD 21 by directly pressing the LCD 21.
[0026]
A projection unit 23 that projects an image of the selected data on an image receiving surface is provided on a surface 11 b of the housing 11. The projection unit 23 is provided with a lens, and the light emitted from the light source provided inside the housing 11 is transmitted to the outside of the housing 11 through the LCD (the projection LCD 77 (FIG. 6)) and the lens. Is emitted. Therefore, an image corresponding to the image displayed on the projection LCD 77 is projected on the image receiving surface provided at a predetermined distance away from the surface 11b.
[0027]
An imaging unit 24 is provided immediately to the left of the projection unit 23. Similarly, a lens is provided in the imaging unit 24, and an imaging element such as a CCD (Charge Coupled Device) 71 (FIG. 6) is provided therein.
[0028]
As will be described later, in the information processing terminal 1, various data are read in accordance with the imaging result of the imaging unit 24, and an image (an image corresponding to the data) represented by the read data is transmitted from the projection unit 23. Projected. The pointer displayed on the projected image can be moved by operating the touch pad 72.
[0029]
On the left side surface 11c of the housing 11, an interface for connecting various devices is provided near the center thereof. For example, from the front to the rear of the housing 11, a video input terminal 25 to which a video signal is input, an audio input terminal 26 to which an audio signal is input, an IEEE (Institute of Electrical and Electronics Engineers) to which various drives and keyboards are connected. ) Port 27, and USB (Universal Serial Bus) ports 28 and 29 are provided.
[0030]
Further, one end of a positioning member 13 that is rotatable within a predetermined range around an axis α indicated by a dashed line in FIG. 2 is fixed by a shaft portion 13A formed in front of the left side surface 11c. Meanwhile, the other end of the positioning member 13 is axially fixed by a shaft portion 13B formed in front of the right side surface 11d shown in FIG.
[0031]
The positioning member 13 is a member 13-1 that rotates in the same plane as the left side surface 11c about the shaft portion 13A, and a member that rotates in the same plane as the right side surface 11d about the shaft portion 13B. 13-3 and a member 13-2 which crosses the members 13-1 and 13-3 at right angles and is formed to connect the members 13-1 and 13-3. The members 13-1 to 13-3 are rotated in conjunction with each other.
[0032]
The height of the front of the housing 11 is adjusted by the positioning member 13, and the angle of the projection axis of the projection unit 23 is determined. That is, when the angle of the projection axis is positioned, the entire information processing terminal 1 is formed by the member 13-2 of the positioning member 13 and one side of the rear bottom surface of the battery pack 14 mounted on the bottom surface 11f (FIG. 5) of the housing 11. Is supported.
[0033]
For example, as shown in FIG. 2, when the positioning member 13 is fixed substantially vertically downward, the angle between the projection axis and the horizontal axis becomes maximum, and the light from the projection unit 23 can irradiate the upper part. It becomes. The maximum angle between the projection axis and the horizontal axis can be appropriately changed according to the length of the members 13-1 and 13-3 of the positioning member 13.
[0034]
On the other hand, as the positioning member 13 is rotated in the outline arrow A1 direction with respect to the substantially vertical downward direction, the angle between the projection axis and the horizontal axis gradually decreases, and the member 13-2 Becomes minimum when one end of the contact is made.
[0035]
Similarly, the angle between the projection axis and the horizontal axis gradually decreases as the positioning member 13 is rotated in the direction indicated by the outline arrow A2 on the basis of the substantially vertical downward direction, and the projection axis and the horizontal axis become parallel. When the surface of the battery pack 14 comes into contact with the plane on which the information processing terminal 1 is placed (when the information processing terminal 1 is no longer supported by the member 13-2), the positioning is performed. The positioning by the member 13 is released.
[0036]
Further, the positioning member 13 is rotatable in a direction indicated by a white arrow A3 from the position where the positioning is released to a position where one end of the member 13-2 is in contact with the upper surface 11a of the housing 11.
[0037]
Therefore, the user can adjust the position of the positioning member 13 and project an image at a position at an optimum height according to the distance to the image receiving surface.
[0038]
As shown in FIG. 3, a fixing belt 12 is provided on the right side surface 11 d of the housing 11 so as to fix the upper of the housing 11 when the user grips the housing 11 from above with the right hand. The fixed belt 12 prevents the information processing terminal 1 from falling.
[0039]
FIG. 4 is a perspective view of the back side of the information processing terminal 1, and a memory card slot 30 is formed on a surface 11e opposite to the surface 11b. Predetermined image data and the like are provided to the information processing terminal 1 by the memory card inserted into the memory card slot 30, and, for example, a corresponding image is projected from the projection unit 23.
[0040]
FIG. 5 is a perspective view of the bottom surface side of the information processing terminal 1. The surface 11 g is formed in front of the bottom surface of the housing 11 (right side in FIG. 5), and is formed in a wide range behind the bottom surface (left side in FIG. 5). The surface 11f forms a step corresponding to the height of the battery pack 14. When the battery pack 14 is mounted on the surface 11f as indicated by the outline arrow, one surface is formed by the surface of the battery pack 14 (the surface of the battery pack 14 shown in FIG. 5) and the surface 11g. You.
[0041]
Terminals 31A and 31B are provided on the surface 11f of the housing 11, and power is supplied from the battery pack 14 to the housing 11 via these terminals 31A and 31B.
[0042]
FIG. 6 is a block diagram illustrating an example of the internal configuration of the information processing terminal 1 in FIG.
[0043]
The CPU (Central Processing Unit) 51 includes, for example, a Pentium (registered trademark) processor manufactured by Intel Corporation, and is connected to the host bus 52. A bridge 53 (a so-called north bridge) is further connected to the host bus 52. The bridge 53 has an AGP (Accelerated Graphics Port) 50 and is connected to a PCI (Peripheral Component Interconnect / Interface) bus 56. ing.
[0044]
The bridge 53 includes, for example, 440BX, which is an AGP Host Bridge Controller manufactured by Intel Corporation, and controls transmission of data such as a CPU 51 and a RAM (Random Access Memory) 54 (so-called main memory). Further, the bridge 53 controls data transmission with the video controller 57 via the AGP 50. The bridge 53 and the bridge (so-called south bridge (PCI-ISA Bridge)) 58 constitute a so-called chipset.
[0045]
The bridge 53 is further connected to a cache memory 55. The cache memory 55 is configured by a memory that can execute a write or read operation at a higher speed than the RAM 54, and caches (temporarily stores) a program or data used by the CPU 51.
[0046]
The CPU 51 has a primary cache memory (a memory that can operate at a higher speed than the cache memory 55 and is controlled by the CPU 51 itself).
[0047]
The RAM 54 is composed of, for example, a DRAM (Dynamic RAM), and stores a program executed by the CPU 51 or data necessary for the operation of the CPU 51. Specifically, for example, the RAM 54 stores the e-mail program 54A, the auto-pilot program 54B, the display control program 54C, the OS (Operating System) 54D, and other application programs 54E1 loaded from the HDD 66 at the time of completion of the startup. To 54En.
[0048]
The e-mail program 54A is a program for sending and receiving so-called e-mails via a network or the like.
[0049]
The autopilot program 54B is a program that sequentially activates and executes a plurality of preset processes (or programs) in a preset order.
[0050]
The display control program 54C is a program for controlling an image projected from the projection unit 23. The detailed functional configuration will be described later.
[0051]
The OS 54D is a program for controlling basic operations of a computer represented by, for example, Windows (registered trademark) 2000 of Microsoft Corporation or so-called Mac OS (trademark) of Apple Computer Corporation. is there.
[0052]
The video controller 57 is connected to the bridge 53 via the AGP 50, receives data (eg, image data or text data) supplied from the CPU 51 via the AGP 50 and the bridge 53, and outputs an image corresponding to the received data. The data is generated or the received data is stored as it is in a built-in video memory.
[0053]
The video controller 57 controls display on the LCD 21 provided on the upper surface 11 a of the housing 11 and display on the projection LCD 77 formed inside the housing 11.
[0054]
For example, the projection LCD 77 is composed of three monochrome LCDs. Each LCD transmits light that is emitted from a light source (not shown), is divided into three colors of RGB light by a dichroic mirror, and is guided. I do. The lights transmitted through the three LCDs are combined into one light by a dichroic prism, transmitted through a lens, and emitted from the projection unit 24 to the outside of the housing 11.
[0055]
The same image may be displayed on the LCD 21 and the projection LCD 77 at the same time, or different images may be displayed.
[0056]
A part of the light from the light source for projecting the image displayed on the projection LCD 77 may be used as the backlight of the LCD 21. Thereby, the continuous driving time can be extended.
[0057]
The memory card interface 65 is connected to the PCI bus 56, and supplies data supplied from the memory card mounted on the memory card slot 30 (FIG. 4) to the CPU 51 or the RAM 54, and, when necessary, supplied from the CPU 51. Output data to memory card.
[0058]
A bridge 58 (so-called south bridge) is also connected to the PCI bus 56. The bridge 58 is made of, for example, PIIX4E manufactured by Intel Corporation, and includes an IDE (Integrated Drive Electronics) controller / configuration register 59, a timer circuit 60, an IDE interface 61, a USB (Universal Serial Bus) interface 62, and the like. Built-in.
[0059]
The bridge 58 is used to control various devices such as a device connected to the IDE bus 63 or an ISA / EIO (Industry Standard Architecture / Extended Input Output) bus 64 or a device connected via the I / O interface 67. / O (Input / Output).
[0060]
The IDE controller / configuration register 59 includes two IDE controllers, a so-called primary IDE controller and a secondary IDE controller, a configuration register (configuration register), and the like (neither is shown).
[0061]
The HDD 66 is connected to the primary IDE controller via the IDE bus 63. When a so-called IDE device such as a CD-ROM drive or HDD (not shown) is mounted on another IDE bus, the mounted IDE device is electrically connected to the secondary IDE controller.
[0062]
The HDD 66 records an e-mail program 66A, an autopilot program 66B, a display control program 66C, an OS 66D, and a plurality of other application programs 66E1 to 66En. The e-mail program 66A, the auto-pilot program 66B, the display control program 66C, the OS 66D, and the application programs 66E1 to 66En recorded on the HDD 66 are sequentially supplied to the RAM 54, for example, in the course of startup (boot-up) processing. , Will be loaded.
[0063]
The USB interface 62 transmits data to a device connected via the USB port 28 or 29 and receives data from the device.
[0064]
The timer circuit 60 supplies data indicating the current time to the CPU 51 via the PCI bus 56.
[0065]
The I / O interface 67 is further connected to the ISA / EIO bus 64. The I / O interface 67 is composed of an embedded controller, in which a ROM 68, a RAM 69, and a CPU 70 are mutually connected.
[0066]
The ROM 68 stores an IEEE 1394 interface program 68A, a touch pad input monitoring program 68B, a key input monitoring program 68C, a wake-up program 68D, and the like in advance.
[0067]
The IEEE 1394 interface program 68A transmits and receives data (data stored in a packet) conforming to the standard defined by IEEE 1394 through the IEEE 1394 port 27. The touch pad input monitoring program 68B is a program for monitoring an input from the touch pad 71 provided to be superimposed on the LCD 21.
[0068]
The key input monitoring program 68C is a program for monitoring inputs from the operation keys 22 or other key switches. The wake-up program 68D checks whether or not a preset time has been reached based on the data indicating the current time supplied from the timer circuit 60 of the bridge 58. When the preset time has come, a predetermined process is performed. (Or a program) is a program that manages the power supply of each chip constituting the information processing terminal 1 in order to activate the information processing terminal 1.
[0069]
In the ROM 68, a BIOS (Basic Input / Output System (basic input / output system)) 68E is further written. The BIOS 68E exchanges data (input / output) between the OS or application programs and peripheral devices (the operation keys 22, the CCD 71, the touch pad 72, the IR emitting / receiving unit 73, the position detecting unit 74, the HDD 66, etc.). Control.
[0070]
The RAM 69 includes registers for touchpad input status, key input status, or set time, IEEE 1394 I / F registers, and the like as registers 69A to 69F.
[0071]
The CCD 71 connected to the I / O interface 67 is provided via a lens in a direction inside the imaging unit 24, and captures an image of a subject at a predetermined timing. The image data obtained by the imaging is output to the I / O interface 67 and supplied to the CPU 51 and the like as appropriate.
[0072]
The IR (Infrared) emitting / receiving unit 73 is provided, for example, in a hole of the surface 11b where the projection unit 23 is formed or in a hole where the imaging unit 24 is formed, and emits infrared light at a predetermined timing. And receives the reflected light. As will be described later, for example, the distance to the image receiving surface is detected from the timing at which the emitted infrared reflected wave is received.
[0073]
The position detecting unit 74 includes, for example, a GPS (Global Positioning System) module, an electronic compass, a gyro sensor, and the like, the current position of the information processing terminal 1, the direction in which the front of the information processing terminal 1 is facing, the information processing terminal 1 The posture position (angle) of the camera is detected.
[0074]
The power supply control circuit 75 is connected to the battery pack 14 via the terminals 31A and 31B (FIG. 5), supplies necessary power to each block, and charges the battery pack 14 or a second battery of a peripheral device. Control.
[0075]
The I / O interface 67 controls transmission and reception of data to and from a device connected via the IEEE 1394 port 27, a so-called wireless LAN (Local Area Network) module such as IEEE 802.11a or 802.11b, or a wired LAN. It controls transmission and reception of data, such as messages or file data, with a network interface 76 such as a LAN connector and a device connected via a network.
[0076]
The drive 101 is appropriately connected to the information processing terminal 1 via a USB port 28 or 29 or an IEEE 1394 port 27. The drive 101 reads data recorded on the magnetic disk 102, the optical disk 103, the magneto-optical disk 104, or the semiconductor memory 105 to be mounted, and supplies the read data to the RAM 54 or the HDD 66.
[0077]
FIG. 7 is a block diagram illustrating a functional configuration example of the information processing terminal 1.
[0078]
Each configuration shown in FIG. 7 is realized by the display control program 66C being expanded in the RAM 54.
[0079]
The captured image acquisition program 121 acquires image data of a result of imaging by the imaging unit 24 (CCD 71), and outputs it to the identification information acquisition program 122 or the projection image generation program 124.
[0080]
The identification information acquisition program 122 analyzes the image data supplied from the captured image acquisition program 121 and acquires identification information. For example, when image data of a barcode captured by the CCD 71 is supplied, the identification information acquisition program 122 reads the barcode as identification information. Further, when image data of a predetermined person's face imaged by the CCD 71 is supplied, the identification information acquisition program 122 identifies a person from the image data and acquires information representing the person. The identification information acquired by the identification information acquisition program 122 is output to the source data acquisition program 123.
[0081]
The source data acquisition program 123 acquires data (source data) of an image projected from the projection unit 24 and outputs it to the projection image generation program 124. For example, when projecting predetermined image data stored in the HDD 66, the source data acquisition program 123 reads the image data from the HDD 66 as source data, and projects the image data acquired via the network. Get image data as source data. Further, the source data acquisition program 123 acquires data corresponding to the identification information supplied from the identification information acquisition program 122, and outputs the acquired data to the projection image generation program 124.
[0082]
The projection image generation program 124 generates an image projected from the projection unit 23, and causes the projection LCD 77 to display the generated image. For example, the projection image generation program 124 generates an image to be projected based on the image data supplied from the captured image acquisition program 121 and the image data supplied from the source data acquisition program 123, and outputs the image to the projection LCD 77. Display. Note that the image generated by the projection image generation program 124 is appropriately corrected according to the positional relationship between the information processing terminal 1 and the image receiving surface.
[0083]
The navigation control program 125 controls the position detection unit 74 to detect the current position of the information processing terminal 1, the direction of the information processing terminal 1, the attitude position of the information processing terminal 1, and the like, and the navigation acquired based on the detection result. The image is output to the projection image generation program 124.
[0084]
The IR detection program 126 controls the IR emission / light reception unit 73 and outputs, for example, information indicating the timing at which the reflected wave of infrared rays is received to the projection image generation program 124. For example, the distance from the housing 11 to the image receiving surface is calculated by the projection image generation program 124, and the image is projected when the distance from the housing 11 to the image receiving surface is within a predetermined range. If the distance to the camera is more than a predetermined range, the projection of the image is limited.
[0085]
Further, the image projected on the projection surface is captured using the autofocus function of the imaging unit 24, the degree of focus of the projected image is identified, and the focus of the projection unit 23 is automatically adjusted. You may do so.
[0086]
Next, the operation of the information processing terminal 1 having the above configuration will be described.
[0087]
First, a process of the information processing terminal 1 for projecting an image corresponding to source data from the front of the image receiving surface will be described with reference to a flowchart of FIG.
[0088]
In step S1, the source data acquisition program 123 acquires source data and outputs it to the projection image generation program 124. For example, when the operation key 22 is operated and a character is input, the source data obtaining program 123 obtains text data corresponding to the user's input as source data and outputs it to the projection image generating program 124. When the user instructs to reproduce a predetermined image, data for reproducing the designated image is obtained from the HDD 66 or via the network interface 76 and output to the projection image generation program 124. You.
[0089]
In step S2, the projection image generation program 124 causes the projection LCD 77 to display an image corresponding to the data supplied from the source data acquisition program 123, and projects the image on the image receiving surface. That is, light from the light source passes through the projection LCD 77 and the lens and is emitted from the projection unit 23 to the outside of the housing 11, and an image corresponding to the image displayed on the projection LCD 77 is displayed on the image receiving surface.
[0090]
FIG. 9 is a diagram illustrating an example of an image projected on an image receiving surface.
[0091]
For example, the information processing terminal 1 placed on the horizontal surface 151 is in front of the image receiving surface 152 (the normal axis of the image receiving surface and the projection axis of the information processing terminal 1 are in the same plane), and the user 141H responds “ When the character "Hello" is input from the operation keys 22, text data corresponding to the input is obtained, and a projection image 152A of "Hello" is displayed on the image receiving surface 152. Note that, in practice, the vertical direction of the projection image 152A is corrected according to the angle of the projection axis positioned by the positioning member 13.
[0092]
In this way, by projecting the image on the image receiving surface, it is not necessary to prepare a large display device such as an LCD in the information processing terminal 1 itself, and the terminal can be reduced in size.
[0093]
That is, in order to perform various operations more efficiently, a large display device such as an LCD is required, and miniaturization of the entire terminal is limited by the size of the display device. By projecting, the size can be reduced without being limited by the size of the display device.
[0094]
The case where the information processing terminal 1 is disposed in front of the image receiving surface 152 has been described above. For example, as illustrated in FIG. 10, the projection axis β of the information processing terminal 1 and the normal axis of the image receiving surface 152 If γ has an angle (both axes are not in the vertical plane), projected image 152A will be distorted according to that angle, and image correction will be required. For example, when a rectangular image is projected without performing image correction, the image is gradually enlarged and projected on the image receiving surface 152 as the distance from the projection unit 23 increases, as in a projected image 152A in FIG.
[0095]
Next, the processing of the information processing terminal 1 that corrects an image according to the positional relationship with the image receiving surface and projects the image will be described with reference to the flowchart of FIG.
[0096]
In step S11, the projection image generation program 124 acquires information on the positional relationship with the image receiving surface. Specifically, the projection image generation program 124 projects a grid-like graphic image (an image in which a plurality of square images are arranged) on an image receiving surface based on data supplied from the source data acquisition program 123.
[0097]
When the image data of the image receiving surface captured by the image capturing unit 24 is supplied from the captured image obtaining program 121, the projection image generating program 124 generates a distortion of the grid projected on the image receiving surface based on the image data. And the positional relationship between the image receiving surface and the housing 11, that is, the angle between the normal axis and the projection axis of the image receiving surface is obtained.
[0098]
For example, the degree of lattice distortion is acquired by the information processing terminal 1 by projecting a lattice-like image 152B as shown in FIG. Thus, the angle between the projection axis β and the normal axis γ of the image receiving surface is obtained.
[0099]
In the example of FIG. 12, the projection axis β of the information processing terminal 1 and the normal axis γ of the image receiving surface 152 are not in the vertical plane, and a predetermined angle is generated between these axes. A keyboard 161 is connected to the USB port 27 of the information processing terminal 1 via a USB cable 162.
[0100]
Note that the image projected to acquire the positional relationship between the information processing terminal 1 and the image receiving surface 152 is not limited to a lattice-shaped image, but is simply a circular image, a rectangular image, or a square image. For example, images of various figures may be projected. For example, the positional relationship between the information processing terminal 1 and the image receiving surface 152 is obtained by projecting a circular image and acquiring the degree of the circular distortion projected on the image receiving surface from the imaging result of the image capturing unit 24.
[0101]
Returning to the description of FIG. 11, in step S12, source data is acquired by the source data acquisition program 123, and the acquired source data is output to the projection image generation program 124.
[0102]
In step S13, the projection image generation program 124 corrects the image corresponding to the data supplied from the source data acquisition program 123, based on the information on the positional relationship with the image receiving surface acquired in step S11.
[0103]
For example, as shown in FIG. 12, when the information processing terminal 1 is on the left side with respect to the normal axis of the image receiving surface 152, and the grid-shaped image 152 </ b> B is projected, (A portion), a larger correction amount is given, and the image is corrected such that the user 141H facing the front of the image receiving surface 152 can check the image 152B in which the squares are arranged. On the other hand, when the information processing terminal 1 is on the right side with respect to the normal axis of the image receiving surface 152, a larger correction amount is given to the left side of the projected image 152B, and the user facing the image receiving surface 152 The image is corrected so that 141H can confirm the image 152B in which the squares are arranged.
[0104]
The vertical direction of the image 152B is corrected according to the angle of the projection axis positioned by the positioning member 13.
[0105]
After correcting the image to be projected in accordance with the positional relationship with the image receiving surface, in step S14, the projection image generation program 124 displays the corrected image on the projection LCD 77, and projects the image corresponding to the source data. .
[0106]
Thus, for example, as shown in FIG. 13, even when the information processing terminal 1 is not installed in front of the image receiving surface 152, the character “Hello” input by the user 141H operating the keyboard 161 is input. Is suppressed from being distorted and projected.
[0107]
As described above, since the image receiving surface on which the graphic image is projected is captured, and the correction is automatically performed based on the correction amount determined based on the image capturing result, the user can change the position of the information processing terminal 1. Even in the case of moving, it is possible to save the trouble of operating the operation keys 22 and the like by themselves to perform correction. In the information processing terminal 1 in which the size of the housing 11 is relatively small and the user can carry it freely, this effect is remarkable. Naturally, the correction amount may be determined by a manual operation by the user.
[0108]
Next, the processing of the information processing terminal 1 when the image receiving surface is not flat will be described with reference to the flowchart in FIG.
[0109]
In step S21, the projection image generation program 124 acquires information on the shape of the image receiving surface. For example, as in the case described above, the projection image generation program 124 projects a grid-like graphic image on an object serving as an image receiving surface based on the data supplied from the source data acquisition program 123, and acquires the captured image. Information on the shape of the image receiving surface is acquired based on the imaging result of the object on which the lattice image is projected, supplied from the program 121.
[0110]
Further, infrared rays may be emitted toward various positions of the object, and the shape of the object may be acquired based on the timing at which the reflected wave is received.
[0111]
Further, when a plurality of imaging units are provided on the same plane of the housing 11, the shape of the object may be acquired based on the parallax of each imaging unit.
[0112]
The processing in steps S22 to S24 is the same as the processing in steps S12 to S14 in FIG. That is, in step S22, data of an image to be projected on the object is acquired by the source data acquisition program 123, and an image corresponding to the acquired data is corrected in step S23 according to the shape of the object. . Then, in step S24, the corrected image is projected on the object having the image receiving surface.
[0113]
For example, when an image is projected on the columnar object 171 shown in FIG. 15, first, as shown in the figure, a grid image 171A is projected on the object 171 and the object 171 on which the image 171A is projected is shown. Is imaged by the imaging unit 24. Then, the shape of the object 171 is acquired by the projection image generation program 124 based on the density of the grid in the image of the imaging result, and the same image as that projected on the plane is projected on the object 171 regardless of the shape. Thus, the image is corrected.
[0114]
By the above processing, for example, a circular image 171B is projected on the side surface of the object 171 as shown in FIG. If the circular image to be projected is not corrected, the circular image 171B projected on the side surface of the cylindrical object 171 is confirmed by the user as an ellipse whose horizontal axis is longer than the vertical axis. Will be done.
[0115]
Similarly, by correcting the image according to the shape of the object as the image receiving surface and projecting the corrected image data, for example, as shown in FIG. 17, a square pyramid was placed on a cube. The color and pattern can be added to such an object 181 depending on the image to be projected. Also in this case, a lattice image is projected on the object 181, the object 181 on which the lattice image is projected is captured, and the shape of the object 181 is acquired based on the captured result.
[0116]
As described above, by performing the correction based on the imaging result of the image receiving surface (object) on which the graphic image is projected, the image can be projected on various image receiving surfaces.
[0117]
Next, the processing of the information processing terminal 1 that controls the projection of an image according to the distance to the image receiving surface will be described with reference to the flowchart in FIG.
[0118]
In step S31, the projection image generation program 124 acquires information on the distance to the image receiving surface. For example, when the infrared light emitted from a predetermined position on the surface 11b is reflected by the image receiving surface by the IR emitting / receiving unit 73 and information indicating the light receiving timing of the reflected wave is notified from the IR detection program 126, the projected image The generation program 124 acquires information indicating the distance to the image receiving surface based on the notified information.
[0119]
Further, the projection unit 23 projects, for example, a predetermined figure image of a square or a circle on an image receiving surface, and obtains a distance to the image receiving surface based on a captured image of the image receiving surface on which the figure image is projected. You may.
[0120]
In this case, the projection image generation program 124 projects the graphic image corresponding to the data supplied from the source data acquisition program 123 on the image receiving surface, and generates a graphic image of the graphic image in the image of the imaging result supplied from the captured image acquisition program 121. The distance to the image receiving surface is obtained based on the size (area). That is, as the distance to the image receiving surface is shorter, a larger graphic image is captured.
[0121]
In step S32, the projection image generation program 124 determines whether or not the distance from the housing 11 to the image receiving surface is within a predetermined range. If it is determined that the distance is equal to or more than the predetermined distance, the process proceeds to step S31. Return and repeat the subsequent processing. On the other hand, in step S32, when the projection image generation program 124 determines that the distance to the image receiving surface is within the predetermined range, the process proceeds to step S33, and thereafter, starts capturing an image.
[0122]
That is, an image corresponding to the source data acquired in step S33 by the source data acquisition program 123 is projected on an image receiving surface within a predetermined distance range in step S34.
[0123]
By the above processing, the projection is performed only when the distance to the image receiving surface is relatively short (when the distance is within a predetermined range). Therefore, the image projected on the image receiving surface is represented by sufficient light from the light source. And a high-contrast image is obtained. In addition, it is possible to limit the projection of an image that cannot be recognized by the user's eyes, and it is possible to suppress battery consumption.
[0124]
In the above, the case where the projection is controlled in accordance with the situation of the image receiving surface acquired based on the imaging result, in other words, the situation in which the information processing terminal 1 is mounted has been described. The operation of the information processing terminal 1 that projects an image corresponding to the information acquired from the resulting image will be described.
[0125]
First, a process of the information processing terminal 1 that projects an image corresponding to identification information acquired from an imaging result will be described with reference to a flowchart of FIG.
[0126]
In step S41, the captured image acquisition program 121 captures an image according to, for example, an instruction from a user, and outputs an image of the captured result to the identification information acquisition program 122.
[0127]
In step S42, the identification information acquisition program 122 acquires, from the image of the imaging result, identification information for identifying each data to be projected, and outputs the acquired identification information to the source data acquisition program 123.
[0128]
In step S43, the source data acquisition program 123 acquires data corresponding to the supplied identification information from the HDD 66 or via a network, and outputs the acquired data to the projection image generation program 124 as source data. .
[0129]
In step S44, the projection image generation program 124 projects an image corresponding to the data supplied from the source data acquisition program 123.
[0130]
According to the above processing, for example, as shown in FIG. 20, when a fossil specimen 192 is displayed on a wall surface 191 and a barcode 193 is prepared in the vicinity thereof in the museum, the user 141H First, in order to project an image acquired by the code 193, the surface 11b (imaging unit 24) of the housing 11 is aimed at the barcode 193 and photographed (step S41 in FIG. 19).
[0131]
In the information processing terminal 1, data corresponding to the barcode 193 obtained from the image of the imaging result is read (steps S42 and S43), and the image is projected (step S44).
[0132]
Therefore, when the user 141H shoots the surface 11b of the housing 11 toward the barcode 193 and subsequently faces the fossil specimen 192, the user 141H overlaps the fossil specimen 192 shown in FIG. Are projected.
[0133]
That is, in this case, as data corresponding to the bar code 193, image data for projecting the skeleton-only dinosaur (fossil) shown in FIG. Alternatively, it is obtained from a museum database via a wireless LAN or the like.
[0134]
Note that the user may be able to select an image to be actually projected from among images corresponding to data acquired based on the barcode 193. For example, a time axis may be displayed on the LCD 21 and a user may specify a predetermined time (age) so that an image of a dinosaur of the specified age is projected. This designation is detected by, for example, the touch pad 72 provided so as to overlap the LCD 21.
[0135]
In addition to the image 192A in which the fossils are fleshed out, various images corresponding to the identification information acquired from the image of the imaging result can be projected.
[0136]
For example, identification information is displayed in the vicinity of a painting displayed on a wall surface, and an explanation of the creator of the painting or the like may be projected in response to the identification information being captured, or a store. In, the description of the product may be projected in response to the image of the barcode printed on the packaging of each product.
[0137]
Further, the obtained identification information is not limited to a barcode, but may be, for example, a two-dimensional code or a numeric string of a predetermined digit.
[0138]
It should be noted that the correction process according to the positional relationship with the image receiving surface described with reference to FIG. 11, the correction process according to the shape of the image receiving surface described with reference to FIG. 14, or FIG. The control processing of projection according to the distance from the image receiving surface described above is also appropriately executed in the above-described processing of projecting an image corresponding to identification information. The same applies to various processes described below.
[0139]
Next, the processing of the information processing terminal 1 that images a person's face and projects information about the person will be described with reference to the flowchart in FIG.
[0140]
That is, in this process, the face of the person acquired based on the imaging result corresponds to the identification information.
[0141]
In step S51, the captured image acquisition program 121 controls the imaging unit 24 according to an instruction from a user to capture an image. Therefore, when the surface 11b of the housing 11 is turned to the face of the person by the user, the image of the person's face is imaged by the imaging unit 24. The captured image is output to the identification information acquisition program 122.
[0142]
In step S52, the identification information acquisition program 122 analyzes the supplied image data, and identifies the person as the subject from the feature data of each part constituting the person's face.
[0143]
In step S53, the source data acquisition program 123 acquires data corresponding to the person identified by the identification information acquisition program 122 from the HDD 66 or via a network, and uses the acquired data as source data as a projection image generation program. 124.
[0144]
In step S54, the projection image generation program 124 projects an image corresponding to the data supplied from the source data acquisition program 123.
[0145]
By the above processing, for example, as shown in FIG. 23, when the user 141H captures the face of the person 201 with the information processing terminal 1, and subsequently turns the surface 11b of the information processing terminal 1 toward the body of the person 201 Then, the person 201 is identified based on the image of the imaging result, and the information acquired as data corresponding to the person 201 (in the example of FIG. 23, the surname (Yamada) of the person 201) is projected on the body.
[0146]
As described above, various types of information can be obtained as identification information from an image of a captured result, and data corresponding thereto can be projected. That is, by using the imaging function of the imaging unit 24, the user can easily and quickly project an optimal image according to the situation without selecting data of the image to be projected by himself. .
[0147]
Next, an operation of the information processing terminal 1 that detects an operation performed by the user on the projected image based on the image of the imaging result and reflects the detected operation on the image to be projected will be described.
[0148]
The flowchart of FIG. 24 illustrates a process of the information processing terminal 1 that detects a user operation on an image of the keyboard projected on the image receiving surface based on the captured image, and reflects the detection result on the image to be projected.
[0149]
In step S61, the projection image generation program 124 projects an image of a keyboard as an input device on an image receiving surface based on data supplied from the source data acquisition program 123.
[0150]
FIG. 25 is a diagram illustrating an example of a keyboard image projected by the information processing terminal 1. For example, a member formed on a ceiling or the like in a state where the surface 11 b is directed to the top plate 211 (image receiving surface). The keyboard image 221 is projected from the information processing terminal 1 supported and fixed on the top plate 211 as an image receiving surface.
[0151]
Further, a display area 222 is formed above the keyboard image 221, and characters corresponding to an operation on the keyboard image 221 are displayed here. The display area 222 and the characters and the like displayed thereon are also images projected by the information processing terminal 1.
[0152]
In step S62, the projection image generation program 124 detects a user input (the movement of the user's finger) to the keyboard image 221 based on the image data captured and supplied by the captured image acquisition program 121, and then proceeds to step S63. To determine whether a character input has been detected.
[0153]
That is, after projecting the keyboard image 221, the state of the top board 211 including the keyboard image 221 is continuously imaged by the imaging unit 24.
[0154]
When the projection image generation program 124 determines in step S63 that an input has not been detected, the process returns to step S62. On the other hand, when it is determined that the user's finger has been moved to a predetermined character area and the input has been detected. In step S64, the source data acquisition program 123 is controlled to acquire image data for projecting a character input by the user.
[0155]
When the data of the image corresponding to the user's input is acquired, the projection image generation program 124 projects the image corresponding to the acquired data on the display area 222 of the top board 211 in step S65.
[0156]
The above processing is repeatedly executed, and the characters input by the user operating the keyboard image 221 are projected on the display area 222. In FIG. 25, the character “GOOD” is projected, and based on the image of the imaging result, the user can select “G” area, “O” area, “O” area, And the case where it is detected that the regions “D” are continuously operated.
[0157]
Thus, for example, even when no device is placed above, below, or near the top board 211, various operations using a personal computer, such as creation of sentences, can be performed.
[0158]
For example, the user can operate the keyboard image 221 to go to the Internet, create a text of an e-mail, and send it. When the Internet is performed by operating the keyboard image 221, screen data of the site to which access is instructed is acquired via the network interface 76, and the screen of the site corresponding to the acquired data is projected on the display area 222. Is done. When an e-mail is performed by operating the keyboard image 221, the created text is transmitted to the mail server designated as the transmission destination via the network interface 76.
[0159]
Note that the information processing terminal 1 is installed at a position in front of the user and obliquely above so as to prevent a part of the user's body from blocking the projection from the projection unit 23. Is preferred. With this, it is possible to prevent the projection from being blocked by the user's body and prevent the image from being projected on the image receiving surface, and to determine which part of the projected keyboard image the user has operated based on the imaging result. It can be detected reliably.
[0160]
In order to more reliably detect an input by the user, a device provided with an LED (Light Emitting Diode) that emits light when the top plate 211 (a predetermined character area of the keyboard image 221) is pressed is provided. The user who operates the keyboard image 221 may be attached.
[0161]
FIG. 26 is an enlarged view showing the vicinity of the fingertip of the user 141H.
[0162]
The light emitting device 231 is formed in a ring shape, and a switch 233 is provided at a position where the user 141H presses the keyboard image 221 (a position in the palm direction), and a position opposite to the switch 233 (a position in the back of the hand). (Position), an LED 232 that emits light when the switch 233 is pressed is disposed.
[0163]
Therefore, when the user presses a predetermined character area in the keyboard image 221, the switch 233 is turned on, and the LED 232 emits light. In the information processing terminal 1, the character area operated by the user is detected based on the position where the LED 232 is emitted in the image of the captured result.
[0164]
This makes it possible to more reliably detect the character area pressed by the user in the keyboard image 221 based on the image of the imaging result.
[0165]
In the above description, a keyboard image is projected as a display device, but various display devices such as a mouse may be projected. For example, when the mouse is projected, the movement of the user's hand touching the mouse image is detected based on the imaging result, and the mouse image and the pointer image are projected according to the detected movement. Controlled.
[0166]
When images of various buttons are projected on a wall or the like, an operated button is detected from an image obtained by imaging, and an image corresponding to the button operated by the user is located near the button. It may be projected.
[0167]
For example, when the guide plate of each floor of the department store is projected on the wall surface, when it is detected from the image of the imaging result by the imaging unit 24 that the user has requested the guidance information of the first floor, In response, an image representing the detailed guidance of the first floor read out is projected on the wall surface.
[0168]
Thus, by combining the projection by the projection unit 23 and the imaging by the imaging unit 24, various information can be provided to the user without being restricted by the installation position of the apparatus. The provided information can be enlarged and displayed over a wide range.
[0169]
For example, it is also possible to detect a user's input and present information according to the input, for example, by combining a large-screen LCD and a touch panel. It can be said that presenting various types of information using the information processing terminal 1 is superior not only in terms of the installation position but also in terms of cost.
[0170]
Further, the user can use the information processing terminal 1 as a navigation terminal for guiding a route to a destination.
[0171]
Next, a process of the information processing terminal 1 that projects a guidance image for guiding a route to a destination will be described with reference to a flowchart of FIG.
[0172]
In step S81, the navigation control program 125 acquires destination information. For example, the navigation control program 125 acquires destination information input by the user on an input screen displayed on the LCD 21. Further, on the projected map, a destination specified by the user with a finger or the like may be detected based on the imaging result and acquired as information on the destination.
[0173]
In step S82, the navigation control program 125 acquires information on the current position by the GPS of the position detection unit 74, and proceeds to step S83, where the electronic compass is used to determine the direction in which the front (surface 11b) of the housing 11 is turned. Get information.
[0174]
In step S84, the navigation control program 125 acquires information on the posture position of the housing 11 based on the output from the gyro sensor of the position detection unit 74.
[0175]
In step S85, the navigation control program 125 searches for a route to the destination from the information on the destination input by the user and the information on the current position, and finds the direction in which the surface 11b of the housing 11 is turned, The data of the guide image to be projected is acquired according to the posture position of the housing 11.
[0176]
The data of the guide image acquired by the navigation control program 125 is supplied to the projection image generation program 124, and the corresponding image is projected in step S86.
[0177]
By the above processing, for example, as shown in FIG. 28, the user 141H walking in the city can project the guidance image 241A representing the guidance to the destination on the wall surface 241 of the building. As described above, guidance that is larger than that displayed on the LCD 21 is displayed, so that the route can be confirmed without fail.
[0178]
In the example of FIG. 28, the guide image 241A displays an image of a white arrow that guides the user 141H facing the wall surface 241 to go to the right, and the user 141H In the right hand direction (the direction indicated by the white arrow A1). Naturally, a map in the vicinity of the current position may be projected to indicate the route to the destination.
[0179]
The series of processes described above can be executed by hardware, but can also be executed by software.
[0180]
When a series of processing is executed by software, a program constituting the software may execute various functions by installing a computer built into dedicated hardware or installing various programs. It is installed in a possible, for example, a general-purpose personal computer from a network or a recording medium.
[0181]
As shown in FIG. 6, the recording medium is provided separately from the main body of the apparatus, and is distributed to provide the user with the program. The program stores a magnetic disk 102 (including a flexible disk) and an optical disk 103 (including a flexible disk). Package media including a CD-ROM (compact disk-only memory), a DVD (including a digital versatile disk), a magneto-optical disk 104 (including an MD (registered trademark) (mini-disk)), or a semiconductor memory 105 And a ROM or HDD 66 in which a program is recorded, which is provided to the user in a state where the program is incorporated in the apparatus main body in advance.
[0182]
In this specification, the steps of describing a program recorded on a recording medium include, in addition to processing performed in chronological order according to the described order, not only chronological processing but also parallel or individual processing. This includes the processing to be executed.
[0183]
【The invention's effect】
ADVANTAGE OF THE INVENTION According to this invention, it becomes possible to implement | achieve a large screen display with a miniaturization of a terminal.
[0184]
Further, according to the present invention, it is possible to easily and quickly acquire the data of the optimal image to be projected without depending on the input from the user.
[Brief description of the drawings]
FIG. 1 is a perspective view illustrating a configuration example of a left side surface of an information processing terminal to which the present invention has been applied.
FIG. 2 is a diagram illustrating rotation of a positioning member.
FIG. 3 is a perspective view illustrating a configuration example of a right side surface of an information processing terminal to which the present invention has been applied.
FIG. 4 is a perspective view illustrating a configuration example of a back surface of an information processing terminal to which the present invention has been applied.
FIG. 5 is a perspective view showing a configuration example of a bottom surface of the information processing terminal to which the present invention is applied.
FIG. 6 is a block diagram illustrating an example of an internal configuration of the information processing terminal.
FIG. 7 is a block diagram illustrating a functional configuration example of a display control program of FIG. 6;
FIG. 8 is a flowchart illustrating processing of the information processing terminal that projects from the front of the image receiving surface.
FIG. 9 is a diagram illustrating an example of an image projected by the processing of FIG. 8;
FIG. 10 is a diagram illustrating an example of an image projected from an oblique direction with respect to an image receiving surface.
FIG. 11 is a flowchart illustrating a process performed by the information processing terminal that projects the image on the image receiving surface in an oblique direction.
FIG. 12 is a diagram illustrating an example of an image projected by the process of FIG. 11;
FIG. 13 is a diagram illustrating an example of another image projected by the processing of FIG. 11;
FIG. 14 is a flowchart illustrating a process of the information processing terminal that projects an object.
FIG. 15 is a diagram illustrating an example of an image projected by the processing of FIG. 14;
FIG. 16 is a diagram illustrating an example of another image projected by the processing of FIG. 14;
FIG. 17 is a diagram showing an example of still another image projected by the processing of FIG. 14;
FIG. 18 is a flowchart illustrating processing of an information processing terminal that controls projection according to a distance to an image receiving surface.
FIG. 19 is a flowchart illustrating processing of an information processing terminal that projects an image of data acquired according to identification information.
20 is a diagram illustrating a user operation before an image is projected by the processing in FIG. 19;
21 is a diagram illustrating an example of an image projected on the image receiving surface of FIG. 20 by the processing of FIG. 19;
FIG. 22 is a flowchart illustrating another process of the information processing terminal that projects an image of data acquired according to identification information.
FIG. 23 is a diagram illustrating an example of an image projected by the processing of FIG. 22;
FIG. 24 is a flowchart illustrating a process of the information processing terminal that controls projection according to a user's input to a projected image.
FIG. 25 is a diagram illustrating an example of an image projected by the processing of FIG. 24;
FIG. 26 is a diagram showing details of FIG. 25.
FIG. 27 is a flowchart illustrating a process of the information processing terminal that projects a guide image for guiding a direction to a destination.
FIG. 28 is a diagram illustrating an example of an image projected by the processing in FIG. 27;
[Explanation of symbols]
Reference Signs List 1 information processing terminal, 21 LCD, 22 operation keys, 23 projection unit, 24 imaging unit, 54C display control program, 102 magnetic disk, 103 optical disk, 104 magneto-optical disk, 105 semiconductor memory, 121 captured image acquisition program, 122 identification information Acquisition program, 123 source data acquisition program, 124 photographed image generation program, 125 navigation control program, 126 IR detection program

Claims (10)

Imaging processing means for imaging a subject;
An acquisition processing unit configured to acquire predetermined data based on an imaging result obtained by the imaging processing unit;
An information processing terminal, comprising: first projection processing means for projecting an image represented by the data acquired by the acquisition processing means. A second projection processing unit that projects a predetermined graphic image for acquiring a shape of the image receiving surface;
The imaging processing unit captures the image receiving surface on which the graphic image is projected by the second projection processing unit,
The first projection processing unit projects an image represented by the data acquired based on an imaging result of the imaging processing unit and corrected according to a shape of the image receiving surface. Item 2. The information processing terminal according to item 1. Further comprising a measurement processing means for measuring the distance to the image receiving surface,
2. The image processing apparatus according to claim 1, wherein the first projection processing unit projects an image represented by the data when a distance to the image receiving surface measured by the measurement processing unit is within a predetermined distance. An information processing terminal according to claim 1. A second projection processing unit configured to project a predetermined graphic image onto the image receiving surface;
The imaging processing unit captures the image receiving surface on which the graphic image is projected by the second projection processing unit,
The information processing terminal according to claim 3, wherein the measurement processing unit measures a distance to the image receiving surface based on a size of the graphic image in an imaging result obtained by the imaging processing unit. An emission processing unit that emits light to the image receiving surface;
The information processing terminal according to claim 3, wherein the measurement processing unit measures a distance to the image receiving surface based on a reflected wave of the light emitted by the emission processing unit. An identification information acquisition processing unit for acquiring predetermined identification information based on an imaging result by the imaging processing unit,
The information processing terminal according to claim 1, wherein the acquisition processing unit acquires data corresponding to the identification information acquired by the identification information acquisition processing unit. Second projection processing means for projecting an image representing a predetermined input device;
Detection processing means for detecting a user input to the image of the input device projected by the second projection processing means,
The acquisition processing means acquires data based on the input of the user, detected by the detection processing means,
The information processing terminal according to claim 1, wherein the projection unit displays an image based on the acquired input data in an area other than an image representing the input device. 2. The information according to claim 1, wherein the imaging unit that performs imaging by the imaging processing unit and the projection unit that performs projection by the first projection processing unit are formed on the same plane of the housing. 3. Processing terminal. An imaging processing step of imaging a subject;
An acquisition processing step of acquiring predetermined data based on an imaging result obtained by the processing of the imaging processing step;
A projection processing step of projecting an image represented by the data acquired by the processing of the acquisition processing step. An imaging control processing step of controlling imaging of a subject;
An acquisition processing step of acquiring predetermined data based on an imaging result by the processing of the imaging control processing step;
And a projection control processing step of controlling projection of an image represented by the data acquired by the processing of the acquisition processing step.

Images