JP4178091B2 - Information communication terminal - Google Patents

Description

  The present invention relates to an information communication terminal such as a mobile phone that can project an image.

Conventionally, as this type of information communication terminal, a mobile phone including a display as an image display unit, a projector as an image projection unit, and a control unit that controls the display and the projector is known (for example, Patent Document 1). This mobile phone is configured to enlarge and project at least a part of an image displayed on a display onto an external projection surface via a projector. In this mobile phone, a part of the image displayed on the screen of the display can be enlarged and projected on an external projection plane, or the entire image on the screen can be enlarged and projected on the projection plane.
Japanese Patent Laid-Open No. 2001-21992

  However, since the conventional mobile phone projects a part or the whole of one individual display image displayed on the display, the information that can be confirmed simultaneously exceeds the information of the individual display image on the display. There was a problem that there was nothing. If a large amount of information is to be obtained from the image projected on the projection surface, an operation for switching the image is required as in the case of the image displayed on the display.

  The present invention has been made in view of the above problems. An object of the present invention is to provide an information communication terminal that can simultaneously confirm information of a plurality of individual display images displayed on an image display unit without performing a screen switching operation.

In order to achieve the above object, the invention of claim 1 controls image display means for displaying an image, image projection means for projecting an image on an external projection surface, the image display means and the image projection means. An information communication terminal comprising: a control unit configured to generate a projection image by integrating a plurality of different types of individual images, and send the image data to the image projection unit. The image projection unit is controlled to project the projection image onto the external projection plane, the image display unit includes a plurality of display units, and a plurality of types of individual images projected onto the external projection plane are displayed on each display. It is characterized by being different individual display images displayed on the part .
Here, the aspect of the projection is not limited to a specific one. For example, as described in claim 2, each of a plurality of types of individual images may be projected by being distributed to a plurality of different individual projection areas on the external projection plane, or a plurality of types of individual images may be superimposed on each other. You may project.
In the case of the superimposed projection, for example, an embedded projection area is set in a part of one individual image, and projection is performed so that another individual image is embedded in the embedded projection area. Alternatively, a priority order may be set for each individual image, and an image with a high priority order may be preferentially projected with respect to a portion overlapped between the individual images. The shape of the embedded projection region is not limited to a specific shape and can be arbitrarily set. Further, in the case of the above-described superimposition projection, one individual image is used as a background image, and the other individual images are transmitted with the character portions remaining so that only the character portions of the other individual images are displayed on the background image. You may make it superimpose and project as an image.
Invention 請 Motomeko 2, in the information communication terminal according to claim 1, which is characterized in that each said plurality of types of individual images is projected distributed to a plurality of different individual projection region on the external projection plane It is .
Also, the invention of claim 3, in the information communication terminal according to claim 1 or 2, provided with the projection image specifying means for a user of the individual images to be projected to the external projection plane is designated, said control means, Projected image data is generated by integrating the individual images designated by the projected image designating means.
Further, the invention of claim 4, in any of the information communication terminal 請 Motomeko 1 to 3, comprises an application execution management means for managing the execution environment of the application program, the control means, from the application execution management means When an image projection command is received, the image projection unit is activated to control to start image projection.

The information communication terminal according to claim 1 to 4, to generate image data of the projected image by integrating different types of individual images with each other, projecting the projected image by sending the image data to the image projection means to the outside projection surface . When the user views the image on the external projection surface, a plurality of types of individual images can be confirmed at the same time. In addition, it is not necessary for the user to perform a screen switching operation in order to confirm these multiple types of individual images. Furthermore, a plurality of types of individual images displayed on a plurality of display units are projected onto the same external projection plane. When the user views the image on the external projection plane, a plurality of types of individual images displayed on each display unit can be confirmed at the same time.
In particular, in the information communication terminal according to claim 2, by projecting each of the plurality of types of individual images to a plurality of different individual projection areas on the external projection plane and projecting the individual images so as not to overlap each other, Interference between individual images can be avoided .
In particular, the information communication terminal according to claim 3, projecting the individual images specified by the user in the projection image specifying means to the external projection plane.
In particular, the information communication terminal according to claim 4, start image projection means starts image projection from the application execution management unit when receiving a command for image projection, the operation of the image projection means when no image projection To stop. As a result, unnecessary power is not consumed by the image projection means when the image projection is not performed.

The “information communication terminal” includes a PDC (Personal Digital Cellular) system, a GSM (Global System for Mobile Communication) system, a TIA (Telecommunications Industry Association) system mobile phone, IMT (International Mobile Telecommunications) -2000, etc. Standardized mobile phones are included. The “information communication terminal” includes a telephone such as a PHS (Personal Handyphone System ) and a car phone, an information communication terminal to which a mobile phone module is added, and a fixed telephone.
The control in the information communication terminal can also be realized by executing a predetermined program on a computer provided in the information communication terminal. Delivery of the program used in the computer may be performed using a recording medium such as an FD or CD-ROM in which the program is recorded as digital information, or may be performed using a communication network such as a computer network.

According to the first to fourth aspects of the present invention, a plurality of types of individual images that are different from each other are integrated and projected onto the external projection plane, so that the user can perform a plurality of types on the external projection plane without performing a screen switching operation. Can be confirmed simultaneously . In addition, there is an effect that a plurality of different types of individual images displayed on a plurality of display units can be simultaneously confirmed on the same external projection plane .
In particular, in the information communication terminal according to the second aspect, the plurality of types of individual images can be projected so as not to overlap each other, and interference between the individual images can be avoided. there is an effect that.
In particular, the information communication terminal according to claim 3, there is an effect that it is possible to separate images to be projected on the external projection plane user specifies.
In particular, the information communication terminal according to claim 4, there is an effect that it is possible to prevent wasteful power consumption by the image projection means has not been made image projection.

Embodiments of the present invention will be described below with reference to the drawings.
FIG. 2 is a block diagram showing an example of a schematic configuration of a mobile phone as an information communication terminal according to the embodiment of the present invention. A main body portion 100 of the cellular phone includes a control unit 111 as a control unit, an internal memory 112, a wireless communication unit 113 as an information reception unit, and an antenna 114. In addition, a microphone 116 and a speaker 117 are connected to the control unit 111 via an audio processing unit 115, an image display unit 119 is connected via an image processing unit 118, and a key operation unit 120 is further connected.
In addition, the mobile phone according to the present embodiment includes an image projection unit 130 as an image projection unit for projecting an image onto an external projection plane (hereinafter simply referred to as “projection plane”) 200 that can be visually recognized by the user. . The image projection unit 130 will be described later.

  The control unit 111 includes, for example, a CPU, a cache memory, a system bus, and the like, and by executing a predetermined control program, data is transmitted to and received from each unit such as the internal memory 112 and the wireless communication unit 113. Or control. Further, the control unit 111 is also used as a control unit that controls image projection onto an image projection unit 130 described later.

  The internal memory 112 is composed of a semiconductor memory such as a RAM or a ROM, and stores a control program executed by the control unit 111 and various data. The internal memory 112 is also used as content data storage means for storing content data such as images, music, and programs downloaded from information providing sites. Further, the internal memory 112 is also used as a data storage unit that stores sound data output from the speaker 117, image data displayed on the image display unit 119, and image data projected by the image projection unit 130.

  The wireless communication unit 114 is controlled by the control unit 111, and performs wireless communication with a base station of a mobile phone communication network as a communication network via an antenna 114 by a predetermined communication method. With this wireless communication, it is possible to perform voice telephone communication with a specific mobile phone or the like, or perform data communication such as transmission / reception of electronic mail or content download from an information providing site.

  The voice processing unit 115 encodes the transmission voice signal input from the microphone 116 by a predetermined method and sends the encoded signal to the control unit 111. Also, the voice processing unit 115 decodes the received voice signal received by the wireless communication unit 113 and outputs it from the speaker 117. Further, the voice processing unit 115 outputs a sound signal such as a sound effect used in an incoming melody or an application program stored in the internal memory 112 from the speaker 117. The sound output means for outputting the sound is configured using the sound processing unit 115 and the speaker 117.

  The image processing unit 118 processes image data received by the wireless communication unit 113, image data such as icons and menus stored in the internal memory 112, incoming call notification images, and the like, and an image composed of a liquid crystal display (LCD) or the like. It is displayed on the display unit 119. The image display means is configured using an image processing unit 118 and an image display unit 119.

  The key operation unit 120 includes a data input key (ten key, * key, # key), a call start key, an end key, a scroll key, a multi-function key, and the like. Used for scrolling and selecting displayed information. The key operation unit 120 is also used as a projection image designating unit for the user to designate individual display images to be collectively projected onto the projection plane among a plurality of individual display images that can be displayed by switching to the image display unit 119.

FIG. 3 is a block diagram illustrating a configuration example of the image projection unit 130. The image projection unit 130 includes a beam light source 131, an optical scanner 132, and a drive control unit 133 for driving them. As the beam light source 131, an LD (semiconductor laser), an LED (light emitting diode), or the like can be used. The intensity of the beam light emitted from the beam light source 131 is controlled by the drive control unit 133 based on the control data sent from the control unit 111. The optical scanner 132 is an optical device that projects the beam light emitted from the beam light source 131 onto the projection surface 200 while scanning two-dimensionally. The scanning of the beam light by the optical scanner 132 is driven and controlled by the drive control unit 133 as in the case of the beam light source 131. As this optical scanner 132, for example, a small galvanometer mirror capable of high-speed scanning can be used. Further, the drive control unit 133 has an image memory for storing image data, and stores image data to be projected that is set and registered in advance, and image data to be projected that is sent together with control data from the control unit 111. Is done. The beam light source 131 and the optical scanner 132 are driven and controlled based on the image data stored in the image memory.
If the beam light source 131 is capable of emitting a plurality of types of light beams (for example, three primary color light beams) having different wavelengths, a color image is projected onto the projection plane 200 by simultaneously scanning and projecting each light beam. can do.
Further, as the beam light source 131, a light source composed of a one-dimensional array element in which light emission points whose intensity can be controlled independently of each other is arranged in a line can be used. In this case, line light emitted from the light source may be scanned one-dimensionally by the optical scanner 132.
As the beam light source 131, a light source composed of a two-dimensional array element in which light emitting points whose intensity can be controlled independently of each other is two-dimensionally arranged can be used. In this case, instead of the optical scanner 132, an enlarged projection optical system that enlarges a two-dimensional image displayed on the light source and projects the image on the projection surface 200 is used.

FIG. 4 is a block diagram illustrating another configuration example of the image projecting unit 130. The image projection unit 130 includes a light source 134 such as a lamp, a spatial light modulator 135, an enlargement projection optical system 136, and a drive control unit 133.
As the spatial light modulator 135, for example, a liquid crystal display used in an ordinary mobile phone or the like can be used. In this case, in contrast to the display mode on the transmissive liquid crystal display, the image is displayed with black and white reversed. Light from the light source 134 is irradiated onto the surface of the liquid crystal display displayed in black and white in this way, and the reflected image is enlarged by the enlargement projection optical system 136 and projected onto the projection plane 200. In addition, as this liquid crystal display, you may also use the liquid crystal display provided with the normal mobile telephone etc.
The spatial light modulator 135 may be a two-dimensional array of small mirrors whose tilts can be controlled independently of each other. In this case, the tilt of each mirror is controlled based on the image data, and the reflected light from the mirror toward the projection plane 200 is turned on / off. The reflected image from the spatial light modulator 135 is magnified by the magnification projection optical system 136 and projected onto the projection plane 200.

Further, the configuration of the image projection unit 130 is not limited to the configuration of FIGS. 3 and 4. For example, the structure which projects using a hologram element may be sufficient.
The image may be projected at a wide angle. For example, the entire inner wall surface of the room may be viewed on the projection surface and the image may be projected at a wide angle. In this case, for example, an incoming call notification with an unprecedented taste can be made so as to project an image of the sky where the starry sky glitters over the entire room like a planetarium.

  FIG. 1 is an explanatory diagram showing a state in which an image is projected by a foldable mobile phone 100 including the image projection unit 130. The mobile phone 100 is placed in a standby state on a desk with the light exit port of the image projection unit 130 facing a desired projection surface 200 or set in a charger for the mobile phone. In addition, the user operates the key operation unit 120 to set one of a normal image display mode in which image projection is not performed and an image projection mode in which image projection is performed. Then, when the image projection mode is executed, the mobile phone 100 according to this embodiment integrates a plurality of different types of individual display images that can be displayed on the image display unit 190 and collectively projects them onto the projection plane 200 as shown below. It is configured to be able to. In the example of FIG. 1, four different individual display images that can be displayed on the image display unit 190 are projected on each of the four divided individual projection areas (hereinafter referred to as “divided projection areas”) 200 a to 200 d on the projection surface 200. can do.

  FIG. 5 is an explanatory diagram showing an example of a projection image projected on the projection plane 200 from the mobile phone 100. FIG. 6 is a flowchart showing an outline of the projection control process in the control unit 111 when the image of FIG. 5 is projected. This mobile phone 100 collectively projects four types of individual display images A to D that can be displayed on the image display unit 190 in the normal image display mode during execution of the image projection mode.

In the projection control process of the control unit 111, first, data used for each individual display image is acquired (step 1).
Here, the first individual display image A is a date / time display image projected onto the first divided projection area 200a. Data used for the date / time display image is generated by a clock unit (not shown) in the control unit 111.
The second individual display image B is an incoming call notification image projected onto the second divided projection area 200b. The data used for the incoming notification image is generated by the control unit 111 when the wireless communication unit 113 receives a call, mail, information from a server on the mobile phone communication network, or the like.
The third individual display image C is a received information display image projected onto the third divided projection area 200c. Data used for the received information display image is generated by the control unit 111 based on newly arrived information data received from the server on the mobile phone communication network by the wireless communication unit 113 and stored in a predetermined area of the internal memory 112.
The fourth individual display image D is a greeting card image projected onto the fourth divided projection region 200d. The data used for the greeting card image is, for example, based on image data selected in association with a specific date / time from a plurality of types of library images stored in advance in the internal memory 112. Is generated.

  Next, based on the data of the individual display images A to D, a process of integrating the individual display images A to D into one projection image as shown in FIG. 5 is executed (step 2), and the image projection unit Image data of a projection image projected at 130 is generated (step 3). The image data generated by the control unit 111 is sent to the image projecting unit 130, and an image in which four individual display images as shown in FIG.

As described above, according to the present embodiment, the four types of individual display images that can be displayed on the image display unit 119 are integrated and projected onto the projection plane 200, so that the user can perform projection without switching the screen. Four types of individual display images can be simultaneously confirmed on the surface 200.
Further, according to the present embodiment, each of the four types of individual display images is distributed and projected onto a plurality of different divided projection areas 200 a to 200 d on the external projection plane 200. By allocating and projecting in this way, the four types of individual display images can be projected so as not to overlap each other, and interference between the individual display images can be avoided, so that the entire individual display images can be reliably Visible.

In the above embodiment, when the mobile phone 100 has a plurality of image display units, the individual display images displayed on the image display units may be integrated and projected onto one projection plane. For example, when the mobile phone 100 has two image display units, a front display and a rear display, the images displayed on the respective displays (individual display units) are integrated as shown in FIGS. Project onto two projection planes. FIG. 7 (a) is a projection plane that collectively displays an image of an application program (an image displayed on the front display) and a standby image (an image displayed on the rear display) of a game running on the mobile phone. This is an example of projection. FIG. 7B shows an image for the player 1 (image displayed on the front display) and an image for the player 2 (displayed on the rear display) of the application program for the two-player game running on the mobile phone. In this example, the displayed images are projected onto the projection surface all at once.
In this way, by integrating the individual display images displayed on the plurality of image display units 119 and projecting them onto one projection plane 200, they are different from each other displayed on the plurality of image display units 119 on the same projection plane 200. Multiple types of individual display images can be confirmed simultaneously.

  Further, in the above embodiment, the projection control process shown in FIG. 8 may be executed so that the user can specify an individual display image to be integrated and projected on the projection plane 200. In this case, prior to data acquisition for image projection, the user operates the key operation unit 120 as a projection image designating unit to designate an individual display image to be projected. Only the designated individual display images are integrated and projected onto the projection plane 200 at a time. In this case, the user can designate individual display images to be collectively projected onto the projection plane 200, and an image can be projected according to the user's wishes.

  In the above embodiment, when there is no image to be projected, the operation of the image projecting unit 130 is stopped, and the control unit 111 determines that an image projection command is received from the outside or the timing of image projection. Sometimes, the image projecting unit 130 may be activated to start image projection. In this case, when the image projection is not performed, the operation of the image projection unit 130 is stopped so that the image projection unit 130 does not consume useless power. Therefore, it is possible to prevent wasteful power consumption by the image projection unit 130 when image projection is not performed, and to prevent the battery in the mobile phone 100 from being consumed.

  Further, as described above, the mobile phone 100 according to the above embodiment may be configured to be able to execute an application program developed by platform-independent object-oriented programming. The activation of the image projection unit 130 and the image projection operation by the image projection unit 130 may be executed based on a command from an application program. Examples of the application program include application programs described in JAVA (registered trademark), C language, BREW (registered trademark), and the like. This application program may be preinstalled in the mobile phone 100, or may be downloaded from a download server via a mobile phone communication network as a communication network, stored in the mobile phone 100, and registered. .

FIG. 9 is a block diagram illustrating an example of a schematic configuration of a mobile phone capable of executing an application program, and FIG. 10 is an explanatory diagram illustrating an example of a software structure in the mobile phone. This cellular phone includes an application program execution management unit 150 as application program execution management means for managing the execution environment of the application program, in addition to the control unit 111 and the like described above. The application program execution management unit 150 includes a system bus, a CPU, a RAM, and the like, and operates according to predetermined middleware for executing the application program. The application program execution management unit 150 corresponds to the central “program execution environment” in the software structure of FIG. 10, and includes a class library, an execution environment management library, an application used for an application program developed by object-oriented programming. Software such as management is provided, and the execution environment of application programs is managed.
Here, the application program can be used by calling a class library such as a function in the program execution environment via a class library API (application interface). The call history of a class library such as this function is held until the virtual execution environment (virtual machine: VM) of the application program is terminated. The execution environment management library in the program execution environment can be used by calling a telephone platform library in the telephone platform described later via the telephone platform API.
The image projection control is executed by sending a control command from the application program execution management unit 150 to the image projection unit 130 via the control unit 111. 9 may be executed by directly sending a control command from the application program execution management unit 150 to the image projection unit 130 as indicated by a broken line in FIG.

In the mobile phone configured as described above, when an image is projected during execution of a standby application program or an application program such as a game, a predetermined instruction for image projection activation request command is issued from the application program to the application program execution environment. Make a function call. Upon receiving this function call, the application program execution environment sends an image projection activation request command to the control unit 111. Upon receiving this image projection start request command, the control unit 111 sends a start request command and image projection control data to the image projection unit 130.
The image projection unit 130 is activated in response to the activation request command, and starts projecting a predetermined image specified by control data based on the image projection control data.

  Note that the application program for starting the image projecting unit 130 and executing the image projecting operation may be a standby application program for projecting an incoming notification image, or other application program specialized for controlling the projector function, for example. There may be.

  Further, in each of the above embodiments, an identifier for identifying whether or not the image is dedicated to projection may be added to the content data of the image projected onto the image projection unit 130. Then, the identifier data added to the content data of the image may be analyzed, and control may be performed based on the analysis result, such as whether or not the image projection unit 130 projects the image.

Explanatory drawing which showed a mode that the image was projected with the mobile telephone which concerns on embodiment of this invention. The block diagram which shows an example of schematic structure of the mobile telephone which concerns on embodiment of this invention. The block diagram which shows the example of 1 structure of the image projection part of the mobile phone. The block diagram which shows the other structural example of the image projection part. Explanatory drawing of the image projected by the image projection part. The flowchart of the projection control process in the control part of the mobile phone. (A) And (b) is explanatory drawing of the image projected with the mobile telephone which concerns on other embodiment. The flowchart of the projection control process in the control part of the mobile telephone which concerns on other embodiment. The block diagram which shows an example of schematic structure of the mobile telephone which can execute an application program. Explanatory drawing which shows an example of the software structure in the mobile phone.

Explanation of symbols

DESCRIPTION OF SYMBOLS 100 Mobile telephone 111 Control part 113 Wireless communication part 130 Image projection part 200 Projection surface 200a-200d Division | segmentation projection area | region

Claims (4)

An information communication terminal comprising image display means for displaying an image, image projection means for projecting an image on an external projection surface, and control means for controlling the image display means and the image projection means,
The control unit integrates a plurality of different types of individual images to generate image data of a projection image, sends the image data to the image projection unit, and projects the projection image onto the external projection plane. Controlling the image projection means ,
The image display means has a plurality of display units,
The information communication terminal characterized in that the plurality of types of individual images projected onto the external projection plane are different individual display images displayed on each display unit . In the information communication terminal according to claim 1,
An information communication terminal characterized by allocating and projecting each of the plurality of types of individual images to a plurality of different individual projection areas on the external projection plane . In the information communication terminal 請 Motomeko 1 or 2,
A projection image specifying means for a user to specify an individual image to be projected onto the external projection plane;
The information communication terminal characterized in that the control means integrates the individual images designated by the projection image designation means to generate projection image data . In any of the information communication terminal 請 Motomeko 1 to 3,
Application execution management means for managing the execution environment of the application program is provided.
The information communication terminal according to claim 1, wherein the control means controls to start the image projection by activating the image projection means when receiving an image projection command from the application execution management means.

Images