JP5331751B2 - Mobile phone - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a mobile phone with a function to synthesize an image in which a processing load of an arithmetic processing unit during synthesizing processing is reduced. <P>SOLUTION: In an upper side case 1 and a lower side case 2, an upper side display part 11 and a lower side display part 12 are respectively set in. The upper side display part 11 is comprised of a transparent display and a display surface 11a is exposed from a first surface 1a of the upper side case 1, and a display surface 11b is exposed from a second surface 1b of the upper side case 1. An image is photographed in the state where a mobile phone 100 is closed, and an overwrite image such as a character, a symbol, a figure and the like is input from the transparent display 11 while the photographed image displayed on the main display surface 12a is visually recognized through the transparent display 11 so as to obtain a state in which the photographed image and the overwrite image are simulatedly synthesized. <P>COPYRIGHT: (C)2012,JPO&amp;INPIT

Description

  The present invention relates to a mobile phone having two display portions.

  In recent mobile phones, various functions are incorporated in addition to the communication function and the photography function. For example, a function is known in which a decorative image displayed on a screen and a real-time captured image of a subject are combined and photographed.

  Such a function includes, for example, a technique for synthesizing an acquired captured image and an input image such as a handwritten character or a figure as disclosed in Patent Document 1, and character information as disclosed in Patent Document 2. This is realized by a technique of combining and displaying a character plane and an image plane including image information.

Japanese Patent Laid-Open No. 10-200727 Japanese Patent Laid-Open No. 5-28241

  As described above, in a conventional mobile phone having a function of combining images, for example, when combining a plane of a captured image and a plane of a picture, the plane of the captured image that is updated every moment is used. Thus, every time it is updated, a composition process with the plane of the painting is required. For this reason, for example, when combining a captured image and a still image such as a decoration image, plane synthesis is required for each frame of the captured image, which increases the processing load on the arithmetic processing device. This is the same even when the plane of the still image is updated.

  In addition, when handwritten input by a user is performed on a captured image, a composition process is required every time handwriting is performed while handwritten input is performed. Will increase.

  The present invention has been made in order to solve the above-described problems, and provides a mobile phone having a function of combining images, in which the processing load of the arithmetic processing unit during the combining process is reduced. For the purpose.

  The mobile phone according to the present invention has a first housing in which a first display unit is housed so that the display surface is exposed from one surface, a first surface, and a second surface opposite to the first surface. A second housing that is slidable on the first display portion with the second surface facing the first housing, and in which the transparent second display portion is housed; A control unit for controlling display of the first and second display units, a touch panel function added to at least the second display unit, and an imaging unit including a camera system capable of capturing moving images and still images. The first and second housings are configured such that the first housing is covered with the second housing by sliding the second housing on the first display unit. The closed state in which the first display unit can be visually recognized through the second display unit, and the second casing is in front The first display unit does not overlap with the first display unit, and the first display unit is open and visible. The control unit closes the first and second housings, and the imaging unit In addition to displaying the captured image of the subject imaged at the first display unit, the overwritten image to be synthesized with the captured image input via the touch panel function of the second display unit And the image composition process of the captured image and the overwritten image is executed at a timing when the first and second housings are opened.

  According to the mobile phone of the present invention, it is possible to reduce the processing load on the arithmetic processing apparatus by reducing the number of arithmetic processes for image composition processing.

It is a perspective view which shows the external appearance of the mobile telephone of embodiment which concerns on this invention. It is a top view which shows the external appearance of the mobile telephone of embodiment which concerns on this invention. It is a top view which shows the external appearance of the mobile telephone of embodiment which concerns on this invention. It is a top view which shows the external appearance of the mobile telephone of embodiment which concerns on this invention. It is a figure which shows the electrical structure of the mobile telephone of embodiment which concerns on this invention. It is a figure which shows an example of the image display in the mobile telephone of embodiment which concerns on this invention. It is a figure which shows an example of the image display in the mobile telephone of embodiment which concerns on this invention. It is a flowchart explaining the 1st usage pattern of the image composition function in the mobile telephone of embodiment which concerns on this invention. It is a figure which shows an example of the image display for demonstrating the 1st usage pattern of the image composition function in the mobile telephone of embodiment which concerns on this invention. It is a figure which shows an example of the image display for demonstrating the 1st usage pattern of the image composition function in the mobile telephone of embodiment which concerns on this invention. It is a flowchart explaining the 2nd usage pattern of the image composition function in the mobile telephone of embodiment which concerns on this invention. It is a flowchart explaining the 3rd usage pattern of the image composition function in the mobile telephone of embodiment which concerns on this invention. It is a figure which shows an example of the image display for demonstrating the 3rd usage pattern of the image composition function in the mobile telephone of embodiment which concerns on this invention. It is a figure which shows an example of the image display for demonstrating the 3rd usage pattern of the image composition function in the mobile telephone of embodiment which concerns on this invention. It is a figure which shows an example of the image display for demonstrating the 3rd usage pattern of the image composition function in the mobile telephone of embodiment which concerns on this invention. It is a flowchart explaining the 4th usage pattern of the image composition function in the mobile telephone of embodiment which concerns on this invention. It is a flowchart explaining the 5th usage pattern of the image composition function in the mobile telephone of embodiment which concerns on this invention. It is a flowchart explaining the 6th usage pattern of the image composition function in the mobile telephone of embodiment which concerns on this invention. It is a figure which shows an example of the image display for demonstrating the 6th usage pattern of the image composition function in the mobile telephone of embodiment which concerns on this invention. It is a figure which shows an example of the image display for demonstrating the 6th usage pattern of the image composition function in the mobile telephone of embodiment which concerns on this invention. It is a figure which shows an example of the image display for demonstrating the 6th usage pattern of the image composition function in the mobile telephone of embodiment which concerns on this invention.

<Appearance of mobile phone>
FIG. 1 is a perspective view showing an appearance of a mobile phone 100 according to an embodiment of the present invention. As shown in FIG. 1, a mobile phone 100 according to the present embodiment includes a lower housing 2 (first housing) and an upper housing 1 (second housing) that are connected to each other by a connecting mechanism (not shown). Body).

  The upper housing 1 has a substantially rectangular plate shape in plan view, and has a first surface 1a and a second surface 1b facing each other. Similarly, the lower housing 2 has a substantially rectangular plate shape in plan view, and has a first surface 2a and a second surface 2b facing each other.

  Then, in the mobile phone 100, the upper housing 1 has the second surface 1b on the lower housing 2 side, and the lower display surface 12a on the lower housing 2 is indicated by an arrow AR along the X-axis direction. Thus, a mechanism (not shown) that can be slid is provided, and the lower housing 2 can be covered with the upper housing 1.

  The lower casing 2 houses a lower display section 12 (first display section) having a touch panel function, and the upper casing 1 houses an upper display section 11 (second display section) having a touch panel function. It has been. It should be noted that the lens portion (not shown) of the camera is provided so as to be exposed from the second surface 2 b of the lower housing 2.

  The upper display unit 11 is a liquid crystal display device that includes, for example, a transmissive liquid crystal panel and does not have a backlight or a reflective material in a portion facing the liquid crystal panel, and maintains a transparent state when no signal is input. This is called a transparent display. The rectangular display surface 11 a of the upper display unit 11 is exposed from the first surface 1 a of the upper housing 1, and the display surface 11 b opposite to the display surface 11 a is from the second surface 1 b of the upper housing 1. Exposed.

  The lower display unit 12 is a liquid crystal display device that is configured by, for example, a transmissive liquid crystal panel, and performs display by transmission and non-transmission of light supplied by a backlight disposed on the back surface or side surface of the liquid crystal panel. The display surface 12 a is exposed from the first surface 2 a of the lower housing 2. Hereinafter, the upper display unit 11 may be referred to as “transparent display 11”, the display surface 11a may be referred to as “front side transmission surface 11a”, and the display surface 11b may be referred to as “back side transmission surface 11b”. Further, the lower display unit 12 may be referred to as “main display 12”, and the display surface 12a may be referred to as “main display surface 12a”.

  In the following, as shown in FIG. 1, the short side direction and the long side direction of the upper casing 1 and the lower casing 2 are respectively the X-axis direction and the Y-axis direction, and the upper casing 1 and the lower casing The thickness direction 2 will be described as the Z-axis direction.

  The lower housing 2 accommodates an audio output unit and an audio input unit (not shown). The audio output unit has a speaker 20, and the audio input unit has a microphone 21. The speaker 20 is exposed at one end in the Y direction on the first surface 2 a of the lower housing 2, and the microphone 21 of the audio input unit is Y on the first surface 2 a of the lower housing 2. It is exposed from the other end of the direction.

  It should be noted that both ends of the second surface 1b of the upper housing 1 in the Y direction correspond to the upper portions of the speaker 20 and the microphone 21 in a state where the upper housing 1 is slid to cover the lower housing 2. The part to be provided has a recess RP (in FIG. 1, only the recess RP corresponding to the upper part of the microphone 21 is shown).

  Any of the recesses RP is provided so as to extend not only to the second surface 1b but also to the side surface, and a call can be made via the speaker 20 and the microphone 21 even when the lower housing 2 is covered by the upper housing 1. Is possible. Note that the audio output unit and the audio input unit may be housed in the lower housing 1, and in that case, the speaker 20 and the microphone 21 are exposed on the first surface 1 a of the upper housing 1. Further, the positions where the speaker 20 and the microphone 21 are disposed may be other than the above.

  The lower housing 2 is further provided with a power connector, an operation unit composed of a plurality of hard keys, etc., but the description and illustration are omitted because they are not related to the present invention.

  The cellular phone 100 is configured such that the upper casing 1 and the lower casing shown in FIG. 1 can be visually recognized by a slide mechanism (not shown) so that the upper casing 1 does not overlap the lower display section 12 and can be visually recognized. Although the lower housing 2 is covered with the positional relationship of the body 2 and the upper housing 1, the lower display unit 12 is visible through the transparent display 11 of the upper housing 1, as shown in FIG. 2. The positional relationship between the upper housing 1 and the lower housing 2 can be presented.

  Hereinafter, in the mobile phone 100, a state in which the upper housing 1 does not overlap the lower display unit 12 is referred to as an “open state”, and a state in which the lower housing 2 is covered by the upper housing 1 is “closed”. This is referred to as “state”.

  2 and 3 are plan views showing the cellular phone 100 in a closed state and an opened state, respectively.

  As shown in FIG. 2, the upper housing 1 and the lower housing 2 overlap in the closed state, but the upper display portion 11 is transparent, so that the lower display is made via the upper display portion 11. The main display surface 12a of the part 12 is visible. Although the shutter button BT of the camera is provided on the upper end surface of the upper housing 1, the position of the shutter button BT is not limited to this, and is provided on the lower housing 2. Also good.

  In addition, as shown in FIG. 3, in the opened state, the upper housing 1 does not overlap the lower display unit 12, and the lower display unit 12 can be seen directly.

  FIG. 4 shows an example in which the cellular phone 100 is opened so that there is no portion where the upper casing 1 and the lower casing 2 overlap. That is, as shown in FIG. 4, when the upper casing 1 is slid in the X direction, the end of the upper casing 1 in the short direction (X direction) is separated from the end of the lower casing 2 in the short direction. After the separation, the positional relationship between the upper housing 1 and the lower housing 2 is such that the short-side end of the upper housing 1 and the short-side end of the lower housing 2 do not overlap. It is also possible to employ a slide mechanism that determines the above. Thereby, the 1st surface 1a of the upper side housing | casing 1 and the 1st surface 2a of the lower side housing | casing 2 become the same plane.

<Electric configuration of mobile phone>
FIG. 5 is a block diagram showing an electrical configuration of mobile phone 100 according to the present embodiment. As shown in FIG. 5, the mobile phone 100 includes a control unit 30, a wireless communication unit 31, an upper display unit 11, a lower display unit 12, an audio output unit (speaker) 20, and an audio input unit (microphone) 21. An upper touch panel 23, a lower touch panel 24, and an imaging unit 25 including a camera system capable of capturing a moving image, a still image, and the like. In addition, the control part 30 and the radio | wireless communication part 31 are accommodated in the lower housing | casing 2, for example.

  The control unit 30 includes a CPU 30a, a storage unit 30b, and the like, and comprehensively manages the operation of the mobile phone 100 by controlling other components of the mobile phone 100. The storage unit 30b includes a ROM, a RAM, and the like. Various functions of the control unit 30 are realized by the CPU 30a executing various programs in the storage unit 30b.

  The wireless communication unit 31 receives a wireless signal from a mobile phone other than the mobile phone 100 or a communication device such as a Web server connected to the Internet by the antenna 31a, and performs amplification processing and down-conversion on the received signal. And output to the control unit 30. In addition, the wireless communication unit 31 performs up-conversion and amplification processing on the transmission signal generated by the control unit 30, and transmits the processed transmission signal to a mobile phone other than the mobile phone 100 or the Internet through the antenna 31a. Wirelessly transmitted to the communication device connected to the.

  The audio output unit 20 converts the audio data from the control unit 30 into audio and outputs it to the outside. The voice input unit 21 converts voice input from the outside into voice data and outputs the voice data to the control unit 30.

  The upper display unit 11 is controlled by the control unit 30 to display various information such as characters, symbols, and graphics on the upper display surface 11a. Further, the upper touch panel 23 and the lower touch panel 24 represent configurations for realizing the touch panel functions of the upper display unit 11 and the lower display unit 12, respectively. The upper display unit 11 has an upper touch panel 23 on the front-side transmission surface 11 a, detects an operation with an indicator such as a user's finger via the touch panel function of the upper touch panel 23, and outputs the detected operation to the control unit 30. The lower display unit 12 has a lower touch panel 24 on the main display surface 12a, detects an operation by an indicator such as a user's finger via the touch panel function of the lower touch panel 24, and sends it to the control unit 30. Output.

  The upper display unit 11 and the lower display unit 12 display moving images and still images captured by the imaging unit 25 under the control of the control unit 30. The display memory 111 stores image data therefor and 121 respectively. The display memories 111 and 121 can be configured by a memory such as a VRAM (Video RAM).

  As described above, the upper display unit 11 does not have a backlight or a reflective material in a portion facing the liquid crystal panel, and thus has no obstruction and maintains a transparent state. Thus, it is possible to display an image or the like by making a predetermined pixel light opaque. In place of the backlight, a light source such as an LED is placed in the upper housing 1 corresponding to the side surface of the upper display unit 11 so that the upper display unit 11 is illuminated from the side surface. Even in the opened state, the upper display unit 11 alone can display an image.

  In addition, you may comprise the upper side display part 11 and the lower side display part 12 with non-self-light-emitting type display apparatuses other than a liquid crystal display device.

<Example of image display on mobile phone>
Next, image display examples on the upper display unit 11 and the lower display unit 12 in the mobile phone 100 will be described with reference to FIGS. 6 and 7.

  FIG. 6 shows a state where the image of the lower display unit 12 is seen through the upper display unit 11 in the cellular phone 100 in the closed state. That is, when the subject is imaged using the photo (or moving image) imaging function with the cellular phone 100 closed, the captured image is displayed on the main display surface 12a of the lower display unit 12, but the upper display unit Since 11 is transparent, the captured image displayed on the main display surface 12 a of the lower display unit 12 can be seen through the upper display unit 11 when viewed from the upper display unit 11 side.

  For example, at this time, if only a part of the subject image OJ is displayed on the main display surface 12a, the display area is widened by opening the mobile phone 100, and as shown in FIG. Can be displayed together on the upper display unit 11 and the lower display unit 12.

  That is, in FIG. 7, the upper half of the subject image OJ is displayed on the upper display unit 11, and the lower half of the subject image OJ is displayed on the lower display unit 12. It can also be displayed.

<Usage of image composition function>
Hereinafter, usage modes of the image composition function in the mobile phone 100 described above will be described with reference to FIGS.

<First usage pattern>
FIG. 8 is a flowchart for explaining the first usage pattern, and shows a basic usage pattern of the image composition function.

  When the camera function is switched on with the cellular phone 100 closed and the imaging operation is started, a captured image is displayed on the main display surface 12a of the main display 12 (step S1). In this case, the cellular phone 100 is closed, but the captured image displayed on the main display surface 12a can be seen through the transparent display 11.

  In this state, the user inputs characters, symbols, figures, or the like by hand using an indicator such as a finger, or reads and inputs an electronic image such as a template by panel operation, on the transparent display 11 having a touch panel function. That is, the user inputs characters, figures, and the like on the transparent display 11 so as to overwrite the captured image displayed on the main display surface 12a (step S2).

  This state is schematically shown in FIG. As shown in FIG. 9, the overwrite image OW input on the transparent display 11 is superimposed on the subject image OJ that is viewed through the transparent display 11. In this state, the subject image OJ and the overwrite image OW have not been subjected to image composition processing. However, when viewed from the upper display unit 11 side, the subject image OJ and the overwrite image OW are combined images on one screen. looks like. Such a state is hereinafter referred to as a “pseudo synthesized state”.

  Next, when the layout is confirmed and the cellular phone 100 is released (step S3), the subject image OJ and the overwritten image OW at that time are subjected to image composition processing by the control unit 30 (FIG. 5), and the composite image is displayed on the transparent display 11. It is displayed above (step S4). Note that when the mobile phone 100 is not opened, the subject image OJ and the overwrite image OW are not fixed. For this reason, the operation of opening the mobile phone 100 corresponds to a shutter operation in the sense that the subject image OJ and the overwrite image OW are determined and combined.

  This state is schematically shown in FIG. As shown in FIG. 10, the subject image OJ and the overwritten image OW that have undergone image synthesis processing are displayed on the transparent display 11, and the real-time subject image OJ is displayed on the main display surface 12 a of the main display 12. Yes.

  Next, the storage instruction by the touch input from the transparent display 11 and the main display 12 by the user, or the input from the operation unit configured by the hard key provided in the upper casing 1 or the lower casing 2 is performed. Based on the instruction, the control unit 30 stores the composite image displayed on the transparent display 11 in a predetermined memory or the like (step S5). Thereafter, in step S6, the display of the composite image is maintained until the mobile phone 100 is closed, and the composite image on the transparent display 11 is erased by closing the mobile phone 100 (step S7). Return to state.

  As described above, in the first usage pattern, the user performs imaging with the cellular phone 100 closed, and visually recognizes the captured image displayed on the main display surface 12 a through the transparent display 11, while the transparent display 11. Input the overwritten image such as characters, symbols and figures. As a result, the captured image and the overwritten image are pseudo-synthesized. Since image synthesis processing is not performed at this stage, it is not necessary to perform image synthesis processing every time a captured image is updated, and the number of arithmetic processing for image synthesis processing can be reduced. As a result, the processing load on the CPU 30a (FIG. 5) of the control unit 30 can be reduced. This is the same even when the overwritten image changes every moment.

<Second usage pattern>
FIG. 11 is a flowchart for explaining the second usage pattern, and shows a modified usage pattern of the image composition function.

  When the cellular phone 100 is closed and the camera function is switched on to start the imaging operation, a captured image is displayed on the main display surface 12a of the main display 12 (step S11). In this case, the cellular phone 100 is closed, but the captured image displayed on the main display surface 12a can be seen through the transparent display 11.

  In this state, the user inputs characters, symbols, figures, etc. by handwriting with an indicator such as a finger, or reads and inputs an electronic image such as a template by panel operation, on the transparent display 11 having a touch panel function. That is, a user inputs a character, a figure, etc. on the transparent display 11 so that it may overwrite on the captured image displayed on the main display surface 12a (step S12). This state is the state of FIG. 9 described in the first usage pattern.

  Next, when the layout is confirmed and the cellular phone 100 is released (step S13), the subject image OJ and the overwrite image OW at that time are subjected to image composition processing by the control unit 30 (FIG. 5), and the composite image is displayed on the transparent display 11. It is displayed above (step S14). Note that when the cellular phone 100 is not opened, the subject image OJ and the overwrite image OW are not fixed. For this reason, the operation of opening the mobile phone 100 corresponds to a shutter operation in the sense that the subject image OJ and the overwrite image OW are determined and combined. This state is the state of FIG. 10 described in the first usage pattern.

  At this stage, when the cellular phone 100 is closed (step S15), the control unit 30 asks the user to determine whether or not to save the composite image displayed on the transparent display 11 (step S16). If saving of the image is selected, the composite image is stored in a predetermined memory or the like, and then the composite image on the transparent display 11 is deleted (step S17), and the process returns to the state of step S1.

  On the other hand, if the user selects not to save the composite image in step S16, the control unit 30 next asks the user to determine whether or not to delete the composite image on the transparent display 11 ( In step S18), if the user selects erasure, the process proceeds to step S17. If the user selects not to erase, the control unit 30 erases the captured image (subject image OJ) from the transparent display 11 and overwrites it. Only the image OW is left and a state where continuous input is possible is made, and the process returns to the state of step S11.

  As described above, in the second usage pattern, the user captures an image with the cellular phone 100 closed, and visually recognizes the captured image displayed on the main display surface 12 a through the transparent display 11, while By inputting an overwrite image such as a symbol, a figure, or the like, the captured image and the overwrite image are artificially synthesized. At this stage, it is the same as the first usage pattern in that no image composition processing is performed, but it is possible to select to close the mobile phone 100 without saving the composite image.

  That is, after the image composition process is performed by opening the mobile phone 100, the user who wants to change the overwrite image OW or the subject image OJ closes the mobile phone 100 again and does not save the composite image. You can return to

  Therefore, when the obtained composite image does not like the user, by selecting not to save the image, it is possible to prevent the memory from being consumed by unnecessary images. Further, when the composite image is not stored, the captured image (subject image OJ) can be erased from the transparent display 11, and only the overwrite image OW can be left so that it can be continuously input. The change can be made, and the operation of changing only the captured image without changing the overwritten image OW is also possible.

<Third usage pattern>
FIG. 12 is a flowchart for explaining the third usage pattern, and shows a usage pattern different from the basic usage pattern described in the first usage pattern.

  When the camera function is switched on with the cellular phone 100 closed and the imaging operation is started, a captured image is displayed on the main display surface 12a of the main display 12 (step S21). In this case, the cellular phone 100 is closed, but the captured image displayed on the main display surface 12a can be seen through the transparent display 11.

  This state is schematically shown in FIG. As shown in FIG. 13, the subject image OJ is viewed through the transparent display 11.

  When the cellular phone 100 is released from this state (step S22), the captured image displayed on the main display surface 12a by the control unit 30 (FIG. 5) is also displayed on the transparent display 11 (step S23). If the cellular phone 100 remains closed, the state of step S21 is maintained.

  This state is schematically shown in FIG. As shown in FIG. 14, the same subject image OJ displayed on the main display surface 12a is also displayed on the front transmission surface 11a. In this case, any subject image OJ is a real-time video.

  In this state, the user inputs characters, symbols, figures, or the like by hand with an indicator such as a finger, or reads and inputs an electronic image such as a template by panel operation on the transparent display 11 having a touch panel function (step S24). ).

  This state is schematically shown in FIG. As shown in FIG. 15, the real-time subject image OJ and the overwrite image OW are displayed as a composite image on the transparent display 11, and only the real-time subject image OJ is displayed on the main display surface 12 a of the main display 12. ing.

  Next, when the layout is confirmed and the user presses the shutter button BT (step S25), a composite image of the subject image OJ and the overwrite image OW at that time is confirmed, and the confirmed composite image is displayed on the transparent display by the control unit 30. 11 is displayed (step S26).

  Next, the storage instruction by the touch input from the transparent display 11 and the main display 12 by the user, or the input from the operation unit configured by the hard key provided in the upper casing 1 or the lower casing 2 is performed. Based on the instruction, the control unit 30 stores the composite image displayed on the transparent display 11 in a predetermined memory or the like (step S27). Thereafter, in step S28, the display of the composite image is maintained until the mobile phone 100 is closed, and the composite image on the transparent display 11 is erased by closing the mobile phone 100 (step S29). Return to state.

  As described above, in the third usage pattern, the real-time subject image OJ is displayed on the transparent display 11 with the mobile phone 100 opened, and characters, symbols, and figures are displayed on the transparent display 11 while the user looks at it. A configuration for inputting an overwritten image such as the above is adopted. Thereby, for example, even if an overwrite image is input so that the subject image OJ cannot be confirmed on the transparent display 11, the user can input the overwrite image while viewing the subject image OJ on the main display 12. Usability for the user is improved.

<Fourth usage pattern>
FIG. 16 is a flowchart for explaining the fourth usage pattern, and shows a modified usage pattern of the third usage pattern.

  When the camera function is switched on with the cellular phone 100 closed and the imaging operation is started, a captured image is displayed on the main display surface 12a of the main display 12 (step S31). In this case, the cellular phone 100 is closed, but the captured image displayed on the main display surface 12a can be seen through the transparent display 11. This state is the state of FIG. 13 described in the third usage pattern.

  When the cellular phone 100 is released from this state (step S32), the captured image displayed on the main display surface 12a by the control unit 30 (FIG. 5) is also displayed on the transparent display 11 (step S33). This state is the state of FIG. 14 described in the third usage pattern. If the cellular phone 100 remains closed, the state of step S31 is maintained.

  In this state, the user inputs characters, symbols, figures, or the like by hand with an indicator such as a finger, or reads and inputs an electronic image such as a template by panel operation on the transparent display 11 having a touch panel function (step S34). ). This state is the state of FIG. 15 described in the third usage pattern.

  Next, when the layout is confirmed and the user presses the shutter button BT (step S35), a composite image of the subject image OJ and the overwrite image OW at that time is confirmed, and the confirmed composite image is displayed on the transparent display by the control unit 30. 11 is displayed (step S36).

  Next, the storage instruction by the touch input from the transparent display 11 and the main display 12 by the user, or the input from the operation unit configured by the hard key provided in the upper casing 1 or the lower casing 2 is performed. Based on the instruction, the control unit 30 stores the composite image displayed on the transparent display 11 in a predetermined memory or the like (step S37). Thereafter, when the user reconfirms the stored composite image and finds a portion that the user does not like, the stored composite image is canceled (erased) based on the user's deletion instruction (step S38). ).

  In this state, the captured image displayed on the main display surface 12a is also displayed on the transparent display 11. However, this captured image is a captured image under shooting conditions close to the subject image OJ of the composite image canceled earlier. Because there is, there is a high possibility of an image that you want to quickly confirm and capture.

  In such a case, when the captured image is captured in a predetermined memory or the like by pressing the shutter button BT (step S39), the captured captured image is read by the control unit 30 and displayed on the transparent display 11 (step S40). .

  In this state, the user inputs characters, symbols, figures, or the like by hand with an indicator such as a finger, or reads and inputs an electronic image such as a template by panel operation on the transparent display 11 having a touch panel function. On the transparent display 11, the captured subject image OJ and the overwritten image OW are displayed as a composite image (step S41). A real-time subject image OJ is displayed on the main display surface 12 a of the main display 12.

  Next, the storage instruction by the touch input from the transparent display 11 and the main display 12 by the user, or the input from the operation unit configured by the hard key provided in the upper casing 1 or the lower casing 2 is performed. Based on the instruction, the control unit 30 stores the composite image displayed on the transparent display 11 in a predetermined memory or the like (step S42). Thereafter, in step S43, the display of the composite image is maintained until the mobile phone 100 is closed, and the composite image on the transparent display 11 is erased by closing the mobile phone 100 (step S44). Return to state.

  As described above, in the fourth usage pattern, the real-time subject image OJ is displayed on the transparent display 11 with the mobile phone 100 opened, and characters, symbols, figures, etc. are displayed from the transparent display 11 while the user looks at it. This is the same as the third usage pattern in that an overwritten image is input. In addition to this, when it is desired to cancel the composite image once stored and continuously create composite images, the captured image is displayed on the transparent display 11 by pressing the shutter button BT and capturing the captured image. The captured image is overwritten. Accordingly, since the captured image does not change during overwriting, it is possible to reduce the burden of calculation processing in the CPU 30a (FIG. 5) of the control unit 30 for image synthesis processing with the overwritten image.

<Fifth usage pattern>
FIG. 17 is a flowchart for explaining the fifth usage pattern, and shows a usage pattern different from the basic usage pattern described in the first usage pattern.

  When the camera function is switched on with the cellular phone 100 closed and the imaging operation is started, a captured image is displayed on the main display surface 12a of the main display 12 (step S51). In this case, the cellular phone 100 is closed, but the captured image displayed on the main display surface 12a can be seen through the transparent display 11. This state is the state of FIG. 13 described in the third usage pattern.

  When the shutter button BT is pressed in this state to capture the captured image in a predetermined memory or the like (step S52), the captured captured image is read by the control unit 30 and displayed on the transparent display 11 (step S3).

  In this state, the user inputs characters, symbols, figures, etc. by handwriting with an indicator such as a finger, or reads out and inputs an electronic image such as a template by panel operation on the transparent display 11 having a touch panel function (step S54). ).

  That is, by inputting characters, figures, etc. to be overwritten on the captured image displayed on the transparent display 11, the subject image OJ and the overwritten image OW of the captured image are displayed on the transparent display 11 as a composite image. Is done.

  When the cellular phone 100 is released from this state (step S55), the composite image is displayed on the transparent display 11 (step S56). When the mobile phone 100 is not opened, the state where the overwrite image OW can be changed or added is maintained.

  Next, the storage instruction by the touch input from the transparent display 11 and the main display 12 by the user, or the input from the operation unit configured by the hard key provided in the upper casing 1 or the lower casing 2 is performed. Based on the instruction, the control unit 30 stores the composite image displayed on the transparent display 11 in a predetermined memory or the like (step S57). Thereafter, in step S58, the display of the composite image is maintained until the mobile phone 100 is closed, and the composite image on the transparent display 11 is erased by closing the mobile phone 100 (step S59). Return to state.

  As described above, in the fifth usage pattern, the mobile phone 100 is imaged in the closed state, the captured image is captured by the shutter operation, the captured image is displayed on the transparent display 11, and the captured image is displayed. On the other hand, overwriting is performed. For this reason, since the captured image does not change during overwriting, it is possible to reduce the burden of calculation processing in the CPU 30a (FIG. 5) of the control unit 30 for image synthesis processing with the overwriting image.

<Sixth usage pattern>
FIG. 18 is a flowchart for explaining the sixth usage pattern, and shows a usage pattern different from the basic usage pattern described in the first usage pattern.

  When the camera function is switched on with the cellular phone 100 opened and the imaging operation is started, a captured image is displayed on the main display surface 12a of the main display 12 (step S61). In this case, the captured image is not displayed on the transparent display 11.

  This state is schematically shown in FIG. As shown in FIG. 19, a real-time subject image OJ is displayed on the main display surface 12 a of the main display 12, and nothing is displayed on the transparent display 11. In this case, the subject can be seen through the rear side transmission surface 11b and the front side transmission surface 11a of the transparent display 11, but the illustration is omitted.

  In this state, the user inputs characters, symbols, figures, or the like by hand with an indicator such as a finger, or reads and inputs an electronic image such as a template by panel operation on the transparent display 11 having a touch panel function (step S62). ).

  That is, when an overwrite image is input while viewing the captured image displayed on the main display surface 12a, only the overwrite image is displayed on the transparent display 11.

  This state is schematically shown in FIG. As shown in FIG. 20, only the overwrite image OW is displayed on the front transmission surface 11 a of the transparent display 11, and only the real-time subject image OJ is displayed on the main display surface 12 a of the main display 12.

  Next, when the layout is confirmed and the user presses the shutter button BT (step S63), the subject image OJ and the overwritten image OW at that time are combined, and the combined image is displayed on the transparent display 11 by the control unit 30. (Step S64). This state is schematically shown in FIG.

  Next, the storage instruction by the touch input from the transparent display 11 and the main display 12 by the user, or the input from the operation unit configured by the hard key provided in the upper casing 1 or the lower casing 2 is performed. Based on the instruction, the control unit 30 stores the composite image displayed on the transparent display 11 in a predetermined memory or the like (step S65). Thereafter, in step S66, the display of the composite image is maintained until the mobile phone 100 is closed, and the composite image on the transparent display 11 is erased by closing the mobile phone 100 (step S67).

  Thereafter, by opening the mobile phone 100 again (step S68), the state returns to step S61.

  As described above, in the sixth usage pattern, the image is taken with the cellular phone 100 opened, but at this stage, the image is not displayed on the transparent display 11 but while viewing the captured image displayed on the main display surface 12a. The overwrite image OW is input. When the layout is finalized, the shutter button BT is pressed to perform image composition processing of the subject image OJ and the overwritten image OW at that time, and display the composite image on the transparent display 11. For this reason, even for captured images that are constantly updated. There is no need to perform an image composition process every time it is updated, and an arithmetic process for the image composition process becomes unnecessary, and the processing load on the CPU 30a (FIG. 5) of the control unit 30 can be reduced. This is the same even when the overwritten image changes.

  The transparent display 11 used in the mobile phone 100 described above may be configured with a normally white mode transmissive liquid crystal panel.

<Modification>
In the third and fourth usage modes described above, the configuration in which the captured image displayed on the main display surface 12a is also displayed on the transparent display 11 by opening the mobile phone 100 is shown. However, a configuration may be adopted in which a captured image is not displayed on the transparent display 11 when the mobile phone 100 is opened. In this case, it is possible to adopt a configuration in which the overwrite image OW is input to the transparent display 11 while viewing the captured image displayed on the main display surface 12a. Then, when the layout is finalized, at the timing when the shutter button BT is pressed or the like, image composition processing of the subject image OJ and the overwritten image OW is performed, and the obtained composite image is displayed on the transparent display 11. It is good also as a structure.

DESCRIPTION OF SYMBOLS 1 Upper housing | casing 2 Lower housing | casing 11 Transparent display 11a Front side transparent surface 11b Back side transparent surface 12 Main display 12a Main display surface

Claims (7)

A first housing in which a first display unit is housed such that the display surface is exposed from one surface;
A first surface and a second surface opposite to the first surface; the second surface is slidable on the first display portion with the second surface facing the first housing; A second housing containing the display unit,
A control unit for controlling display of the first and second display units;
A touch panel function added to at least the second display unit;
An imaging unit including a camera system capable of capturing a moving image and a still image,
The first and second housings are
By sliding the second casing on the first display unit,
A closed state in which the first display unit is visible through the second display unit while the first case is covered with the second case;
The second housing does not overlap the first display unit, and exhibits an open state in which the first display unit is visible.
The controller is
While the first and second housings are closed, a captured image of the subject imaged by the imaging unit is displayed on the first display unit, and via the touch panel function of the second display unit. The overwritten image to be combined with the captured image that has been input is displayed on the second display unit, and the combined image of the captured image and the overwritten image is displayed when the first and second housings are opened. A mobile phone that performs processing. The captured image is
The mobile phone according to claim 1, wherein the mobile phone is a captured image determined by a shutter operation. The controller is
The mobile phone according to claim 1 or 2, wherein a composite image of the captured image and the overwrite image is displayed on the second display unit in a state where the first and second housings are opened. The controller is
The mobile phone according to claim 3, wherein, when a save instruction is received, the composite image displayed on the second display unit is saved in a predetermined storage unit. The controller is
The mobile phone according to claim 3, wherein the composite image displayed on the second display unit is deleted by closing the first and second housings. The controller is
6. The mobile phone according to claim 5, wherein after closing the first and second housings, the composite image is erased after receiving an instruction to erase the composite image displayed on the second display unit. The controller is
When receiving an instruction not to delete the composite image displayed on the second display unit, the captured image is deleted from the composite image, and only the overwritten image is displayed on the second display unit. Item 7. The mobile phone according to Item 6.

Images