JP4005119B2 - Mobile device - Google Patents

Description

  The present invention relates to a mobile terminal equipped with a camera that includes a lens and an image sensor for photographing a subject. The portable terminal digitally processes an image photographed by a camera such as a notebook personal computer, a PDA (Personal Digital Assistant), or a cellular phone, and displays it on the display of the portable terminal.

  Conventionally, an ultra-small camera having an image sensor such as a CCD is mounted on a mobile phone, and a photographed image is attached to an e-mail and sent. In a foldable mobile phone, in an open state, for example, the camera lens provided on the outside of the mobile phone is pointed at a friend, the photographed image is displayed on a display provided on the inside of the mobile phone, and an appropriate Adjustments are made so that the image is captured in the size and position, the shutter key is pressed to capture the image, and the image is sent as an e-mail attachment.

  In addition, when taking a picture of the face of a person who has a mobile phone, a small sub-display that displays the day of the week and the like provided on the outside with the lens located on the outside facing the user with the mobile phone folded The image of his / her face taken on the instrument is displayed, the shutter key is pressed to take a picture, and the picture is sent as an attachment to an e-mail.

As mentioned above, in the past,
(1) When photographing the other party, shoot with the lens on the outside of the mobile phone facing the other party, and display the image on the inner display, so that the other party's image is seen through. It was displayed on the vessel.

  (2) When photographing yourself, close the mobile phone, shoot with the outside lens facing you, and display the image on a small sub-display that displays the day of the week etc. on the outside of the lens. The image was displayed on the outer sub-display so that it could be reflected by the mirror.

  For this reason, when shooting the other party, you (the photographer) can see the other party's image displayed on the display inside the mobile phone and check the facial expression. There is a problem that it is unclear whether the image was shot in the size or size, and the only way to confirm it is to have the image displayed and displayed after shooting.

  In order to solve these problems, the present invention displays an image as if it was reflected in a mirror on the first screen that can be seen from the other party when the other party is photographed with a mobile terminal, or displays a status indicating a photographing state, An object is to display an image on a second screen that can be seen by a photographer, and to check an image taken by the photographed person and a photographing state at the time of photographing.

Means for solving the problem will be described with reference to FIG.
In FIG. 1, a portable terminal 1 is provided with a main LCD 2, shutters 3, 42, a sub LCD 5, a camera 6, and the like.

  The main LCD 2 corresponds to a display inside the mobile terminal 1 and is a screen (second screen) provided on the side different from the lens constituting the camera 6, that is, on the opposite side.

  The shutter key 42 or the shutter 3 is for taking an image by operating the shutter of the camera 6.

  The sub LCD 5 corresponds to a display on the outside of the mobile terminal 1 and is a screen (first screen) provided on the same side as the lens constituting the camera 6.

  The camera 6 is composed of a lens, an image sensor, and the like, and shoots a subject to generate an image.

Next, the configuration and operation will be described.
The mobile terminal 1 is a second screen provided on the side opposite to the side on which the lens constituting the camera 6 and the sub LCD 5 serving as the first screen are provided on the same side as the side on which the lens constituting the camera 6 is provided. The main LCD 2 is arranged, and the control unit 8 displays an image taken with the lens facing the subject to be photographed on the main LCD 2, and displays the taken image or a status indicating the photographing state on the sub LCD 5.

  At this time, a through image for viewing the subject to be photographed is displayed on the main LCD 2, and when displaying the image on the sub LCD 5, a horizontally reversed image reflected in the mirror as seen from the subject to be photographed is displayed.

  Further, when the shutter key 42 or the shutter 3 is pressed, a still image shot on the main LCD 2 is displayed. When an image is displayed on the sub LCD 5, a still image is displayed or a status is displayed. The completion status is displayed.

  Further, when an image is displayed on the sub LCD 6, the image is reduced or cut out and displayed.

  Further, a switching means for switching and displaying an image or status on the sub LCD 5 is provided.

  Accordingly, when the mobile terminal 1 captures the other party, the sub LCD 5 that is the first screen visible from the other party displays an image as if it was reflected in the mirror, or displays a status indicating the shooting state, and is visible to the photographer. By displaying an image on the main LCD 2 which is the second screen, it is possible to confirm an image taken by the person at the time of shooting and a shooting state.

  According to the present invention, when the mobile terminal 1 captures an image of the other party, the first screen (sub LCD 5) visible from the other party displays an image as if it was reflected in the mirror or displays a status indicating the shooting state, and Since a configuration in which an image (through image) is displayed on the second screen (main LCD 2) that can be seen by the person, it is possible to check the image taken by the person at the time of shooting and the shooting state. The photographer and the photographer can easily adjust to the optimal feeling and size by looking at the cost photographer's image together.

  The present invention displays an image as if it was reflected in a mirror or a status indicating a shooting state on a first screen (sub LCD 5) that is visible from the other side when the other party is photographed by the portable terminal 1, and from the photographer. Since a configuration is adopted in which an image (through image) is displayed on the second screen (main LCD 2) that can be seen, it is possible to check the image and shooting state of the photographed person at the time of shooting, and The photographer and the photographer can easily adjust to the optimal feeling and size by looking at the cost photographer's image together.

Next, embodiments and operations of the present invention will be described in detail sequentially with reference to FIGS.
FIG. 1 shows an overview of the present invention.

  1A shows a side view in a substantially open state, FIG. 1B shows a front view in an open state, and FIG. 1C shows a front view in a state of being folded in two and closed. Indicates.

  In FIG. 1, the portable terminal 1 is provided with a main LCD 2 as a second screen at the upper part and an input device 4 and a control part at the lower part as shown in the opened inside of FIG. Is.

  When the mobile terminal 1 is a mobile phone, the main LCD 2 is a screen that displays a telephone number, images to be transmitted and received, and the like.

  The control unit performs various controls (image display, transmission / reception control, etc.) by a program and a hardware circuit, and will be described later with reference to FIG.

  The shutter 3 is provided on the side surface and is used for photographing by operating the camera 6 when the portable terminal 1 is folded in half.

  The input device 4 performs various operation instructions, input of telephone numbers, input of e-mail messages, etc. by pressing keys. Here, the camera key 41, the shutter key 42, the menu key 43, the telephone book, etc. A key 44, a start key 45, a calendar key 46, a clear key 47, a power key 48, a numeric keypad, and the like are included.

The camera key 41 is pressed to activate the camera mode.
The shutter key 42 is pressed to generate an image photographed by the camera.

  The clear key 47 is used to perform various types of clearing. Here, the clear key 47 is pressed to clear a captured image.

  The antenna 7 is for transmitting and receiving radio waves. In this case, the shutter key 42 and the shutter 3 are pressed to turn on during photographing and notify the subject.

FIG. 2 shows an example screen of the present invention.
FIG. 2A shows an example of the sub LCD 5.

  (A-1) in FIG. 2 shows the number of dots on the screen. Here, as shown in the drawing, the sub LCD 5 is a screen having a size of 96 dots in the whole vertical direction, 72 dots in the image display portion, and 64 dots in the whole horizontal direction.

  (A-2) in FIG. 2 shows a state in which a message “photographing in progress” is displayed on the sub LCD 5. The message “being photographed” represents a state in which the subject 6 is photographed by the camera 6 and the image is being displayed on the main LCD 2 (see FIGS. 4 and 5).

  (A-3) in FIG. 2 shows a state in which the message “Displaying” is displayed on the sub LCD 5. This “displaying” message represents a state in which a still image taken by the camera 6 is captured on the main LCD 2 (see FIGS. 4 and 5).

FIG. 2B shows an example of the main LCD 2.
(B-1) in FIG. 2 shows the number of dots on the screen. Here, as shown in the figure, the main LCD 2 is a screen having a size of 176 dots in the entire vertical direction, 140 dots in the portion displaying an image, and 132 dots in the entire horizontal direction.

  (B-2) of FIG. 2 shows a state in which a message “Image is being stored” is displayed. This “image saving” message represents a state in which a still image obtained by photographing the subject to be photographed by the camera 6 is being saved (stored) in a file (see FIGS. 4 and 5).

FIG. 3 shows a display image diagram (viewed from above) of the present invention.
In FIG. 3, the left side is a photographer 51, a person who holds the mobile terminal 1 with his hand and photographs the lens of the camera 6 toward the photographer 52, and a through image obtained by photographing the subject 52 on the main LCD 2. (An image similar to the case where the subject 52 is directly viewed from the photographer 51) is displayed.

  The photographed person 52 on the right side is a person who is photographed with the lens of the camera 5 of the portable terminal 1 being directed, and is an image obtained by photographing the expense photographer on the sub-LCD 5 (left and right reversed). Is displayed in the same way as if it was reflected in the mirror.

  The central portable terminal 1 is the portable terminal having the configuration shown in FIGS. 1 and 2 described above, and here, a diagram seen from the top to the bottom is shown.

  As described above, when the photographer 51 holds the mobile terminal 1 with his hand and points the lens of the camera 6 toward the photographed person 52 and presses the camera key 41 to enter the camera mode, as shown in the figure, from the photographer 51. A through image is displayed on the main LCD 2 that can be seen, and a horizontally reversed image is displayed on the sub LCD 5 that is visible to the photographed person 52. The photographed person 52 gives the photographer 51 the feeling and size of the photographed image. At the same time, it can be recognized in real time, and it is possible to share the captured image during shooting.

  FIG. 4 shows a flowchart for explaining the operation of the present invention. Here, the main LCD 2 and the sub LCD 5 are the same as those having the same numbers described in FIGS. The portable terminal 1 performs an operation such as an operation that the photographer 51 depresses a key provided on the portable terminal 1 described above, or detects that the key is depressed when the portable terminal 1 is depressed. And so on.

  In FIG. 4, the camera key 41 is pressed in S1. This is because the photographer 51 presses the camera key 41 of the mobile terminal 1. In response to the press, the sub LCD 5 displays a character display “photographing in progress” and a through image on the main LCD 2.

  As described above, when the photographer 51 holds the portable terminal 1 with his hand and points the lens constituting the camera 6 of the portable terminal 1 toward the photographed person 52 and presses the camera key 41, the photographer 51 appears on the main LCD 2 visible to the photographer 51. A through image of the photographed person is displayed, and characters currently being photographed are displayed on the sub LCD 5 that can be seen by the photographed person 52, so that the photographed person 52 can recognize that he is photographing.

  In S <b> 2, the photographer 51 presses (operates) the shutter key 42 of the mobile terminal 1 or the shutter 3 provided on the side surface of the mobile terminal 1. In response to the pressing, the sub LCD 5 displays a character display “being displayed” and also displays a still image on the main LCD 2.

  As described above, when the photographer 51 presses the shutter key 42 or the shutter 3 with the lens constituting the camera 6 of the portable terminal 1 facing the photographed person 52, the photographed person is displayed on the main LCD 2 that can be seen from the photographer 51. Is displayed on the sub LCD 5 that is visible to the photographed person 52, and the characters that are currently displaying the photographed still picture are displayed, and the photographed person 52 is displaying the still image in which the photographed person is photographed. Can be recognized.

  In S3, the photographer 51 looks at the photographed still image displayed on the main LCD 2, and determines whether to save the photographed image. If YES, the process proceeds to S4. In the case of NO, since the photographer has decided not to save, the process proceeds to S6.

  In S4, since it has been decided to save the still image taken by the photographer in YES in S3, the shutter key 42 or the shutter 3 is pressed to instruct saving. In response to the instruction, the character display “currently displaying” is displayed on the sub LCD 5 and the character display “image saving” is displayed on the main LCD 2.

In S5, the image is stored in the memory.
If the photographer 51 sees the still image displayed on the main LCD 2 and decides to save it through S3 YES, S4 to S5, when the shutter key 42 or the shutter 3 is pressed, the sub LCD 5 displays “ "Displaying", "Maintaining image" is displayed on the main LCD 2, and a still image is stored in the internal memory or the like.

  In S6, since it has been decided not to save the still image taken by the photographer in NO in S3, the clear key 47 is pressed to instruct clearing.

  In step S7, the still image on the working memory is cleared in response to the instruction to clear in step S6.

  If the photographer 51 sees the still image displayed on the main LCD 2 and decides not to save it by the above S3 NO, S6, S7, the still image is cleared when the clear key 47 is pressed. It becomes.

  FIG. 5 is a flowchart for explaining another operation of the present invention. This is because the flowchart shown in FIG. 4 displays characters representing the shooting state on the sub LCD 5, whereas in FIG. It is.

  In FIG. 5, the camera key 41 is pressed in S21. This is because the photographer 51 presses the camera key 41 of the mobile terminal 1. In response to the press, the sub LCD 5 displays a character display “photographing in progress” and a through image on the main LCD 2.

  When the photographer 51 holds the mobile terminal 1 with his hand by the above-described S21 and the like and the camera key 41 is pressed with the lens constituting the camera 6 of the mobile terminal 1 directed toward the subject 52, the main visible to the photographer 51 is displayed. A through image of the photographed person is displayed on the LCD 2, and a horizontally reversed image is displayed on the sub LCD 5 that can be seen from the photographed person 52, and the photographer 51 can view an image of the photographed person 52 on the main LCD 2. At the same time, the person to be photographed 52 can see on the sub LCD 5 a left-right reversed image of the same image as in the mirror.

  In S22, the camera key 41 is pressed. In response to the pressing, a horizontally reversed image is displayed on the sub LCD 5 and a through image is displayed on the main LCD 2.

  When the photographer 51 depresses the camera key 41 with the lens constituting the camera 6 of the mobile terminal 1 facing the photographed person 52 by the above S22 and the like, the photographed person is displayed on the main LCD 2 that can be seen by the photographer 51. A through image is displayed, a left-right inverted image is displayed on the sub LCD 5 that is visible to the photographed person 52, the photographer 51 can observe the photographed person, and the photographed person 52 has photographed himself / herself. A horizontally reversed image can be observed.

  In S23, the photographer 51 depresses (operates) the shutter key 42 of the mobile terminal 1 or the shutter 3 provided on the side surface of the mobile terminal 1. In response to the pressing, the sub LCD 5 displays characters “being displayed” or a still image and also displays the still image on the main LCD 2.

  When the photographer 51 depresses the shutter key 42 or the shutter 3 with the lens constituting the camera 6 of the portable terminal 1 facing the photographed person 52 by the above S23 or the like, the photographer 51 is displayed on the main LCD 2 visible to the photographer 51. A still image obtained by photographing the photographed person is displayed, and a character display “displaying” is displayed on the sub LCD 5 that is visible to the photographed person 52, or a still image that is horizontally reversed is displayed, and the photographer 51 displays the photographed still image. At the same time, the person to be photographed 52 can observe the captured character display or the still image reversed left and right.

  In S24, the photographer 51 looks at the photographed still image displayed on the main LCD 2, and determines whether to save the photographed image. If YES, the process proceeds to S25. In the case of NO, since the photographer has decided not to save, the process proceeds to S27.

  In S25, since it has been decided to save the still image taken by the photographer in YES in S24, the shutter key 42 or the shutter 3 is pressed to instruct saving. In response to this instruction, the character display “currently displaying” is displayed on the sub LCD 5 or the character display “storing” is displayed, and the character display “image is being stored” is displayed on the main LCD 2.

In S26, the still image is stored in the memory.
If the photographer 51 sees and saves the still image displayed on the main LCD 2 through YES and S25 to S26 in S24, when the shutter key 42 or the shutter 3 is pressed, the sub-LCD 5 displays “ “Displaying” or “Saving”, “Maintaining image” is displayed on the main LCD 2 and a still image is stored in the internal memory or the like.

  In S27, since it is determined that the still image taken by the photographer 51 is not saved in NO in S24, the clear key 47 is pressed to instruct clearing.

  In step S28, the still image in the working memory is cleared in response to the instruction for clearing in step S27.

  If the photographer 51 sees the still image displayed on the main LCD 2 and decides not to save it by S24 NO, S27, and S28, the still image is cleared when the clear key 47 is pressed. It becomes.

  FIG. 6 is a flowchart for explaining the operation of the present invention. In FIG. 6, since the sub LCD 5 is smaller in size than the main LCD 2, the entire image cannot be displayed. Therefore, here, the image displayed on the main LCD 2 is reduced and displayed on the sub LCD 5, or cut out and partly cut out. Is displayed on the screen. The display on the main LCD 2 is the same as the flowchart of FIG.

  In FIG. 6, in S41, the camera key 41 is pressed. In response to the pressing, the sub LCD 5 displays a character display “photographing in progress”.

  In S42, the camera key 41 is pressed. In response to the pressing, a through image is displayed on the sub LCD 5I.

  In step S43, it is determined whether the display is reduced. In the case of YES, the image is reduced and displayed on the sub LCD 5 in S44, and the process proceeds to S45. On the other hand, in the case of NO, the calendar key 46 is pressed in S46, an image partially cut out is displayed on the sub LCD 5 in S47, and the process proceeds to S45.

  In S45, the shutter key 42 or the shutter 3 is pressed. In response to the pressing, the still image reduced or cut out is displayed on the sub LCD 5.

  As described above, the sub LCD 5 that can be seen by the subject 52 can be reduced in size so that the same image as the image displayed on the main LCD 2 is displayed, or a part of the sub LCD 5 can be cut out and displayed. It is possible to switch arbitrarily.

  FIG. 7 shows a system configuration diagram of the present invention. This shows an example of a system configuration diagram when the mobile terminal 1 described above is applied to a mobile phone. Here, the main LCD 28 and the sub LCD 30 correspond to the main LCD 2 and the sub LCD 5 described above.

  In FIG. 7, a system LSI 11 indicates a circuit portion that has been converted to an LSI, and includes the following 12 to 21 and the like.

  The audio interface unit 12 amplifies a signal from the microphone 22 or sends an audio signal to the receiver 23 to utter a sound.

  The audio codec unit 3 performs encoding that facilitates transmission of audio, returns encoded audio data to audio, and the like.

  The TDMA unit 14 converts audio data, image data, character data, etc. into a predetermined format, or demodulates the data from the predetermined format.

The modulation unit 15 modulates the signal from the TDMA unit 14 and passes it to the transmission unit 16.
The demodulator 20 demodulates the signal received by the receiver 18.

  The CPU unit 21 executes various processes in accordance with a program stored in a ROM (not shown) and performs overall control.

  The transmitter 16 converts the signal passed from the modulator 15 into a signal for transmission based on the reference frequency signal from the reference oscillator 19, sends it to the antenna 7 via the SW 17, and transmits it as a radio wave. .

  The receiving unit 18 receives and amplifies the weak signal received by the antenna 7 via the SW 17, and extracts (receives) a specific signal based on the signal from the reference oscillator 19.

  The reference oscillator 19 oscillates a reference frequency signal, and is a crystal oscillator, for example.

  The power source / power control unit 35 supplies power to each unit based on the power from the battery 36, or charges the battery 36 and supplies power to each unit when power is supplied from an AC adapter (not shown). Control.

The microphone 22 converts the uttered voice into an electric signal.
The receiver 23 converts the sound into an audio electric signal.

  The memory unit 25 stores various data (image data, still image data, telephone numbers, etc.).

  The main LCD controller unit 26 controls the display of images and characters on the main LCD 28.

  The main LCD driver unit 27 is driven to display images and characters on the main LCD 28.

  The main LCD 28 displays images and characters, and corresponds to the main LCD 2 shown in FIG.

  The sub LCD controller / driver unit 29 controls display of images and characters on the sub LCD 30.

  The sub LCD 30 displays images and characters, and corresponds to the sub LCD 5 shown in FIG.

The camera signal processing unit 31 captures an image by controlling the camera sensor.
The camera unit 32 includes a camera sensor (for example, a CCD), a lens (not shown), an automatic focusing mechanism, an automatic diaphragm mechanism, and the like. The camera unit 32 shoots the subject 52 and generates an image. .

  The keyboard unit 33 is composed of shutter keys 1, operation keys such as camera keys, and a numeric keypad for inputting characters and numbers, and corresponds to the input device 4 shown in FIG.

  The side switch 34 is a switch provided on the side of the portable device 1 and is the shutter key 3 in FIG.

  In the description of this embodiment, when the camera 5 is activated, photographed, and saved, it is activated using the camera key 41, shutter key 42, calendar key 46, and the like that constitute the input device 4 with the portable terminal 1 opened. However, this is merely an example, and activation may be performed using other keys constituting the input device 4, and the mobile terminal 1 may be activated regardless of the keys constituting the input device 4. Various operation keys, switches, slide switches, etc., which are separately provided, such as the shutter 3 provided on the side surface, may be provided for activation.

  The present invention displays an image as if it was reflected in a mirror or a status indicating a shooting state on a first screen (sub LCD 5) that is visible from the other side when the other party is photographed by the portable terminal 1, and from the photographer. Since a configuration is adopted in which an image (through image) is displayed on the second screen (main LCD 2) that can be seen, it is possible to check the image and shooting state of the photographed person at the time of shooting, and The present invention relates to a portable terminal in which the photographer and the photographer can easily adjust the image to the optimal feeling and size by looking at the cost photographer's image together.

1 is an overview of the present invention. It is an example of a screen of the present invention. It is a display image image figure (view seen from the top) of the present invention. It is an operation | movement explanatory flowchart of this invention. It is another operation | movement description flowchart of this invention. It is an operation | movement explanatory flowchart of this invention. It is a system configuration diagram of the present invention.

Explanation of symbols

1: Mobile terminal 2, 28: Main LCD
3: Shutter 4: Input device 41: Camera key 42: Shutter key 43: Menu key 44: Phonebook key 45: Start key 46: Calendar key 47: Clear key 48: Power key 5, 30: Sub LCD
6: Camera 7: Antenna 51: Photographer 5: Subject 11: System LSI
32: Camera section

Claims (8)

In a mobile terminal equipped with a camera that includes a lens and an image sensor that captures the subject,
A first screen provided on the same side as the side provided with the lens;
A second screen provided on a side different from the side on which the lens is provided;
Means for displaying on the second screen an image photographed with the lens facing the object to be photographed, and displaying status information indicating a photographing state by the portable terminal on the first screen. A featured mobile terminal. In the mobile terminal,
When a shutter key provided on the portable terminal is pressed, an image photographed by the image sensor is displayed on the second screen, and status information indicating a photographing completion state is displayed on the first screen. The mobile terminal according to claim 1, wherein: In the mobile terminal,
3. The switching unit according to claim 1, further comprising a switching unit configured to switch the information displayed on the first screen to the status information or an image captured by the image sensor. Mobile device. In the mobile terminal,
When a key provided on the portable terminal is pressed, an image input from the image sensor is displayed on the second screen, and status information indicating that the image is being captured is displayed on the first screen. The mobile terminal according to claim 1, wherein the mobile terminal is displayed. In the mobile terminal,
When a predetermined operation is performed on the mobile terminal in a state where status information indicating that shooting is being performed is displayed on the first screen, an image input from the image sensor is displayed on the first screen. The mobile terminal according to claim 4, wherein: In the mobile terminal,
Status information indicating that an image is being stored or status information indicating that an image is being displayed on the second screen is displayed on the first screen when the image captured by the image sensor is stored. The mobile terminal according to claim 1, wherein the mobile terminal is displayed. In the mobile terminal,
The portable terminal according to claim 6, wherein when the image is stored, information indicating that the image is being stored is displayed on the second screen. In a mobile terminal equipped with a camera that includes a lens and an image sensor that captures the subject,
A first screen provided on the same side as the side provided with the lens;
A second screen provided on a side different from the side on which the lens is provided;
An image photographed with the lens facing the object to be photographed is displayed on the second screen, and status information representing the photographing state by the portable terminal or the image is selectively displayed on the first screen. And a portable terminal.

Images