JP2005123930A - Portable terminal - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To improve operability of a portable terminal having an image pickup function. <P>SOLUTION: The existing shutter key 16 and center key 9 are prepared as keys for photography at the time of camera photography/storage. In a camera mode, when the shutter key 16 on the side is depressed, it is judged as horizontal position photography and image data of image pickup is stored as long sideways image. When the center key 9 at the front is depressed, it is judged as vertical position photography and stored as a vertically long image. Since there may be cases of photographing at the vertical position and photographing at the horizontal position according to an object, the vertical position photography and the horizontal position photography are mixed, however, as to the stored image data of image pickup, both of a vertical position photographed image and a horizontal position photographed image can also be displayed with rotary processing so that the vertically long and the long sideways of the image coincide with the vertically long and the long sideways of a picture of a display part 4 at the time of browsing. Consequently, a special rotary operation and editing become unnecessary. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to a mobile terminal device such as a mobile phone device with a camera or a digital camera, and more particularly to a mobile terminal device that enables storage and browsing of captured images.

  In recent years, electronic devices are becoming smaller and more functional. For example, a mobile phone device has a large screen and can display a large amount of character information and high-definition images. On the other hand, among recent mobile phone devices, there is a so-called camera mobile phone equipped with a camera equipped with an imaging lens and an image sensor that converts input light into an electrical signal. Image display size, camera resolution and processing power are improved. The same is true for digital cameras.

  Images taken with camera-equipped mobile phone devices and digital cameras are usually sent to devices with large-capacity storage devices such as personal computers (PCs) via small storage media or e-mail, and viewed, edited, and printed on computers. It has become. Recently, digital camera type mobile phone devices have been commercialized.

  In conventional mobile phone devices with cameras and digital cameras, captured and stored images are unified in either portrait or landscape. For camera-equipped mobile phone devices, portrait is the mainstream, and for digital cameras, landscape is the basic. For example, in the case of a mobile phone device with a camera, the image size is selected from 160 × 120 pixels, 320 × 240 pixels, and 640 × 480 pixels. However, depending on the composition of the subject, there may be a case of shooting in the vertical position and a case of shooting in the horizontal position. For example, a person is photographed in a vertical position and a landscape is photographed in a horizontal position. Here, the image photographed in the horizontal position means that the camera-equipped mobile phone device is photographed in a state in which the camera-equipped cellular phone device is rotated 90 degrees and turned sideways. Therefore, an image photographed in the vertical position and an image photographed in the horizontal position are mixed, which makes it difficult to view the stored photographed image. In many cases, the camera-equipped mobile phone device is provided with an image editing function, and a desired position can be obtained by using a 90-degree rotation function. Alternatively, the image data may be transferred to a personal computer and rotated by 90 degrees with personal computer image editing software to obtain a desired position.

  On the other hand, some of the high-end models of digital cameras have been commercialized with built-in sensors that automatically determine the vertical and horizontal directions. Power Shot G3 (a product name of a digital camera: Canon Inc.) is equipped with an “SI sensor” (high-sensitivity stress detection device) in which the camera automatically determines the vertical / horizontal position during shooting. Since the camera can always recognize the upper side of the screen, it enables high-precision exposure control that minimizes the effects of light sources such as the sun and the sky. Further, an image captured in the vertical position based on the output of the “SI sensor” can be rotated and displayed during reproduction.

There is also a camera that records the information corresponding to the framing switched to the photographic film by switching the angle of view in conjunction with the operation state of the selection switch that switches the shooting screen to either vertical framing or horizontal framing. (See Patent Document 1).
JP-A-63-298233

  In conventional mobile phone devices with cameras and digital cameras, captured and stored images are unified in either portrait or landscape. In the case of a mobile phone device with a camera, the portrait is mainstream, and in the case of a digital camera, it is landscape. However, depending on the subject, there may be a case where the image is taken in the vertical position and a case where the image is taken in the horizontal position. Therefore, at the time of browsing, it is difficult to see because either the vertical position captured image or the horizontal position captured image is displayed by being rotated 90 degrees from the normal position. The user must rotate the images by 90 degrees using an image editing tool or the like. That is, it is troublesome because an additional work of editing occurs after shooting and saving.

  On the other hand, some of the high-end models of digital cameras have been commercialized with built-in sensors that automatically determine the vertical and horizontal directions. However, this sensor leads to an increase in cost. Depending on the shooting posture and the composition of the subject, a sensor judgment error may occur.

  Therefore, an object of the present invention is to provide a portable terminal device having an imaging function with improved operability without increasing the size of the device.

  A portable terminal device according to an aspect of the present invention is a portable terminal device having a plurality of types of functions including a subject imaging function and a plurality of types of operation modes, and imaging the subject when the imaging function is instructed to obtain image data Imaging means for outputting image data, image data processing means for processing and outputting given image data, image data storage means for storing image data input from the image data processing means, and a plurality of predetermined keys, Each of the plurality of predetermined keys indicates an imaging function in the imaging operation mode when the key is operated, and indicates another type of function in the other operation modes.

  Therefore, in the imaging operation mode, the imaging function can be instructed by operating any of a plurality of predetermined keys, so that the operability is improved as compared with the case of using a single key for imaging. In addition, since each of the plurality of predetermined keys indicates another type of function when operated in another operation mode, each of the plurality of predetermined keys can be used both as an instruction for an imaging function and an instruction for another type of function. As a result, it is possible to realize a mobile terminal device having an imaging function with improved operability without increasing the configuration.

  According to another aspect of the present invention, there is provided a mobile terminal device that captures an image of an object and outputs image data, an image data processing unit that processes and outputs applied image data, and image data input from the image data processing unit Image data storage means for storing the image data and a plurality of imaging keys operated to instruct the imaging means to take an image, and the image data processing means captures the given image data for the subject of the imaging means. The image data processing means is instructed for a different imaging angle for each of the plurality of imaging keys when a key operation is performed.

  Therefore, since any of a plurality of imaging keys can be operated to instruct imaging, the operability is superior to instructing imaging with only one imaging key. In addition, a different imaging angle can be instructed for each of the plurality of imaging keys without adding a special mechanism (circuit) for instructing (specifying) the imaging angle. As a result, it is possible to provide a mobile terminal device having an imaging function with improved operability without increasing the size of the device.

  Preferably, there are two imaging keys, and the imaging angles for each of the imaging keys differ from each other by 90 degrees. Therefore, it is possible to indicate that the imaging angle is 90 degrees shifted from each other for each imaging key to be operated.

  Preferably, the image data processing means performs processing for image rotation based on the instructed imaging angle so that the given image data becomes image data imaged at a predetermined imaging angle.

  Therefore, since the image data acquired by imaging is uniformly processed after being processed at a predetermined imaging angle and stored in the image data storage unit, the image data is stored and stored in the image data storage unit. The captured image data is stored in a state of being captured at a predetermined imaging angle regardless of the angle at the time of imaging.

  Preferably, the image data processing means inputs the given image data, and outputs information indicating the imaging angle designated for the image data together with the input image data, and the image data storage means inputs from the image data processing means The image data and the information indicating the imaging angle are stored in association with each other.

  Therefore, in the image data storage means, the image data of the image can be stored and stored in association with the information indicating the imaging angle at the time of imaging.

  Preferably, the read image data processing means further includes read image data processing means for processing the image data read from the image data storage means based on information indicating an imaging angle corresponding to the image data, and the read image data processing means reads the read image. Image rotation processing is performed based on information indicating a corresponding imaging angle so that the data becomes image data captured at a predetermined imaging angle.

  Preferably, when a subject image based on image data is displayed on a screen prepared in advance, the predetermined imaging angle is such that the vertical and horizontal directions of the displayed subject image coincide with the predetermined vertical and horizontal directions of the screen. Is an angle. Therefore, the subject image based on the image data obtained by imaging is easy to see because the vertical and horizontal directions of the subject image coincide with the predetermined vertical and horizontal directions when the screen is displayed.

  Preferably, when the image size of the captured image data is equal to or greater than a predetermined level, the processing of the image data based on the imaging angle by the data processing unit is executed, and when the image size is less than the predetermined level, the imaging angle instruction and the data processing unit Control means for controlling to omit processing of the image data based on the imaging angle is further provided.

  Therefore, the processing by the image data processing unit of the image data acquired by imaging is not uniformly executed, but can be controlled to be selectively executed according to the size of the image size.

  Preferably, each of the imaging keys is provided at a position where the mobile terminal device can be operated with the imaging angle instructed when the imaging key is operated. Therefore, since the imaging key for the imaging angle is provided at a position that can be operated according to the imaging angle, the operability is excellent.

  According to still another aspect of the present invention, an imaging unit that converts incident light into an electrical signal and outputs it as image data, and stores image data that is captured and output by the imaging unit when a save instruction is given. The image data storage means for storing and a plurality of storage keys operated to give a storage instruction, and a different function in addition to the function of giving a storage instruction when operated to each of the plurality of storage keys Assign.

  Therefore, since it is possible to instruct to save image data obtained by taking an image by operating any of the plurality of storage keys, the operability is improved as compared with the case of using one storage key. . In addition, since each of the multiple storage keys is assigned a different function in addition to the function for giving the storage instruction, each of the multiple storage keys is used as an instruction for the captured image data storage function and other types of functions. Can be combined. As a result, it is possible to realize a mobile terminal device having an imaging function with improved operability without increasing the configuration.

  According to still another aspect of the present invention, an imaging unit that converts incident light into an electric signal and outputs the image data as image data, and a storage instruction, when the storage instruction is given, the image data output by imaging by the imaging unit And storing a plurality of storage keys operated to give a storage instruction, and the storage instruction includes angle information when the image is stored by the image data. The angle information given when each of the plurality of storage keys is operated is different from each other.

  Therefore, since any of a plurality of storage keys can be operated to instruct to store the captured image data, the operability is superior to instructing the storage function with only one storage key. In addition, a different imaging angle can be specified at the time of operation for each of the plurality of storage keys without adding a special mechanism (circuit) for specifying (specifying) the imaging angle. As a result, it is possible to provide a mobile terminal device having an imaging function with improved operability without increasing the size of the device.

  Hereinafter, an embodiment of the present invention will be described with reference to the drawings. The present invention can be applied to any portable terminal, but in the following, as a preferred embodiment, a digital camera having one liquid crystal screen and operating keys arranged on the same surface as the liquid crystal screen is provided. A portable telephone device with a function (hereinafter simply referred to as a cellular phone) will be described. Note that the type of the mobile phone is not limited to this, and may be a folding mobile phone device in which the screen and the operation surface are provided in separate housings. Further, it may be a digital camera not equipped with a telephone function or a PDA (Personal Digital Assistans) in which the camera is built-in or attachable.

  In describing, terms used in the embodiments will be described.

  “Vertical mobile phone” refers to a state in which the mobile phone is carried with the top (upper and lower) of the character string printed on the keyboard in the normal position, that is, with the top and bottom of the mobile phone in the correct position (hereinafter referred to as upright State), the length of the rectangular screen in the vertical direction is longer than that in the horizontal direction. For example, if the liquid crystal screen is 320 dots × 240 dots, the vertical direction is 320 dots long and the horizontal direction is 240 dots long.

  'Image is portrait or landscape' means that the length of the image in the vertical direction (matches the vertical direction of the screen) is the horizontal direction (screen If the length of the image is longer than that of the image in the horizontal direction, the image is referred to as a vertically long image (vertically long image). Called.

  'Vertical position and vertical position image' refers to a vertically long image. When the image is displayed on the screen and viewed in an upright state, the vertical length of the image is longer than that of the horizontal direction. “Horizontal position and horizontal position image” refers to a horizontally long image. When the image is displayed on the screen and viewed in an upright state, the horizontal length of the image is longer than that of the vertical direction.

  'Normal position of the vertical position image' is the position where the long side of the vertical position image displayed on the screen is aligned in the vertical direction, and 'Normal position of the horizontal position image' is the horizontal position displayed on the screen. This is the position where the long side of the image is viewed in the horizontal direction.

  'Vertical frame' refers to the case where the frame image is displayed in an upright position on the screen and the vertical length of the frame image is longer than that in the horizontal direction. When the frame image is displayed on the screen and viewed in an upright state, the frame image has a longer length in the horizontal direction than that in the vertical direction.

(Configuration of mobile phone)
FIG. 1 shows a state viewed from the front (liquid crystal screen and key surface) in a state in which the numeric key operation unit 17 of the cellular phone 1 according to the embodiment of the present invention is closed (stored). FIG. 2 shows a state viewed from the front with the numeric key operation unit 17 of the mobile phone 1 of FIG. 1 opened. FIG. 3 shows an external view of the mobile phone of FIG. The mobile phone 1 has a plurality of types of functions such as a function of capturing an image of a subject, a function of processing data including image data, and an original communication function.

  Referring to FIGS. 1 and 2, the mobile phone 1 is stored in the back of the display unit 4 by rotation or sliding, unlike the folding system. FIG. 1 shows a state in which the numeric key operation unit 17 is stored. In the opened state in FIG. 2, a key group 19 including number keys and other keys provided in the numeric key operation unit 17 is shown.

  As shown in FIGS. 1 and 2, when the user carries the mobile phone 1 in an upright state, the speaker 2 is at the upper center of the front of the mobile phone 1, the antenna 20 is at the top, the microphone 3 is at the bottom, The display part 4 is each arrange | positioned at the front. A shutter key 16 that is operated to activate a camera mode (imaging operation mode), or to perform a shutter instruction function or a captured image storage instruction function for the camera is disposed on the right side surface toward the user. ing. The upper and lower side keys 5 and 6 used for volume adjustment, menu movement, and various settings are arranged on the left side surface facing the user. In the camera mode, a preview image of the subject is displayed on the display unit 4. 1, the left and right soft keys 7, 8, center key 9, up / down / left / right navigation keys 10, 13, 11 and 12 are displayed below the display unit 4, the SEND key 14 operated when sending an e-mail, and the end of the operation. An END key 15 that is operated to instruct is provided. The center key 9 functions in the same manner as the shutter key 16 when operated in the camera mode in the upright state, but determines the data input content by the user in other operation modes and instructs the control unit 411 described later. Operated for function. When the user is carrying the device upright, the center key 9 is located at a position where the user can easily press it with the thumb. As a result, the shutter can be easily operated.

  FIG. 3 shows a state viewed from the back (camera lens surface) of FIG. 1 with the numeric key operation unit 17 closed. A convex mirror 22 is disposed next to the imaging unit 21 having a camera lens surface. This is for self-photographing, that is, for confirming the subject when the user photographs himself / herself. The numeric key operation unit 18 is the back of the numeric key operation unit 17. Here, it is drawn vertically for comparison with FIGS. 1 and 2, but when photographing in the horizontal position, it is rotated 90 degrees counterclockwise from the upright state of FIG. 1 or FIG. This is called a horizontal position state. That is, the side surface on which the shutter key 16 is located rotates 90 degrees and is positioned upward in the figure (the top surface in the upright state is located on the right side of the drawing), so that if the user is carrying with the right hand, the right hand There is a shutter key 16 at a position where it can be easily pressed with an index finger. As a result, the shutter can be easily operated. In these drawings, only the keys for explaining the present embodiment are shown, but the type and number of keys provided are not limited to these.

  FIG. 4 schematically shows a functional configuration of the mobile phone 1. Referring to FIG. 4, the mobile phone 1 includes a control unit 411, an imaging unit 21, an image processing unit 413, a first memory 414, a second memory 415, a display driver unit 416, a display unit 4, a center key 9, a shutter key 16, Other than these, a key operation unit 418, a backlight 420, an image compression processing unit 421, an image expansion processing unit 422, an antenna 20, a wireless unit 424, a communication control unit 425, an image switching control unit 426, and a mobile light 23 are provided. .

  The control unit 411 controls the operation of each unit constituting the mobile phone 1. For example, the image processing unit 413, the first memory 414, the second memory 415, the display driver unit 416, the backlight 420, the image compression processing unit 421, the image expansion processing unit 422, the communication control unit 425, the image switching control unit 426, and the like are controlled. To do. The imaging unit 21 includes an imaging lens, an imaging device such as a CCD (Charge Coupled Device) image sensor or a CMOS (Complementary Metal Oxide Semiconductor) image sensor, and RGB color filters. The imaging unit 21 converts the light reflected by the subject and incident on the imaging lens into RGB three-color light through a color filter, and converts the RGB three-color light into an electrical signal by the imaging device.

  The image processing unit 413 includes an amplification unit, an A / D conversion unit, and a signal processing unit. The amplifying unit amplifies the electrical signal corresponding to RGB sent from the imaging unit 21 and sends the amplified electrical signal to the A / D conversion unit. The A / D conversion unit converts the analog electrical signal corresponding to RGB amplified by the amplification unit into a digital signal, outputs image data, and sends the image data to the image processing unit 413. The signal processing unit performs signal processing such as pixel interpolation processing on the image data sent from the A / D conversion unit. The image processing unit 413 operates to send the image data subjected to signal processing to the first memory 414 based on the control signal sent from the control unit 411.

  The first memory 414 is used as a working memory, and temporarily stores image data sent from the image processing unit 413. At this time, the image data is sent to the first memory 414 via the image switching control unit 426. Then, the first memory 414 temporarily stores the image data, for example, by deleting the old image data in time or overwriting the newest image data.

  The control unit 411 transmits a control signal to the display driver unit 416 and transmits the image data stored in the first memory 414 to the display driver unit 416.

  The display driver unit 416 applies a driving voltage to each pixel electrode of the display unit 4 in accordance with image data to be displayed on the display unit 4. The display unit 4 is realized by a liquid crystal, EL (Electro Luminescence), or the like, and displays an image based on image data sent via the display driver unit 416.

  The backlight 420 includes a light emitting diode (LED) that is a light emitting element, and illuminates the display unit 4 and the key operation unit 418 from the back side. Control such as turning on / off the backlight 420 and adjusting brightness are performed by the control unit 411. Note that the backlight 420 may be turned on until a predetermined operation for turning off the light is performed by the user, or may be turned off when a predetermined time elapses after the light is turned on. Similarly to the backlight 420, the mobile light 23 is configured by an LED or the like, and the control unit 411 performs control such as lighting and extinguishing and brightness adjustment.

  As described above, the key operation unit 418 includes a key for inputting numbers and characters.

  The shutter key 16 is pressed when the user wants to shoot a desired subject during camera shooting. At this time, in the present embodiment, the shutter key 16 is pressed in the horizontal position state. Then, in response to the instruction signal input from the shutter key 16 when the control unit 411 is pressed, the control unit 411 sets the vertical / horizontal determination result 50 to “horizontal” indicating the horizontal position state and outputs the result to the image compression processing unit 421. .

  The image compression processing unit 421 includes a compression unit 55 and a 90-degree rotation unit 56. The image compression processing unit 421 reads the image data stored in the first memory 414, compresses the read image data by the compression unit 55 based on the input aspect determination result 50, and then stores and saves it in the second memory 415. To do. The second memory 415 stores image data stored in the first memory 414, various received data received via the antenna 20 and the like, and information such as telephone numbers and names in the telephone directory.

  The center key 9 is pressed when the user wants to shoot a desired subject during camera shooting. At this time, in this embodiment, the center key 9 is pressed in the upright state of FIG. 1 or FIG. Then, the control unit 411 responds to the instruction signal input from the center key 9 in response to the depression, and sets the vertical / horizontal determination result 50 to “vertical” indicating the upright state and gives it to the image compression processing unit 421. The processing unit 421 reads the image data stored in the first memory 414, compresses the read image data based on the given vertical / horizontal determination result 50 by the compression unit 55, and then stores and stores the image data in the second memory 415.

  Based on an instruction from the control unit 411, the image compression processing unit 421 compresses the image data read from the first memory 414 using a predetermined compression method, and sends the image data after the compression processing to the second memory 415. . When the vertical / horizontal determination result 50 of the instructions of the control unit 411 is “vertical”, the compression unit 55 compresses the image as it is. When the vertical / horizontal determination result 50 is “horizontal”, the read image data is inverted by the 90-degree rotation unit 56. After rotating 90 degrees clockwise, compression is performed by the compression unit 55. Depending on how the software is assembled, it may be rotated 90 degrees counterclockwise after compression. Here, the predetermined compression method is an image compression method such as JPEG (Joint Photographic Experts Group) or PNG (Portable Network Graphics). The image compression processing unit 421 may not perform compression depending on an instruction from the control unit 411. At that time, the image data read from the first memory 414 is sent to the second memory 415 in the bitmap representation.

  In another embodiment of the present invention, the image compression processing unit 421 does not rotate 90 degrees, and the image data compressed by a predetermined compression method together with the vertical / horizontal determination result 50 sent from the control unit 411 is processed. 2 Send to memory 415. The second memory 415 stores and saves the given image data by adding information indicating whether or not the image data is compressed and the vertical / horizontal determination result 50. For example, when the digital still camera image file format standard “Exif” is used as the image storage format, the vertical / horizontal determination result 50 may be substituted into the Orientation of Tag number 0x0112. This Orientation is a tag indicating where the image data is stored and in which direction. By doing so, the vertical / horizontal determination result 50 is included in the image in a versatile format, and the image data captured by the mobile phone 1 is transferred to have other image processing functions such as a personal computer. High compatibility can be obtained when handling with equipment.

  The image decompression processing unit 422 reads image data stored in the second memory 415 and performs decompression processing. Then, the image expansion processing unit 422 sends the image data subjected to the expansion processing to the first memory 414 used as a work memory. If the image data read from the second memory 415 is uncompressed data such as a bitmap representation image or character data, the decompression process is not performed.

  The antenna 20 transmits and receives voice data, character data, image data, and the like when performing wireless communication with a base station (not shown) via wireless radio waves. The wireless unit 424 demodulates data received from the base station via the antenna 20 based on a predetermined communication protocol, and transmits character data and image data sent from the communication control unit 425 during transmission. Modulate and amplify and transmit to the base station via the antenna 20. The communication control unit 425 sends the image data demodulated by the wireless unit 424 in the received data to the image compression processing unit 421 via the image switching control unit 426. Then, the image compression processing unit 421 compresses the image data from the other party received via the wireless unit 424, the communication control unit 425, and the image switching control unit 426, and stores it in the second memory 415. Further, the communication control unit 425 sends character data or the like in the received data to the second memory 415 based on an instruction from the control unit 411 and stores it therein.

  The image switching control unit 426 switches from which route the image processing unit 413 and the communication control unit 425 send image data when acquiring image data. The image data acquired in this way is sent to the first memory 414.

  The key press determination unit 51 in the control unit 411 in this embodiment determines whether or not a predetermined key is pressed in a predetermined scene. The vertical / horizontal determination unit 52 in the control unit 411 is the shutter key 16 depending on whether the key press determined by the key press determination unit 51 in the control unit 411 is the shutter key 16 or the center key 9 during the camera preview. For example, the vertical / horizontal determination result 50 is set to “horizontal”, and if it is the center key 9, the vertical / horizontal determination result 50 is transmitted to the image compression processing unit 421 as “vertical”.

(Shooting and image saving processing in camera mode)
5A to 5D show the difference between an image taken in an upright state and an image taken in a horizontal position. When shooting in an upright state, an image is formed on the image sensor of the imaging unit 21 as shown in FIG. It is assumed that the point S of the image sensor corresponds to a signal readout start point (fixed) corresponding to image data. Therefore, in the case of FIG. 5A, the vertical and horizontal directions of the subject image coincide with the vertical (Y) and horizontal (X) of the image sensor surface, so that if the signal is read from the point S, the read signal The image data generated and stored by this means a vertically positioned image, and when read and displayed in an upright state, the horizontal X1 and vertical Y1 of the screen of the display unit 4 coincide with the horizontal and vertical of the vertically long image. .

  In the case of shooting in the horizontal position state, a subject image is formed on the image sensor as shown in FIG. 5B. Therefore, the angle of the imaging unit 21 (image sensor) for imaging the subject is as shown in FIG. Is 90 degrees different. In the case of FIG. 5B, the vertical and horizontal directions of the subject image and the horizontal (X) and vertical (Y) of the image sensor surface coincide with each other. The image generated by the signal is rotated 90 degrees clockwise with respect to the image generated by the signal read out in the upright state of FIG. When the image data based on the signal read from the point S in the horizontal position state of FIG. 5B is stored (saved) as it is, when this is read and displayed on the display unit 4 in the upright state, the image is rotated by 90 degrees. Thus, it becomes difficult to see from the displayed state (see FIG. 5C), and the user must correct the state in which the mobile phone 1 is moved and rotated 90 degrees.

  Therefore, in this embodiment, when it is determined that the shooting state is the horizontal position state of FIG. 5B, the counterclockwise is used when storing (saving) the image data generated from the signal read from the point S. It is rotated 90 degrees around and stored (see FIG. 5D). Alternatively, the image data generated from the signal read from the point S is stored (saved) as it is, but is rotated 90 degrees counterclockwise when being read and displayed (reproduced) (see FIG. 5D). FIG. 5D shows a horizontally long image, in which the horizontal X1 and the vertical Y1 of the screen of the display unit 4 coincide with the horizontal and vertical sides of the horizontal image.

  A processing procedure for shooting and image storage according to the shooting state will be described below.

  FIG. 6 shows an operation when a key press for saving image data is not required, and FIG. 7 shows an operation when a key press for saving is required. 6 can be said to be a processing flow closer to a digital camera, and FIG. 7 is a processing flow closer to a mobile phone. Next, with reference to FIG. 6 and FIG. 7, an operation when processing image data obtained by capturing in the camera mode of the mobile phone 1 will be described.

  In FIG. 6, the preview state (step S (hereinafter simply referred to as S) 1) is set as the starting point. The preview is a pre-shooting state in which an image (moving image) based on a subject image captured and acquired by the image capturing unit 21 as a camera mode when the user activates the camera of the image capturing unit 21 is displayed on the display unit 4. That is, it indicates a state before the shutter key 16 is pressed.

  Since the key is pressed in the preview state, the key pressing determination unit 51 determines what the pressed key is (S2). In the present embodiment, a shutter key 16 and a center key 9 are assigned as shooting keys for shooting. At this time, when the user presses the clear key (not shown), the END key 15 and the right soft key 8, the camera mode is terminated, and when the photographing key is pressed, the image displayed on the display unit 4 at that time is a still image. (S4), and when any other key is pressed, the process returns to S1.

  When the image becomes a still image (when shooting is executed), the image data obtained by shooting is automatically saved thereafter (S7). The storage (S7) is to store the image data acquired by photographing in the second memory 415 after being compressed by a predetermined compression method by the compression unit 55.

  In this embodiment, before saving, the key press determination unit 51 determines which one of the shutter key 16 and the center key 9 is pressed as a photographing key (S5). If it is determined that the shutter key 16 is pressed, the vertical / horizontal determination unit 52 sets the vertical / horizontal determination result 50 to “horizontal”, and the 90-degree rotation unit 56 rotates the image data to be stored by 90 degrees (S6). Since this rotation processing is performed internally, the image displayed on the display unit 4 remains a still image at the time of shooting. As shown in FIG. 1, the shutter key 16 is arranged on the right side surface. Therefore, in order to read out an image taken and stored in the horizontal position state and display it in the vertical position image, the 90 degree rotation (S6) is performed after being counterclockwise (S7).

  Depending on how the software is assembled, it may be rotated 90 degrees after compression by the compression unit 55. When the center key 9 is pressed, the vertical / horizontal determination unit 52 sets the vertical / horizontal determination result 50 to “vertical”, so that the image data is stored without being rotated (S7).

  In FIG. 7, the processing of S1 to S3 is performed as in FIG. If it is determined that the shooting key has been pressed, the image displayed on the display unit 4 at that time stops (S4a). At the same time, the control unit 411 displays a screen asking whether to save the displayed image (S7) (save confirmation screen display: S4b). In this save confirmation screen, information that the center key 9 is operated to instruct “save” is presented. In this save confirmation screen, information that the shutter key 16 is operated to instruct “save at 90 degrees” may be presented. The saving (S7) is to store the image data in the second memory 415 by compressing the image data by a predetermined compression method, as in FIG.

  In the save key press determination (S5a), it is determined which of the shutter key 16 and the center key 9 is pressed as the save key. When the key press determination unit 51 determines that the shutter key 16 has been pressed, the vertical / horizontal determination unit 52 outputs the vertical / horizontal determination result 50 as “horizontal” to the image compression processing unit 421. Therefore, the 90-degree rotation unit 56 outputs image data. Is rotated 90 degrees (S6). Since this rotation process is an internal process, the image displayed on the display unit remains a still image at the time of shooting. As in FIG. 6, the 90-degree rotation (S6) is performed counterclockwise. Depending on how the software is assembled, it may be rotated 90 degrees after compression.

  If the key press determination unit 51 determines that the center key 9 has been pressed, the vertical / horizontal determination unit 52 sets the vertical / horizontal determination result 50 to “vertical” and outputs the result to the image compression processing unit 421. Therefore, the image data is stored as it is (S7). The

  If the key press determination unit 51 determines that the clear key, the END key 15 or the right soft key 8 is pressed, the captured image data is discarded and the process returns to the preview state (S1). In the present embodiment, the right soft key 8 operated after the preview state and shooting is assigned to “cancel”.

  In normal use, the same key is often pressed for shooting and saving, so the procedure of FIG. 8 may be executed instead of the procedure of FIG. In FIG. 8, S1 to S4b are executed similarly to FIG.

  Thereafter, in the save / shooting key press determination (S5b), when the save key (center key 9) is pressed, the key press determination unit 51 determines which of the shutter key 16 and the center key 9 is pressed as the shooting key. . If it is determined that the shutter key 16 has been pressed, the vertical / horizontal determination unit 52 outputs the vertical / horizontal determination result 50 as “horizontal”, so the 90 ° rotation unit 56 rotates the image data by 90 ° (S6). Thereafter, it is stored (S7).

  If it is determined that the center key 9 has been pressed, the vertical / horizontal determination unit 52 outputs the vertical / horizontal determination result 50 as “vertical”, so that the image data is stored as it is (S7).

  FIG. 9 shows another procedure for storing image data obtained by photographing in the camera mode. The procedure of S1 to S5 is executed in the same manner as in FIG. Thereafter, depending on whether the shutter key 16 or the center key 9 is pressed as the photographing key, either the vertical position information or the horizontal position information is stored together with the image data file (S7a, S6a). This vertical position / horizontal position information is referred to when browsing an image using stored image data.

  In the procedure of FIGS. 6 to 9, a message “Saved in library” may be displayed at the time of saving. Further, when the vertical / horizontal determination result 50 is “horizontal”, an alert message such as “rotated 90 degrees and saved in the horizontal position” may be displayed.

  A frame may be added when shooting a camera or editing a saved image. Conventionally, only the vertical frame has been prepared as the frame to be displayed, but in this embodiment, a horizontal frame is also prepared, which can be set by the user selecting either the vertical frame or the horizontal frame. You may make it do.

  In the case of a terminal equipped with a continuous shooting mode, when the storage confirmation is not performed as shown in FIG. 6, continuous shooting is possible by pressing the shutter key 16 or the center key 9 for a long time. In the case of this continuous shooting, the vertical / horizontal discrimination is performed as in the case of single image shooting.

  Although the embodiment of the still camera has been described above, the present invention can be similarly applied to a video camera. In the case of a video camera, vertical / horizontal discrimination is performed using a recording start key. Usually, the recording start key corresponds to the shutter key 16 and the center key 9 of the still camera.

  Further, the control unit 411 may operate as follows. In other words, if the captured image size (number of vertical and horizontal pixels) is greater than or equal to a certain size, data processing (rotation by 90 degrees) based on the vertical / horizontal position determination is performed, and if the captured image size is less than a certain size, the vertical The position / lateral position determination is not performed, and data processing based on this determination may be omitted. That is, when the photographed image size is large, it is considered that the transfer is intended to an information processing apparatus having a higher function than the external mobile phone 1 such as a personal computer. The screen of a personal computer is usually landscape, but the screen size is large and the image browsing software is substantial, so portrait images and landscape images are often mixed. On the other hand, when the captured image size is small, it is considered that the mobile phone 1 is intended for use. This is because the mobile phone 1 has many vertical mobile phones. By doing so, it is possible to prevent confusion and erroneous pressing by two types of shooting keys when the size of the shot image is small.

  In the present embodiment, the photographing keys are assigned to the shutter key 16 and the center key 9, but may be assigned to a side key, a right soft key, or the like. The storage key may be assigned to another key as with the shooting key.

(Processing when viewing captured / saved images)
Next, a process at the time of browsing a photographed / saved image will be described. In this embodiment, a vertical mobile phone as shown in FIG. 1 or FIG. 2 is assumed. As described above, when the captured image is stored, the image is stored with the distinction between the vertical and horizontal directions, so that when viewed in an upright state, all images can be displayed in the vertical position so that they can be viewed correctly.

  In image file list display (list display), thumbnails are often used to improve listability. Due to the screen design, thumbnails are often square. For example, if the display unit 4 is a QVGA (Quarter Video Graphics Array) size screen (vertical 320 dots x horizontal 240 dots), a total of nine vertical 48 dots x horizontal 48 dots thumbnails in 3 rows and 3 columns per screen are displayed. To do. The horizontal image is trimmed to the left and right, and the vertical image is trimmed to the upper and lower sides to make a square and then reduced to the thumbnail size (48 dots vertically and horizontally). Alternatively, the aspect ratio of the vertical and horizontal directions may be left as they are, and may be reduced to fit the thumbnail size (vertical and horizontal 48 dots).

  When the image files stored in the upright state are read and displayed one by one, the vertically long image is displayed in the same size or reduced according to the screen size of the display unit 4 as before. A horizontally long image is reduced and displayed in accordance with the left and right screen sizes of the display unit 4. For example, an image of 240 vertical dots × 320 horizontal dots is reduced to 180 vertical dots × 240 horizontal dots. Alternatively, it may be displayed at the same magnification as in the case of a vertically long image. At this time, the protruding left and right portions can be displayed by moving the image left and right by pressing the left and right navigation keys.

  In the present embodiment, the following is performed so that the stored image can be viewed correctly in the vertical position when the stored image is viewed in the upright state. That is, based on the vertical position information or the horizontal position information stored together with the image file, the image data of the image file is displayed after being rotated as necessary. Specifically, the image data read from the second memory 415 is given to the image expansion processing unit 422. In the image expansion processing unit 422, when the horizontal position information is added to the given image data, the 90-degree rotation unit 57 rotates the expanded image data 90 degrees counterclockwise to the display driver unit 416. give. If the vertical position information is added, it is given to the display driver unit 416 as it is (or subjected to 0 degree rotation processing). Therefore, the image data is displayed as a vertical position image on the display unit 4 that is driven based on the given image data by the display driver unit 416. The decompression process is performed only on the compressed image data.

  In the list display of image files, for example, thumbnails of 48 dots vertically and horizontally are displayed. The image having the horizontal position information is trimmed to the left and right, and the image having the vertical position information is trimmed to the square size by trimming the top and bottom to match the thumbnail size (48 dots vertically and horizontally). Alternatively, the aspect ratio of the vertical and horizontal directions may be left as they are, and may be reduced to fit the thumbnail size (vertical and horizontal 48 dots).

  In the single display of the image file, the image having the vertical position information is displayed in the same size or reduced according to the screen size of the display unit 4 as usual. An image having horizontal position information is reduced and displayed in accordance with the left and right screen sizes of the display unit 4. For example, an image of 240 vertical dots × 320 horizontal dots is reduced to 180 vertical dots × 240 horizontal dots. Alternatively, it may be displayed at the same magnification as in the case of a vertically long image. Thereby, the vertical position image is displayed on the screen at the normal position, and the horizontal position image is also displayed on the screen at the normal position.

  According to the present embodiment, when both an image taken in the upright state and an image taken in the horizontal position state are stored and read out and displayed on the display unit 4 in the upright state, the image is taken according to the shooting state. Therefore, the user does not need to reversely rotate the image by 90 degrees using an image editing tool or the like. That is, convenience is improved because no additional work of editing occurs after shooting and saving.

  Further, in this embodiment, since only two types of keys for photographing are prepared from the key group provided in advance in the mobile phone 1, a sensor for automatically distinguishing the vertical position and the horizontal position is specially prepared. Cost increase can be avoided compared to the method. In addition, since the user can distinguish and press the two types of shooting keys with a natural vertical and horizontal shooting posture, the operability is good. As a result, the intention of the user, that is, the intention of photographing and storing and reproducing and displaying as a vertical position image, or photographing and storing and reproducing and displaying as a horizontal position image can be reflected in the image data, and is automatically determined. It is possible to prevent judgment mistakes that are often found in sensor systems.

  The embodiment disclosed this time should be considered as illustrative in all points and not restrictive. The scope of the present invention is defined by the terms of the claims, rather than the description above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims.

It is a figure which shows an example of the general view seen from the front (a liquid crystal screen and a key surface) of the mobile telephone which is one embodiment of this invention. It is a figure which shows the other example of the external view seen from the front (a liquid crystal screen and a key surface) of the mobile telephone which is one embodiment of this invention. FIG. 3 is an overview diagram viewed from the back surface (camera lens surface) of the mobile phone according to the embodiment of the present invention. It is a functional block diagram of the mobile telephone which is one embodiment of this invention. (A)-(D) is a figure explaining the difference between the image image | photographed in the erect state and the image image | photographed in the horizontal position state. It is a flowchart which shows an example of operation | movement in the camera mode of the mobile telephone which is one embodiment of this invention. It is a flowchart which shows the other example of operation | movement in the camera mode of the mobile telephone which is one embodiment of this invention. It is a flowchart which shows the further another example of the operation | movement in the camera mode of the mobile telephone which is one embodiment of this invention. It is a flowchart which shows the further another example of the operation | movement in the camera mode of the mobile telephone which is one embodiment of this invention.

Explanation of symbols

  1 mobile phone, 2 speaker, 3 microphone, 4 display, 5 upper side key, 6 lower side key, 7 left soft key, 8 right soft key, 9 center key, 10 upper navigation key, 11 left navigation key, 12 right navigation key, 13 Down navigation key, 14 SEND key, 15 END key, 16 Shutter key, 17 Numeric key operation unit, 18 Numeric key operation unit (rear), 19 Key group, 20 Antenna, 21 Imaging unit, 22 Convex mirror, 23 Mobile light, 411 Control , 413 image processing unit, 414 first memory, 415 second memory, 416 display driver unit, 418 key operation unit, 420 backlight, 421 image compression processing unit, 422 image expansion processing unit, 424 wireless unit, 425 communication control , 426 Image switching control unit.

Claims (11)

A portable terminal device having a plurality of types of functions including a subject imaging function and a plurality of types of operation modes,
Imaging means for imaging the subject and outputting image data when the imaging function is instructed;
Image data processing means for processing and outputting the given image data;
Image data storage means for storing the image data input from the image data processing means;
With a plurality of predetermined keys,
Each of the plurality of predetermined keys indicates the imaging function in an imaging operation mode when the key is operated, and indicates another type of function in another operation mode. Imaging means for imaging a subject and outputting image data;
Image data processing means for processing and outputting the given image data;
Image data storage means for storing the image data input from the image data processing means;
A plurality of imaging keys operated to instruct imaging to the imaging means;
The image data processing means processes the given image data based on an imaging angle indicating an angle for imaging with respect to the subject of the imaging means,
The portable terminal device, wherein when the key is operated, a different imaging angle is instructed to the image data processing means for each of the plurality of imaging keys.   The portable terminal device according to claim 2, wherein the plurality of imaging keys are two, and the imaging angles of the imaging keys are different from each other by 90 degrees.   The image data processing means performs processing for image rotation based on the instructed imaging angle so that the given image data becomes the image data imaged at a predetermined imaging angle. The portable terminal device according to claim 2 or 3. The image data processing means inputs the given image data, and outputs information indicating the imaging angle designated for the image data together with the input image data,
The portable terminal device according to claim 2 or 3, wherein the image data storage unit stores the image data input from the image data processing unit and information indicating the imaging angle in association with each other. Read image data processing means for processing the image data read from the image data storage means based on information indicating the imaging angle corresponding to the image data,
The read image data processing means performs image rotation processing based on information indicating the corresponding imaging angle so that the read image data becomes the image data captured at the predetermined imaging angle. The mobile terminal device according to claim 5, wherein the mobile terminal device is characterized.   When the image of the subject based on the image data is displayed on a screen prepared in advance, the predetermined imaging angle matches the vertical and horizontal directions of the displayed subject image with the predetermined vertical and horizontal directions of the screen. The mobile terminal device according to claim 4, wherein the mobile terminal device has such an angle.   When the image size of the captured image data is greater than or equal to a predetermined level, the processing of the image data based on the imaging angle by the data processing means is executed, and when the image size is less than the predetermined level, the imaging angle instruction and the data processing The mobile terminal device according to claim 2, further comprising a control unit that controls to omit processing of the image data based on the imaging angle of the unit.   Each of the said imaging key is provided in the position which can be operated in the state which carried the said portable terminal device with the said imaging angle instruct | indicated when this imaging key is operated, From Claim 2 characterized by the above-mentioned. The mobile terminal device according to any one of 8. Imaging means for converting incident light into an electrical signal and outputting it as image data;
Image data storage means for storing and storing the image data captured and output by the imaging means when a save instruction is given;
A plurality of storage keys operated to give the storage instruction,
Each of the plurality of storage keys is assigned a different function in addition to the function of giving the storage instruction when operated. Imaging means for converting incident light into an electrical signal and outputting it as image data;
Image data storage means for storing and saving the image data captured and output by the imaging means based on the save instruction when a save instruction is given;
A plurality of storage keys operated to give the storage instruction,
The storage instruction includes angle information at the time of storing an image based on the image data, and the angle information given when each of the plurality of storage keys is operated is different from each other. apparatus.

Images