JP5902788B2 - Portable terminal device, control method, and program - Google Patents

Description

  The present invention relates to a mobile terminal device having a camera function.

  A mobile terminal device such as a mobile phone is usually provided with a camera function, and high image quality is one of the issues regarding the camera function. In the past, such a problem has been achieved by performing image processing for transmitting an image signal captured by the camera function to an image processing apparatus different from the mobile phone to achieve high image quality (Patent Literature). 1).

  However, in recent years, mobile terminal devices having a camera function have been developed with higher functionality of the device itself, that is, higher resolution of the camera, larger screen and higher resolution of the LCD as an image display unit. As a result, the software processing load in the apparatus tends to increase. In such a trend, it has become important as a requirement of the mobile terminal device to provide user-friendliness and processing speed (including sensible).

JP 2003-281511 A

  As an example of usability of a camera function in a mobile terminal device, when performing camera shooting with a mobile terminal device, post-processing such as high image quality after shooting is completed and shooting is not allowed to move the mobile terminal device is a UI (User Interface) It is difficult to understand, and as a result, the user feels the inconvenience of not moving the portable terminal device until the post-processing is finished, and the perceived slowness of the photographing operation.

  Therefore, an object of the present invention is to make it possible to clearly identify a time during which a device must not be moved and a post-processing time after photographing in a portable terminal device having a camera function.

The portable terminal device according to the present invention is
A mobile terminal device having a camera function,
A camera module unit including an image processing unit for processing an image obtained by the camera function;
A storage unit for storing image data processed by the camera module unit;
Post-processing means for performing post-processing including image stabilization and image quality enhancement processing on the image data;
A display control unit for controlling the display of the image display unit;
Among the start or end timings of a plurality of processes from the start of shooting by the camera function to the end of post-processing by the post-processing means, at least a shooting trigger that defines the start of shooting by the camera function, and image processing by the image processing unit A detection unit that detects a shooting completion trigger that defines an end, and an end trigger that defines the end of the post-processing in the post-processing unit,
The display control unit performs guidance display with the characters “being photographed” on the image display unit from the time of occurrence of the shooting trigger to the time of occurrence of the shooting completion trigger, and the end from the time of occurrence of the shooting completion trigger. Until the trigger , the image being post- processed by the post- processing means is displayed.

  According to the present invention, it is possible to clearly identify the time during which the apparatus should not be moved and the post-processing time after photographing when photographing with the camera.

It is the figure which showed the block configuration of the Example of the portable terminal device which concerns on this invention. It is a figure for comparing and explaining the processing on UI and the display form at the time of camera photographing in the mobile terminal device so far and the embodiment of the present invention.

[Configuration of Example]
Next, the structure of the Example of the portable terminal device which concerns on this invention is demonstrated with reference to drawings.

  FIG. 1 shows an embodiment in which the present invention is applied to a mobile phone among mobile terminal devices.

  Referring to FIG. 1, the mobile phone 1 includes a microprocessor MPU. FIG. 1 is a functional block diagram showing the configuration of the microprocessor MPU. The microprocessor MPU includes a CPU (post-processing means) 11 that operates under program control and executes at least camera shake correction and image quality improvement processing, and a camera. A camera module unit 12 including an image processing unit that performs image processing including image format conversion on the acquired shooting (image) data, and a detection unit that detects the end of shooting, image processing, camera shake correction, and image quality improvement processing 13 and the display control part 14 which monitors the trigger from the detection part 13 and updates a display screen by the trigger. The mobile phone 1 also stores a RAM 20 for storing photographing data, various programs for realizing various functions of the OS (Operating System) and the mobile phone, and in this embodiment, a program for controlling image processing. ROM 30 and LCD 40 as an image display unit.

  Each component of the MPU is interconnected by an internal bus, and the RAM 20, ROM 30, and LCD 40 are connected by a data bus.

  The operation of the following embodiments will be described using a plurality of types of triggers. These triggers will be described as follows.

  Shooting trigger TG1: A signal generated when the user presses the shutter button when shooting.

  Shooting completion trigger TG2: a signal generated at the timing of completion of image processing (= shooting data acquisition processing completion) including shooting (exposure) processing and image format conversion processing in the camera module unit.

  End trigger TG3: A signal generated at the timing when the camera shake correction and the image quality enhancement processing for the photographing data acquired from the camera module unit in the CPU 11 are completed.

  The shooting completion trigger TG2 is notified from the camera module unit 12 to the detection unit 13, and the end trigger TG3 is notified to the detection unit 13 by the program executed by the CPU 11 when the camera shake correction or the image quality enhancement processing ends. The display control unit 14 monitors whether the detection unit 13 has received the shooting completion trigger TG2 and the end trigger TG3, and performs display control according to the received trigger.

  FIG. 1 shows the components necessary for carrying out the present invention among the components provided in the mobile phone 1, and the configuration necessary for functioning as a mobile phone in addition to the key input unit is well known. Therefore, illustration and description are omitted.

[Operation of the embodiment]
Next, the operation of the embodiment of the present invention will be described with reference to FIG.

  FIG. 2 is a diagram for comparing and explaining the processing on the UI at the time of photographing by the camera in the conventional cellular phone and the cellular phone according to the embodiment of the present invention.

  FIG. 2A shows a display form at the time of camera photographing in a conventional cellular phone. In the conventional display mode, the LCD displays a text display guidance such as “photographing” or “processing” on a single color background, but the user does not know the completion of shooting = the device moves during that time It is misunderstood that it should not be done, and it is an unfavorable form on UI.

  On the other hand, in the present embodiment, first, in the mobile phone 1, when the user performs an operation of selecting use of the camera function by the key input unit, the CPU 11 reads out and executes the program stored in the ROM 30, whereby The camera module unit 12 is set according to the purpose specified by the program. As a result, the camera module unit 12 starts its operation. The camera module unit 12 performs shooting processing in synchronization with the program and the shooting trigger TG1 when the shutter button is pressed, and stores shooting data in the RAM 20.

  The detection unit 13 monitors the presence / absence of the shooting completion trigger TG2 from the camera module unit 12. The detection unit 13 also monitors an end trigger TG3 for camera shake correction and image quality enhancement processing performed on the photographing data stored in the RAM 20 by the program in the CPU 11.

  The display control unit 14 monitors the shooting trigger TG1 and the detection unit 13, and as shown in FIG. 2B, the LCD 40 performs predetermined processing from the time when the shooting trigger TG1 is generated until the time when the shooting completion trigger TG2 is generated. In this case, a guidance display with the characters “being photographed” is performed on a background of a single color, here. Subsequently, when the display control unit 14 knows that the detection unit 13 has received the shooting completion trigger TG2, the display control unit 14 updates the display, and displays a post-process image indicating that post-processing such as camera shake correction and high image quality processing is being performed. Displayed on the LCD 40. Further, when the display control unit 14 learns that the detection unit 13 has received the end trigger TG3 of each process, the display control unit 14 updates the display screen of the LCD 40 to an image for confirmation after image processing in accordance with the end trigger TG3.

  In this way, in the processing process starting from shooting, the display screen is updated by clearly detecting the start or end of each processing by a trigger, thereby reducing the ease of use and the sensory delay on the UI. . In other words, by updating the display screen by grasping each stage of the processing process starting from shooting, in particular, by displaying the image being post-processed immediately after the restraint time that the device should not be moved has elapsed, When the post-processing image is displayed, it can be determined that the constraint can be released, which can shorten the constraint time that the device should not be moved compared to the conventional display mode. it can.

  Note that the image being post-processed may be displayed without changing the image at the start of post-processing, but in order to suppress the sensory delay, the image becomes clear with time by camera shake correction and image quality enhancement processing. It is preferable to display an image that has been converted into an image.

[Effect of Example]
In the embodiment of the present invention, the function of the detection unit 13 is used to monitor the start or end trigger of each process in the process starting from shooting, and the display screen on the LCD 40 can be updated according to the trigger, thereby completing the shooting. By clearly displaying the post-processing after shooting and displaying the progress of the post-processing on the screen, it is possible to clearly notify the user when the mobile phone should not be moved during shooting. Slowness can be suppressed.

  The present invention is preferably applied to a portable terminal device in which a microprocessor having a camera module unit including an image processing unit that processes photographing (image) data obtained by a camera function is mounted. In this case, the mobile terminal device includes, as elements necessary for achieving the above object, a microprocessor (RAM) for storing shooting (image) data transferred from the camera module unit, a high-level memory, and the like. ROM (Read Only Memory) storing various software programs for realizing various functions necessary for image processing software programs and portable terminal devices for image quality improvement, LCD (Liquid Crystal Display) as an image display unit It is desirable to provide.

  In addition to a CPU (Central Processing Unit) that executes instructions, the microprocessor includes a detection unit that detects the end of post-processing such as camera shooting completion and image quality enhancement, and a display control unit that monitors the detection unit and updates the display screen .

  The present invention can also be applied to a so-called external type portable terminal device in which the camera module unit is integrated with the camera and disposed outside the microprocessor.

  The present invention is preferably implemented in the following manner.

(First aspect)
A camera module unit including an image processing unit that processes an image obtained by the camera function, a RAM that stores image data transferred from the camera module unit, and at least for image processing for camera shake correction and high image quality ROM storing the software program, post-processing means for performing post-processing including image stabilization and image quality improvement processing on the image data based on the software program, LCD as an image display unit, A display control unit that controls display on the LCD; and a detection unit that detects start or end timings of a plurality of processes from the start of photographing by the camera function to the end of post-processing by the post-processing unit, and the display control The unit is configured to start or end the plurality of processes in the detection unit when shooting with the camera function. By updating the display contents of the LCD every time it is detected, the portable terminal apparatus and displaying distinguishes between display during post-processing of the display and imaging after the end of the image being photographed.

(Second aspect)
In the first aspect, the display control unit performs the display during the photographing by displaying the characters “being photographed”, and displays the post-processing of the image after the photographing after the post-processing. This is done by displaying an image.

(Third aspect)
In the second aspect, as a detection of the start timing or end timing of the plurality of processes, at least a shooting trigger that is generated by pressing a shutter button of the camera function and defines the start of the character display of “shooting” Detection and detection of a shooting completion trigger that is generated upon completion of image processing in the camera module unit and regulates switching from the character display of “shooting” to image display during post-processing after completion of shooting And detection of an end trigger that is generated upon completion of the post-processing in the post-processing means and regulates switching from image display during post-processing after the end of photographing to image display for confirmation. .

(Fourth aspect)
In any one of the first to third aspects, the post-processing means, the display control unit, the detection unit, and the camera module unit are realized by a microprocessor.

(5th aspect)
In any one of the first to fourth aspects, the display control unit is configured to display an image that is being post-processed after the photographing is finished, and that the image display is sharpened with time by the camera shake correction and the high image quality processing. By displaying this, it is possible to suppress the sensational delay of the user.

(Sixth aspect)
In a display control method for a portable terminal device having an LCD and a camera function, an image processing process for processing an image obtained by the camera function, a process for storing the processed image data in a memory, and the image data A post-processing process for performing post-processing including camera shake correction and image quality improvement processing, and a detection process for detecting the start or end timing of a plurality of processes from the start of shooting by the camera function to the end of the post-processing process; And a process of updating the display content of the LCD every time the start or end timing of the plurality of processes is detected at the time of shooting by the camera function, and post-processing of the display during shooting and the image after the shooting ends A display control method for a portable terminal device, characterized in that the display is distinguished from the display inside.

  The present invention can be applied to any portable information processing apparatus equipped with a camera module unit and an MPU, or an MPU in which the camera module unit is on-chip.

    1 Mobile phone

Claims (4)

A mobile terminal device having a camera function,
A camera module unit including an image processing unit for processing an image obtained by the camera function;
A storage unit for storing image data processed by the camera module unit;
Post-processing means for performing post-processing including image stabilization and image quality enhancement processing on the image data;
A display control unit for controlling the display of the image display unit;
Among the start or end timings of a plurality of processes from the start of shooting by the camera function to the end of post-processing by the post-processing means, at least a shooting trigger that defines the start of shooting by the camera function, and image processing by the image processing unit A detection unit that detects a shooting completion trigger that defines an end, and an end trigger that defines the end of the post-processing in the post-processing unit,
The display control unit performs guidance display with the characters “being photographed” on the image display unit from the time of occurrence of the shooting trigger to the time of occurrence of the shooting completion trigger, and the end from the time of occurrence of the shooting completion trigger. Until the trigger , the mobile terminal device displays an image being post- processed by the post- processing means . The display control unit displays, as the image being post-processed, an image that is sharpened with time by the camera shake correction and the image quality enhancement process from the occurrence of the shooting completion trigger to the end trigger , portable terminal apparatus according to claim 1 Symbol mounting, characterized in that. A method of controlling a mobile terminal device having a camera function,
After detecting a shooting trigger that defines the start of shooting by the camera function, until detecting a shooting end trigger that defines the end of processing of the image obtained by the camera function by the image processing unit included in the camera module unit, A first step of performing guidance display with characters “under photographing” on the image display unit;
The post-processing is performed from the detection of the shooting end trigger until the detection of an end trigger defining the end of post-processing including image stabilization and image quality improvement processing for image data processed by the camera module unit. A second step of displaying the image inside;
A control method characterized by comprising: A program to be executed by a computer of a mobile terminal device having a camera function,
After detecting a shooting trigger that defines the start of shooting by the camera function, until detecting a shooting end trigger that defines the end of processing of the image obtained by the camera function by the image processing unit included in the camera module unit, A first process for displaying a guide with characters “capturing” on the image display unit;
The post-processing is performed from the detection of the shooting end trigger until the detection of an end trigger defining the end of post-processing including image stabilization and image quality improvement processing for image data processed by the camera module unit. A second process for displaying the image inside;
A program characterized by causing the computer to perform the.

Images