KR101587106B1 - Mobile terminal and method for porcessing digital image thereof - Google Patents

Abstract

The present invention relates to a mobile terminal and a digital image processing method thereof, and more particularly, to a mobile terminal and a digital image processing method thereof, Decoding an indicator of an image fragment requested by the command among the selected images according to a scenario if the input command is an instruction corresponding to a scenario; And decoding the image fragment corresponding to the decoded indicator.

Mobile terminal, digital image, indicator

Description

[0001] MOBILE TERMINAL AND METHOD FOR PORCESSING DIGITAL IMAGE THEREOF [0002]

The present invention relates to a mobile terminal for quickly processing a high-resolution digital image and a digital image processing method thereof.

A terminal such as a personal computer, a notebook computer, a mobile phone, or the like can be configured to perform various functions. Examples of such various functions include a data and voice communication function, a function of photographing a video or a moving image through a camera, a voice storage function, a music file playback function through a speaker system, and an image or video display function. Some terminals include additional functions to execute games, and some other terminals are also implemented as multimedia devices. Moreover, recent terminals can receive a broadcast or multicast signal to view a video or television program.

In general, a terminal can be divided into a mobile terminal and a stationary terminal according to whether it can be moved or not, and the mobile terminal can be divided into a handheld terminal (or a handheld terminal) And a vehicle mount terminal.

Efforts are continuing to support and enhance the functions of terminals. The foregoing efforts include not only changes and improvements in structural components that form the terminal, but also improvements in software or hardware.

As a terminal with a camera becomes popular, it is necessary to process a digital image quickly and efficiently in a mobile terminal having a limited memory space and processing power. In particular, digital image processing techniques are important for quickly displaying high resolution images on a display having a relatively low resolution. Therefore, there have been a lot of studies on image processing technology for quickly processing high resolution images.

The present invention provides a mobile terminal that performs partial decoding of an image using an indicator and a digital image processing method thereof.

The present invention also provides a mobile terminal that performs image processing using previously decoded image data and a digital image processing method thereof.

In order to achieve the above-mentioned object, a mobile terminal according to an embodiment of the present invention includes an input unit for generating data corresponding to a user input, an input unit for inputting a command through the input unit, A controller for decoding an indicator for a desired image fragment of the selected image according to a scenario and decoding an image fragment mapped to the decoded indicator according to a scenario corresponding to the predefined scenario; And a memory for storing the decoded image fragments. The display unit displays the image fragments stored in the buffer.

According to another aspect of the present invention, there is provided an image processing method including the steps of acquiring an image, generating a scenario for the acquired image, generating at least one image fragment according to the generated scenario, And storing the generated indicator together with the acquired image.

According to another aspect of the present invention, there is provided a computer-readable recording medium storing a program for causing a computer to execute the steps of: selecting an image to be subjected to image viewing; inputting a predetermined command after selecting the image; confirming whether the input command corresponds to a scenario; Decoding an indicator of the image fragment requested by the command among the selected images according to a scenario if the command is an instruction corresponding to the scenario; and decoding the image fragment corresponding to the decoded indicator .

The mobile terminal according to at least one embodiment of the present invention configured as described above is capable of performing partial decoding of the image by allowing arbitrary access to the image through the indicator.

In addition, the mobile terminal related to the present invention can previously process the digital image because the decoded image data is previously stored and used for image processing.

Hereinafter, a mobile terminal related to the present invention will be described in detail with reference to the drawings. The suffix "module" and " part "for components used in the following description are given merely for convenience of description, and do not give special significance or role in themselves. Accordingly, it should be noted that the above-mentioned "module" and "part"

The terminal may be implemented in various forms. For example, the terminal described in this specification may include a mobile terminal such as a mobile phone, a smart phone, a notebook computer, a digital broadcasting terminal, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player) And fixed terminals such as a digital TV, a desktop computer, and the like. In the following description, it is assumed that the terminal is a mobile terminal. However, it will be readily apparent to those skilled in the art that the configuration according to the following description may be applied to the fixed terminal, except for components specifically configured for mobile use.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention.

The mobile terminal 100 includes a wireless communication unit 110, an audio / video input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, A controller 170, a controller 180, a power supply 190, and the like. 1 shows a mobile terminal having various components. However, not all illustrated components are required. A mobile terminal may be implemented by more components than the illustrated components, or a mobile terminal may be implemented by fewer components.

Hereinafter, the components will be described in order.

The wireless communication unit 110 may include at least one component that enables wireless communication between the mobile terminal 100 and the wireless communication system or wireless communication between the mobile terminal 100 and the network in which the mobile terminal 100 is located. For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short-range communication module 114, and a location information module 115 have.

The broadcast receiving module 111 receives broadcast signals and / or broadcast-related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. The broadcast management server may refer to a server for generating and transmitting broadcast signals and / or broadcast related information, or a server for receiving broadcast signals and / or broadcast related information generated by the broadcast management server and transmitting the generated broadcast signals and / or broadcast related information. The broadcast-related information may refer to a broadcast channel, a broadcast program, or information related to a broadcast service provider. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and a broadcast signal in which a data broadcast signal is combined with a TV broadcast signal or a radio broadcast signal.

Meanwhile, the broadcast related information may be provided through a mobile communication network, and in this case, it may be received by the mobile communication module 112.

The broadcast-related information may exist in various forms. For example, an EPG (Electronic Program Guide) of DMB (Digital Multimedia Broadcasting) or an ESG (Electronic Service Guide) of Digital Video Broadcast-Handheld (DVB-H).

The broadcast receiving module 111 receives broadcasting signals using various broadcasting systems. In particular, the broadcasting receiving module 111 may be a Digital Multimedia Broadcasting-Terrestrial (DMB-T), a Digital Multimedia Broadcasting-Satellite (DMB-S) Only Digital Broadcast-Handheld (DVB-H), Integrated Services Digital Broadcast-Terrestrial (ISDB-T), and the like. Of course, the broadcast receiving module 111 is configured to be suitable for all broadcasting systems that provide broadcasting signals as well as the digital broadcasting system described above.

The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

In addition, the mobile communication module 112 transmits and receives radio signals to at least one of a base station, an external terminal, and a server on a mobile communication network. Here, the wireless signal may include various types of data depending on a voice call signal, a video call signal, or a text / multimedia message transmission / reception.

The wireless Internet module 113 is a module for wireless Internet access, and the wireless Internet module 113 can be built in or externally. WLAN (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access) and the like can be used as wireless Internet technologies.

The short-range communication module 114 refers to a module for short-range communication. Bluetooth, radio frequency identification (RFID), infrared data association (IrDA), ultra wideband (UWB), ZigBee, and the like can be used as the short distance communication technology.

The location information module 115 is a module for confirming or obtaining the location of the mobile terminal. A typical example of the position information module 115 is a Global Position System (GPS) module. According to the present technology, the GPS module calculates distance information and accurate time information from three or more satellites, and then applies trigonometry to the calculated information to obtain three-dimensional current position information according to latitude, longitude, and altitude It can be calculated accurately. At present, a method of calculating position and time information using three satellites and correcting an error of the calculated position and time information using another satellite is widely used. In addition, the GPS module can calculate speed information by continuously calculating the current position in real time.

An audio / video (A / V) input unit 120 is for inputting an audio signal or a video signal, and may include a camera 121 and a microphone 122. The camera 121 processes an image frame such as a still image or a moving image obtained by the image sensor in the video communication mode or the photographing mode. Then, the processed image frame can be displayed on the display unit 151. [

The image frame processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. [ The camera 121 may be equipped with two or more cameras according to the configuration of the terminal.

The microphone 122 receives an external sound signal by a microphone in a communication mode, a recording mode, a voice recognition mode, or the like, and processes it as electrical voice data. The processed voice data can be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 112 when the voice data is in the call mode, and output. The microphone 122 may be implemented with various noise reduction algorithms for eliminating noise generated in the process of receiving an external acoustic signal.

The user input unit 130 generates input data for a user to control the operation of the terminal. The user input unit 130 may include a key pad, a dome switch, a touch pad (static / static), a jog wheel, a jog switch, and the like. Particularly, when the touch pad has a mutual layer structure with the display unit 151, which will be described later, it can be called a touch screen.

The sensing unit 140 senses the current state of the mobile terminal 100 such as the open / close state of the mobile terminal 100, the position of the mobile terminal 100, the presence or absence of user contact, the orientation of the mobile terminal, And generates a sensing signal for controlling the operation of the mobile terminal 100. For example, when the mobile terminal 100 is in the form of a slide phone, it is possible to sense whether the slide phone is opened or closed. Also, it is responsible for a sensing function related to whether or not the power supply unit 190 is powered on, whether the interface unit 170 is connected to an external device, and the like. Meanwhile, the sensing unit 140 may include a proximity sensor 141. This will be discussed later in connection with touch screens.

The interface unit 170 serves as an interface with all external devices connected to the mobile terminal 100. For example, a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device having an identification module, an audio I / O port, Video input / output (I / O) ports, earphone ports, and the like.

Here, the identification module is a chip that stores various information for authenticating the use right of the mobile terminal 100, and includes a user identification module (UIM), a subscriber identity module (SIM) ), A Universal Subscriber Identity Module (" USIM "), and the like. In addition, an apparatus having an identification module (hereinafter referred to as 'identification device') can be manufactured in a smart card format. Accordingly, the identification device can be connected to the terminal 100 through the port. The interface unit 170 receives data from an external device or receives power from the external device to transfer the data to each component in the mobile terminal 100 or to transmit data in the mobile terminal 100 to an external device.

The interface unit 170 may be a path through which power from the cradle is supplied to the mobile terminal 100 when the mobile terminal 100 is connected to an external cradle, Various command signals may be transmitted to the mobile terminal. The various command signals or the power source input from the cradle may be operated as a signal for recognizing that the mobile terminal is correctly mounted on the cradle.

The output unit 150 is for outputting an audio signal, a video signal, or an alarm signal. The output unit 150 may include a display unit 151, an audio output module 152, and an alarm unit 153.

The display unit 151 displays and outputs information processed by the mobile terminal 100. For example, when the mobile terminal is in the call mode, a UI (User Interface) or a GUI (Graphic User Interface) associated with a call is displayed. If the mobile terminal 100 is in the video communication mode or the photographing mode, the captured image and / or the received image or UI and GUI are displayed.

Also, the display unit 151 includes a display buffer (buffer) 151a for temporarily storing output data when displaying (outputting) the output data on the screen.

Meanwhile, as described above, when the display unit 151 and the touch pad have a mutual layer structure to constitute a touch screen, the display unit 151 can be used as an input device in addition to the output device. The display unit 151 may be a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, a three-dimensional display 3D display). Some of these displays can be configured to be transparent so that they can be viewed from outside. This may be referred to as a transparent display. A typical example of the transparent display is a transparent organic light emitting diode (TOLED) or the like. In addition, there may be two or more display units 151 according to the embodiment of the mobile terminal 100. For example, the mobile terminal 100 may be provided with an external display unit (not shown) and an internal display unit (not shown) at the same time. The touch screen may be configured to detect not only the touch input position and area but also the touch input pressure.

The audio output module 152 outputs audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, The sound output module 152 outputs an acoustic signal related to functions (e.g., call signal reception sound, message reception sound, etc.) performed in the mobile terminal 100. [ The sound output module 152 may include a speaker, a buzzer, and the like.

The alarm unit 153 outputs a signal for notifying the occurrence of an event of the mobile terminal 100. Examples of events that occur in the mobile terminal include call signal reception, message reception, key signal input, touch input, and the like. The alarm unit 153 may output a signal for notifying the occurrence of an event in a form other than an audio signal or a video signal. For example, it is possible to output a signal in a vibration mode. When the call signal is received or a message is received, the alarm unit 153 can output a vibration to notify it. Alternatively, when the key signal is input, the alarm unit 153 can output the vibration by the feedback to the key signal input. The user can recognize the occurrence of an event through the vibration output as described above. Of course, a signal for notification of occurrence of an event may also be output through the display unit 151 or the sound output module 152.

The memory 160 may store a program for processing and controlling the control unit 180 and may store a function for temporarily storing input / output data (e.g., a phone book, a message, a still image, . In addition, the memory 160 may store data on vibration and sound of various patterns outputted when a touch is input on the touch screen. The memory 160 includes a cache memory 161, which is a high-speed storage device for temporarily storing data and instructions.

The memory 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), a RAM (Random Access Memory) SRAM (Static Random Access Memory), ROM (Read Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM (Programmable Read- And an optical disc. Also, the mobile terminal 100 may operate a web storage for performing a storage function of the memory 160 on the Internet.

The control unit 180 typically controls the overall operation of the mobile terminal. For example, voice communication, data communication, video communication, and the like. In addition, the control unit 180 may include a multimedia module 181 for multimedia playback and an image processing unit 182 for image processing. The multimedia module 181 and the image processing unit 182 may be implemented in the control unit 180 or separately from the control unit 180.

The image processing unit 182 processes the input image data under the control of the control unit 180 and outputs the processed image data. That is, the image processing unit 182 decodes input image data. The image processing unit 182 stores the decoded image data in the display buffer 151a and the cache memory 161. [

The controller 180 may perform a pattern recognition process for recognizing handwriting input or drawing input performed on the touch screen as characters and images, respectively.

The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power necessary for operation of the respective components.

The various embodiments described herein may be embodied in a recording medium readable by a computer or similar device using, for example, software, hardware, or a combination thereof.

According to a hardware implementation, the embodiments described herein may be implemented as application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays May be implemented using at least one of processors, controllers, micro-controllers, microprocessors, and electrical units for performing functions. In some cases, And may be implemented by the control unit 180.

According to a software implementation, embodiments such as procedures or functions may be implemented with separate software modules that perform at least one function or operation. The software code may be implemented by a software application written in a suitable programming language. In addition, the software codes may be stored in the memory 160 and executed by the control unit 180. [

Hereinafter, a process of preparing an original image of full resolution for efficiently displaying an image in a mobile terminal having a limited memory capacity and a processing power source will be described.

2 is a flowchart illustrating a method of preparing an original image in a mobile terminal according to an embodiment of the present invention. The present embodiment describes a process of acquiring and preparing an original image from the camera 121. FIG.

Referring to FIG. 2, the image processing unit 182 acquires a digital image through the camera 121 under the control of the controller 180 (S101). In other words, when the execution of the camera 121 is requested through the user input unit 130, the controller 180 operates the camera 121 according to the request. After the camera 121 is driven, the controller 180 controls the camera 121 in accordance with a user input (e.g., a photographing instruction) input through the user input unit 130 to photograph the photograph. The camera 121 acquires a full resolution digital image through the photographing operation, compresses the acquired original image, and transmits the compressed digital image to the image processing unit 182. [ The image processor 182 receives the original image and stores it in the memory 160 as a code file.

The image processing unit 182 generates a starting scenario based on the acquired parameters of the digital image (hereinafter, image) and the terminal parameters (S102). Here, the terminal parameter includes a display resolution (screen size), a number of zoom steps (e.g., four steps), a start position of an image according to a zoom step, and the parameter of the image includes an image size and the like.

In the start scenario, the operation of zooming the image comprises at least one or more steps. For example, scenarios for image zooming that do not use the first view image are plans for zooming in several steps, where to start the step-by-step image, and so on. In addition, the scenario for image zoom using the first view image further includes a plan for how to create the first view image.

When the start scenario is generated, the image processing unit 182 determines the size and position of at least one image fragment according to the generated start scenario (S103). That is, the image processing unit 182 forms a set of image fragments composed of image fragments of the start scenarios. For example, if the zoom phase of the start scenario is four, then four image fragments are constructed. Here, the set of image fragments is formed by a standard of a viewer, an image size, and a screen size.

Next, the image processing unit 182 decodes the acquired image and generates temporary landmarks corresponding to the boundaries of the generated image fragments in the decoded image (S104).

The image processing unit 182 generates a direct access structure (DAS) based on the code file of the decoded original image and the generated temporary landmark (S105). The DAS consists of a set of indicators of image fragments.

In addition, the image processing unit 182 generates a thumbnail through the terminal parameter and the decoded original image (S105). That is, the image processor 182 generates a thumbnail (thumbnail) by scaling the decoded image at a predetermined ratio based on a terminal parameter (e.g., preview image size).

The thumbnail is used to create a first view image of the starting scenario, and the DAS is used to perform image processing according to the starting scenario.

The image processor 182 generates image information (information object) including the generated DAS and thumbnail and stores the image information together with the original image data in the memory 160 (S105). The original image file thus generated includes the original (real) image and information about the image. Here, the image information is implemented as a file of an exchange image file format (EXIF), and includes preview (thumbnail) and indicator data (DAS) and metadata related to the image. Generally, the metadata includes at least one of a camera manufacturer, a camera model, a camera firmware version, a shooting time (shutter release moment), a storage time, a latitude and longitude (using GPS) X resolution, y resolution, x size, y size, color depth, color depth, white balance setting, B / W reference point, pixel compression / sampling / positioning (Y: Cb: Cr) Orientation, file compression scheme, image name, and the like.

At this time, the control unit 180 may directly store the original image including the image information received from the image processing unit 182 or inquire whether or not to store the image, and then determine whether to store the original image according to a user response to the inquiry .

3 is a flowchart illustrating an original image preparation process of a mobile terminal according to another embodiment of the present invention. The present embodiment describes an example in which an image file is loaded from a source other than a camera to a terminal.

Referring to the drawing, the image processing unit 182 loads an image file from a source other than the camera 121 (S201). That is, the control unit 180 accesses the image file from another source and transmits the image file to the image processing unit 182. The other source may be the memory 160 or other terminal in the terminal. The mobile terminal 100 of the present invention can download and load an image file stored in another terminal through wireless communication.

Next, the image processing unit 182 checks the file type of the loaded image file (S202). In other words, the image processing unit 182 checks whether the loaded image file includes a DAS and a thumbnail.

If it is determined that the DAS and the thumbnail are not included in the loaded image file, the image processing unit 182 creates a start scenario using the parameters of the loaded image and the terminal parameters (S204).

When the start scenario is generated, the image processor 182 determines the size and position of the image fragments in step S205 according to the generated start scenario (S205).

The image processing unit 182 decodes the loaded image and generates a temporary landmark corresponding to the boundary of the image fragments in the decoded image (S206).

When the temporary landmark is generated, the image processing unit 182 generates a DAS using the decoded image and the temporary landmark, and generates a thumbnail image through the decoded image and the terminal parameter (S207). The image fragment indicator comprising the DAS is used to accelerate access to the image fragment.

When the generation of the DAS and the thumbnail image is completed, the image processing unit 182 generates the DAS and the thumbnail image together with the loaded image as a specific file (e.g., EXIF file) and stores the generated DAS and thumbnail image. The image processing unit 182 may insert image information including a DAS and a thumbnail (preview) in a header part of the loaded image file.

If the DAS and the thumbnail are configured in the loaded image file, the image file is directly stored in the memory 160 (S203, S209).

4 is an exemplary diagram illustrating an original image and its derivative image for efficient image representation using a start-up scenario in a mobile terminal according to an embodiment of the present invention.

4A shows an original image having a full resolution and an image obtained by scaling the original image to a basic scale level. The number of the basic scaling levels is four including a source image (1: 1). In this embodiment, the basic scaling level is set to 1: 1, 1: 2, 1: 4, 1: 8, but the same value as the basic scaling level can be changed.

According to Fig. 4B, a thumbnail and a set of image fragments are shown. Here, the thumbnail can be generated by scaling the decoded original image based on the terminal parameters. These thumbnails (preview information) are located in the header portion of the image file.

The set of image fragments consists of image fragments corresponding to the stages of the scenario. As shown in Fig. 4B, a landmark corresponding to the boundary of the original image is displayed for each image fragment. Then, the original image in which the set of image fragments is displayed may be displayed as the first view image.

Referring to FIG. 4C, a starting scenario of an image representation including a first view image and four zoomed images is shown. The first view image can be generated from the thumbnail shown in FIG. 4B using interpolation without decoding the original image.

The four zoomed images shown in FIG. 4C are each step-by-step image fragments that perform a zoom operation in accordance with the starting scenario. The four-step zoom series of the start scenario corresponds to the image fragment set shown in Fig. 4B, respectively. Each stepped image ((a) - (d)) shown in FIG. 4C can be made by decoding the requested image fragment acquired at a properly assigned base scale level.

5 illustrates a block structure of an image fragment according to an embodiment of the present invention.

The image fragment is rectangular in shape as a part of the entire image, and has a block structure as shown in Fig. A structural indicator for these image fragments is used to decode only the requested image fragments without decoding the entire image.

Figures 6A-6C illustrate the indicator structure of an image block in accordance with one embodiment of the present invention.

Referring to FIG. 6A, the indicator for the image fragment is composed of m indicators. Where m is the vertical size of the image fragment and corresponds to the number of rows (lines) of the block. In addition, the indicator is composed of one absolute indicator and at least one relative indicator.

The absolute indicator IB0,0 is an indicator for the first image block of the image fragment, and the relative indicator RBi, 0 is an indicator for the first image block of the i-th row blocks of the image fragment.

As shown in FIG. 6B, the absolute indicator IB0,0 for the first image block of the image fragment includes block DC data, block position data, and additional data. The block DC data is an average of brightness and color difference signals for the block, and the block position data indicates a position of a first block of a predetermined image fragment in the original image.

6C, a relative indicator RBi, 0 for the first image block among the i-th row blocks includes block differential DC data, relative block position data, and additional data for the color element. The block differential DC data is the data relative to the first block of the image fragment, and is the difference between the DC data of IB0,0 and RBi, 0. The relative block position data also refers to the relative position of the block when the first block of the image fragment is used as a reference.

In the additional data field of the absolute indicator and the relative indicator, data for accelerating decoding of the image block is inserted.

7 is a flowchart illustrating a digital image processing method of a mobile terminal according to an embodiment of the present invention. The present embodiment describes a process of performing image processing such as zooming or scrolling a specific image in an image viewer.

Referring to FIG. 7, when a specific command is input from the user input unit 130 while performing the entire view of a specific image, the controller 180 determines whether the input command is a command corresponding to the start scenario (S310 - S330). For example, if it is desired to search a part of a specific photograph and perform detailed checking while performing an album view, the user may first input an image enlargement command through the user input unit 130. [

If it is determined that the input command is a command corresponding to the start scenario, the controller 180 determines whether a first view image is requested (S340).

If the first view image is requested in step S340, the image processing unit 182 decodes the thumbnail image included in the image file under the control of the controller 180 in step S350.

Subsequently, the image processor 182 scales the decoded thumbnail image to a screen size (resolution) of the display unit 151 (S360).

If the first view image is not requested in step S340, the image processing unit 182 decodes the indicator for the image fragment according to the start scenario (S380). That is, the image processing unit 182 decodes an indicator of a predefined image fragment at the current stage according to the start scenario.

After the decoding of the indicator is performed, the image processing unit 182 decodes the image fragment corresponding to the decoded indicator (S390). Resource-intensive image fragments in terminals with poor user interface and limited screen are decoded according to predefined structure indicators.

When the decoding of the image fragment is completed, the image processing unit 182 displays the decoded image fragment on the display unit 151 (S370). In other words, the image processing unit 182 transmits the decoded image fragment to the display buffer 151a. The display unit 151 displays the decoded image fragment stored in the display buffer 151a on the screen.

If the input command does not correspond to the scenario in step S330, the controller 180 controls the image processing unit 182 to decode an arbitrary image fragment (S400). Subsequently, the image processor 182 displays the decoded image fragment on the display screen (S370).

At this time, the image processing unit 182 stores the decoded image fragment in the cache memory 161, and then uses the image data stored in the cache memory 161 during image processing.

Also, the image processor 182 updates the image data stored in the cache memory 161. For example, image data close to the image fragment displayed on the current display screen is stored, and if it is not adjacent image data, it is deleted. The proximity image data is a collection of image fragments that may be displayed by the next user command.

8 is a flowchart illustrating an image fragment decoding method in a mobile terminal according to an embodiment of the present invention.

If the command entered by the user in step S330 of FIG. 7 is not an instruction corresponding to the scenario, an arbitrary image fragment is requested (S410).

The image processing unit 182 plans a method for forming the requested image fragment (S420).

If a method for forming the image fragment is planned, the image processing section 182 obtains at least one or more image sub-fragments to form the requested image fragment (S430).

There are three methods for obtaining the image sub-fragment for generating the required image fragment.

First, the display buffer image sub-fragment (DBISF) is obtained from the display buffer 151a having the image sub-fragments generated in the preceding step.

The second step is to obtain a cache memory image sub-fragment (CMISF) from the cache memory 161 storing the decoded image sub-fragments in the preceding step. The resolution of the image sub-fragments stored in the cache memory 161 is one of the basic scale levels of the image resolution and can be reduced to downsampling if the rendering conditions are not satisfied at the present stage.

Finally, a decoded image sub-fragment (DISF), i.e., a new image sub-fragment, is obtained through sub-fragment decoding.

Through the above methods, the image processing unit 182 acquires three image sub-fragments and generates a desired image fragment using the obtained image sub-fragments (S440). Here, the image processing unit 182 operates in one of two operation modes. The operation mode includes a zoom mode and a scrolling mode.

When the operation mode is the zoom mode, the image processing unit 182 uses the newly decoded image sub-segment of the three inputted image sub-segments and the image sub-segment stored in the cache memory. The image processing unit 182 adjusts the two image sub-fragments based on one scaling grid.

Meanwhile, when the operation mode is the scrolling mode, the image processor 182 generates an image fragment using the newly decoded image sub-fragment of the three inputted image sub-fragments and the image sub-fragment stored in the display buffer . The two image sub-segments are adjusted and assembled based on the previously determined scale grid.

9 is a flow chart illustrating a method of processing image sub-segments in a mobile terminal in accordance with an embodiment of the present invention.

First, the image processing unit 182 acquires start block data of the requested image fragment (S431), and determines a basic scale level for decoding the requested image sub-fragment (S432).

Once the base scale level is determined, the image processing unit 182 performs decoding of the requested image sub-segment under the determined base scale level (S433). Here, the image processing unit 182 stores information about the decoded block in the memory 160. The information on the decoded block includes an image block indicator, a DC coefficient for a color component of the corresponding block, and additional information for accelerating image block decoding.

Further, according to an embodiment of the present invention, the above-described method can be implemented as computer-readable code on a medium on which a program is recorded. The computer readable medium includes all kinds of recording devices in which data that can be read by a computer system is stored. Examples of the computer-readable medium include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, and the like, and also implemented in the form of a carrier wave (for example, transmission over the Internet) . In addition, the computer may include a control unit 180 of the terminal.

The mobile terminal described above can be applied to not only the configuration and method of the embodiments described above but also all or some of the embodiments may be selectively combined so that various modifications may be made to the embodiments It is possible.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention;

2 is a flow chart illustrating a method for preparing an original image in a mobile terminal according to one embodiment of the present invention.

3 is a flowchart illustrating an original image preparation process of a mobile terminal according to another embodiment of the present invention.

4 is a diagram illustrating an original image and its derivative image for efficient image representation using a start-up scenario in a mobile terminal according to an embodiment of the present invention;

5 illustrates a structure of an image fragment associated with an embodiment of the present invention.

Figures 6A-6C illustrate an indicator structure of an image block in accordance with an embodiment of the present invention.

7 is a flow chart illustrating a digital image processing method of a mobile terminal according to an embodiment of the present invention.

8 is a flow chart illustrating a method of decoding an arbitrary image fragment in a mobile terminal according to an embodiment of the present invention.

9 is a flow diagram illustrating a method for processing image sub-segments in a mobile terminal in accordance with an embodiment of the present invention.

DESCRIPTION OF THE REFERENCE NUMERALS

100: mobile terminal 110: wireless communication unit

120: A / V input unit 130: user input unit

140: sensing unit 150: output unit

160: memory 170: interface section

180: control unit 190: power supply unit

Claims (15)

Acquiring an image; Generating a scenario for the acquired image; Generating at least one image fragment according to the generated scenario; Generating an indicator for the generated image fragment; And And storing the generated indicator together with the acquired image, Wherein the generating the indicator comprises: Decoding the acquired image to display a temporary landmark at a boundary of the image fragment; And And generating an indicator for the image fragment using the decoded image and the temporary landmark. ≪ Desc / Clms Page number 21 > 2. The method according to claim 1, And a compressed image of full resolution is received from the camera. 2. The method according to claim 1, Loading an image file from a memory or other terminal in the terminal; Determining whether the loaded image file includes an indicator for an image fragment. ≪ Desc / Clms Page number 21 > 4. The method according to claim 3, wherein in the step of checking whether the indicator is included, And storing the loaded image file if the loaded image file includes an indicator. 2. The method according to claim 1, And generating a scenario based on the acquired image parameter and the terminal parameter. 6. The method of claim 5, And the image size of the digital image. 6. The method of claim 5, The display resolution, the number of zoom steps, and the start position of the zoom step image. delete Receiving a predetermined command during image viewing; Confirming whether the input command corresponds to a scenario; Decoding the indicator for the image segment of the predetermined image according to the scenario if the input command is an instruction corresponding to the scenario; And And decoding the image fragment corresponding to the decoded indicator, Wherein decoding the image fragment comprises: Receiving a plurality of image sub-fragments for generating the requested image fragments in association with the image fragments; And And forming the requested image fragment using the plurality of input image sub-segments. delete 10. The apparatus of claim 9, wherein the plurality of image sub- An image sub-fragment from the cache memory, an image sub-fragment from the display buffer, and a decoded new image sub-segment. An input unit for generating data corresponding to a user input; If an input command is input through the input unit while an image to be displayed is selected, if the input command is an instruction corresponding to a predefined scenario, the indicator for the desired image fragment of the selected image is decoded according to the scenario, A control unit for decoding the image fragment mapped to the decoded indicator; A display unit including a buffer for temporarily storing the decoded image fragment and displaying an image fragment stored in the buffer; And a memory for storing the decoded image fragment. 13. The apparatus according to claim 12, A first indicator for a first block of the image fragment, And a second indicator for a first one of the predetermined row blocks of the image fragment. 14. The apparatus of claim 13, wherein the first indicator comprises: Block DC data, block position data, and additional data. 14. The apparatus of claim 13, wherein the second indicator comprises: The block differential DC data and the relative block position data and the additional data relative to the first block of the image fragment.

Images