KR20100137865A - Mobile terminal and method for porcessing digital image thereof - Google Patents

Abstract

PURPOSE: A mobile terminal and a digital image processing method thereof are provided to approach an image through an indicator thereby performing partial decoding of the image. CONSTITUTION: If a command corresponding to a scenario is inputted through an input part in the state which the image selected performing image view, a control unit(180) decodes an indicator about an image fragment of the selected image according to the scenario. The control unit decodes an image fraction mapping in the decoded indicator. A buffer(161) stores the decoded image fraction provisionally. A display unit(151) indicates the image fraction stored in the buffer.

Description

Mobile terminal and its digital image processing method {MOBILE TERMINAL AND METHOD FOR PORCESSING DIGITAL IMAGE THEREOF}

The present invention relates to a mobile terminal for quickly processing a high resolution digital image and a digital image processing method thereof.

Terminals such as personal computers, laptops, mobile phones, etc. may be configured to perform various functions. Examples of such various functions include data and voice communication functions, taking pictures or videos through a camera, storing voices, playing music files through a speaker system, and displaying images or videos. Some terminals include additional functionality to play games, while others are implemented as multimedia devices. Moreover, recent terminals can receive a broadcast or multicast signal to watch a video or television program.

In general, a terminal may be divided into a mobile terminal and a stationary terminal according to whether or not it is mobile, and again, the mobile terminal may be a portable terminal (or handheld terminal) according to whether the user can directly carry it. And it may be divided into a vehicle mount terminal (vehicle mount terminal).

Efforts to support and increase the function of the terminal continue. The above efforts include not only changes and improvements in structural components forming the terminal, but also improvements in software and hardware.

As terminals equipped with cameras become more common, there is a need to process digital images quickly and efficiently in a mobile terminal having limited memory space and processing power. In particular, digital image processing techniques are important for quickly displaying high resolution images on displays with relatively low resolution. Accordingly, there have been studies on image processing technology for processing high resolution images quickly.

The present invention provides a mobile terminal for performing partial decoding of an image using an indicator and a digital image processing method thereof.

The present invention also provides a mobile terminal for performing image processing using previously decoded image data and a digital image processing method thereof.

According to an embodiment of the present invention for realizing the above object, the mobile terminal includes an input unit for generating data corresponding to a user input and an input command when a command is input through the input unit while an image to perform image viewing is selected. A control unit for decoding an indicator for a required image fragment of the selected image according to a scenario, and decoding an image fragment mapped to the decoded indicator according to the scenario; And a display for displaying an image fragment stored in the buffer, and a memory for storing the decoded image fragment.

The present invention also provides a method of acquiring an image, generating a scenario for the acquired image, generating at least one image fragment according to the generated scenario, and an indicator for the generated image fragment. And generating the generated indicator together with the obtained image.

In addition, the present invention comprises the steps of selecting an image to perform the image viewing, receiving a predetermined command after the image selection, checking whether the input command is a command corresponding to the scenario, and the confirmation result If the input command is a command corresponding to a scenario, decoding an indicator for an image fragment requested by the command among the selected images according to a scenario; and decoding an image fragment corresponding to the decoded indicator. Include.

The mobile terminal according to at least one embodiment of the present invention configured as described above may perform partial decoding of an image by allowing arbitrary access to the image through an indicator.

In addition, the mobile terminal according to the present invention can store digitally decoded image data and use it for later image processing.

Hereinafter, a mobile terminal related to the present invention will be described in more detail with reference to the accompanying drawings. The suffixes "module" and "unit" for components used in the following description are merely given in consideration of ease of preparation of the present specification, and do not impart any particular meaning or role by themselves. Therefore, it should be noted that the "module" and "unit" may be used interchangeably with each other.

The terminal may be implemented in various forms. For example, a terminal described herein includes a mobile terminal such as a mobile phone, a smart phone, a notebook computer, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), a navigation device, and the like. And fixed terminals such as digital TVs, desktop computers, and the like. In the following description, it is assumed that the terminal is a mobile terminal. However, it will be readily apparent to those skilled in the art that the configuration according to the following description may also be applied to the fixed terminal except for components specially configured for mobile use.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention.

The mobile terminal 100 includes a wireless communication unit 110, an A / V input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, and an interface. The unit 170, the controller 180, and the power supply unit 190 may be included. 1 shows a mobile terminal having various components. However, not all illustrated components are required. The mobile terminal may be implemented by more components than the illustrated components, and the mobile terminal may be implemented by fewer components.

Hereinafter, the components will be described in turn.

The wireless communication unit 110 may include one or more components for wireless communication between the mobile terminal 100 and the wireless communication system or wireless communication between the mobile terminal 100 and a network in which the mobile terminal 100 is located. For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless internet module 113, a short range communication module 114, a location information module 115, and the like. have.

The broadcast receiving module 111 receives a broadcast signal and / or broadcast related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. The broadcast management server may mean a server that generates and transmits a broadcast signal and / or broadcast related information or a server that receives a previously generated broadcast signal and / or broadcast related information and transmits the same to a terminal. The broadcast related information may mean information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast signal may include not only a TV broadcast signal, a radio broadcast signal, and a data broadcast signal, but also a broadcast signal having a data broadcast signal combined with a TV broadcast signal or a radio broadcast signal.

Meanwhile, the broadcast related information may be provided through a mobile communication network, and in this case, may be received by the mobile communication module 112.

The broadcast related information may exist in various forms. For example, it may exist in the form of Electronic Program Guide (EPG) of Digital Multimedia Broadcasting (DMB) or Electronic Service Guide (ESG) of Digital Video Broadcast-Handheld (DVB-H).

The broadcast receiving module 111 receives a broadcast signal using various broadcasting systems, and in particular, digital multimedia broadcasting-terrestrial (DMB-T), digital multimedia broadcasting-satellite (DMB-S), and media forward link (MediaFLO). Digital broadcast signals can be received using digital broadcasting systems such as only), digital video broadcast-handheld (DVB-H), integrated services digital broadcast-terrestrial (ISDB-T), and the like. Of course, the broadcast receiving module 111 is configured to be suitable for all broadcasting systems that provide broadcasting signals as well as the digital broadcasting system described above.

The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

In addition, the mobile communication module 112 transmits and receives a radio signal with at least one of a base station, an external terminal, and a server on a mobile communication network. The wireless signal may include various types of data according to transmission and reception of a voice call signal, a video call call signal, or a text / multimedia message.

The wireless Internet module 113 is a module for wireless Internet access, and the wireless Internet module 113 can be built in or externally. Wireless Internet technologies may include Wireless LAN (Wi-Fi), Wireless Broadband (Wibro), World Interoperability for Microwave Access (Wimax), High Speed Downlink Packet Access (HSDPA), and the like.

The short range communication module 114 refers to a module for short range communication. As a short range communication technology, Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, and the like may be used.

In addition, the location information module 115 is a module for checking or obtaining the location of the mobile terminal. A representative example of the location information module 115 is a GPS (Global Position System) module. According to the current technology, the GPS module calculates distance information and accurate time information from three or more satellites, and then applies triangulation to the calculated information, thereby obtaining three-dimensional current position information according to latitude, longitude, and altitude. It can be calculated accurately. Currently, a method of calculating position and time information using three satellites and correcting the error of the calculated position and time information using another satellite is widely used. In addition, the GPS module may calculate speed information by continuously calculating the current position in real time.

Meanwhile, the A / V input unit 120 is for inputting an audio signal or a video signal, and may include a camera 121 and a microphone 122. The camera 121 processes an image frame such as a still image or a moving image obtained by the image sensor in the video communication mode or the photographing mode. The processed image frame may be displayed on the display unit 151.

The image frame processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. Two or more cameras 121 may be provided according to the configuration aspect of the terminal.

The microphone 122 receives an external sound signal by a microphone in a call mode, a recording mode, a voice recognition mode, etc., and processes the external sound signal into electrical voice data. The processed voice data may be converted into a form transmittable to the mobile communication base station through the mobile communication module 112 and output in the call mode. The microphone 122 may implement various noise removing algorithms for removing noise generated in the process of receiving an external sound signal.

The user input unit 130 generates input data for the user to control the operation of the terminal. The user input unit 130 may include a key pad, a dome switch, a touch pad (constant voltage / capacitance), a jog wheel, a jog switch, and the like. In particular, when the touch pad has a mutual layer structure with the display unit 151 described later, this may be referred to as a touch screen.

The sensing unit 140 detects the current state of the mobile terminal 100 such as the open / closed state of the mobile terminal 100, the position of the mobile terminal 100, the presence or absence of user contact, the orientation of the mobile terminal, the acceleration / deceleration of the mobile terminal, and the like. To generate a sensing signal for controlling the operation of the mobile terminal 100. For example, if the mobile terminal 100 is in the form of a slide phone, it may sense whether the slide phone is opened or closed. In addition, it is responsible for sensing functions related to whether the power supply unit 190 is supplied with power or whether the interface unit 170 is coupled to an external device. The sensing unit 140 may include a proximity sensor 141. This will be described later with reference to the touch screen.

The interface unit 170 serves as an interface with all external devices connected to the mobile terminal 100. For example, wired / wireless headset ports, external charger ports, wired / wireless data ports, memory card ports, ports for connecting devices with identification modules, audio input / output (I / O) ports, Video I / O (Input / Output) port, earphone port, etc. may be included.

Here, the identification module is a chip that stores various types of information for authenticating the use authority of the mobile terminal 100, and includes a user identification module (UIM) and a subscriber identify module (SIM). ), A Universal Subscriber Identity Module (“USIM”), and the like. In addition, the device equipped with the identification module (hereinafter, 'identification device') may be manufactured in the form of a smart card. Therefore, the identification device may be connected to the terminal 100 through a port. The interface unit 170 receives data or power from an external device and transmits the data to each component inside the mobile terminal 100 or transmits the data inside the mobile terminal 100 to an external device.

In addition, when the mobile terminal 100 is connected to an external cradle, the interface unit 170 serves as a passage through which power from the cradle is supplied to the mobile terminal 100 or inputted from the cradle by a user. Various command signals may be a passage for transmitting to the mobile terminal. Various command signals or power input from the cradle may be operated as signals for recognizing that the mobile terminal is correctly mounted on the cradle.

The output unit 150 is for outputting an audio signal, a video signal, or an alarm signal. The output unit 150 may include a display unit 151, an audio output module 152, an alarm unit 153, and the like.

The display unit 151 displays and outputs information processed by the mobile terminal 100. For example, when the mobile terminal is in a call mode, the mobile terminal displays a user interface (UI) or a graphic user interface (GUI) related to the call. When the mobile terminal 100 is in a video call mode or a photographing mode, the mobile terminal 100 displays a photographed and / or received image, a UI, or a GUI.

In addition, the display unit 151 includes a display buffer 151a that temporarily stores the output data when displaying the output data on the screen.

Meanwhile, as described above, when the display unit 151 and the touch pad form a mutual layer structure to form a touch screen, the display unit 151 may be used as an input device in addition to the output device. The display unit 151 may be a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, or a three-dimensional display. 3D display). Some of these displays can be configured to be transparent so that they can be seen from the outside. This may be referred to as a transparent display. A representative example of the transparent display is a transparent organic light emitting diode (TOLED). In addition, two or more display units 151 may exist according to the implementation form of the mobile terminal 100. For example, an external display unit (not shown) and an internal display unit (not shown) may be simultaneously provided in the mobile terminal 100. The touch screen may be configured to detect a touch input pressure as well as a touch input position and area.

The sound output module 152 outputs audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, and the like. In addition, the sound output module 152 outputs a sound signal related to a function (eg, a call signal reception sound, a message reception sound, etc.) performed by the mobile terminal 100. The sound output module 152 may include a speaker, a buzzer, and the like.

The alarm unit 153 outputs a signal for notifying occurrence of an event of the mobile terminal 100. Examples of events occurring in the mobile terminal include call signal reception, message reception, key signal input, and touch input. The alarm unit 153 may output a signal for notifying occurrence of an event in a form other than an audio signal or a video signal. For example, the signal may be output in the form of vibration. When a call signal is received or a message is received, the alarm unit 153 may output a vibration to inform this. Alternatively, when a key signal is input, the alarm unit 153 may output a vibration in response to the key signal input. Through the vibration output as described above, the user can recognize the occurrence of the event. Of course, the signal for event occurrence notification may be output through the display unit 151 or the sound output module 152.

The memory 160 may store a program for processing and controlling the controller 180 and may provide a function for temporarily storing input / output data (for example, a phone book, a message, a still image, a video, etc.). It can also be done. In addition, the memory 160 may store data on vibration and sound of various patterns output when a touch input on the touch screen is performed. The memory 160 includes a cache memory 161 that is a high speed storage device that temporarily stores data and instructions.

The memory 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), RAM Random Access Memory (RAM) Static Random Access Memory (SRAM), Read-Only Memory (ROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Programmable Read-Only Memory (PROM) magnetic memory, It may include at least one type of storage medium of the optical disk. In addition, the mobile terminal 100 may operate a web storage that performs a storage function of the memory 160 on the Internet.

And the controller 180 typically controls the overall operation of the mobile terminal. For example, perform related control and processing for voice calls, data communications, video calls, and the like. In addition, the controller 180 may include a multimedia module 181 for multimedia playback and an image processor 182 for image processing. The multimedia module 181 and the image processor 182 may be implemented in the controller 180 or may be implemented separately from the controller 180.

The image processor 182 processes and outputs image data input under the control of the controller 180. That is, the image processor 182 decodes the input image data. The image processor 182 stores the decoded image data in the display buffer 151a and the cache memory 161.

The controller 180 may perform a pattern recognition process for recognizing a writing input or a drawing input performed on the touch screen as text and an image, respectively.

The power supply unit 190 receives an external power source and an internal power source under the control of the controller 180 to supply power for operation of each component.

Various embodiments described herein may be implemented in a recording medium readable by a computer or similar device using, for example, software, hardware or a combination thereof.

According to a hardware implementation, the embodiments described herein include application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), and the like. It may be implemented using at least one of processors, controllers, micro-controllers, microprocessors, and electrical units for performing the functions. It may be implemented by the controller 180.

In a software implementation, embodiments such as procedures or functions may be implemented with separate software modules that allow at least one function or operation to be performed. The software code may be implemented by a software application written in a suitable programming language. In addition, the software codes may be stored in the memory 160 and executed by the control unit 180. [

Hereinafter, a process of preparing an original image of full resolution for displaying an image efficiently in a mobile terminal having a limited memory capacity and processing power will be described.

2 is a flowchart illustrating a method of preparing an original image in a mobile terminal according to an embodiment of the present invention. This embodiment describes a process of obtaining and preparing an original image from the camera 121.

2, under the control of the controller 180, the image processor 182 obtains a digital image through the camera 121 (S101). In other words, when the execution of the camera 121 is requested through the user input unit 130, the controller 180 operates the camera 121 according to the request. After the camera 121 is driven, the controller 180 controls the camera 121 to take a picture according to a user input (for example, a recording command) input through the user input unit 130. Through the photographing operation, the camera 121 obtains a full resolution digital image, compresses the obtained original image, and transmits the original image to the image processor 182. The image processor 182 receives the original image and stores the original image in the memory 160 as a code file.

The image processor 182 generates a starting scenario based on the parameters of the acquired digital image (hereinafter, an image) and a terminal parameter (S102). Here, the terminal parameter includes a display resolution (screen size), the number of zoom steps (for example, four steps), a start position of an image for each zoom step, and the parameter of the image includes an image size and the like.

In addition, in the start scenario, an operation of zooming (enlarging / reducing) an image includes at least one or more steps. For example, a scenario for zooming an image that does not use the first view image is planning how many steps to zoom, where to start the stepped image, and so on. In addition, the scenario for image zoom using the first view image further includes a plan for how to generate the first view image.

When the start scenario is generated, the image processor 182 determines the size and position of at least one image fragment according to the generated start scenario (S103). That is, the image processing unit 182 is a set of image fragments consisting of the image fragments of the stage of the start scenario. For example, if the zoom step of the start scenario is 4, four image fragments are constructed. Here, the image fragment set is formed by a viewer's standard, image size, and screen size.

Subsequently, the image processor 182 decodes the obtained image and generates temporary landmarks corresponding to the boundary of the generated image fragments in the decoded image (S104).

The image processor 182 generates a direct access structure (DAS) based on the code file of the decoded original image and the generated temporary landmark (S105). The DAS consists of a set of indicators (structural indicators) for the image fragment.

In addition, the image processor 182 generates a thumbnail through the terminal parameter and the decoded original image (S105). That is, the image processor 182 generates a thumbnail (preview) by scaling the decoded image by a predetermined ratio based on the terminal parameter (for example, the preview image size).

The thumbnail is used to generate the first view image of the start scenario, and the DAS is used to perform image processing according to the start scenario.

The image processor 182 generates image information (information object) including the generated DAS and thumbnails and stores the image information (information object) in the memory 160 along with the original image data (S105). The original image file generated in this way contains the full resolution original (real) image and information about the image. Here, the image information is implemented as a file in an exchangeable image file format (EXIF), and includes a preview (thumbnail), indicator data (DAS), and metadata related to the image. In general, metadata includes camera manufacturer, camera model, camera firmware version, shooting time (the moment the shutter is pressed), recording time, latitude and longitude of the shooting location (using GPS), shutter speed, lens focal length, aperture value, and exposure compensation , Shooting program, metering mode, white balance setting, B / W reference point, pixel compression / sampling / positioning (Y: Cb: Cr), component setting and compression ratio, color space, x resolution, y resolution, x size, y size, Include orientation, file compression, image name, and more.

In this case, the controller 180 may immediately store the original image including the image information received from the image processor 182 or query whether the image is to be stored, and determine whether to store the original image according to a user response to the query. Can be.

3 is a flowchart illustrating an original image preparation process of a mobile terminal according to another embodiment of the present invention. The embodiment will be described taking an example of loading an image file to a terminal from a source other than a camera.

Referring to the drawing, the image processor 182 loads an image file from a source other than the camera 121 (S201). That is, the controller 180 accesses the image file from another source and transmits the image file to the image processor 182. The other source may be a memory 160 or another terminal in the terminal. The mobile terminal 100 of the present invention may download and load an image file stored in another terminal through wireless communication.

Next, the image processor 182 checks the file type of the loaded image file (S202). In other words, the image processor 182 checks whether the loaded image file includes a DAS and a thumbnail.

As a result of the check, if the DAS and the thumbnail are not configured in the loaded image file, the image processor 182 generates a start scenario using the parameters of the loaded image and the terminal parameters (S204).

When the start scenario is generated, the image processing unit 182 determines the size and position of the step-by-step image fragments according to the generated start scenario (S205).

The image processor 182 decodes the loaded image and generates a temporary landmark corresponding to the boundary of the image fragments in the decoded image (S206).

When the temporary landmark is generated, the image processor 182 generates a DAS using the decoded image and the temporary landmark, and generates a thumbnail image through the decoded image and the terminal parameter (S207). The image fragment indicator constituting the DAS is used to accelerate access to the image fragment.

When the generation of the DAS and the thumbnail image is completed, the image processor 182 generates and stores the DAS and the thumbnail image as a specific file (for example, an EXIF file) together with the loaded image (S208). The image processor 182 may insert image information including a DAS and a thumbnail (preview) to a header portion of the loaded image file.

On the other hand, if the DAS and the thumbnail is configured in the loaded image file, the image file is stored in the memory 160 as it is (S203, S209).

4 is an exemplary diagram illustrating an original image and a derivative image thereof for efficient image representation using a start scenario in a mobile terminal according to an embodiment of the present invention.

FIG. 4A shows an original image of the full resolution and an image scaled from the original image to a basic scale level. The number of basic scaling levels is four in total including the original image (1: 1). In the present embodiment, 1: 1, 1: 2, 1: 4, and 1: 8 are set as default scaling levels. However, a value equal to the number of basic scaling levels may be changed.

According to FIG. 4B, a set of thumbnails and image fragments is shown. Here, the thumbnail may be generated since the decoded original image is scaled based on the terminal parameter. This thumbnail (preview information) is located in the header portion of the image file.

And, the image fragment set is composed of image fragments corresponding to each stage of the scenario. As shown in Fig. 4B, a landmark corresponding to the boundary of each image fragment is displayed on the original image. The original image on which the image fragment set is displayed may be displayed as the first view image.

Referring to FIG. 4C, a start scenario of an image representation including a first view image and four zoomed images is shown. The first view image can be created from the thumbnail shown in FIG. 4B using interpolation without decoding the original image.

The four zoomed images shown in FIG. 4C are respective stepped image fragments for performing a zoom operation according to the starting scenario. The four-stage zoom series of the starting scenarios correspond respectively to the set of image fragments shown in FIG. 4B. Each stepped image (a)-(d) shown in FIG. 4C can be made by decoding of the required image fragment obtained at the appropriately assigned base scale level.

5 illustrates a block structure of an image fragment according to an embodiment of the present invention.

The image fragment is rectangular in shape as part of the overall image and has a block structure as shown in FIG. The structural indicator for these image fragments is used to decode only the required image fragments without decoding the entire image.

6A to 6C illustrate an indicator structure of an image block according to an embodiment of the present invention.

Referring to FIG. 6A, the indicator for the image fragment consists of m indicators. Here, m is the vertical size of the image fragment, which corresponds to the number of rows (lines) of the block. In addition, the indicator is composed of one absolute indicator and at least one relative indicator.

The absolute indicator IB0,0 is an indicator for the first image block of the image fragment, and the relative indicator RBi, 0 is an indicator for the first image block of the i th row blocks of the image fragment.

As shown in FIG. 6B, the absolute indicator IB0,0 for the first image block of the image fragment includes block DC data, block position data, and additional data. The block DC data is an average of brightness and chrominance signals for the corresponding block, and the block position data indicates the position of the first block of the predetermined image fragment in the original image.

As shown in FIG. 6C, the relative indicator RBi, 0 for the first image block of the i-th row blocks includes block differential DC data, relative block position data, and additional data for the color element. The block differential DC data is relative to the first block of the image fragment, and is a difference between DC data of IB0,0 and RBi, 0. The relative block position data also refers to the relative position of the block when the first block of the image fragment is referenced.

In the additional data field of the absolute indicator and the relative indicator, data for accelerating the decoding of the image block is inserted.

7 is a flowchart illustrating a digital image processing method of a mobile terminal according to an embodiment of the present invention. This embodiment describes a process of performing an image processing such as zooming or scrolling a specific image in an image viewer.

Referring to FIG. 7, when a specific command is input from the user input unit 130 while performing a whole view of a specific image, the controller 180 checks whether the input command corresponds to a start scenario (S310 to S). S330). For example, when performing a album view, if a user wants to check a detail of a specific photo by searching, the user may first input an image enlargement command through the user input unit 130.

As a result of the check, if the input command corresponds to a start scenario, the controller 180 checks whether a first view image is required (S340).

When the first view image is requested in step S340, the image processor 182 decodes the thumbnail image included in the image file under the control of the controller 180 (S350).

Subsequently, the image processor 182 scales the decoded thumbnail image to the screen size (resolution) of the display unit 151 (S360).

If the first view image is not required in step S340, the image processor 182 decodes an indicator for the image fragment according to the start scenario (S380). That is, the image processor 182 decodes the indicator of the image fragment predefined in the current step according to the start scenario.

After decoding of the indicator is performed, the image processor 182 decodes the image fragment corresponding to the decoded indicator (S390). In terminals with poor user interfaces and limited screens, resource-intensive image fragments are decoded according to predefined structure indicators.

When decoding of the image fragment is completed, the image processing unit 182 displays the decoded image fragment on the display unit 151 (S370). In other words, the image processor 182 transmits the decoded image fragment to the display buffer 151a. The display unit 151 displays the decoded image fragment stored in the display buffer 151a on the screen.

If the input command in step S330 does not correspond to a scenario, the controller 180 controls the image processor 182 to decode an arbitrary image fragment (S400). Subsequently, the image processor 182 displays the decoded image fragment on a display screen (S370).

In this case, the image processor 182 stores the decoded image fragment in the cache memory 161 and then uses the image data stored in the cache memory 161 during image processing.

In addition, the image processor 182 updates the image data stored in the cache memory 161. For example, image data close to the image fragment currently displayed on the display screen is stored, and if not, close to the image data. The proximity image data is a collection of image fragments that are likely to be displayed by the next user command.

8 is a flowchart illustrating a method of decoding an arbitrary image fragment in a mobile terminal according to an embodiment of the present invention.

If the command input by the user in step S330 of FIG. 7 is not a command corresponding to the scenario, an arbitrary image fragment is required (S410).

The image processor 182 plans a method for forming the required image fragment (S420).

If a method for forming the image fragment is planned, the image processing unit 182 obtains at least one or more image sub fragments to form the required image fragment (S430).

There are three ways to obtain an image subfragment for generating the required image fragment.

First, a display buffer image sub-fragment (DBISF) is obtained from the display buffer 151a having the image sub fragments generated in the previous step.

Second, a cache memory image sub-fragment (CMISF) may be obtained from the cache memory 161 storing the image sub-fragments decoded in the preceding step. The resolution of the image sub fragments stored in the cache memory 161 is one of the basic scale levels of the image resolution, and if the expression condition is not satisfied at this stage, the resolution may be reduced to down sampling.

Finally, a decoded image sub-fragment (DISF), i.e., a new image sub-fragment, is obtained through sub-fragment decoding.

Through the above methods, the image processor 182 obtains three image subfragments and generates a desired image fragment using the obtained image subfragments (S440). Here, the image processor 182 operates in one of two operation modes. The operation mode includes a zoom mode and a scrolling mode.

When the operation mode is the zoom mode, the image processor 182 uses the newly decoded image subfragment among the three input image subfragments and the image subfragment stored in the cache memory. The image processor 182 adjusts the two image sub fragments based on one scaling grid.

Meanwhile, when the operation mode is the scrolling mode, the image processor 182 generates an image fragment using the newly decoded image subfragment among the three input image fragments and the image subfragment stored in the display buffer. . The two image subfragments are adjusted and assembled based on a previously defined scale grid.

9 is a flowchart illustrating a method of processing an image sub fragment in a mobile terminal according to an embodiment of the present invention.

First, the image processor 182 acquires start block data of a requested image fragment (S431), and determines a basic scale level for decoding of the requested image sub fragment (S432).

When the base scale level is determined, the image processor 182 performs decoding of the requested image sub fragment under the determined base scale level (S433). Here, the image processor 182 stores the information about the decoded block in the memory 160. The information about the decoded block includes an image block indicator, a DC coefficient for the color component of the block, and additional information for accelerating image block decoding.

According to an embodiment of the present invention, the above-described method may be embodied as computer readable codes on a medium in which a program is recorded. The computer-readable medium includes all kinds of recording devices in which data that can be read by a computer system is stored. Examples of the computer-readable medium include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, and the like, and also implemented in the form of a carrier wave (for example, transmission over the Internet) . In addition, the computer may include the controller 180 of the terminal.

The above-described mobile terminal is not limited to the configuration and method of the above-described embodiments, the embodiments may be configured by selectively combining all or part of each embodiment so that various modifications can be made. It may be.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention.

2 is a flowchart illustrating a method of preparing an original image in a mobile terminal according to an embodiment of the present invention.

3 is a flowchart illustrating an original image preparation process of a mobile terminal according to another embodiment of the present invention.

4 is an exemplary diagram illustrating an original image and a derivative image thereof for efficient image representation using a start scenario in a mobile terminal according to an embodiment of the present invention.

5 is a structure of an image fragment associated with one embodiment of the present invention.

6A to 6C illustrate an indicator structure of an image block associated with one embodiment of the present invention.

7 is a flowchart illustrating a digital image processing method of a mobile terminal according to an embodiment of the present invention.

8 is a flowchart illustrating a method of decoding an arbitrary image fragment in a mobile terminal according to an embodiment of the present invention.

9 is a flowchart illustrating a method of processing an image subfragment in a mobile terminal according to an embodiment of the present invention.

[Explanation of symbols on the main parts of the drawings]

100: mobile terminal 110: wireless communication unit

120: A / V input unit 130: user input unit

140: sensing unit 150: output unit

160: memory 170: interface unit

180: control unit 190: power supply unit

Claims (15)

Obtaining an image; Generating a scenario for the acquired image; Generating at least one image fragment in accordance with the generated scenario; Generating an indicator for the generated image fragment; And storing the generated indicator together with the obtained image. The method of claim 1, wherein the acquiring the image comprises: A digital image processing method of a mobile terminal, characterized in that to receive a compressed image of the full resolution from a camera. The method of claim 1, wherein the acquiring the image comprises: Loading an image file from an internal memory or another terminal; And confirming whether the loaded image file includes an indicator for an image fragment. According to claim 3, In the step of checking whether the indicator included, And storing the loaded image file if the loaded image file includes an indicator. The method of claim 1, wherein the scenario generation step, And generating a scenario based on the acquired image parameter and the terminal parameter. The method of claim 5, wherein the image parameter, Digital image processing method of a mobile terminal, characterized in that it comprises an image size. The method of claim 5, wherein the terminal parameter, And a display resolution, a zoom step number, and a start position of the zoom step image. The method of claim 1, wherein the indicator generation step, Decoding the obtained image and displaying a temporary landmark on a boundary of the image fragment; Generating an indicator for the image fragment using the decoded image and the temporary landmark. Receiving a predetermined command while performing image viewing; Checking whether the input command corresponds to a scenario; Decoding the indicator for an image fragment of the selected image according to a scenario if the inputted command is a command corresponding to a scenario; And decoding the image fragment corresponding to the decoded indicator. The method of claim 9, wherein decoding the image fragment comprises: Receiving a plurality of image subfragments for generating the required image fragments; And forming the required image fragment by using the inputted plurality of image subfragments. The method of claim 10, wherein the plurality of image sub-snippets, Image subfragment from cache memory, image subfragment from display buffer, new decoded image subfragment. An input unit generating data corresponding to a user input; If a command is input through the input unit while the image to be viewed is selected, if the input command corresponds to a predefined scenario, the indicator for the required image fragment of the selected image is decoded according to the scenario. A control unit for decoding an image fragment mapped to the decoded indicator; A display unit including a buffer for temporarily storing the decoded image fragment and displaying an image fragment stored in the buffer; And a memory for storing the decoded image fragment. The method of claim 12, wherein the indicator, A first indicator for the first block of the image fragment, And a second indicator for a first block of predetermined row blocks of the image fragment. The method of claim 13, wherein the first indicator, A mobile terminal comprising block DC data, block position data, and additional data. The method of claim 13, wherein the second indicator, And block differential DC data, relative block position data, and additional data relative to the first block of the image fragment.

Images