KR101658999B1 - Signal processing apparatus and method thereof - Google Patents

Abstract

The present invention relates to a signal processing apparatus and method for grouping corresponding images into group images when similarity between arbitrary plural images is smaller than a preset threshold based on meta information. To this end, a signal processing method according to the present invention includes: checking the similarity between a plurality of images; Comparing the identified similarity with a predetermined threshold value; And grouping and displaying corresponding images related to the degree of similarity when the degree of similarity between the images is smaller than the predetermined threshold value as a result of the comparison.

Signal processing device, image, thumbnail, similarity, meta information, photographing information

Description

[0001] SIGNAL PROCESSING APPARATUS AND METHOD THEREOF [0002]

The present invention relates to a signal processing apparatus and a method thereof.

2. Description of the Related Art Generally, a signal processing apparatus is a device that performs predetermined signal processing on various input data.

An object of the present invention is to provide a method and apparatus for comparing the similarities of arbitrary plural images based on meta information (including photographing information and authoring information), and when the arbitrary plural images are similar, And a method thereof.

Another object of the present invention is to provide a signal processing apparatus and method for displaying a plurality of selected images in an area different from an area in which an existing screen is displayed when a plurality of grouped images are selected.

Yet another object of the present invention is to provide a signal processing apparatus and a method thereof for constructing an additional layer on an existing screen when a plurality of grouped images are selected and displaying the selected plurality of images on the additional layer I have to.

According to another aspect of the present invention, there is provided a signal processing method comprising: confirming a degree of similarity between a plurality of images; Comparing the identified similarity with a predetermined threshold value; And grouping and displaying corresponding images related to the degree of similarity when the degree of similarity between the images is smaller than the predetermined threshold value as a result of the comparison.

According to an aspect of the present invention, there is provided a signal processing apparatus comprising: a control unit for grouping corresponding images related to the similarity when a similarity degree between a plurality of images is less than a preset threshold value; And a display unit for displaying the grouped images.

A signal processing apparatus and method according to an embodiment of the present invention compares the similarities of arbitrary plural images based on meta information (including photographing information and authoring information), and when the arbitrary plural images are similar, There is an effect that a plurality of displayed images can be displayed more simply by grouping and displaying a plurality of arbitrary images.

In addition, a signal processing apparatus and method thereof according to an embodiment of the present invention can display a plurality of selected images in an area different from an area in which an existing screen is displayed, The layer is formed and the selected plurality of images are displayed on the additional layer, thereby improving the user's convenience.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings, wherein like or corresponding elements are denoted by the same reference numerals, and a duplicate description thereof will be omitted.

1 is a block diagram showing a configuration of a mobile terminal 100 for explaining a signal processing apparatus according to an embodiment of the present invention.

The mobile terminal 100 may be implemented in various forms. For example, the mobile terminal 100 may be a cellular phone, a smart phone, a notebook computer, a digital broadcasting terminal, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player), a navigation , And so on.

1, the mobile terminal 100 includes a wireless communication unit 110, an A / V input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, A memory 160, an interface unit 170, a control unit 180, a power supply unit 190, and the like. Not all of the components of the mobile terminal 100 shown in Fig. 1 are essential components, and the mobile terminal 100 may be implemented by more components than the components shown in Fig. 1, The mobile terminal 100 may be implemented.

The wireless communication unit 110 may include at least one component for performing wireless communication between the mobile terminal 100 and the wireless communication system or wireless communication between the mobile terminal 100 and the network on which the mobile terminal 100 is located have. For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short range communication module 114 and a location information module 115 .

The broadcast receiving module 111 receives broadcast signals and / or broadcast-related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel, a terrestrial channel, and the like. The broadcast management server may be a server for generating and transmitting broadcast signals and / or broadcast related information, or a server for receiving previously generated broadcast signals and / or broadcast related information and transmitting the broadcast signals and / or broadcast related information to the mobile terminal 100. The broadcast-related information may refer to a broadcast channel, a broadcast program, or information related to a broadcast service provider. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and a broadcast signal in which a data broadcast signal is combined with a TV broadcast signal or a radio broadcast signal.

Meanwhile, the broadcast related information may be provided through a mobile communication network, and in this case, it may be received by the mobile communication module 112. The broadcast-related information may exist in various forms. For example, an EPG (Electronic Program Guide) of DMB (Digital Multimedia Broadcasting) or an ESG (Electronic Service Guide) of Digital Video Broadcast-Handheld (DVB-H).

The broadcast receiving module 111 receives broadcasting signals using various broadcasting systems. In particular, the broadcasting receiving module 111 may be a Digital Multimedia Broadcasting-Terrestrial (DMB-T), a Digital Multimedia Broadcasting-Satellite (DMB-S) Only Digital Broadcast-Handheld (DVB-H), Integrated Services Digital Broadcast-Terrestrial (ISDB-T), and the like. Of course, the broadcast receiving module 111 is configured to be suitable for all broadcasting systems that provide broadcasting signals as well as the digital broadcasting system described above. The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

The mobile communication module 112 transmits and receives a radio signal to at least one of a base station, an external terminal, and a server on a mobile communication network. Here, the wireless signal may include various types of data related to transmission and reception of a voice call signal, a video call signal, and / or a text / multimedia message.

The wireless Internet module 113 refers to a module for wireless Internet access, and the wireless Internet module 113 can be embedded in the mobile terminal 100 or externally. Here, the wireless Internet technology includes a wireless LAN (WLAN), a Wi-Fi, a wireless broadband (Wibro), a WiMAX, a high speed downlink packet access (HSDPA) Can be used.

The short-range communication module 114 means a module for short-range communication. Here, as a short range communication technology, Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, etc. may be used .

The location information module 115 is a module for confirming or obtaining the location of the mobile terminal. As an example, there is a GPS module. The GPS module receives position information from a plurality of satellites. Here, the location information may include coordinate information indicated by latitude and longitude. For example, the GPS module can accurately calculate the current position according to the triangulation method by measuring the correct time and distance from three or more satellites and measuring three different distances. A method of obtaining distance and time information from three satellites and correcting the error by one satellite may be used. In particular, the GPS module can acquire latitude, longitude and altitude as well as three-dimensional velocity information and accurate time from the position information received from the satellite. As the position information module 115, a Wi-Fi Positioning System and / or a Hybrid Positioning System may be applied.

The A / V input unit 120 is for inputting an audio signal or a video signal. The A / V input unit 120 includes a camera 121 and a microphone 122, . The camera 121 processes an image frame such as a still image or a moving image obtained by the image sensor in the video communication mode or the photographing mode. The processed image frame can be displayed on the display unit 151. [

The image frame processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. [ The camera 121 may be composed of two or more according to the configuration of the mobile terminal and / or the usage environment.

The microphone 122 receives an external sound signal by a microphone in a communication mode, a recording mode, a voice recognition mode, and the like, and processes it as electrical voice data. In the call mode, the processed voice data can be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 112 and output. The microphone 122 may be implemented with various noise reduction algorithms for eliminating noise generated in the process of receiving an external sound signal.

The user input unit 130 generates input data for a user to control the operation of the mobile terminal. The user input unit 130 may include a key pad, a dome switch, a touch pad (static / static), a jog wheel, a jog switch, and the like.

The sensing unit 140 may sense the position of the mobile terminal 100 such as the open / close state of the mobile terminal 100, the position of the mobile terminal 100, the presence of the user, the orientation of the mobile terminal 100, 100, and generates a sensing signal for controlling the operation of the mobile terminal 100. For example, when the mobile terminal 100 is in the form of a slide phone, it is possible to sense whether the slide phone is opened or closed. The sensing unit 140 senses whether the power supply unit 190 is powered on, whether the interface unit 170 is connected to an external device, and the like. Meanwhile, the sensing unit 140 may include a proximity sensor 141.

The output unit 150 is for outputting an audio signal (or a signal related to auditory sense) or a video signal (or a signal related to time) or an alarm signal or a signal related to a tactile sense. The display unit 151, the sound output module 152, the alarm unit 153, the haptic module 154, and the like.

The display unit 151 displays (or outputs) the information processed by the mobile terminal 100. For example, when the mobile terminal 100 is in the call mode, a UI (User Interface) or GUI (Graphic User Interface) associated with a call is displayed. If the mobile terminal 100 is in the video communication mode or the photographing mode, the captured image and / or the received image or UI and GUI are displayed.

The display unit 151 may be a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED) (Flexible Display), and a 3D display (3D Display).

Some of these displays may be transparent or light transmissive so that they can be seen through. This can be referred to as a transparent display, and a typical example of the transparent display is TOLED (Transparent OLED) and the like. The rear structure of the display unit 151 may also be of a light transmission type. With this structure, the user can see an object located behind the terminal body through the area occupied by the display unit 151 of the terminal body.

There may be two or more display units 151 according to the embodiment of the mobile terminal 100. For example, the plurality of display units may be spaced apart from one another (on the same surface) or arranged integrally with the mobile terminal 100, and may be disposed on different surfaces, respectively.

Meanwhile, the display unit 151 is connected to a touch screen (hereinafter, referred to as 'touch screen') in which a sensor (hereinafter, referred to as 'touch sensor' May be used as an input device in addition to the output device. The touch sensor may take the form of, for example, a touch film, a touch sheet, a touch pad, a touch panel, or the like.

The touch sensor may be configured to convert a pressure applied to a specific portion of the display unit 151 or a change in capacitance generated in a specific portion of the display unit 151 to an electrical input signal. The touch sensor can be configured to detect not only the position and area to be touched but also the pressure at the time of touch. If there is a touch input to the touch sensor, the corresponding signal (s) is sent to a touch controller (not shown). The touch controller processes the signal (s) and transmits the corresponding data to the controller 180. Thus, the control unit 180 can know which area of the display unit 151 is touched or the like.

The proximity sensor 141 may be disposed in an inner region of the mobile terminal 100 or in the vicinity of the touch screen, which is surrounded by the touch screen. The proximity sensor 141 refers to a sensor that detects the presence of an object approaching a predetermined detection surface or an object existing in the vicinity thereof without mechanical contact by using electromagnetic force or infrared rays. The proximity sensor 141 has a longer lifetime and higher utilization than the contact-type sensor.

Examples of the proximity sensor 141 include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor. And to detect the proximity of the pointer by the change of the electric field along the proximity of the pointer when the touch screen is electrostatic. In this case, the touch screen (touch sensor) may be classified as a proximity sensor.

Hereinafter, for convenience of explanation, the act of recognizing that the pointer is positioned on the touch screen while the pointer is not in contact with the touch screen is referred to as "proximity touch" The act of actually touching the pointer on the screen is called "Contact Touch ". A position where the pointer is proximally touched on the touch screen means a position where the pointer corresponds to the touch screen vertically when the pointer is touched.

Further, the proximity sensor 141 detects a proximity touch and a proximity touch pattern (for example, a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, do. Information corresponding to the detected proximity touch operation and the proximity touch pattern may be output on the touch screen.

The sound output module 152 outputs audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, and a broadcast reception mode. The sound output module 152 outputs an acoustic signal related to functions (e.g., call signal reception sound, message reception sound, etc.) performed in the mobile terminal 100. The audio output module 152 may include a receiver, a speaker, a buzzer, and the like.

The alarm unit 153 outputs a signal for notifying the occurrence of an event of the mobile terminal 100. Examples of events generated in the mobile terminal 100 include a call signal reception, a message reception, a key signal input, a touch input, and the like. The alarm unit 153 may output a signal for informing occurrence of an event in a form other than an audio signal or a video signal, for example, vibration. When the call signal is received or the message is received, the alarm unit 153 may vibrate the mobile terminal 100 via the vibration means. Alternatively, when the key signal is input, the alarm unit 153 may vibrate the mobile terminal 100 through the vibration means with the feedback of the key signal input. Through the above-described vibration, the user can recognize the occurrence of the event. Of course, a signal for notifying the occurrence of an event may also be output through the display unit 151 or the audio output module 152 so that they 151 and 152 may be classified as a part of the alarm unit 153.

The haptic module 154 generates various tactile effects that the user can feel. A typical example of the haptic effect generated by the haptic module 154 is vibration. The intensity and pattern of the vibration generated by the haptic module 154 are controllable. For example, different vibrations may be synthesized and output or sequentially output.

In addition to vibration, the haptic module 154 may include a pin arrangement vertically moving with respect to the contact skin surface, a spraying force or suction force of air through the injection port or the suction port, a spit on the skin surface, contact with an electrode, And various effects of tactile effect such as effect of reproducing the cold sensation using the heat absorbing or heatable element can be generated.

The haptic module 154 can transmit a tactile effect through direct contact, and the tactile effect can be felt by a user through a muscular sense such as a finger or an arm. The haptic module 154 may include two or more haptic modules 154 according to the configuration of the mobile terminal 100. [

The memory 160 may store a program for processing and control of the controller 180 and may have a function for temporarily storing input / output data (e.g., a phone book, a message, a still image, . ≪ / RTI > The memory 160 may store data related to vibrations and sounds of various patterns that are output upon touch input on the touch screen.

The memory 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory) A random access memory (SRAM), a read only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a programmable read-only memory (PROM) A disk, and / or an optical disk. In addition, the mobile terminal 100 may operate in association with the web storage or operate web storage that performs a storage function of the memory 150 on the Internet.

The interface unit 170 serves as an interface with all external devices connected to the mobile terminal 100. For example, the interface unit 170 may include a headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device having an identification module, An audio input / output (I / O) port, a video I / O (input / output) port, and an earphone port. Here, the identification module is a chip that stores various information for authenticating the use right of the mobile terminal 100, and includes a user identification module (UIM), a subscriber identity module (SIM) A Universal Subscriber Identity Module (USIM), and the like. In addition, the device having the identification module (hereinafter, referred to as 'identification device') can be manufactured in a smart card format. Accordingly, the identification module can be connected to the mobile terminal 100 through the port. The interface unit 170 receives data from an external device or receives power from the external device and transmits the received data to each component in the mobile terminal 100 or transmits data in the mobile terminal 100 to an external device.

When the mobile terminal 100 is connected to an external cradle, the interface unit 170 may be a path through which power from the cradle is supplied to the mobile terminal 100, or various commands A signal may be transmitted to the mobile terminal 100. The various command signals or the power source inputted from the cradle may be operated as a signal for recognizing that the mobile terminal 100 is correctly mounted on the cradle.

The controller 180 typically controls the overall operation of the mobile terminal 100. For example, the control unit 180 performs related control and processing for voice call, data communication, video call, and the like. In addition, the controller 180 may include a multimedia module 181 for multimedia playback. The multimedia module 181 may be implemented in the control unit 180 or may be implemented separately from the control unit 180.

The control unit 180 can perform a pattern recognition process for recognizing handwriting input or drawing input performed on the touch screen as characters and images, respectively.

The power supply unit 190 receives an external power source and an internal power source under the control of the controller 180 and supplies power required for operation of the respective components.

The functions of the components applied to the mobile terminal 100 may be implemented in a computer-readable recording medium using software, hardware, or a combination thereof. According to a hardware implementation, a plurality of application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs) A control unit, a micro-controller, a microprocessor, and an electric unit for performing a function. In some cases, such embodiments may be implemented by the controller 180. According to a software implementation, embodiments such as procedures or functions may be implemented with separate software modules that perform at least one function or operation. The software code may be implemented by a software application written in a suitable programming language. The software codes may also be stored in the memory 160 and executed by the control unit 180. [ In addition, the navigation session 300 applied to the mobile terminal 100 provides a general navigation function.

Meanwhile, the control unit 180 applied to the mobile terminal 100 according to an embodiment of the present invention checks the mutual similarities between the plurality of images, and when each of the similarities is smaller than a predetermined threshold value, So that the images can be grouped into one group and displayed.

2 is a block diagram illustrating a configuration of a telematics terminal 200 for explaining a signal processing apparatus according to an embodiment of the present invention. As shown in FIG. 2, a central processing unit (Central Processing unit (CPU) 222, a key control unit 221 for controlling various key signals, an LCD control unit 223 for controlling the LCD, and a main board having a memory 224 for storing various kinds of information 220).

The memory 224 stores map information (map data) for displaying vehicle guidance information (road guidance information for guiding the user while driving or not driving) on the map of the display unit (or LCD)

The memory 224 stores various information for controlling the traffic information collection control algorithm and a traffic information collection control algorithm that allows the vehicle to input traffic information according to the current road conditions.

The main board 220 includes a communication module 201 for performing voice communication and data transmission / reception through a mobile communication terminal provided with a unique device number, A GPS module 202 for receiving a GPS signal for route tracking and generating current position data of the vehicle based on the received GPS signal or transmitting traffic information collected by a user as a GPS signal, A gyro sensor 203 for detecting a traveling direction, a CD deck 204 for reproducing a signal recorded on a compact disc (CD), and the like.

The communication module 201 and the GPS module 202 transmit / receive signals through the first antenna 205 and the second antenna 206, respectively.

The main board 220 is connected to a TV module 230 that receives a broadcast signal through a broadcast signal antenna (or TV antenna) 231.

The main board 220 is connected to a liquid crystal display (LCD) 211 under the control of the LCD controller 223 through an interface board 213.

After the LCD 211 receives the broadcast signal received through the TV module 230, the LCD controller 223 controls the signal processing of the broadcast signal, 213 and outputs the video signal to the LCD 211 through the amplifier 254 under the control of the audio board 240 to be described later. In addition, the LCD 211 displays various video signals and character signals based on the control signal of the LCD control unit 223.

Also, the LCD 211 may be configured to receive input from a user using a touch screen method.

The main board 220 is connected to the front board 212 under the control of the key controller 221 through the interface board 213. The front board 212 constitutes a button and a menu for inputting various key signals and provides a key signal corresponding to a key (or a button) selected by the user to the main board 220. In addition, the front board 212 may include a menu key for directly inputting traffic information, and the menu key may be controlled by the key controller 221.

The audio board 240 is connected to the main board 220 and processes various audio signals. The audio board 240 includes a microcomputer 244 for controlling the audio board 240, a tuner 243 for receiving a radio signal through an antenna (or a radio antenna) 245, A power supply unit 242 for supplying power to the microcomputer 244 and a signal processing unit 241 for performing signal processing for outputting various audio signals.

The audio board 240 is connected to a radio antenna 245 for receiving radio signals and a tape deck 246 for reproducing audio tapes.

The audio board 240 is connected to an amplifier 254 for outputting a signal processed by the audio board 240.

The amplifier 254 is also connected to the vehicle interface 250. That is, the main board 220 and the audio board 240 are connected to the vehicle interface 250, respectively. The vehicle interface 250 includes a handsfree 251 for inputting a voice signal without using the hands of the vehicle operator, an airbag 252 for providing safety for the occupant, a speed sensor 251 for detecting the speed of the vehicle, (253), and the like.

The speed sensor 253 calculates the vehicle speed and provides the calculated vehicle speed information to the central processing unit 222. [

In addition, the navigation session 300 applied to the telematics terminal 200 provides a general navigation function.

Meanwhile, the central processing unit 222 applied to the telematics terminal 200 according to the embodiment of the present invention checks the mutual similarity between a plurality of images, and when each of the similarities is smaller than a predetermined threshold value, Images related to the degree of similarity can be grouped into a group and displayed.

Hereinafter, the configuration of a signal processing apparatus according to an embodiment of the present invention will be described with reference to FIG. Here, the signal processing apparatus may be a smart phone, a portable terminal, a mobile terminal, a personal digital assistant (PDA), or the like, as well as the mobile terminal 100 and the telematics terminal 200. [ PDA, a personal computer, a notebook computer, a Wibro terminal, an IPTV terminal, a telematics terminal, a navigation terminal, an AVN (Audio Video Navigation) terminal, a camera ), And the like.

3, the signal processing apparatus 400 includes an input unit 410, a storage unit 420, a control unit 430, and a control unit 430. The input unit 410, the storage unit 420, A display unit 440, an audio output unit 450, and a communication unit 460.

The input unit 410 receives input of a button operation by the user, or receives an instruction or a control signal by an operation such as touching / scrolling the displayed screen.

The input unit 410 may be a variety of devices such as a keypad, a touch screen, a jog shuttle, a microphone, and a mouse.

The input unit 410 may include a microphone (not shown) and / or a camera (not shown), and receive voice and / or image information of the user through the microphone and / or the camera.

The storage unit 420 stores various user interface (UI) and / or graphical user interface (GUI).

The storage unit 420 stores data and programs necessary for the signal processing apparatus 400 to operate.

In addition, the storage unit 420 stores a plurality of images. At this time, the image may be an image of an original size photographed through a camera or the like, or may be a thumbnail. Also, the image may be an image produced through an image authoring program such as a photoshop, an illustrator, or the like.

In addition, the storage unit 420 stores meta information included in each of the plurality of images. In this case, the meta information means related information when photographing the image through a camera or the like, or related information when the image is produced through an image authoring program or the like. That is, the meta information includes at least one of a device name, a shooting date, a shooting time, an aperture value, a shooting mode, a shutter speed, an ISO value (or practical sensitivity value), a focal distance, (Including the image size of the image file), image file format (including image size), image size (including image size), image size (including spot light metering, center-weighted average metering, Image file name, and the like.

In addition, the resolution may be selected from the group consisting of CIF (Common Intermediate Format), QCIF (Quarter Common Intermediate Format), QCIF +, Quarter Quarter Common Intermediate Format (QQCIF), Video Graphics Array (VGA), Quarter Video Graphics Array (QVGA) Quarter Video Graphics Array (SVGA), Extended Graphics Array (SVGA), Super Extended Graphics Array (SXGA), SXGA +, WSXGA (Wide SXGA), WSXGA + (WSXGA), Quadruple Extended Graphics Array UXGA (Ultra Extended Graphics Array), UWXGA (Ultra Wide Extended Graphics Array), and the like.

The image file format may be a BMP, RLE, JPG, JPEG, GIF, PNG, PDS, PDD, TIF, PDF, RAW, AI, EPS, SVG, SVGZ, IFF, FPX, FRM, PCX, PXR, SCT, TGA, VDA, ICB, VST, and the like.

In addition, the storage unit 420 stores data (information or control signals) transmitted from an information providing center or a mobile terminal connected by wire / wireless communication.

The control unit 430 executes an overall control function of the signal processing device 400. [

The control unit 430 displays a plurality of images stored in the storage unit 420 on the display unit 440.

In addition, the controller 430 may determine similarity between the plurality of images among the plurality of images stored in the storage unit 420, group the images determined to be similar, and display the grouped images on the display unit 440).

When the grouped images displayed on the display unit 440 are selected, the controller 430 displays at least two or more images included in the selected grouped image on one side of the display unit 440 Or overlaps with an image that has been displayed, and is displayed on the display unit 440. In addition, when the selected grouped image is displayed, the control unit 430 forms an additional layer on the existing image displayed on the display unit 440, It may be controlled to display a plurality of images.

The control unit 430 may store the image and the grouped image information displayed on the display unit 440 in the storage unit 420 or may be connected to an arbitrary terminal connected through the communication unit 460 Lt; / RTI >

The display unit 440 may display various contents such as various menu screens by using the user interface and / or graphical user interface included in the storage unit 420 under the control of the controller 430. [ Here, the content displayed on the display unit 440 includes various text or image data (including map data and various information data), a menu screen including data such as an icon, a list menu, and a combo box. Also, the display unit 440 may be a touch screen.

Also, the display unit 440 displays a plurality of images stored in the storage unit 420 under the control of the controller 430.

In addition, the display unit 440 displays an image grouped by the control of the controller 430. At this time, the displayed grouped image may display the number of images included in the grouped image together on one side of the displayed grouped image.

In addition, when displaying the grouped image, the display unit 440 may display the remaining images excluding the images included in the grouped image among the displayed plurality of images, and the representative image selected from the grouped images together Display.

For example, the image included in the plurality of images may include a first image, a second image, a third image, a fourth image, ..., an Nth image, and the like, The second image, and the third image, the display unit 440 displays the remaining images (the fourth image, the fifth image, and the third image) except for the first through third images included in the grouped image among the plurality of images, , ..., Nth image) and a representative image of the grouped image (e.g., the first image among the first to third images).

The audio output unit 450 outputs audio information included in the signal processed by the control unit 430. Here, the audio output unit 450 may be a speaker.

The communication unit 460 may include a wireless Internet module or a local area communication module. Here, the wireless Internet module may include WLAN, WiFi, WiBro, WiMAX, HSDPA, and the like. The local communication module may include Bluetooth, RFID, infrared communication, UWB, ZigBee, and the like.

The signal processing apparatus 400 may further include a universal antenna for performing communication with an external terminal through a wired / wireless communication network and transmitting / receiving signals in various frequency bands.

Hereinafter, a signal processing method according to the present invention will be described in detail with reference to FIGS. 1 to 8. FIG.

4 is a flowchart illustrating a signal processing method according to the first embodiment of the present invention.

First, the control unit 430 displays a plurality of images stored in the storage unit 420 on the display unit 440. When the predetermined first button provided on the signal processing apparatus 400 or the predetermined second button displayed on the display unit 440 is clicked, the controller 430 displays the selected button on the display unit 440 (Or calculates) the degree of similarity between images based on the meta information included in each of the plurality of images.

The control unit 430 controls the display unit 440 to display the plurality of images stored in the storage unit 420 on the display unit 440, When the second button displayed on the display unit 440 is clicked, the similarity between the images may be checked on the basis of the meta information included in each of the plurality of images stored in the storage unit 420.

The meta information included in the image includes at least one of a device name, a shooting date, a shooting time, an aperture value, a shooting mode, a shutter speed, an ISO value (or practical sensitivity value) , Image file format, and image file name), application program name (image authoring program name), storage time, resolution (including horizontal and vertical size information of the image file) .

For example, with respect to the first and second meta information included in the first and second images included in the plurality of images, the controller 430 determines whether at least one component included in the first meta information (For example, the first shooting date, the first shooting time, the first aperture value, and the first shutter speed information) and at least one component included in the second meta information corresponding to the first meta information (Including, for example, the second photographing date (corresponding to the first photographing date information), the second photographing time, the second stop value, and the second shutter speed information). That is, the control unit 430 determines whether or not the first difference value between the first shooting date and the second shooting date, the second difference value between the first shooting time and the second shooting time, And a fourth difference value between the first shutter speed and the second shutter speed are respectively calculated. Here, the calculated first difference value, second difference value, third difference value, and fourth difference value are included in the degree of similarity (S110).

Thereafter, the controller 430 compares the determined similarity (or the calculated similarity) with a predetermined threshold value. At this time, the predetermined threshold may be set for each component included in the meta information corresponding to the meta information. That is, the predetermined threshold may be a first threshold (a threshold value corresponding to the shooting date) corresponding to the shooting date, the shooting time, the aperture value, and the shutter speed included in the first and second meta information, (A threshold corresponding to the photographing time), a third threshold (a threshold corresponding to the aperture value), and a fourth threshold (a threshold corresponding to the shutter speed).

For example, the controller 430 may calculate a first difference value, a second difference value, a third difference value, and a fourth difference value included in each of the identified similarities, Value, the second threshold value, the third threshold value, and the fourth threshold value, respectively. That is, the first difference value and the first threshold value, the second difference value and the second threshold value, the third difference value and the third threshold value, and the fourth difference value and the fourth threshold value (S120).

When the similarity degree is smaller than the preset threshold value, the control unit 430 groups the plurality of images related to the determined similarity degree into one group, as a result of the comparison between the determined similarity degree and the predetermined threshold value do. That is, a plurality of images related to the degree of similarity are set as one group image.

For example, the controller 430 determines that the first difference value is smaller than the first threshold value, the second difference value is smaller than the second threshold value, and the third difference value is smaller than the third threshold value And grouping the first image and the second image associated with the similarity including the difference values into one group when the fourth difference value is smaller than the fourth threshold value.

At this time, as in the above example, when comparing the similarity with the predetermined threshold value, it is determined whether all the components included in the similarity degree satisfy all the conditions of all the threshold values included in the predetermined threshold value can do.

Alternatively, the at least one component included in the similarity degree may be configured to determine whether or not the condition of the threshold value set in the corresponding component included in the predetermined threshold value is satisfied. That is, it is determined whether at least one of the first, second, third, and fourth difference values is smaller than at least one of the first, second, third, and fourth threshold values corresponding to the at least one It is also possible to configure it to judge. For example, the controller 430 may determine whether the first difference value is smaller than the first threshold value or the second difference value is smaller than the second threshold value (S130).

Then, the control unit 430 selects a representative image from among at least two images included in the grouped image.

For example, the controller 430 selects the first image as the representative image from the first and second images (or a plurality of images) included in the grouped image. The representative image selection may be configured to be selected based on the meta information. For example, an image having the fastest shooting time among the images included in the grouped image may be selected as the representative image (S140).

Then, the control unit 430 displays the remaining images excluding the images included in the grouped image among the plurality of images and the selected representative image on the display unit 440.

For example, as shown in FIG. 5, the control unit 430 may include first and second images in the grouped image among a plurality of images (including first image to Nth image), and the grouped image Is selected as the first image, the sixth to ninth images are included in another grouped image, and the representative image of the another grouped image is selected as the sixth image, The third image, the fourth image, the fifth image, ..., the tenth image, the eleventh image, ..., the first image, the second image, and the sixth through ninth images, The first image 502 and the sixth image 503 selected by the representative image 501 and the representative image are displayed on a partial area 511 on the display unit 440.

In addition, when the representative image is displayed on the display unit 440, the controller 430 may display the number of images included in the grouped image together on one side of the representative image.

For example, as shown in FIG. 5, the controller 430 may control the number of images included in the grouped image to be displayed 504 on one side of the representative image (S150).

6A, when the grouped image is selected from among the images displayed on the display unit 440, the controller 430 displays at least two or more images included in the selected grouped image, And is displayed on a portion 512 on the display unit 440. At this time, another image 511 on the display unit 440 displays the remaining images excluding the images included in the grouped image among the plurality of images, and the selected representative image (the screen shown in FIG. 5) .

6B, when the grouped image is selected from among the images displayed on the display unit 440, the controller 430 displays at least two or more images included in the selected grouped image, A new layer may be formed in a state where an existing image is displayed 511 and at least two or more images included in the selected grouped image may be displayed on the newly formed layer image 513 .

In addition, the method of displaying the grouped image on the display unit 440 is not limited to the above example, and may be variously implemented.

The control unit 430 may add an arbitrary image to a specific grouped image by using a user input, i.e., a drag and drop function, on the images displayed on the display unit 440 Alternatively, a specific image included in an arbitrary grouped image may be excluded (or deleted) from the arbitrary grouped image (S160).

As described above, the signal processing apparatus 400 can perform the processes for all the images stored in the storage unit 420, or for any images selected by the user among the plurality of images, Or any selected images), so that similar images for all of the images can be grouped and displayed on the display unit 440.

In addition, the signal processing apparatus 400 may use the meta information of the corresponding image among the continuous images (for example, a continuous shooting time, a continuous storage time, or a continuous file name) May be configured to determine the degree of similarity. That is, when a similar image is photographed or stored using a camera, an authoring program, or the like, similar images are sequentially stored in similar image names or stored in a similar time zone, It is possible to reduce the time required for judging the degree of similarity.

7 is a flowchart illustrating a signal processing method according to a second embodiment of the present invention.

First, the control unit 430 displays a plurality of images stored in the storage unit 420 on the display unit 440. When the predetermined first button provided on the signal processing apparatus 400 or the predetermined second button displayed on the display unit 440 is clicked, the controller 430 displays the selected button on the display unit 440 (Or calculates) the degree of similarity between the images based on the predetermined regions preset for the plurality of images.

The control unit 430 controls the display unit 440 to display the plurality of images stored in the storage unit 420 on the display unit 440, When the second button displayed on the display unit 440 is clicked, the degree of similarity between the images may be checked on the basis of the preset specific regions of the plurality of images stored in the storage unit 420. [

In addition, the preset specific area may include the entire area of the image or the partial area of the image for any image.

It is preferable that the similarity between the images is checked for the plurality of images by comparing a partial area or a whole area of the first image included in the plurality of images with the same area of the second image included in the plurality of images (An area corresponding to a partial area or an entire area of one image) and / or a surrounding area (an area including at least a part of the partial area or the entire area of the first image) .

For example, the controller 430 controls the first region of the first image included in the plurality of images and the second region of the second image (the region corresponding to the first region of the first image, (The same as the coordinates of the region) and the third region (the region including at least a portion of the first region of the first image). That is, the controller 430 calculates the difference value of the first pixel value between the first area and the second area. In addition, the controller 430 calculates the difference value of the second pixel value between the first area and the third area. When calculating the difference value of the pixel value between the first area and the third area, the controller 430 compares each of the plurality of area areas included in the third area with the first area, The difference between the first pixel value and the third pixel value may be calculated as a difference value between the first pixel value and the third pixel value. Here, the calculated difference value of the first pixel value or the calculated difference value of the second pixel value is included in the similarity. The minimum value or the maximum value among the calculated difference values of the first and second pixel values may be set as a difference value between the first image and the second image (or a difference value between the representative pixel values) .

In addition, when the similarity between the plurality of images is checked, the controller 430 directly compares the information of the original (original size) image or uses the information of the thumbnail image of the original image It may be configured to check the similarity between images (S210).

Thereafter, the controller 430 compares the determined similarity (or the calculated similarity) with a predetermined threshold value. At this time, the predetermined threshold may be set to include pixel values (including RGB values, YCbCr values, etc.)

For example, the controller 430 may compare the calculated difference value of the first pixel value with the preset threshold value or compare the difference value of the calculated second pixel value with the predetermined threshold value .

For example, the control unit 430 may compare the difference value of the representative pixel value (e.g., the difference value of the second pixel value) among the calculated difference values of the first and second pixel values with the predetermined threshold value (S220).

When the similarity degree is smaller than the preset threshold value, the control unit 430 groups the plurality of images related to the determined similarity degree into one group, as a result of the comparison between the determined similarity degree and the predetermined threshold value do. That is, a plurality of images related to the degree of similarity are set as one group image.

For example, when the difference value of the representative pixel value (for example, the difference value of the second pixel value) is smaller than the threshold value, the controller 430 controls the first image related to the difference value of the representative pixel value And the second images are grouped into one group (S230).

Then, the control unit 430 selects a representative image from among at least two images included in the grouped image.

For example, the controller 430 selects the first image as the representative image from the first and second images (or a plurality of images) included in the grouped image. The representative image selection may be selected based on first and second meta information included in the first and second images, respectively. For example, an image having the fastest shooting time among the images included in the grouped image may be selected as the representative image (S240).

Then, the control unit 430 displays the remaining images excluding the images included in the grouped image among the plurality of images and the selected representative image on the display unit 440.

For example, as shown in FIG. 5, the control unit 430 may include first and second images in the grouped image among a plurality of images (including first image to Nth image), and the grouped image Is selected as the first image, the sixth to ninth images are included in another grouped image, and the representative image of the another grouped image is selected as the sixth image, The third image, the fourth image, the fifth image, ..., the tenth image, the eleventh image, ..., the first image, the second image, and the sixth through ninth images, The first image 502 and the sixth image 503 selected by the representative image 501 and the representative image are displayed on a partial area 511 on the display unit 440.

In addition, when the representative image is displayed on the display unit 440, the controller 430 may display the number of images included in the grouped image together on one side of the representative image.

For example, as shown in FIG. 5, the controller 430 may control the number of images included in the grouped image to be displayed 504 on one side of the representative image (S250).

6A, when the grouped image is selected from the images displayed on the display unit 440, the controller 430 displays at least two or more images included in the selected grouped image, And is displayed on a portion 512 on the display unit 440. At this time, another image 511 on the display unit 440 displays the remaining images excluding the images included in the grouped image among the plurality of images, and the selected representative image (the screen shown in FIG. 5) .

6B, when the grouped image is selected from among the images displayed on the display unit 440, the controller 430 displays at least two or more images included in the selected grouped image, A new layer may be formed in a state where an existing image is displayed 511 and at least two or more images included in the selected grouped image may be displayed on the newly formed layer image 513 .

In addition, the method of displaying the grouped image on the display unit 440 is not limited to the above example, and may be variously implemented.

The control unit 430 may add an arbitrary image to a specific grouped image by using a user input, i.e., a drag and drop function, on the images displayed on the display unit 440 Alternatively, a specific image included in an arbitrary grouped image may be excluded (or deleted) from the arbitrary grouped image (S260).

8 is a flowchart illustrating a signal processing method according to the third embodiment of the present invention.

First, the control unit 430 displays a plurality of images stored in the storage unit 420 on the display unit 440. At this time, the displayed plurality of images may include a single image or a grouped image, as shown in FIG. 5 (S310).

The control unit 430 performs a grouping addition / deletion function on the image when any one of the plurality of images displayed on the display unit 440 is dragged and dropped by the user.

That is, after the first image among the plurality of images displayed on the display unit 440 is selected by the user input, the controller 430 displays the selected first image on the second image using the drag & The first image and the second image are grouped into one group. At this time, the representative image setting between the first image and the second image may use meta information included in each of the first and second images. In addition, the representative image setting between the first image and the second image may set the first image selected by the drag-and-drop function as the representative image.

In addition, the control unit 430 controls the display unit 440 to display a specific image selected from the grouped images among the plurality of images displayed on the display unit 440 using the drag & If it is located on the desktop (or a blank area where no other image or the like is displayed), the specific image is controlled to be deleted from the grouped image (S320).

In this manner, it is possible to configure to add or delete any image selected by using the drag-and-drop function for a plurality of images (including single image or grouped images) displayed on the display unit 440 to a specific group.

Those skilled in the art will appreciate that various modifications, additions and substitutions are possible, without departing from the essential characteristics of the invention. Therefore, the embodiments disclosed in the present invention are intended to illustrate rather than limit the scope of the present invention, and the scope of the technical idea of the present invention is not limited by these embodiments. The scope of protection of the present invention should be construed according to the following claims, and all technical ideas within the scope of equivalents should be construed as falling within the scope of the present invention.

1 is a block diagram illustrating a configuration of a mobile terminal for explaining a vehicle control apparatus according to an embodiment of the present invention.

2 is a block diagram illustrating a configuration of a telematics terminal for explaining a vehicle control apparatus according to an embodiment of the present invention.

3 is a block diagram showing a configuration of a signal processing apparatus according to an embodiment of the present invention.

4 is a flowchart illustrating a signal processing method according to the first embodiment of the present invention.

5 is a diagram illustrating a screen of a display unit according to an embodiment of the present invention.

6A and 6B are views illustrating screens of a display unit according to an embodiment of the present invention.

7 is a flowchart illustrating a signal processing method according to a second embodiment of the present invention.

8 is a flowchart illustrating a signal processing method according to the third embodiment of the present invention.

Claims (18)

Confirming the similarity between the plurality of images; Comparing the identified similarity with a predetermined threshold value; Wherein when the degree of similarity between the images is smaller than the predetermined threshold value, the first and second images corresponding to the similarity are grouped and displayed on the first display unit in an overlapping manner, Displaying the number of images together on one side of the displayed grouped image; And And displaying the first and second images included in the selected grouped image on the second display unit different from the first display unit so that they do not overlap when the grouped image displayed overlapping with the first display unit is selected And the signal processing method. 2. The method of claim 1, Wherein the degree of similarity between the first meta information of the first image included in the plurality of images and the second meta information of the second image included in the plurality of images is calculated. 3. The method of claim 2, wherein the first and second meta information comprises: A photographing date, a photographing time, an aperture value, and a shutter speed. 4. The apparatus of claim 3, wherein the predetermined threshold value includes first through fourth threshold values corresponding to the shooting date, shooting time, aperture value, and shutter speed, Wherein grouping and displaying the first and second images comprises: When the calculated similarity degree is smaller than the first to fourth threshold values with respect to the result of the comparison of the calculated similarity and the first to fourth threshold values, the shooting date, the shooting time, the aperture value, and the shutter speed, Grouping the first and second images; Selecting a representative image based on the meta information among the grouped first and second images; And And displaying the selected representative image and the remaining images excluding the first and second images from among the plurality of images. 2. The method of claim 1, A predetermined first region of the first image included in the plurality of images and a predetermined second region including at least a portion of the first region or the first region of the second image included in the plurality of images And calculating a difference value of pixel values between the corresponding regions. 6. The method of claim 5, wherein the comparing the identified similarity with the predetermined threshold comprises: And comparing the difference value of the calculated pixel value with the preset threshold value. The method of claim 6, wherein grouping and displaying the images comprises: When the difference between the calculated pixel value and the preset threshold value is less than the preset threshold value and the difference between the calculated pixel value is less than the preset threshold value, A grouping process; Selecting a representative image based on the meta information included in each of the grouped first and second images; And And displaying the selected representative image and the remaining images excluding the first and second images from among the plurality of images. The method of claim 1, wherein grouping and displaying the images comprises: And displaying the number of images included in the grouped image on one side of the grouped and displayed image. The method according to claim 1, If the displayed grouped image is selected, forming an additional layer on the screen on which the grouped image is displayed; Further comprising the step of displaying two or more images included in the selected grouped image on the formed additional layer. A controller for grouping first and second images corresponding to the similarity when the similarity between the plurality of images is smaller than a preset threshold value; And A first display unit for overlapping and displaying the grouped first and second images and displaying the number of images included in the grouped image together on one side of the displayed grouped image, And a display unit including a second display unit for displaying the selected first and second images so as not to overlap when the image is selected. 11. The apparatus according to claim 10, And calculates the similarity between the first meta information of the first image included in the plurality of images and the second meta information of the second image included in the plurality of images. 12. The method of claim 11, wherein the first and second meta information comprises: A photographing date, a photographing time, an aperture value, and a shutter speed. 13. The method of claim 12, wherein the predetermined threshold value includes first through fourth threshold values corresponding to the shooting date, shooting time, aperture value, and shutter speed, When the calculated similarity is smaller than the first to fourth threshold values in relation to the comparison result of the calculated similarity and the predetermined threshold value, the shooting date, the shooting time, the aperture value, and the shutter speed, , Grouping the first and second images related to the calculated similarity, and selecting representative images based on the meta information among the grouped first and second images. 11. The apparatus according to claim 10, A predetermined first region of the first image included in the plurality of images and a predetermined second region including at least a portion of the first region or the first region of the second image included in the plurality of images Calculates a difference value of pixel values between the corresponding regions, and compares the difference value of the calculated pixel values with a predetermined threshold value. 15. The apparatus of claim 14, Grouping the first and second images related to the calculated pixel value when the difference value of the calculated pixel value is smaller than the preset threshold value and grouping the first and second images related to the calculated pixel value into each of the grouped first and second images And the representative image is selected based on the meta information. 16. The apparatus as claimed in claim 13 or 15, And controls the display unit to display the remaining images excluding the first and second images among the plurality of images and the selected representative image. 11. The apparatus according to claim 10, And controls the display unit to display the number of images included in the grouped image on one side of the grouped and displayed image. 11. The apparatus according to claim 10, Wherein when the displayed grouped image is selected, an additional layer is formed on the screen on which the grouped image is displayed, and the display unit is controlled to display two or more images included in the selected grouped image on the formed additional layer And outputs the signal to the signal processing unit.

Images