KR20100131295A - Signal processing apparatus and method thereof - Google Patents

Abstract

PURPOSE: A signal processing apparatus and a method thereof are provided to group images when the images are similar, thereby displaying the images. CONSTITUTION: When similarity of an image is smaller than a preset threshold value, a controller groups images related to the similarity into one group(S120,S130). The controller selects a representative image among at least two images in the grouped image(S140). The controller displays the representative image and the other images except the grouped images on a display unit(S150).

Description

Signal processing apparatus and method thereof {SIGNAL PROCESSING APPARATUS AND METHOD THEREOF}

The present invention relates to a signal processing apparatus and a method thereof.

Generally, a signal processing apparatus is a device which processes predetermined input data.

An object of the present invention is to compare the similarity of any of a plurality of images on the basis of meta information (including shooting information, authoring information), and when the plurality of images are similar, grouping and displaying the plurality of images It is to provide a signal processing apparatus and a method thereof.

Another object of the present invention is to provide a signal processing apparatus and method for displaying a plurality of selected images in a region different from a region where an existing screen is displayed when a plurality of grouped images are selected.

It is still another object of the present invention to provide a signal processing apparatus and method for configuring an additional layer on an existing screen and displaying the selected plurality of images on the additional layer when a plurality of grouped images are selected. There is.

A signal processing method according to the present invention for achieving the above objects comprises the steps of: checking the similarity between a plurality of images; Comparing the checked similarity with a preset threshold; And when the similarity between the images is smaller than the preset threshold, as a result of the comparison, grouping and displaying corresponding images related to the similarity.

According to an aspect of the present invention, there is provided a signal processing apparatus including: a controller configured to group corresponding images related to the similarity when a similarity between a plurality of images is smaller than a preset threshold; And a display unit for displaying the grouped images.

The signal processing apparatus and method thereof according to an embodiment of the present invention compare the similarity of any of a plurality of images based on meta information (including photographing information and authoring information), and if the plurality of images are similar, By grouping and displaying an arbitrary plurality of images, there is an effect that a plurality of images to be displayed can be displayed more simply.

In addition, the signal processing apparatus and the method according to an embodiment of the present invention, when a plurality of grouped images are selected, displays the selected plurality of images in an area different from the area in which the existing screen is displayed, or add on the existing screen By configuring a layer to display the selected plurality of images on the additional layer, the user's convenience can be improved.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings, and the same or corresponding components will be denoted by the same reference numerals regardless of the reference numerals and redundant description thereof will be omitted.

1 is a block diagram showing a configuration of a mobile terminal 100 for explaining a signal processing apparatus according to an embodiment of the present invention.

The mobile terminal 100 may be implemented in various forms. For example, the mobile terminal 100 may be a mobile phone, a smart phone, a notebook computer, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), a navigation device (vehicle navigation device). , Etc.

As shown in FIG. 1, the mobile terminal 100 includes a wireless communication unit 110, an A / V input unit 120, a user input unit 130, a sensing unit 140, and an output unit 150. , A memory 160, an interface unit 170, a controller 180, a power supply unit 190, and the like. Not all components of the mobile terminal 100 shown in FIG. 1 are essential components, and the mobile terminal 100 may be implemented by more components than those shown in FIG. 1, and fewer components. The mobile terminal 100 may also be implemented.

The wireless communication unit 110 may include one or more components for performing wireless communication between the mobile terminal 100 and the wireless communication system or wireless communication between the mobile terminal 100 and the network in which the mobile terminal 100 is located. have. For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless internet module 113, a short range communication module 114, a location information module 115, and the like. .

The broadcast receiving module 111 receives a broadcast signal and / or broadcast related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel, a terrestrial channel, and the like. The broadcast management server may mean a server that generates and transmits a broadcast signal and / or broadcast related information or a server that receives a pre-generated broadcast signal and / or broadcast related information and transmits the same to the mobile terminal 100. The broadcast related information may mean information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast signal may include not only a TV broadcast signal, a radio broadcast signal, and a data broadcast signal, but also a broadcast signal having a data broadcast signal combined with a TV broadcast signal or a radio broadcast signal.

Meanwhile, the broadcast related information may be provided through a mobile communication network, and in this case, may be received by the mobile communication module 112. The broadcast related information may exist in various forms. For example, it may exist in the form of Electronic Program Guide (EPG) of Digital Multimedia Broadcasting (DMB) or Electronic Service Guide (ESG) of Digital Video Broadcast-Handheld (DVB-H).

The broadcast receiving module 111 receives broadcast signals using various broadcasting systems, and in particular, digital multimedia broadcasting-terrestrial (DMB-T), digital multimedia broadcasting-satellite (DMB-S), and media forward link (MediaFLO). Digital broadcast signals can be received using digital broadcasting systems such as only), digital video broadcast-handheld (DVB-H), integrated services digital broadcast-terrestrial (ISDB-T), and the like. Of course, the broadcast receiving module 111 is configured to be suitable for all broadcasting systems that provide broadcasting signals as well as the digital broadcasting system described above. The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

The mobile communication module 112 transmits and receives a radio signal with at least one of a base station, an external terminal, and a server on a mobile communication network. The wireless signal may include various types of data according to transmission and reception of voice call signals, video call signals, and / or text / multimedia messages.

The wireless internet module 113 refers to a module for wireless internet access, and the wireless internet module 113 may be embedded or external to the mobile terminal 100. Here, wireless Internet technologies include wireless LAN (WLAN), Wi-Fi, WiBro, WiMAX, World Interoperability for Microwave Access (WMAX), HSDPA (High Speed Downlink Packet Access), and the like. Can be used.

The short range communication module 114 means a module for short range communication. Here, as short range communication technology, Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, etc. may be used. .

The location information module 115 is a module for checking or obtaining the location of the mobile terminal. An example is a GPS module. The GPS module receives location information from a plurality of satellites. Here, the location information may include coordinate information represented by latitude and longitude. For example, the GPS module can measure the exact time and distance from three or more satellites and calculate three different distances accurately according to triangulation. A method of obtaining distance and time information from three satellites and correcting the error with one satellite may be used. In particular, the GPS module can obtain not only the location of latitude, longitude, and altitude but also accurate time together with the three-dimensional speed information from the location information received from the satellite. As the location information module 115, a Wi-Fi Positioning System and / or a Hybrid Positioning System may be applied.

The A / V input unit 120 is for inputting an audio signal or a video signal, and the A / V input unit 120 includes a camera 121 and a microphone 122. May be included. The camera 121 processes an image frame such as a still image or a video obtained by an image sensor in a video call mode or a photographing mode. The processed image frame may be displayed on the display unit 151.

The image frame processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. Two or more cameras 121 may be configured according to the configuration type and / or usage environment of the mobile terminal.

The microphone 122 receives an external sound signal by a microphone in a call mode, a recording mode, a voice recognition mode, etc., and processes the external sound signal into electrical voice data. In the call mode, the processed voice data may be converted into a form transmittable to the mobile communication base station through the mobile communication module 112 and output. The microphone 122 may implement various noise removing algorithms for removing noise generated in the process of receiving an external sound signal.

The user input unit 130 generates input data for the user to control the operation of the mobile terminal. The user input unit 130 may include a key pad, a dome switch, a touch pad (static pressure / capacitance), a jog wheel, a jog switch, and the like.

The sensing unit 140 may be a mobile terminal 100 such as an open / closed state of the mobile terminal 100, a location of the mobile terminal 100, a presence or absence of a user contact, an orientation of the mobile terminal 100, an acceleration / deceleration of the mobile terminal 100, or the like. The sensing state of the mobile terminal 100 generates a sensing signal for controlling the operation of the mobile terminal 100. For example, when the mobile terminal 100 is a slide phone type, it may sense whether the slide phone is opened or closed. In addition, the sensing unit 140 is responsible for sensing functions related to whether the power supply unit 190 is supplied with power, whether the interface unit 170 is coupled to an external device, and the like. The sensing unit 140 may include a proximity sensor 141.

The output unit 150 is for outputting an audio signal (or a signal related to hearing) or a video signal (or a signal related to time) or an alarm signal or a signal related to a tactile sense, and the output unit 150. ) May include a display unit 151, a sound output module 152, an alarm unit 153, and a haptic module 154.

The display unit 151 displays (or outputs) information processed by the mobile terminal 100. For example, when the mobile terminal 100 is in a call mode, the mobile terminal 100 displays a user interface (UI) or a graphic user interface (GUI) related to the call. When the mobile terminal 100 is in a video call mode or a photographing mode, the mobile terminal 100 displays a photographed and / or received image, a UI, or a GUI.

The display unit 151 may include a liquid crystal display (LCD), a thin film transistor liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), and a flexible display. It may include at least one of a flexible display and a 3D display.

Some of these displays may be configured as transparent or light transmissive so that they can be seen through them. This may be referred to as a transparent display. A representative example of the transparent display is TOLED (Transparant OLED). The rear structure of the display unit 151 may also be configured as a light transmissive structure. With this structure, the user can see the object located behind the terminal body through the area occupied by the display unit 151 of the terminal body.

According to an implementation form of the mobile terminal 100, two or more display units 151 may exist. For example, a plurality of display units may be spaced apart or integrally disposed on one surface (same surface) in the mobile terminal 100, or may be disposed on different surfaces.

On the other hand, when the display unit 151 and a sensor for detecting a touch operation (hereinafter referred to as a touch sensor) form a mutual layer structure (hereinafter referred to as a touch screen), the display unit 151 Can be used as an input device in addition to the output device. The touch sensor may have, for example, a form of a touch film, a touch sheet, a touch pad, a touch panel, or the like.

In addition, the touch sensor may be configured to convert a change in pressure applied to a specific portion of the display unit 151 or a capacitance generated in a specific portion of the display unit 151 into an electrical input signal. The touch sensor may be configured to detect not only the position and area of the touch but also the pressure at the touch. When there is a touch input to the touch sensor, the corresponding signal (s) is sent to a touch controller (not shown). The touch controller processes the signal (s) and then transmits the corresponding data to the controller 180. As a result, the controller 180 can determine which area of the display unit 151 is touched.

The proximity sensor 141 may be disposed in the inner region of the mobile terminal 100 surrounded by the touch screen or near the touch screen. The proximity sensor 141 refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or an object present in the vicinity without using mechanical force by using an electromagnetic force or infrared rays. The proximity sensor 141 has a longer life and higher utilization than a contact sensor.

Examples of the proximity sensor 141 include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor. When the touch screen is capacitive, the touch screen is configured to detect the proximity of the pointer by a change in an electric field according to the proximity of the pointer. In this case, the touch screen (touch sensor) may be classified as a proximity sensor.

Hereinafter, for convenience of explanation, the act of allowing the pointer to be recognized without being in contact with the touch screen so that the pointer is located on the touch screen is referred to as "Proximity Touch", and the touch The act of actually touching the pointer on the screen is called "Contact Touch". The position of the proximity touch with the pointer on the touch screen means a position where the pointer is perpendicular to the touch screen when the pointer is in proximity touch.

In addition, the proximity sensor 141 detects a proximity touch and a proximity touch pattern (for example, a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, and a proximity touch movement state). do. Information corresponding to the sensed proximity touch operation and proximity touch pattern may be output on the touch screen.

The sound output module 152 outputs audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, and the like. In addition, the sound output module 152 outputs a sound signal related to a function (eg, a call signal reception sound, a message reception sound, etc.) performed in the mobile terminal 100. The sound output module 152 may include a receiver, a speaker, a buzzer, and the like.

The alarm unit 153 outputs a signal for notifying occurrence of an event of the mobile terminal 100. Examples of events generated in the mobile terminal 100 include call signal reception, message reception, key signal input, and touch input. The alarm unit 153 may output a signal for notifying an occurrence of an event in a form other than an audio signal or a video signal, for example, vibration. When a call signal is received or a message is received, the alarm unit 153 may vibrate the mobile terminal 100 through a vibration means. Alternatively, when the key signal is input, the alarm unit 153 may vibrate the mobile terminal 100 through the vibration means in response to the key signal input. The user can recognize the occurrence of the event through the vibration as described above. Of course, the signal for event occurrence notification may be output through the display unit 151 or the voice output module 152, so that they 151, 152 may be classified as part of the alarm unit 153.

The haptic module 154 generates various tactile effects that a user can feel. Vibration is a representative example of the haptic effect generated by the haptic module 154. The intensity and pattern of vibration generated by the haptic module 154 can be controlled. For example, different vibrations may be synthesized and output or may be sequentially output.

The haptic module 154, in addition to the vibration, the pin arrangement to move vertically with respect to the contact skin surface, the blowing force or suction force of the air through the injection or inlet, the grazing to the skin surface, the contact of the electrode (eletrode), the stimulation such as electrostatic force Various tactile effects can be produced, such as the effects of the heat-absorbing effect and the effect of reproducing a sense of cold using the elements capable of absorbing heat or heat.

The haptic module 154 may not only deliver the haptic effect through direct contact, but may also be implemented to allow the user to feel the haptic effect through a muscle sense such as a finger or an arm. Two or more haptic modules 154 may be provided according to the configuration of the portable terminal 100.

The memory 160 may store a program for processing and controlling the controller 180, and a function for temporarily storing input / output data (for example, a phone book, a message, a still image, a video, etc.). You can also do The memory 160 may store data regarding vibrations and sounds of various patterns output when a touch input on the touch screen is performed.

The memory 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (eg, SD or XD memory). Random Access Memory (RAM) Static Random Access Memory (SRAM), Read-Only Memory (ROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Programmable Read-Only Memory (PROM) magnetic memory, Magnetic It may include a storage medium of at least one type of disk, optical disk. In addition, the mobile terminal 100 may operate a web storage that performs a storage function of the memory 150 on the Internet, or may operate in connection with the web storage.

The interface unit 170 serves as an interface with all external devices connected to the mobile terminal 100. For example, the interface unit 170 may include a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device equipped with an identification module, An audio input / output (I / O) port, a video input / output (I / O) port, and an earphone port may be configured. Here, the identification module is a chip that stores various information for authenticating the use right of the mobile terminal 100, and includes a user identification module (UIM), a subscriber identify module (SIM), and universal user authentication. It may include a module (Universal Subscriber Identity Module (USIM)). In addition, the device equipped with the identification module (hereinafter referred to as 'identification device'), may be produced in the form of a smart card (Smart Card). Therefore, the identification module may be connected to the mobile terminal 100 through a port. The interface unit 170 may receive data from an external device or receive power and transmit the data to each component inside the mobile terminal 100 or transmit data within the mobile terminal 100 to an external device.

The interface unit 170 may be a passage through which power from the cradle is supplied to the mobile terminal 100 when the mobile terminal 100 is connected to an external cradle, or various commands input by the user from the cradle. It may be a passage through which a signal is transmitted to the mobile terminal 100. Various command signals or power input from the cradle may be operated as signals for recognizing that the mobile terminal 100 is correctly mounted on the cradle.

The controller 180 typically controls the overall operation of the mobile terminal 100. For example, the controller 180 performs related control and processing for voice call, data communication, video call, and the like. In addition, the controller 180 may include a multimedia module 181 for multimedia playback. The multimedia module 181 may be implemented in the controller 180 or may be implemented separately from the controller 180.

The controller 180 may perform a pattern recognition process for recognizing a writing input or a drawing input performed on a touch screen as text and an image, respectively.

The power supply unit 190 receives an external power source and an internal power source under the control of the controller 180 to supply power for operation of each component.

The functions of the components applied to the mobile terminal 100 may be implemented in a computer-readable recording medium using software, hardware or a combination thereof. Hardware implementations include Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), Processors, Controllers The controller may be implemented using at least one of controllers, micro-controllers, microprocessors, and electrical units for performing functions. In some cases such embodiments may be implemented by the controller 180. In a software implementation, embodiments such as procedures or functions may be implemented with separate software modules that allow at least one function or operation to be performed. The software code may be implemented by a software application written in a suitable programming language. In addition, the software code may be stored in the memory 160 and executed by the controller 180. In addition, the navigation session 300 applied to the mobile terminal 100 provides a general navigation function.

Meanwhile, the controller 180 applied to the mobile terminal 100 according to an embodiment of the present invention checks the mutual similarity between a plurality of images, and when the identified similarities are smaller than a preset threshold, the corresponding similarities are determined. Images related to and grouped together can be displayed in a group.

2 is a block diagram showing the configuration of the telematics terminal 200 for explaining the signal processing apparatus according to an embodiment of the present invention. As shown in FIG. Processing Unit (CPU) 222, a main board having a built-in key control unit 221 for controlling various key signals, an LCD control unit 223 for controlling an LCD, and a memory 224 for storing various types of information. 220).

The memory 224 stores map information (map data) for displaying vehicle guidance information (road guidance information for guiding a user during driving / non-driving) on a map of the display unit (or LCD) 211.

In addition, the memory 224 stores a traffic information collection control algorithm for inputting traffic information according to a road condition on which the vehicle is currently traveling and various information for controlling the algorithm.

The main board 220 is a communication module 201 that is assigned a unique device number and performs voice calls and data transmission and reception through a mobile communication terminal embedded in a vehicle, and guides the location of the vehicle and travels from the starting point to the destination. A GPS module 202 for receiving a GPS signal for path tracking and the like, generating current location data of the vehicle based on the received GPS signal, or transmitting traffic information collected by a user as a GPS signal; A gyro sensor 203 for detecting the driving direction, a CD deck 204 for reproducing a signal recorded on a compact disk (CD), and the like.

In addition, the communication module 201 and the GPS module 202 transmit / receive signals through the first antenna 205 and the second antenna 206, respectively.

In addition, the main board 220 is connected to the TV module 230 that receives the broadcast signal through the broadcast signal antenna (or TV antenna) 231.

In addition, the main board 220 is connected to a liquid crystal display (LCD) 211 under the control of the LCD controller 223 through an interface board 213.

The LCD 211 performs a predetermined signal processing process on the broadcast signal received through the TV module 230, and then controls the signal processed broadcast signal by the LCD controller 223 on the interface board ( A video signal is displayed on the LCD 211 through 213, and the audio signal is output through the amplifier 254 under the control of the audio board 240 to be described later. In addition, the LCD 211 displays various video signals and text signals based on the control signals of the LCD control unit 223.

In addition, the LCD 211 may be configured to receive an input from a user by using a touch screen method.

In addition, the main board 220 is connected to the front board 212 under the control of the key controller 221 through the interface board 213. The front board 212 configures buttons and menus for inputting various key signals, and provides the main board 220 with a key signal corresponding to a key (or button) selected by a user. In addition, the front board 212 may include a menu key for directly inputting traffic information, and the menu key may be configured to be controlled by the key controller 221.

The audio board 240 is connected to the main board 220 and processes various audio signals. The audio board 240 includes a microcomputer 244 for controlling the audio board 240, a tuner 243 for receiving a radio signal through an antenna (or radio antenna) 245, And a power processor 242 for supplying power to the microcomputer 244, and a signal processor 241 for performing signal processing for outputting various voice signals.

In addition, the audio board 240 is connected to a radio antenna 245 for receiving a radio signal and a tape deck 246 for playing an audio tape.

Also, the audio board 240 is connected to an amplifier 254 for outputting a voice signal processed by the audio board 240.

In addition, the amplifier 254 is connected to the vehicle interface 250. That is, the main board 220 and the audio board 240 are connected to the vehicle interface 250, respectively. In addition, the vehicle interface 250 may include a hands-free 251 for inputting a voice signal without using a vehicle driver's hand, an airbag 252 for providing passenger safety, and a speed sensor for detecting a vehicle speed. 253 and the like can be connected.

In addition, the speed sensor 253 calculates a vehicle speed and provides the calculated vehicle speed information to the central processing unit 222.

In addition, the navigation session 300 applied to the telematics terminal 200 provides a general navigation function.

On the other hand, the central processing unit 222 applied to the telematics terminal 200 according to an embodiment of the present invention, by checking the mutual similarity between a plurality of images, when the identified similarity is smaller than a predetermined threshold, Images related to the similarity can be grouped and displayed in a group.

Hereinafter, a configuration of a signal processing apparatus according to an embodiment of the present invention will be described with reference to FIG. 3. Here, the signal processing apparatus includes not only a mobile terminal 100 and a telematics terminal 200 but also a smart phone, a portable terminal, a mobile terminal, and a personal digital assistant. PDAs, Personal Computers, Notebook Computers, Wibro Terminals, Internet Protocol Television (IPTV) Terminals, Telematics Terminals, Navigation Terminals, AVN (Audio Video Navigation) Terminals, Cameras It can be applied to various terminals such as).

3 is a block diagram showing a configuration of a signal processing apparatus according to an embodiment of the present invention. As shown in FIG. 3, the signal processing apparatus 400 includes an input unit 410, a storage unit 420, and a control unit 430. , A display unit 440, a voice output unit 450, and a communication unit 460.

The input unit 410 receives a command or a control signal by an operation such as receiving a button operation by a user or touching / scrolling the displayed screen.

In addition, the input unit 410 may select a function desired by the user or receive information, and various devices such as a keypad, a touch screen, a jog shuttle, a microphone, and a mouse may be used.

In addition, the input unit 410 may include a microphone (not shown) and / or a camera (not shown), and may receive voice and / or image information of the user through the microphone and / or the camera.

The storage unit 420 stores various user interfaces (UIs) and / or graphical user interfaces (GUIs).

In addition, the storage unit 420 stores data, a program, and the like necessary for the signal processing apparatus 400 to operate.

In addition, the storage unit 420 stores a plurality of images. In this case, the image may be an image of an original size photographed by a camera or the like, or may be a thumbnail. In addition, the image may be an image produced through an image authoring program such as Photoshop or Illustrator.

In addition, the storage unit 420 stores meta information included in each of the plurality of images. In this case, the meta information means related information when the image is taken by a camera or the like, or related information when the image is produced by an image authoring program. That is, the meta information includes a device name, a shooting date, a shooting time, an aperture value, a shooting mode, a shutter speed, an ISO value (or a practical sensitivity value), a focal length, a metering method (evaluation metering), Spot metering, center-weighted average metering, etc., application name (image authoring program name), storage time, resolution (including horizontal and vertical size information of the image file), image file format, Image file name, and so on.

In addition, the resolution is CIF (Common Intermediate Format), QCIF (Quarter Common Intermediate Format), QCIF +, QQCIF (Quarter Quarter Common Intermediate Format), VGA (Video Graphics Array), QVGA (Quarter Video Graphics Array), QQVGA (Quarter) Quarter Video Graphics Array (SVGA), Super Video Graphics Array (SVGA), Extended Graphics Array (XGA), Super Extended Graphics Array (SXGA), SXGA +, Wide SXGA (WSXGA), WSXGA + (WSXGA), Quadruple Extended Graphics Array (QXGA), Ultra Extended Graphics Array (UXGA), Ultra Wide Extended Graphics Array (UWXGA), and the like.

In addition, the image file format is BMP, RLE, JPG, JPEG, GIF, PNG, PDS, PDD, TIF, PDF, RAW, AI, EPS, SVG, SVGZ, IFF, FPX, FRM, PCX, PCT, PIC, PXR, SCT, TGA, VDA, ICB, VST and the like.

In addition, the storage unit 420 stores data (information or control signals) transmitted from an information providing center or a mobile terminal connected by wired / wireless communication.

The controller 430 executes an overall control function of the signal processing device 400.

In addition, the controller 430 displays a plurality of images stored in the storage unit 420 on the display unit 440.

In addition, the controller 430 may determine similarity between the plurality of images among the plurality of images stored in the storage unit 420, group the images determined to be similar, and display the grouped images in the display unit ( 440).

In addition, when the grouped image displayed on the display unit 440 is selected, the controller 430 displays at least two or more images included in the selected grouped image on one side of the display unit 440. Alternatively, the display unit 440 overlaps with the previously displayed image so as to be displayed on the display unit 440. In addition, when displaying the selected grouped image, the controller 430 forms an additional layer on the existing image displayed on the display unit 440 and is included in the selected grouped image on the formed layer. It is also possible to control to display a plurality of images.

In addition, the controller 430 may store information on the image and the grouped image displayed on the display unit 440 in the storage unit 420 or to any terminal connected through the communication unit 460. Can transmit

The display unit 440 may display various contents such as various menu screens using a user interface and / or a graphic user interface included in the storage unit 420 under the control of the controller 430. Here, the content displayed on the display unit 440 includes a menu screen including various text or image data (including map data and various information data), data such as icons, list menus, combo boxes, and the like. In addition, the display unit 440 may be a touch screen.

In addition, the display unit 440 displays a plurality of images previously stored in the storage unit 420 under the control of the controller 430.

In addition, the display unit 440 displays an image grouped by the control of the controller 430. In this case, the displayed grouped image may display the number of images included in the grouped image together on one side of the displayed grouped image.

In addition, the display unit 440, when displaying the grouped image, the remaining images other than the image included in the grouped image of the plurality of displayed images together with the representative image selected from the grouped image together Display.

For example, an image included in the plurality of images includes a first image, a second image, a third image, a fourth image, ..., an N-th image, and the like, and the first image, the first image, When the second image and the third image are included, the display unit 440 may include the remaining images (fourth image and fifth image) except for the first to third images included in the grouped image among the plurality of images. , ..., N-th image and a representative image of the grouped image (eg, the first image among the first to third images).

The voice output unit 450 outputs voice information included in a signal processed by a predetermined signal by the controller 430. Here, the voice output unit 450 may be a speaker.

The communication unit 460 may include a wireless internet module or a short range communication module. The wireless Internet module may include WLAN, Wi-Fi, WiBro, WiMAX, HSDPA, and the like, and the short-range communication module may include Bluetooth, RFID, infrared communication, UWB, ZigBee, and the like.

In addition, the signal processing apparatus 400 may further include a general-purpose antenna capable of communicating with an external terminal through a wired / wireless communication network and transmitting / receiving signals of various frequency bands.

Hereinafter, a signal processing method according to the present invention will be described in detail with reference to FIGS. 1 to 8.

4 is a flowchart illustrating a signal processing method according to a first embodiment of the present invention.

First, the controller 430 displays the plurality of images previously stored in the storage unit 420 on the display unit 440. Subsequently, the controller 430 is displayed on the display unit 440 when a preset first button provided on the signal processing device 400 or a preset second button displayed on the display unit 440 is clicked. The similarity between the images is confirmed (or calculated) based on the meta information included in each of the plurality of images.

In this case, the control unit 430 may include the first button provided in the signal processing apparatus 400 or the display unit before displaying a plurality of images previously stored in the storage unit 420 on the display unit 440. When the second button displayed on the display unit 440 is clicked, the similarity between the images may be confirmed based on meta information included in each of the plurality of images stored in the storage unit 420.

In addition, the meta information included in the image may include a device name, a shooting date, a shooting time, an aperture value, a shooting mode, a shutter speed, an ISO value (or a practical sensitivity value), a focal length, and a metering method (evaluation metering) used in the image. , Partial metering, center-weighted average metering, etc., application name (image authoring program name), storage time, resolution (including horizontal and vertical size information of the image file), image file format, and image file name. It is.

For example, with respect to the first and second meta information included in the first and second images included in the plurality of images, the controller 430 may include at least one component included in the first meta information. (Eg, including a first photographing date, a first photographing time, a first aperture value, and first shutter speed information) and at least one component included in the second meta information corresponding to the first meta information. (For example, information between the second photographing date (corresponding to the first photographing date information), the second photographing time, the second aperture value, and the second shutter speed information) is compared. That is, the controller 430 may include a first difference value between the first shooting date and the second shooting date, a second difference value between the first shooting time and the second shooting time, and the first aperture value. And a third difference value between the second aperture value and a fourth difference value between the first shutter speed and the second shutter speed, respectively. Here, the calculated first difference value, second difference value, third difference value, and fourth difference value are included in the similarity (S110).

Thereafter, the controller 430 compares the checked similarity (or calculated similarity) with a preset threshold. In this case, the preset threshold may be set for each component included in the meta information corresponding to the meta information. That is, the preset threshold may correspond to a first threshold value (threshold value corresponding to the shooting date) corresponding to the shooting date, the shooting time, the aperture value, and the shutter speed included in the first and second meta information. The second threshold value (threshold value corresponding to the shooting time), the third threshold value (threshold value corresponding to the aperture value), and the fourth threshold value (threshold value corresponding to the shutter speed) may be set.

For example, the controller 430 may be configured to firstly set the first difference value, the second difference value, the third difference value, and the fourth difference value respectively included in the checked similarity to each component. A value, a second threshold value, a third threshold value, and a fourth threshold value, respectively. That is, the first difference value and the first threshold value, the second difference value and the second threshold value, the third difference value and the third threshold value, and the fourth difference value and the fourth threshold value. Are respectively compared (S120).

Thereafter, the controller 430 groups the plurality of images related to the checked similarity as one group when the similarity is less than the predetermined threshold as a result of the comparison between the checked similarity and the preset threshold. do. That is, a plurality of images related to the similarity are set as one group image.

For example, the controller 430 may include the first difference being smaller than the first threshold, the second difference being smaller than the second threshold, and the third difference being greater than the third threshold. And when the fourth difference value is less than the fourth threshold value, group the first image and the second image related to the similarity including the difference values into one group.

At this time, as in the above example, when comparing the similarity and the preset threshold, it is configured to determine whether all components included in the similarity satisfy all the conditions of all the threshold included in the preset threshold. can do.

Alternatively, the controller may be configured to determine whether at least one component included in the similarity satisfies a condition of a threshold set in a corresponding component included in the preset threshold. That is, whether at least one of the first, second, third, and fourth difference values is smaller than at least one of the first, second, third, and fourth threshold values corresponding to the at least one. It can also be configured to make a judgment. For example, the controller 430 may be configured to determine whether the first difference is less than the first threshold or the second difference is less than the second threshold (S130).

Thereafter, the controller 430 selects a representative image from at least two images included in the grouped image.

For example, the controller 430 selects the first image as the representative image from the first and second images (or a plurality of images) included in the grouped image. The representative image selection may be configured to be selected based on the meta information. For example, among the images included in the grouped image, the image having the fastest shooting time may be selected as the representative image (S140).

Thereafter, the controller 430 displays the remaining image except for the images included in the grouped image and the selected representative image on the display unit 440.

For example, as illustrated in FIG. 5, the controller 430 may include first and second images in the grouped image among a plurality of images (including first to Nth images) and the grouped image. When a representative image of is selected as the first image, another grouped image includes sixth through ninth images, and a representative image of the another grouped image is selected as the sixth image, from among the plurality of images. At least one remaining image except for the first and second images and the sixth to ninth images (third image, fourth image, fifth image, ..., tenth image, eleventh image, ..., The N-th image 501 and the first image 502 and the sixth image 503 selected as the representative image are displayed on the partial region 511 on the display unit 440.

In addition, the controller 430 may display the number of images included in the grouped image together on one side of the representative image when displaying the representative image on the display unit 440.

For example, as illustrated in FIG. 5, the controller 430 may control to display 504 the number of images included in the grouped image on one side of the representative image (S150).

Thereafter, when the grouped image is selected among the images displayed on the display unit 440, the controller 430 displays at least two or more images included in the selected grouped image as illustrated in FIG. 6A. A portion 512 on the display unit 440 is displayed. In this case, another portion 511 on the display unit 440 may display remaining images except for images included in the grouped image among the plurality of images, and the selected representative image (the screen illustrated in FIG. 5). Can be.

In addition, when the grouped image is selected among the images displayed on the display unit 440, the controller 430 may display at least two or more images included in the selected grouped image as illustrated in FIG. 6B. In a state in which an existing image is displayed 511, a new layer may be formed to display at least two images included in the selected grouped image on the newly formed layer 513. .

In addition, the method of displaying the grouped image on the display unit 440 is not limited to the above example, and may be variously implemented.

In addition, the controller 430 may add an arbitrary image to a specific grouped image by using a user input, that is, a drag and drop function, with respect to the images displayed on the display unit 440. Alternatively, a specific image included in any grouped image may be excluded (or deleted) from the grouped image (S160).

As such, the signal processing apparatus 400 may perform the above processes on all images (multiple images) with respect to a plurality of images previously stored in the storage unit 420 or arbitrary images selected by a user among the plurality of images. Image, or any selected images) may be grouped and displayed on the display unit 440 for all the images.

In addition, the signal processing apparatus 400 may use the corresponding images by using meta information of the corresponding image among consecutive images (for example, an image having a continuous shooting time or storage time or an image having a stored file name consecutive). It may be configured to determine the similarity between the two. That is, when photographing or storing similar images using a camera or an authoring program, the similar images are stored in order in the storage unit 420 in sequence by using the characteristics of being stored consecutively under similar image names or stored in similar time zones. In this case, by configuring the similarity between successive images, the time required for the similarity determination can be saved.

7 is a flowchart illustrating a signal processing method according to a second embodiment of the present invention.

First, the controller 430 displays the plurality of images previously stored in the storage unit 420 on the display unit 440. Subsequently, the controller 430 is displayed on the display unit 440 when a preset first button provided on the signal processing device 400 or a preset second button displayed on the display unit 440 is clicked. The similarity between the images is confirmed (or calculated) based on specific areas preset for the plurality of images.

In this case, the control unit 430 may include the first button provided in the signal processing apparatus 400 or the display unit before displaying a plurality of images previously stored in the storage unit 420 on the display unit 440. When the second button displayed on the display unit 440 is clicked, the degree of similarity between the images may be checked based on predetermined regions of the plurality of images stored in the storage unit 420.

In addition, the predetermined specific area may include the entire area of the image or a partial area of the image with respect to any image.

The determining of the similarity between the images with respect to the plurality of images may include partial or entire regions of the first image included in the plurality of images, and the same region of the second image included in the plurality of images (the first image). Compare the difference value of the pixel value with each other in comparison with the partial region or the entire region of the first image and / or the peripheral region (any region including at least a portion of the partial region or the entire region of the first image) It is.

For example, the controller 430 may include a first region of a first image included in the plurality of images and a second region of a second image (the region corresponding to the first region of the first image). The difference value of the pixel value between the same as the coordinate of the region and the third region (the region including at least a portion of the first region of the first image) is compared. That is, the controller 430 calculates a difference value of the first pixel value between the first area and the second area. In addition, the controller 430 calculates a difference value of the second pixel value between the first region and the third region. When calculating a difference value of the pixel value between the first region and the third region, the controller 430 compares the plurality of section regions included in the third region with the first region, respectively, to compare the results. The difference value of the minimum pixel value of each section may be calculated as a difference value of the second pixel value between the first region and the third region. Here, the calculated difference value of the first pixel value or the calculated difference value of the second pixel value is included in the similarity. In addition, a minimum value or a maximum value among the calculated difference values of the first and second pixel values may be set as a difference value (or difference value of a representative pixel value) of the pixel value between the first image and the second image. .

In addition, when confirming the similarity between the plurality of images, the controller 430 directly compares information of the original (original size) image, or uses the information of the thumbnail image with respect to the original image to reduce the amount of computation. It may be configured to check the similarity between the images (S210).

Thereafter, the controller 430 compares the checked similarity (or calculated similarity) with a preset threshold. In this case, the preset threshold may be set including a pixel value (including an RGB value, a YCbCr value, and the like).

For example, the controller 430 may compare the calculated difference between the first pixel value and the predetermined threshold value, or compare the calculated difference between the second pixel value and the predetermined threshold value. .

As another example, the controller 430 may determine a difference value of a representative pixel value (for example, a difference value of a second pixel value) from among the calculated difference values of the first and second pixel values. It may be compared with (S220).

Thereafter, the controller 430 groups the plurality of images related to the checked similarity as one group when the similarity is less than the predetermined threshold as a result of the comparison between the checked similarity and the preset threshold. do. That is, a plurality of images related to the similarity are set as one group image.

For example, when the difference value of the representative pixel value (for example, the difference value of the second pixel value) is smaller than the threshold value, the controller 430 may include a first image related to the difference value of the representative pixel value. And grouping the second image into one group (S230).

Thereafter, the controller 430 selects a representative image from at least two images included in the grouped image.

For example, the controller 430 selects the first image as the representative image from the first and second images (or a plurality of images) included in the grouped image. The representative image selection may be configured to be selected based on first and second meta information included in the first and second images, respectively. For example, the image having the fastest shooting time may be selected as the representative image among the images included in the grouped image (S240).

Thereafter, the controller 430 displays the remaining image except for the images included in the grouped image and the selected representative image on the display unit 440.

For example, as illustrated in FIG. 5, the controller 430 may include first and second images in the grouped image among a plurality of images (including first to Nth images) and the grouped image. When a representative image of is selected as the first image, another grouped image includes sixth through ninth images, and a representative image of the another grouped image is selected as the sixth image, from among the plurality of images. At least one remaining image except for the first and second images and the sixth to ninth images (third image, fourth image, fifth image, ..., tenth image, eleventh image, ..., The N-th image 501 and the first image 502 and the sixth image 503 selected as the representative image are displayed on the partial region 511 on the display unit 440.

In addition, the controller 430 may display the number of images included in the grouped image together on one side of the representative image when displaying the representative image on the display unit 440.

For example, as illustrated in FIG. 5, the controller 430 may control to display 504 the number of images included in the grouped image on one side of the representative image (S250).

Thereafter, when the grouped image is selected from among the images displayed on the display unit 440, the controller 430 displays at least two or more images included in the selected grouped image as illustrated in FIG. 6A. A portion 512 is displayed on the display unit 440. In this case, another portion 511 on the display unit 440 may display remaining images except for images included in the grouped image among the plurality of images, and the selected representative image (the screen illustrated in FIG. 5). Can be.

In addition, when the grouped image is selected among the images displayed on the display unit 440, the controller 430 may display at least two or more images included in the selected grouped image as illustrated in FIG. 6B. In a state in which an existing image is displayed 511, a new layer may be formed to display at least two images included in the selected grouped image on the newly formed layer 513. .

In addition, the method of displaying the grouped image on the display unit 440 is not limited to the above example, and may be variously implemented.

In addition, the controller 430 may add an arbitrary image to a specific grouped image by using a user input, that is, a drag and drop function, with respect to the images displayed on the display unit 440. Alternatively, a specific image included in any grouped image may be excluded (or deleted) from the grouped image (S260).

8 is a flowchart illustrating a signal processing method according to a third embodiment of the present invention.

First, the controller 430 displays the plurality of images previously stored in the storage unit 420 on the display unit 440. In this case, the displayed plurality of images may include a single image or grouped images as illustrated in FIG. 5 (S310).

Thereafter, when one of a plurality of images displayed on the display unit 440 is dragged and dropped by a user input, the controller 430 performs a grouping add / delete function on the corresponding images.

That is, the controller 430 selects a first image from among a plurality of images displayed on the display unit 440 by a user input, and then selects the selected first image on another second image using a drag and drop function. When positioned, the first image and the second image are grouped into one group. In this case, the representative image setting between the first image and the second image may use meta information included in the first and second images, respectively. The representative image setting between the first image and the second image may set the first image in which the drag and drop function is selected as the representative image.

In addition, the controller 430 selects a specific image included in the grouped image from among the plurality of images displayed on the display unit 440, and then selects and drags the selected specific image to the display unit 440. If it is located on a background screen (or a blank area in which no other image is displayed), the specific image is controlled to be deleted from the grouped image (S320).

As such, the selected image may be added or deleted to a specific group by using a drag and drop function for a plurality of images (including a single image or grouped images) displayed on the display unit 440.

Those skilled in the art will appreciate that various modifications and variations can be made without departing from the essential characteristics of the present invention. Therefore, the embodiments disclosed in the present invention are not intended to limit the technical idea of the present invention but to describe the present invention, and the scope of the technical idea of the present invention is not limited by these embodiments. The protection scope of the present invention should be interpreted by the following claims, and all technical ideas within the equivalent scope should be interpreted as being included in the scope of the present invention.

1 is a block diagram showing the configuration of a mobile terminal for explaining a vehicle control apparatus according to an embodiment of the present invention.

2 is a block diagram showing the configuration of a telematics terminal for explaining a vehicle control apparatus according to an embodiment of the present invention.

3 is a block diagram showing a configuration of a signal processing apparatus according to an embodiment of the present invention.

4 is a flowchart illustrating a signal processing method according to a first embodiment of the present invention.

5 is a diagram illustrating a screen of a display unit according to an exemplary embodiment of the present invention.

6A and 6B illustrate screens of a display unit according to an exemplary embodiment of the present invention.

7 is a flowchart illustrating a signal processing method according to a second embodiment of the present invention.

8 is a flowchart illustrating a signal processing method according to a third embodiment of the present invention.

Claims (18)

Confirming similarity between the plurality of images; Comparing the checked similarity with a preset threshold; And And when the similarity between the images is smaller than the predetermined threshold, as a result of the comparison, grouping and displaying the corresponding images related to the similarity. The method of claim 1, wherein the checking of the similarity level comprises: And calculating similarity between first meta information of a first image included in the plurality of images and second meta information of a second image included in the plurality of images. The method of claim 2, wherein the first and second meta information, At least one of the name of the device used for shooting, shooting date, shooting time, aperture value, shooting mode, shutter speed, practical sensitivity value, focal length, metering method, image authoring program name, storage time, resolution, image file format, and image file name Signal processing method comprising one. The method of claim 3, wherein the grouping of the corresponding images is displayed. A result of comparing the calculated similarity with the preset threshold, when the calculated similarity is less than the threshold, when the similarity between the first and second images related to the calculated similarity is less than the preset threshold Grouping the first and second images; Selecting a representative image based on meta information among the grouped first and second images; And And displaying the remaining images other than the first and second images and the selected representative image among the plurality of images. The method of claim 1, wherein the checking of the similarity level comprises: A predetermined first area of a first image included in the plurality of images and a predetermined second area including at least a portion of the first area or the first area of a second image included in the plurality of images; And a difference value of pixel values between the corresponding areas is calculated. The method of claim 5, wherein the comparing of the checked similarity with the predetermined threshold value comprises: And comparing the calculated difference between the calculated pixel value and the predetermined threshold value. The method of claim 6, wherein the grouping of the corresponding images is displayed. The first and second images related to the calculated pixel value when the difference value of the calculated pixel value is smaller than the predetermined threshold value as a result of the comparison between the calculated pixel value and the predetermined threshold value; Grouping them; Selecting a representative image based on meta information included in each image among the grouped first and second images; And And displaying the remaining images other than the first and second images and the selected representative image among the plurality of images. The method of claim 1, wherein the grouping of the corresponding images is displayed. And displaying the number of images included in the grouped image on one side of the grouped and displayed image. The method of claim 1, If the displayed grouped image is selected, forming an additional layer on a screen on which the grouped image is displayed; And displaying at least two images included in the selected grouped image on the formed additional layer. A controller configured to group corresponding images related to the similarity when the similarity between the plurality of images is smaller than a preset threshold; And And a display unit for displaying the grouped images. The method of claim 10, wherein the control unit, And calculating similarity between first meta information of a first image included in the plurality of images and second meta information of a second image included in the plurality of images. The method of claim 11, wherein the first and second meta information, Include at least one of a device name, a shooting date, a shooting time, an aperture value, a shooting mode, a shutter speed, an ISO value, a focal length, a metering method, an image authoring program name, a storage time, a resolution, and an image file format used for shooting. Signal processing device characterized in that. The method of claim 12, wherein the control unit, When the calculated similarity is less than the threshold as a result of the comparison between the calculated similarity and the preset threshold, group the first and second images related to the calculated similarity, and the grouped first and second And a representative image is selected from the two images based on the meta information. The method of claim 10, wherein the control unit, A predetermined first area of a first image included in the plurality of images and a predetermined second area including at least a portion of the first area or the first area of a second image included in the plurality of images; And comparing the calculated difference between the calculated pixel values and a predetermined threshold value, by comparing the calculated difference between the pixel values. The method of claim 14, wherein the control unit, When the difference value of the calculated pixel value is smaller than the predetermined threshold value, the first and second images related to the calculated pixel value are grouped and included in each of the grouped first and second images. And a representative image is selected based on the received meta information. The method of claim 13 or 15, wherein the control unit, And displaying the remaining images other than the first and second images and the selected representative image among the plurality of images to be displayed on the display unit. The method of claim 10, wherein the control unit, And controlling the display unit to display the number of images included in the grouped image on one side of the grouped and displayed image. The method of claim 10, wherein the control unit, When the displayed grouped image is selected, an additional layer is formed on a screen on which the grouped image is displayed, and the display unit is controlled to display two or more images included in the selected grouped image on the formed additional layer. Signal processing apparatus characterized in that.

Images