KR101585245B1 - Method for processing image and device for displaying image thereof - Google Patents

Abstract

The present invention comprises: recognizing an object included in an image using an object program; Generating a partial image around the object; And automatically displaying the generated partial image, and an image display apparatus using the same.

Description

Technical Field [0001] The present invention relates to an image processing method and an image display apparatus using the image processing method.

The present invention relates to an image processing method and an image display apparatus using the same.

Recently, according to the trend of digital convergence (Digital Convergence), a digital photo device having a large capacity storage media provides a photo album function.

Here, a digital device is a device having a digital circuit for processing digital data. The digital device is a computer, a printer, a digital TV, a digital camera, a digital copier, a personal digital assistant (PDA) Mobile multimedia players (PMPs), MP3 players, digital video recorders, electronic albums, and the like.

Generally, when providing a list of pictures in a digital device, a thumbnail image of each picture file is extracted and reproduced and displayed. At this time, the user can view several pictures simultaneously through a thumbnail image. Alternatively, a plurality of pictures can be sequentially viewed through the slide show function.

However, the user sometimes wants to zoom in on only specific objects included in the image. For this purpose, a user can manually select a specific object using an editing tool provided on a camera or a display device, and enlarge the selected object.

The present invention is for automatically extracting a specific object included in an image and generating a partial image to provide a convenient working environment for a user.

According to an aspect of the present invention, there is provided an image processing method comprising: recognizing an object included in an image using an object recognition program; Generating a partial image around the object; And automatically displaying the generated partial image. Here, the object may be a face of a person.

According to an aspect of the embodiment of the present invention, the step of generating the partial image around the object may include: determining the aspect ratio of the object; And determining the shape of the partial image in consideration of the aspect ratio.

According to an aspect of the embodiment of the present invention, the step of automatically displaying the generated partial image may include a step of displaying the generated partial image in a slide show if the generated partial image is plural.

According to an aspect of the embodiment of the present invention, the step of automatically displaying the generated partial image includes: detecting whether the user approaches within a predetermined distance; And automatically displaying the generated partial image together with the image if the user approaches within a predetermined distance.

An image display apparatus according to another embodiment of the present invention includes a memory for storing image data and an object recognition program for recognizing an object in an image; A display unit configured to display the image data; And a control unit for recognizing an object in the image using the object recognition program, generating a partial image around the recognized object, and automatically displaying the partial image on the display unit. Here, the object may be a face of a person.

According to another aspect of the present invention, the control unit can determine the aspect ratio of the object and determine the shape of the partial image in consideration of the aspect ratio.

According to an embodiment of another embodiment of the present invention, the control unit can control the display unit to display a plurality of the partial images in a slide show, the plurality of objects being plural, thereby generating a plurality of partial images have.

According to an aspect of another embodiment of the present invention, the image display apparatus further includes a sensor for sensing a user's approach, and when the user approaches within a predetermined distance, So that the display unit can be automatically displayed.

According to an aspect of another embodiment of the present invention, the image display apparatus further includes a sensing unit for measuring a tilt of the image device, and the control unit controls the horizontal direction of the partial image in consideration of the tilt of the image device. You can determine the vertical ratio.

According to the present invention having the above-described configuration, a user can automatically display a partial image including an object in an image by dividing it. Thus, the present invention can provide a graphical user interface (GUI) that is convenient for the user.

Hereinafter, a mobile communication terminal according to the present invention will be described in detail with reference to the drawings. The suffix "module" and " part "for the components used in the following description are given or mixed in consideration of ease of specification, and do not have their own meaning or role.

A mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player) , Navigation, and the like.

The image display apparatus 100 includes a communication unit 10, a sensing unit 20, a display unit 30, a memory 40, an interface unit 50, a control unit 60, and a power supply unit . The components shown in FIG. 1 are not essential, so that an image display device having more or fewer components may be implemented.

The communication unit 10 is an apparatus for transmitting and receiving image related information between the image display apparatus 100 and the wireless communication system or between the image display apparatus and another terminal. The communication unit 10 may include a WIFI module 11, a short distance communication module 12, and a location information module 13. [

The WIFI module 11 refers to a module for wireless Internet access, and can be embedded in the image display device 100 or externally. Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), and HSDPA (High Speed Downlink Packet Access) can be used as a wireless Internet technology in place of WIFI.

The short-range communication module 12 is a module for short-range communication. Bluetooth, Radio Frequency Identification (RFID), infrared data association (IrDA), Ultra Wideband (UWB), ZigBee, and the like can be used as a short range communication technology.

The position information module 13 is a module for acquiring the position of the mobile communication terminal, and a representative example thereof is a GPS (Global Position System) module.

The sensing unit 20 senses the current state of the image display device, such as whether or not an external object approaches the user, whether the user touches the user, the orientation of the image display device, the acceleration / deceleration of the image display device, And generates a sensing signal for controlling the operation of the microcomputer 100. For example, when the user approaches the image display device within a predetermined distance, the sensing unit 20 senses this and generates a sensing signal. It is also possible to sense whether power is supplied to the power supply unit, whether the interface unit 50 is connected to an external device, and the like. The sensing unit 20 may include an infrared sensor 21, an ultrasonic sensor 22, a photosensor 23, and a proximity sensor 24.

The display unit 30 displays (outputs) the information processed in the image processing apparatus 100. For example, when an image is displayed on the image display device, a UI (User Interface) or a GUI (Graphic User Interface) associated with the display process of the image is displayed.

The display unit 30 may be a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), a flexible display display, and a 3D display.

Some of these displays may be transparent or light transmissive so that they can be seen through. This can be referred to as a transparent display, and a typical example of the transparent display is TOLED (Transparent OLED) and the like. The rear structure of the display unit 30 may also be of a light transmission type. With this structure, the user can see an object located behind the terminal body through the area occupied by the display unit 30 of the terminal body.

There may be two or more display units 30 according to the embodiment of the image processing apparatus 100. For example, in the image processing apparatus 100, a plurality of display portions may be spaced apart from one another or may be disposed integrally with each other, or may be disposed on different surfaces, respectively.

(Hereinafter, referred to as a 'touch screen') in which a display unit 30 and a sensor (hereinafter, referred to as 'touch sensor') that detects a touch operation form a mutual layer structure, It can also be used as an input device. The touch sensor may have the form of, for example, a touch film, a touch sheet, a touch pad, or the like.

The touch sensor may be configured to convert a change in a pressure applied to a specific portion of the display unit 30 or a capacitance generated in a specific portion of the display unit 30 to an electrical input signal. The touch sensor can be configured to detect not only the position and area to be touched but also the pressure at the time of touch.

If there is a touch input to the touch sensor, the corresponding signal (s) is sent to the touch controller. The touch controller processes the signal (s) and transmits the corresponding data to the control unit 60. Thus, the control unit 60 can know which area of the display unit 30 is touched or the like.

Referring to FIG. 1, a proximity sensor 24 may be disposed in an inner region of the mobile communication terminal or in the vicinity of the touch screen, which is surrounded by the touch screen. The proximity sensor refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or a nearby object without mechanical contact using the force of an electromagnetic field or infrared rays. The proximity sensor has a longer life span than the contact sensor and its utilization is also high.

Examples of the proximity sensor include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor. And to detect the proximity of the pointer by the change of the electric field along the proximity of the pointer when the touch screen is electrostatic. In this case, the touch screen (touch sensor) may be classified as a proximity sensor.

The memory 40 may store a program for the operation of the controller 60 and temporarily store input / output data (e.g., still images, moving images, etc.). The memory 40 may store data on vibration and sound of various patterns outputted when a touch is input on the touch screen.

The memory 40 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (e.g., SD or XD memory), a RAM (Random Access Memory), SRAM (Static Random Access Memory), ROM (Read Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM A disk, and / or an optical disk. The image display apparatus 100 may operate in association with a web storage that performs a storage function of the memory 40 on the Internet.

The interface unit 50 serves as a path for communication with all external devices connected to the image display apparatus 100. The interface unit 50 receives data from an external device or supplies power to each component in the image display device 100 or allows data in the image display device 100 to be transmitted to an external device. For example, a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device having an identification module, an audio I / O port, A video input / output (I / O) port, an earphone port, and the like may be included in the interface unit 50.

The interface unit 50 is a path through which power from the cradle is supplied to the image display apparatus 100 when the image display apparatus 100 is connected to an external cradle, Various command signals may be transmitted to the mobile terminal. The various command signals or the power source input from the cradle may be operated as a signal for recognizing that the mobile terminal is correctly mounted on the cradle.

The controller 60 typically controls the overall operation of the image display device. For example, display processing of image data and audio data and control and processing related thereto are performed.

The control unit 60 can perform a pattern recognition process for recognizing handwriting input or drawing input performed on the touch screen as characters and images, respectively.

The power supply unit (not shown) receives external power and internal power under the control of the controller 60 and supplies power required for operation of the respective components.

The various embodiments described herein may be embodied in a recording medium readable by a computer or similar device using, for example, software, hardware, or a combination thereof.

According to a hardware implementation, the embodiments described herein may be implemented as application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays May be implemented using at least one of a processor, controllers, micro-controllers, microprocessors, and other electronic units for performing other functions. In some cases, The embodiments described may be implemented by the control unit 60 itself.

According to a software implementation, embodiments such as the procedures and functions described herein may be implemented with separate software modules. Each of the software modules may perform one or more of the functions and operations described herein. Software code can be implemented in a software application written in a suitable programming language. The software codes are stored in the memory 40 and can be executed by the control unit 60. [

2 is a perspective view of an example of an image display apparatus according to the present invention, as viewed from the front.

The body includes a case (a casing, a housing, a cover, and the like) which forms an appearance. In this embodiment, the case may be divided into a front case 101 and a rear case 102. [ A variety of electronic components are embedded in the space formed between the front case 101 and the rear case 102. At least one intermediate case may be additionally disposed between the front case 101 and the rear case 102. [

The cases may be formed by injection molding a synthetic resin or may be formed to have a metal material such as stainless steel (STS) or titanium (Ti) or the like.

The sensing unit 20, the display unit 30, the sound output units 71 and 72, the camera 75, and the user input units 81, 82 and 83 can be disposed in the front body 101, have.

The sensing unit 20 may be a photo sensor, an ultrasonic sensor, or a proximity sensor. The sensing unit detects whether an external object approaches the image display unit within a predetermined distance.

The display unit 30 occupies most of the main surface of the front case 101. Sound output units 71 and 72 are disposed in the area adjacent to both ends of the display unit 30, and a camera 75 is disposed in the center of one side. The user input unit 81-83 may be disposed at the lower center of the front case 101 as shown in the figure.

The user input unit 81-83 is operated to receive a command for controlling the operation of the image display apparatus 100, and may include a plurality of operation units. The operating units may also be referred to as manipulating portions and may be employed in any manner as long as the user is operating in a tactile manner with a tactile impression.

Hereinafter, an image display method according to an embodiment of the present invention will be described with reference to FIG.

3 is a flowchart illustrating an image processing method according to an embodiment of the present invention. As shown in the figure, an object recognition program is stored in the memory 40 of the image processing apparatus 100 (S1). This object recognition program is a program for recognizing an object included in an image (including a still image and a moving image). For example, a face recognition program. It includes a program for recognizing not only a face but also a building, a building, an animal, etc. from the background. This object recognition program may be stored in the memory 40 by the image processing apparatus manufacturer by default or may be stored in the memory 40 by the user through the communication unit 10 or the interface 50. [ Meanwhile, when a partial image generation command for the image is generated through the user input unit in a state where the image stored in the memory 40 is displayed on the display unit 30, the controller 60 controls the object in the image, (S2). Next, the controller 60 checks the cross ratio of the object (S3), and generates a partial image having a cross ratio corresponding to the cross ratio (S4). For example, according to the object recognition program, if a person's face has a cross ratio of 3: 2, the partial image is generated as a horizontally long image (that is, it does not need to be the same in a 3: 2 ratio). Alternatively, the partial image may be generated differently depending on the state in which the image display device is placed. For example, if the image display device is placed in a horizontally long form, a partial image of 3: 2 is generated. If the image display device is placed in a long form, a partial image of 2: 3 can be generated. The above-mentioned cross ratio is only an example, and the present invention should not be construed as being limited to this ratio. When the partial image is generated in this manner, the partial image is displayed on the display unit 30. [ At this time, the partial image may be displayed in the form of a thumbnail, or may be displayed in a form of a slide show. The image processing apparatus 100 may be turned on and a partial image may be displayed when an external object approaches (using an ultrasonic sensor, an infrared sensor, a photosensor, or the like) at the sensing unit 20. A specific application example will be described in detail with reference to FIG. 4 through FIG. Or when the image processing apparatus enters a predetermined area, the position information module 13 senses it, so that the partial images can be displayed on the display unit 30. [ Alternatively,

According to the embodiment of the present invention as described above, the image processing apparatus automatically detects an object in an image, generates a partial image corresponding to the object, and displays the partial images in the form of a slide show or a thumbnail, It is possible to relieve the trouble of 'generation'.

Hereinafter, an example in which the image processing method according to the present invention is applied will be described in detail with reference to the image views of FIG. 4 to FIG.

FIG. 4 is a diagram illustrating a first application example to which an image processing method according to an embodiment of the present invention is applied, FIG. 5 is a flowchart illustrating a second application example to which an image processing method according to an embodiment of the present invention is applied FIG. 6 is an image diagram for explaining a third application example to which an image processing method according to an embodiment of the present invention is applied, FIG. 7 is a fourth application example to which an image processing method according to an embodiment of the present invention is applied Fig.

[First Application Example]

4 is an image diagram illustrating a first application example to which an image processing method according to an embodiment of the present invention is applied. As shown in FIG. 4 (a), the display unit 30 of the image display device 100 includes a plurality of people 101-104, buildings, and the like. At this time, when the face recognition program stored in the memory 40 is driven, the controller 60 can recognize the face in the image. Then, the control unit 60 automatically generates the partial images 101-1, 102-1, 103-1, and 104-1 around the recognized face (see FIG. 4 (b)). The partial images 101-1, 102-1, 103-1, and 104-1 may be displayed on the display unit 30 in the form of a slide show or a thumbnail. 4 (c) shows a partial image 101-1. When a predetermined time elapses, the next partial images 102-1, 103-1, and 104-1 are sequentially displayed on the display unit 30, Lt; / RTI > At this time, the cross ratio of the partial image may correspond to the cross ratio of the display portion. In FIG. 4, the image display device 100 is arranged in a long horizontal shape, and a partial image can also be generated in a long horizontal shape (for example, a horizontal bar vertical ratio of 3: 2). The aspect ratio of the partial image may be determined according to the arrangement state of the image display apparatus 100. [ That is, when the image display apparatus 100 is placed in a long horizontal state, the partial image can be generated in a horizontally long shape.

According to the first application example as described above, the user can conveniently create a partial image centered on a person's face.

[Second Application Example]

5 is an image diagram for explaining a second application example to which an image processing method according to an embodiment of the present invention is applied.

FIG. 5 (a) is a view for explaining a screen 200 in which people and buildings are distinguished from backgrounds. As shown in the figure, the person 201 or the building 202 distinguishes the background color from its hue and saturation. When the object recognition program stored in the memory 40 is activated, the control unit 60 distinguishes the objects 201 and 202 included in the image from backgrounds. Then, the control unit 60 automatically cuts the image within a certain range around the object to generate a partial image.

FIG. 5B is a view for explaining an example in which a cross-sectional aspect ratio of a partial image is determined. As shown, the face 310 of the person is recognized by the control unit 60. [ At this time, a is larger than b in a: b, which is the cross-sectional vertical ratio. In this case, a partial image of a long horizontal shape is generated. On the other hand, when the whole body 320 of a person is recognized by the control unit 60, a 'becomes smaller than b'. In this case, a partial image having a long vertical shape is generated.

That is, the cross-sectional aspect ratio of the recognized object determines the cross-sectional aspect ratio of the partial image.

According to this, a partial image to be generated is generated in accordance with a user's demand.

[Third Application Example]

FIG. 6 is an image diagram illustrating a third application example to which an image processing method according to an embodiment of the present invention is applied.

6 illustrates an example of controlling the on-off or contrast of the image display apparatus through user's approach detection. As shown in the figure, the sensing unit 20 is disposed on the front surface of the image display apparatus. The sensing unit includes an infrared sensor 21, an ultrasonic sensor 22, a photosensor 23, and a proximity sensor 24. The infrared sensor 21 senses the approach of an external object (including a user and an object). When the sensing unit 20 senses the approach of the external object 400, the controller 60 turns the display unit 30 on. If an external object is not detected for a predetermined time, the display unit 30 can be turned off.

In sensing the approach of the external object 400, a camera module may be used instead of the sensing unit. That is, when the moving object (the approach of the external object) is detected while the camera is turned on, the display unit 30 is turned on, and if there is no moving object for a predetermined time, the display unit 30 is turned off.

Alternatively, when the sensing unit 20 detects the approach of the external object 400, it reproduces the predetermined moving image, and stops the moving image if there is no moving object for a predetermined period of time. Even in this case, a camera can be used instead of the sensing unit.

Or sensing the approach of the external object 400 by the sensing unit 20, a predetermined menu is displayed on the display unit 30, thereby allowing the user to conveniently execute the desired menu.

Alternatively, when the sensing unit 20 detects the approach of the external object 400, it automatically generates a partial image of the predetermined image, displays it in a slide show or a thumbnail form, and if there is no moving object for a predetermined time, The control unit 30 turns off.

[Fourth application example]

7 is an image diagram for explaining a fourth application example to which an image processing method according to an embodiment of the present invention is applied.

7 is a diagram for explaining an example in which the on-off control of the image display apparatus 100 according to the present invention is performed using the portable terminal 500. In FIG. The portable terminal 500 is a product frequently carried by a user, and can be connected to the image display apparatus 100 through WIFI or Bluetooth, as shown in the figure. When the user who holds the portable terminal 500 approaches the image display apparatus 100 within a predetermined distance (range of WIFI or Bluetooth), it recognizes the approach of the terminal through the communication unit 10, , The controller 60 of the image display apparatus 100 turns the display unit 30 on. At the same time, a preset partial image can be automatically displayed on the display unit 30. [

Alternatively, when the display unit 30 is turned on, the position information module 13 may be used. That is, when the user sets a predetermined area, the controller 60 checks whether the image display device 100 has entered the predetermined area through the location information module 13. [ The control unit 60 turns on the display unit 30 and automatically generates a partial image of a predetermined image and displays the partial image on the display unit 30. [ At this time, the predetermined area may be determined based on the tag information previously stored in the tag of the image.

Alternatively, when turning on the display unit 30, the timer included in the control unit 60 may be used, that is, by the date information generated by the setting of the user or included in the tag information of the image, The ON / OFF of the unit 30 is determined. That is, the timer of the control unit 60 turns on the display unit 30 when a date set by the user or a date or time that matches the date information belonging to the image tag information, And display it on the display unit 30 automatically.

The above-described image processing method and image display apparatus using the same can be applied to a configuration and a method of the embodiments described above in a limited manner, May be selectively combined.

1 is a block diagram of an image display apparatus according to an embodiment of the present invention;

2 is a front perspective view of an image display apparatus according to an embodiment of the present invention;

3 is a flowchart illustrating an image processing method according to an embodiment of the present invention.

FIG. 4 is an image diagram for explaining a first application example to which an image processing method according to an embodiment of the present invention is applied. FIG.

FIG. 5 is an explanatory diagram illustrating a second application example to which an image processing method according to an embodiment of the present invention is applied. FIG.

FIG. 6 is an image diagram for explaining a third application example to which an image processing method according to an embodiment of the present invention is applied. FIG.

FIG. 7 is an image for explaining a fourth application example to which an image processing method according to an embodiment of the present invention is applied; FIG.

Claims (11)

Recognizing an object included in the image using an object program; Generating a partial image around the object; And And automatically displaying the generated partial image, Wherein generating the partial image around the object comprises: Confirming whether the image display device has entered a predetermined area based on the tag information previously stored in the tag of the image or checking whether the time information included in the tag information matches the current date or time; And Automatically generating the partial image if the entry of the predetermined area is confirmed or the matching is confirmed, Wherein the step of automatically displaying the generated partial image comprises: Determining whether a portable terminal connected to the short-range wireless communication through a wireless communication unit approaches within a predetermined distance; And turning on the display unit of the image display device in response to the approach of the user when it is determined that the user having the portable terminal is approaching through the wireless communication unit. The method according to claim 1, Wherein the object is a human face. The method according to claim 1, Wherein the step of generating a partial image around the object Determining an aspect ratio of the object; And determining the shape of the partial image in consideration of the aspect ratio. The method according to claim 1, Wherein the step of automatically displaying the generated partial image comprises: And displaying the created partial image as a slide show when the generated partial image is a plurality of partial images. The method according to claim 1, Wherein the step of automatically displaying the generated partial image comprises: Detecting whether the user approaches within a predetermined distance; And And automatically displaying the generated partial image along with the image if the user approaches within a predetermined distance. A memory for storing image data and an object recognition program for recognizing an object in the image; A display unit configured to display the image data; A wireless communication unit for performing short-range wireless communication; And And a control unit for recognizing an object in the image using the object recognition program, generating a partial image around the recognized object, and automatically displaying the partial image on the display unit, Wherein, Based on the tag information previously stored in the tag of the image data, whether or not the image display device has entered a predetermined area, or whether the time information included in the tag information matches the current date or time, If the entry of the predetermined area is confirmed or the matching is confirmed, the partial image is automatically generated, Wherein the control unit determines whether the portable terminal connected by short-range wireless communication approaches within a predetermined distance through the wireless communication unit and, when it is determined that the portable terminal has accessed the portable terminal, ON). The method according to claim 6, Wherein the object is a person's face. The method according to claim 6, Wherein, Determines the aspect ratio of the object, and determines the shape of the partial image in consideration of the aspect ratio. The method according to claim 6, Wherein, Wherein the control unit controls the display unit to display a plurality of partial images in a slide show, the plurality of partial images being generated by a plurality of the objects, thereby generating a plurality of partial images. The method according to claim 6, Further comprising a sensor for sensing a user's access, Wherein, And controls the display unit to automatically display the partial image together with the image when the user approaches within a predetermined distance. The method according to claim 6, Further comprising a sensing unit for measuring a tilt of the imaging device, Wherein, And determines the aspect ratio of the partial image in consideration of the tilt of the image device.

Images