KR101431276B1 - Image related information handling method and image processing apparatus performing the method - Google Patents

Abstract

A method of processing image related information using a touch screen and an image processing apparatus using the same according to the present invention includes the steps of selecting one image coordinate on an image displayed on a screen, checking whether a memo stored in association with the selected image coordinate exists, A memo is created and stored for the selected image coordinates according to whether or not a memo is stored in relation to the coordinates, or a memo is displayed in association with the selected image coordinates, and a specific person in the image Or memorize a memo or the like, and utilize the memo, a more convenient image processing apparatus can be provided to the user.

Image, coordinates, memo, image processing device

Description

TECHNICAL FIELD [0001] The present invention relates to a method for processing image related information using a touch screen and an image processing apparatus using the same,

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to processing of image related information, and more particularly, to a method of processing image related information using a touch screen in which information related to an image on a specific coordinate included in an entire image is stored and utilized, .

Recently, terminals provide various functions and services in order to meet the needs of users, while keypad having a fixed matrix arrangement is still used as a user input device. For example, in the case of a user input device, there has been no significant change in a conventional keypad-type input device even though a color and high-resolution display screen is adopted in the terminal and the slimness and the miniaturization are progressing.

As an alternative to the user interface using the keypad, a large number of terminals produced in the future are expected to be adopted as a touch-type user interface such as a touch pad or a touch screen. This is a result of cost reduction of the touch interface device and solving the problem of low reliability and life time of the conventional touch interface devices.

The touch pad is a flat plate with a pressure sensor. When the touch pad is touched by a finger or a pen, the indicator of the screen moves and the computer recognizes the pressure.

The touch screen includes a position sensor for outputting the coordinates of the touch point by pressing a point on the display screen with a finger or the like. For example, the display screen may be defined as a touch screen device that also serves as a touch pad.

Such touch-type input devices include a pressure resistive film type, a contact type capacitance type, a surface acoustic wave (SAW) type, an infrared light sensing type, and a piezoelectric type. Of these, a pressure type resistive membrane type, which has a high transmittance, a high reaction speed and a high resistance, and is less influenced by the operating environment, is generally employed most as a touch screen.

In particular, the touch screen can provide interactive and immediate correspondence between the content displayed on the screen and the content input through the screen, and various types of input can be performed in a variety of ways, thereby providing high user satisfaction and ease of use can do. In other words, as compared to a conventional user input device such as a keypad having a fixed arrangement, various types of input and output can be simultaneously realized as a concept of integrating an output device and an input device constituting a user interface. In particular, it becomes possible to realize input through a graphic-based person while changing from a text-based interface composed of numerals and characters to a high-resolution graphic-based interface in the related art, and the keypad installation area is omitted when the keypad is replaced So that it is possible to display a relatively large screen on a terminal having the same volume.

Various applications have been proposed for the application using the touch screen, but applications for storing or retrieving information related to the image displayed on the touch screen are not provided. In recent years, there has been a need for such a new application in consideration of the current situation in which applications such as photographing and image transmission using mobile communication terminals are widely used among users.

Accordingly, the present invention provides an image-related information processing method using a storage touch screen, which enables a user to record a note on image coordinates selected by a user on an image displayed on a screen, And an object thereof is to provide a processing apparatus.

According to an aspect of the present invention, there is provided a method of processing image-related information using a touch screen, the method comprising: selecting one image coordinate on an image displayed on a screen; A step of generating a memo for the selected image coordinates according to whether or not there is a memo stored in relation to the selected image coordinates and displaying a memo stored in association with the selected image coordinates .

When a memo is created and stored for the selected image coordinates or a memo is displayed related to the selected image coordinates, if there is no memo associated with the selected image coordinates, Displaying at least one memo-related category associated with the selected image coordinates; storing one of the objects selected by the user in the address book and a memo recorded by the user for a category selected by the user among the memo-related categories .

The step of storing the memo recorded by the user is characterized in that the memo information inputted by the user is matched with the selected image coordinates, the selected one of the address book, and the name of the image and is stored.

The note related category may include at least one of a text memo, a voice memo, and a moving picture memo.

Wherein the object is a person or an object on the image.

In the step of creating and saving a memo for the selected image coordinates or displaying a memo relating to the selected image coordinates, if the memo already stored in association with the selected image memo already exists, And outputting the memo of the category selected by the user.

The step of creating a memo for the selected image coordinates and displaying the memo in association with the selected image coordinates may include displaying the memo in a pop-up form when there is only one memo associated with the selected image coordinates And outputs the output signal.

According to another aspect of the present invention, there is provided a method for processing image related information using a touch screen, comprising: selecting one image coordinate on an image displayed on a screen; providing an address book related to the selected image coordinate to a user; And storing the memo recorded by the user with respect to the object selected by the user.

The step of storing the memo recorded by the user is characterized in that the memo information recorded by the user is matched with the selected image coordinate, the selected one of the address book, and the name of the image and is stored.

The method of processing image related information using the touch screen may further include displaying at least one memo related category related to the selected image coordinates. In this case, the step of storing the memo recorded by the user may include: And stores the memo recorded by the user for a category selected by the user among the memo-related categories and an object selected by the user from among the address book.

According to another aspect of the present invention, there is provided an image processing apparatus including a touch controller for calculating and outputting an image coordinate value for one touch region selected by a user among images displayed on a screen, And a central control unit for generating a memo for the selected image coordinates according to whether or not there is a memo stored in association with the selected image coordinates or displaying a memo stored in association with the selected image coordinates .

Wherein the central control unit displays at least one memo-related category associated with the address book and the selected image coordinates associated with the selected image coordinates when there is no memo associated with the selected image coordinates, The memo recorded by the user is matched to the name of the image selected by the user from among the address book, the category selected by the user among the memo-related categories, and the name of the image.

The central control unit may display the stored memo by category if the memo already stored in association with the selected image coordinates already exists, and output the memo of the category selected by the user.

According to another aspect of the present invention, there is provided an image processing apparatus including a touch controller for calculating and outputting an image coordinate value for one touch region selected by a user among images displayed on a screen, and an address book related to the image coordinate value to a user And a central control unit for storing the memo recorded by the user on the object selected by the user among the address book.

According to the present invention, in a portable terminal including an image processing module having a touch screen, a memo is stored and utilized for a specific person or object in an image while an image such as a photograph is displayed, The device can be provided to the user.

While the invention is susceptible to various modifications and alternative forms, specific embodiments thereof are shown by way of example in the drawings and will herein be described in detail. It is to be understood, however, that the invention is not to be limited to the specific embodiments, but includes all modifications, equivalents, and alternatives falling within the spirit and scope of the invention. Like reference numerals are used for like elements in describing each drawing.

The terms first, second, etc. may be used to describe various components, but the components should not be limited by the terms. The terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, the first component may be referred to as a second component, and similarly, the second component may also be referred to as a first component. And / or < / RTI > includes any combination of a plurality of related listed items or any of a plurality of related listed items.

The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. The singular expressions include plural expressions unless the context clearly dictates otherwise. In the present application, the terms "comprises" or "having" and the like are used to specify that there is a feature, a number, a step, an operation, an element, a component or a combination thereof described in the specification, But do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, or combinations thereof.

Unless defined otherwise, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. Terms such as those defined in commonly used dictionaries are to be interpreted as having a meaning consistent with the contextual meaning of the related art and are to be interpreted as either ideal or overly formal in the sense of the present application Do not.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. Hereinafter, the same reference numerals will be used for the same constituent elements in the drawings, and redundant explanations for the same constituent elements will be omitted.

1A to 1D are conceptual diagrams illustrating a method of storing image related information in an image processing apparatus using a touch screen according to the present invention.

1A shows a screen image when a specific coordinate area is touched while a user has stored a photograph stored in the image processing apparatus or immediately picked up a photograph and displayed on the screen. FIG. 1A shows a case where there is no information stored in association with a touched coordinate area. In Fig. 1A, the coordinates touched by the user are x = 30, y = 35. When the user selects a specific coordinate on the displayed image as in Fig. 1A, a pop-up menu is executed in the touched coordinate as shown in Fig. 1B. The pop-up menu provides a note by category for the image coordinates. 1B, a voice memo, a text memo, a camcorder (movie) memo, and the like are provided, but the user has selected the current text memo.

1C shows a menu provided when the user selects a text memo. That is, in FIG. 1C, the address book stored by the image processing apparatus according to the present invention is provided so that a person corresponding to the selected image coordinates can be selected. When the user selects a person named "Kim Dae Jin" among the persons in the address book provided in FIG. 1C, a screen for memorizing the text of the selected person is provided as shown in FIG. When a text memo is selected as shown in FIG. 1B, a screen for inputting and storing text is provided. When a voice memo is selected, an application for voice recording and storage will be provided as shown in FIG. When a camcorder (movie) memo is selected, an application for video recording and storage is provided as shown in FIG. 1d. When the user finishes inputting, the information stored by the image processing apparatus according to the present invention includes an image name (e.g., a photograph name in the case of a photograph), a path in which the image is stored, address book information related to the image, Data regarding coordinates having storage information, and content information such as text, voice, or cam totem memories stored for each coordinate.

The image related information processing method according to the present invention can be applied to various modifications other than the example shown in Figs. 1A to 1D. For example, as shown in FIG. 1C, when the address book of a specific person is displayed on the screen, a function of making a call to a phone number registered in the person can be provided. In addition, the present invention may store information about a particular object in an image as well as a person. For example, information about the terminal may be input in the form of text, voice, or moving picture, and utilized in a photograph displaying various models of portable terminals.

FIG. 2 shows the screen of the image processing apparatus according to the present invention when there is information stored in association with image coordinates touched by a user.

When the user selects the coordinates of the specific position among the displayed images, the information stored in association with the touched image coordinates is displayed as shown in FIG. As a method of displaying the coordinates storing the image-related information, for example, a method of displaying a mark, such as a circle or an icon, on the user's face part of the photograph may be used.

FIG. 2 shows a pop-up menu in the case where a voice memo, a text memo, and a camcorder memo are stored in association with the selected image coordinates. However, if there is one memo, the pop-up text, audio output, The contents of the memo can be output in the form

In the above embodiments of the present invention shown in FIGS. 1A to 1D and FIG. 2, an image is a photograph, but any image provided in the form of a two-dimensional or three- And will be included in the scope of the invention.

3 is a block diagram of a mobile terminal to which an image related information processing method according to an embodiment of the present invention is applied.

The portable terminal according to the present invention includes a touch input unit 310, a key input unit 320, a camera module unit 330, a microphone 340, a control unit 350, a storage unit 360, a display unit 370, (380), a wireless transceiver (390), and the like. Here, the control unit 350 may include a touch control unit 351 and a central control unit 353.

3, the touch input unit 310 receives at least one touch input from a user and converts it into a form of potential difference, capacitance, wavelength, or IR light interrupt, and outputs the converted result to the touch control unit 351. [ . Here, the touch input unit 310 includes a touch screen, and may include a touch pad in addition to a touch screen.

The touch control unit 351 receives a value having a form such as a potential difference, a capacitance, a wavelength, or an IR light interruption with respect to a predetermined touch input from the touch input unit 310 and outputs it as a coordinate value form (X, Y) And outputs the result of the conversion to the central control unit 353. In particular, the touch controller 351 according to the present invention calculates an image coordinate value for a selected touch area using a touch pen, a finger, or the like, by a user among the images displayed on the screen, And outputs it to the central control unit 353.

The key input unit 320 receives a key input from a user on a keypad, converts the key input into a key code corresponding to the key input, and outputs the converted key code to the central control unit 353. [ Here, the key input unit 320 may be omitted when the portable terminal device according to the present invention is implemented as a front touch screen.

The camera module unit 330 converts the photographed image image into a form of image data that can be displayed through image processing, and outputs the image data to the central control unit 353. The camera module unit 330 may include a camera (not shown) and an image processing unit (not shown) including a CMOS image sensor or a CCD image sensor.

The microphone 340 converts the ambient sound of the user and / or the user into an electrical signal form and outputs the electrical signal to the central control unit 353.

The central control unit 353 checks whether or not there is a memo stored in association with the coordinate value of the image received from the touch control unit 351. If there is no memo stored, And stores the memo information inputted by the user in relation to the selected category and the address book by matching with the names of the image coordinates, the address book, and the image.

On the other hand, when the memo already stored in association with the selected image coordinates already exists, the central control unit 353 directly outputs the stored memo to the pop-up window, or if the stored memo is a plurality of memos for various categories, Prints the memo according to your choice.

The central control unit 353 also receives a key code from the key input unit 320 and inputs at least a character corresponding to the key code, a numeric input, a setting change of the image processing apparatus, a setting display of the image processing apparatus, One operation can be performed.

The central control unit 353 receives the image data from the camera module unit 330 and stores the image data in the storage unit 360 in the form of an image file recognizable in a file system such as FAT16 or FAT32 , It is possible to perform operations such as deletion, name change, folder position shift, and the like on the stored image file, post-processing such as image brightness adjustment, image color adjustment, and insertion of characters into an image.

The central control unit 353 receives an electrical signal from the microphone 340, converts the electrical signal into an electrical signal that can be transmitted through speech processing, and outputs the converted electrical signal to the wireless transmitting / receiving unit 390.

The central control unit 353 receives an electrical signal corresponding to the voice of the other party from the wireless transmitting / receiving unit 390, converts the electrical signal into an electrical signal that can be output via audio processing, 380).

The storage unit 360 receives and stores at least one of the setting information of the image processing apparatus, the operating system execution information, and the application execution information from the central control unit 353. The central processing unit 353 receives the setting information, And outputs at least one of execution information and application execution information to the central control unit 353.

The display unit 370 receives the image data from the central control unit 353 and outputs the image data on the screen of the image processing apparatus. The display unit 370 may be implemented using a display device such as a liquid crystal display (LCD).

The speaker 380 receives an electrical signal from the central control unit 353, converts the electrical signal into sound, and outputs the sound.

The wireless transmitting / receiving unit 390 receives a transmittable electrical signal corresponding to a user and / or a sound around the user from the central control unit 353, and can transmit a transmittable electrical signal to the other portable terminal through a wired or wireless network .

The wireless transceiver 390 receives an electrical signal corresponding to the voice of the other party through a wired or wireless network from the counterpart terminal and outputs an electrical signal corresponding to the voice of the other party to the central control unit 353.

The touch control unit 351 and the central control unit 353 according to the present invention may be embodied as one semiconductor chip by being implemented as one block like the control unit 350. [ Also, in another embodiment of the present invention, the touch input unit 310 and the touch control unit 351 may be implemented as one block like a touch screen module unit (not shown). For example, the touch control unit 351 may be manufactured together by the same semiconductor process as the touch input unit 310 manufacturing process.

4 is a flowchart illustrating an operation of the image-related information processing method using the touch screen according to the present invention.

First, a specific image is displayed on the screen (S401). A user selects a specific image coordinate using a touch pen or a finger on the displayed image (S402). When a specific image coordinate is selected by the user, the image processing apparatus according to the present invention checks whether there is a memorized note associated with the selected image coordinate (S403). If it is determined in step S403 that there is no stored memo associated with the selected image coordinates (NO in step S403), the image processing apparatus provides a pop-up menu for selecting memos for each category (step S404). Also, an address book related to the selected image coordinates is provided in the form of a pop-up menu (S405). When the user selects a specific person on the category and the address book, the information of the text memo, the voice memo, or the moving picture memo inputted by the user is matched with the image coordinates, the address book, and the name of the image and is stored (S406).

On the other hand, if it is determined in step S403 that the memo already stored in association with the selected image coordinates exists (YES in step S403), it is checked whether there is one memo associated with the selected image coordinate in step S410. If there is one related memo (YES in S410), the corresponding information is output (S420). That is, in the case of a text memo, the text is displayed. In the case of a voice memo, the voice is outputted. In case of a memo memo, the corresponding memo is output. However, if there are two or more related memos (NO in S410), the type of memo present for each category is provided and displayed (S411). When the user selects one of the memos provided for each category, the image processing apparatus according to the present invention outputs the memo of the selected category (S412). Also in this case, if the selected memo is a text memo, the corresponding text is displayed. If the selected memo is a voice memo, the voice is outputted. If the memo is a memo memo, the corresponding memo is outputted.

The above-described image processing apparatus according to the present invention can be applied not only to a mobile communication terminal to which an image processing module having a touch screen is applied, but also to a personal digital assistant (PDA), a portable multimedia player (PMP) Player, and the like, having a touch screen.

It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined in the appended claims. It will be possible.

FIGS. 1A to 1D are conceptual diagrams illustrating a method of storing image related information in an image processing apparatus using a touch screen according to the present invention.

2 is a view showing a screen in the case where there is information stored in association with image coordinates touched by a user in the image processing apparatus according to the present invention.

3 is a block diagram of a mobile terminal to which an image related information processing method according to an embodiment of the present invention is applied.

4 is a flowchart illustrating an operation of an image-related information processing method using a touch screen according to the present invention.

Description of the Related Art [0002]

310: touch input unit 320: key input unit

330: camera module section 340: microphone

350: control unit 360: storage unit

370: Display section 380: Speaker

390: Wireless transmission /

Claims (20)

Selecting one image coordinate on the image displayed on the screen; Checking whether a stored memo exists in relation to the selected image coordinates; And Creating a memo for the selected image coordinates, or displaying a memo associated with the selected image coordinates, depending on whether or not a memo is stored associated with the selected image coordinates, Creating and saving a memo for the selected image coordinates, or displaying a memo associated with the selected image coordinates, If no memo is stored in association with the selected image coordinates, Displaying an address book associated with the selected image coordinates and at least one memo related category associated with the selected image coordinates; Storing one of the objects selected by the user in the address book and a memo recorded by the user for a category selected by the user among the memo related categories. delete The method according to claim 1, Wherein the step of storing the memo recorded by the user comprises: Wherein the memo information input by the user is stored by matching the selected memo information with the selected image coordinates, the selected one of the address book, and the name of the image. The method according to claim 1, Wherein the memo-related category includes at least one of a text memo, a voice memo, and a moving picture memo. The method according to claim 1 or 3, Wherein the object is a person or an object on the image. The method according to claim 1, Creating and saving a memo for the selected image coordinates, or displaying a memo associated with the selected image coordinates, If the memo already stored in association with the selected image coordinates already exists, Displaying the stored memo by category; Wow And outputting a note of the category selected by the user. The method according to claim 1, Wherein the step of creating a memo for the selected image coordinates and displaying the memo in association with the selected image coordinates comprises: And if there is only one stored memo in relation to the selected image coordinates, the stored memo is output in a pop-up form. Selecting one image coordinate on the image displayed on the screen; Providing an address book associated with the selected image coordinates to a user; And Storing a memo recorded by a user on an object selected by the user of the address book, Wherein the step of storing the memo recorded by the user comprises: Wherein the memo information recorded by the user is stored by matching the selected memo information with the selected image coordinates, the selected one of the address book, and the name of the image. delete 9. The method of claim 8, Further comprising displaying at least one memo-related category associated with the selected image coordinates, Wherein the step of storing the memo recorded by the user comprises: Storing a memo recorded by the user for a selected one of the memo-related categories and one selected by the user from among the address book, the memo selected by the user. 11. The method according to claim 8 or 10, Wherein the object is a person or an object on the image. A touch screen control unit for calculating and outputting an image coordinate value for one touch region selected by the user among the images displayed on the screen; Wow A memory for storing the selected image coordinates; a memory for storing the selected image coordinates; a memory for storing the selected image coordinates; And a central control unit for displaying a memo, The central control unit, If no memo is stored in association with the selected image coordinates, Displaying an address book associated with the selected image coordinates and at least one memo related category associated with the selected image coordinates, Wherein a memo recorded by the user for the selected image coordinates is stored by matching one of the objects selected by the user among the address book, the category selected by the user among the memo related categories, and the name of the image. Image processing apparatus. delete 13. The method of claim 12, Wherein the memo-related category includes at least one of a text memo, a voice memo, and a moving picture memo. 13. The method of claim 12, The central control unit, If the memo already stored in association with the selected image coordinates already exists, Displays the stored memo by category, and outputs the memo of the category selected by the user. 13. The method of claim 12, Wherein the object is a person or an object on the image. A touch screen control unit for calculating and outputting an image coordinate value for one touch region selected by the user among the images displayed on the screen; Wow And a central control unit for providing an address book related to the image coordinate value to a user and storing a memo recorded by a user on an object selected by the user among the address book, The central control unit, And stores the memo information recorded by the user in correspondence with the selected image coordinates, the selected one of the address book, and the name of the image. delete 18. The method of claim 17, The central control unit, Displaying at least one memo-related category associated with the selected image coordinate, storing one of the objects selected by the user in the address book and the memo recorded by the user for the category selected by the user among the memo-related categories And the image processing apparatus. The method according to claim 17 or 19, Wherein the object is a person or an object on the image.

Images