KR20150080796A

KR20150080796A - Method for processing data and an electronic device thereof

Info

Publication number: KR20150080796A
Application number: KR1020140000285A
Authority: KR
Inventors: 한용길; 안진완
Original assignee: 삼성전자주식회사
Priority date: 2014-01-02
Filing date: 2014-01-02
Publication date: 2015-07-10

Abstract

According to an embodiment of the present invention, a method for operating an electronic device comprises the operations of: displaying one or more objects on a display; selecting at least a part of objects from the display, and receiving designed user input; responding to the reception of the user input, and storing data related to one or more objects; and responding to the reception of the user input, and automatically executing at least one application formed to use the data.

Description

[0001] METHOD FOR PROCESSING DATA AND AN ELECTRONIC DEVICE THEREOF [0002]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a method and an electronic apparatus for selecting information in an electronic device and storing selected information.

An electronic device is a terminal that supports a communication function or a multimedia function based on mobility, and is used in various fields due to its convenience of use and portability. The electronic device may provide an input device such as a touch screen panel, a keypad for user input, and may control various application programs provided by the electronic device through the provided input device.

On the other hand, the electronic device can provide a memo function as one of information input methods. The memo function can store the information input through the input device and can check the stored memo.

Various embodiments of the present invention may provide a method and an electronic device for storing one or more information being displayed in an electronic device.

Various embodiments of the present invention may provide a method and apparatus for providing various types of information in operating a memo function.

According to various embodiments of the present invention, there is provided a method of operating an electronic device, the method comprising: displaying one or more objects on a display; selecting at least a portion of the objects in the display; receiving a designated user input; In response to receiving the user input, storing data associated with the one or more of the objects; and in response to receiving the user input, configuring at least one application configured to use the data May be automatically executed.

According to various embodiments of the present invention there is provided an electronic device comprising a display, a memory, and at least one processor for displaying one or more objects, wherein the processor is adapted to select at least a portion of the objects Receive user input, store data associated with the one or more of the objects, and automatically execute at least one application configured to use the data.

According to various embodiments of the present invention, there is provided an electronic device for displaying one or more objects on a first layer, selecting one or more of the objects from the one or more objects of the first layer, Displaying a memo application in a first area of the two layers, displaying the selected one or more objects in a second area of the second layer, selecting at least one of the objects displayed in the second area, And an application or program for processing to move or copy the at least one object to the editing area.

According to various embodiments of the present invention, various contents such as text, address, or image selected in the operation of displaying in the electronic device providing the memo function can be attached to the memo function through a simple input.

Figure 1 shows a block diagram for an electronic device according to various embodiments.
Figure 2 shows a memo processing module for an electronic device according to various embodiments.
Figures 3A-3C illustrate operations for providing a memo area in an electronic device according to various embodiments.
Figure 4 illustrates the operation of performing a memo function in an electronic device according to various embodiments.
5 illustrates an operation for performing a memo function in an electronic device according to various embodiments.
6 illustrates an operation for performing a memo function in an electronic device according to various embodiments.
7 illustrates an operation for performing a memo function in an electronic device according to various embodiments.
Figure 8 illustrates an operation for performing a memo function in an electronic device according to various embodiments.
9 shows a flow of operations for performing a memo function in an electronic device according to various embodiments.
10 shows a block diagram of hardware in accordance with various embodiments.

Hereinafter, the present invention will be described with reference to the accompanying drawings. While the invention has been described in terms of specific embodiments and illustrated in the accompanying drawings, it is to be understood that the invention is not limited to those precise embodiments. Accordingly, it is intended that the present invention not be limited to the particular embodiment, but should be understood to include all modifications, equivalents, and alternatives falling within the spirit and scope of the invention. In connection with the description of the drawings, like reference numerals have been used for like elements. Further, the detailed description of well-known functions and constructions that may obscure the gist of the present invention will be omitted. In the following description, only parts necessary for understanding the operation according to various embodiments of the present invention will be described, and the description of other parts will be omitted so as not to obscure the gist of the present invention.

It should be noted that the terms such as " including, " " including, " etc. that may be used in the present invention indicate the existence of a corresponding function, operation, component or the like and do not limit one or more additional functions, . Also, in the present invention, the terms such as "comprises" or "having ", and the like, are used to specify that there is a feature, a number, a step, an operation, an element, a component, But do not preclude the presence or addition of other features, numbers, steps, operations, components, parts, or combinations thereof.

An electronic device according to various embodiments of the present invention may be a device including a communication function. For example, the electronic device may be a smartphone, a tablet personal computer, a mobile phone, a videophone, an e-book reader, a desktop personal computer a laptop computer, a netbook computer, a personal digital assistant (PDA), a portable multimedia player (PMP), an MP3 player, a mobile medical device, a camera, or a wearable device (Eg, head-mounted-device (HMD) such as electronic glasses, electronic apparel, electronic bracelets, electronic necklaces, electronic apps or smartwatch) One can be included. Also, an electronic device according to various embodiments of the present invention may be one or more of the various devices described above. In addition, it is apparent to those skilled in the art that the electronic device according to various embodiments of the present invention is not limited to the above-described devices.

Hereinafter, an electronic device according to various embodiments will be described with reference to the accompanying drawings. The term user as used in various embodiments may refer to a person using an electronic device or a device using an electronic device (e.g., an artificial intelligence electronic device).

Figure 1 shows a block diagram 100 for an electronic device 101 according to various embodiments. 1, the electronic device 101 includes a memo processing module 105, a bus 110, a processor 120, a memory 130, an input / output interface 140, a display 150, . &Lt; / RTI >

The memo processing module 105 may control to select one or more objects that are outputting to the display 150. The memo processing module 105 can call an application that performs the designated operation and processes the memo function. The memo processing module 105 can control the display module to output a memo area displaying the inputted information corresponding to the application processing the memo function that is called. The memo processing module 105 may display the selected object in a designated area of a layer outputting the memo area. The memo processing module 105 can attach (e.g., move or copy) a part or all of the objects displayed on the layer where the memo area is outputted to the memo area, and display the attached object in the memo area.

The bus 110 may be a circuit that interconnects the components described above and communicates (e.g., control messages) between the components described above.

The processor 120 may communicate with other components (e.g., the memory 130, the input / output interface 140, the display 150, the communication interface 160) via the bus 110, Etc.), decrypt the received command, and execute an operation or data processing according to the decrypted command.

The memory 130 (e.g., memory 125) is received from the processor 120 or other components (e.g., the input / output interface 140, the display 150, the communication interface 160, etc.) And may store instructions or data generated by the processor 120 or other components. The memory 130 may include programming modules such as, for example, a kernel 131, a middleware 132, an application programming interface (API) 133, or an application 134. Each of the above-described programming modules may be composed of software, firmware, hardware, or a combination of at least two of them.

The kernel 131 may include system resources used to execute operations or functions implemented in other programming modules, such as the middleware 132, the API 133 or the application 134 : The bus 110, the processor 120, or the memory 130). The kernel 131 may also provide an interface for accessing and controlling or managing the individual components of the electronic device 101 at the middleware 132, the API 133 or the application 134 have.

The middleware 132 can act as an intermediary for the API 133 or the application 134 to communicate with the kernel 131 to exchange data. In addition, the middleware 132 may be configured to communicate with at least one of the (multiple) applications 134, in association with the work requests received from the (multiple) applications 134, Load balancing for work requests can be performed using a method such as assigning a priority to use the system resources (e.g., the bus 110, the processor 120, or the memory 130) of the electronic device 101 Can be performed.

The API 133 is an interface through which the application 134 can control the functions provided by the kernel 131 or the middleware 132. For example, the API 133 is a file control, a window control, And so on. &Lt; / RTI >

The input / output interface 140 may receive commands or data input from a user via a sensor (e.g., an acceleration sensor, a gyro sensor) or an input device (e.g., a keyboard or touch screen) ), The memory 130, the communication interface 160, or the memo processing module 170. For example, the input / output interface 140 may provide the processor 120 with data on the user's touch input via the touch screen. The input / output interface 140 is connected to the output device (for example, the input / output interface 140) via the bus 110 to the processor 120, the memory 130, the communication interface 160, Speaker or display). For example, the input / output interface 140 can output voice data processed through the processor 120 to a user through a speaker.

Display 150 may display various information (e.g., multimedia data or text data, etc.) to the user. The display 150 may comprise a touch screen for inputting commands by touching or proximity touching the input means with the display. The touch screen may include a touch panel to simultaneously perform an input function and a display function. The touch panel can include a liquid-crystal display (LCD) or an active-matrix organic light-emitting diode (AM-OLED) and is flexible, transparent or wearable . The touch panel can recognize a touch input in at least one of an electrostatic, a pressure sensitive, an infrared or an ultrasonic manner. The touch panel may further include a controller. In the case of electrostatic type, the touch panel can recognize not only direct touch but also proximity touch. The proximity touch may also be referred to as contactless touch or hovering. Such a touch panel may further include a tactile layer to provide a tactile response to the user. The touch screen may include a hologram, which can show stereoscopic images in the air using interference of light. Additionally, the touch screen may further comprise a control circuit for controlling the touch panel or hologram. The touch screen and the touch panel may be represented by the display 150, unless otherwise specified in the following description.

The communication interface 160 may connect communications between the electronic device 101 and an external device (e.g., electronic device 102, electronic device 104, or server 106). For example, the communication interface 160 may be a network communication (e.g., an Internet, a LAN, a WAN, a telecommunication network, a cellular network, a satellite network or a plain old telephone service (POTS) (E. G., Universal serial bus (USB), high-definition (HDMI), etc.), wireless local area network (WLAN) definition multimedia interface), RS-232 (recommended standard 232), or plain old telephone service (POTS)). According to one embodiment, a protocol (e.g., a local communication protocol, a network communication protocol, or a wired communication protocol) for communication between the electronic device 101 and an external device is supported by at least one of the API 133 or the middleware 132 . Each of the electronic devices 102 and 104 may be the same (e.g., of the same type) device as the electronic device 101 or a different (e.g., different type) device.

2 shows a memo processing module 105 for an electronic device according to various embodiments.

Referring to FIG. 2, the memo processing module 105 may include one or more modules of a sensing module 210, an acquisition module 220, and a providing module 230.

Various embodiments for each module will be described below.

The sensing module 210 may sense a memo area call occurring in the electronic device 101. [ According to one embodiment, the electronic device 101 may invoke the memo area with one or more text data and / or multimedia data (hereinafter, media data) being output to the display 150. According to one embodiment of invoking a memo area in the electronic device 101, when using an input means such as a touch pen or an electronic pen, the display 150 may be controlled by a button input attached to the input means and / (150) by hovering or touching. According to one embodiment, the electronic device 101 can call a memo area by touching or touching a certain area of the display 150 while pressing a button attached to the touch pen. In calling the memo area, the electronic device 101 may perform an operation of selecting one or more of the objects output to the display 150 and an operation of calling the memo area. According to one embodiment, the electronic device 101 performs an operation of calling a memo area (for example, touching an object or touching an object in a state of pressing a button of an input means) And touching the note area). In addition, according to the above description, the note area is called by performing an operation of selecting an object designated by the input means and calling a note area. However, if the object designated by the input means is selected, And the electronic device 101 can automatically call the memo area when the object is selected by the designated input, without performing a separate gesture for calling the memo area.

If the acquisition module 220 detects an instruction to invoke the memo area in the electronic device 101, the acquisition module 220 may determine whether there is an object selected with the command to invoke the memo area, and if the selected object exists, Information about the object can be obtained. The selected object or corresponding information includes address data in the case of a page having a specified address (e.g., a web page), text data in the selected area in case the selected area is text data, image data in the case of image data, And data for one or more of the thumbnail image data at the selected time point in case of moving image data. However, the present invention is not limited to the memo area. Instead, the electronic device may be linked to the selected object based on the selected object type (for example, the above-described data type). You can call the area of the program that can be accessed, or provide a list of programs that can be interlocked. According to one embodiment, if the selected object is text, a memo string can be called, and if the selected object is an image, the image editing area can be called. According to one embodiment, when the selected object is sound data, a list may be provided to call a sound playback area or a sound edit area, or to select an area to be called in the sound playback area and sound edit area.

The providing module, the electronic device 101, may output the memo area to the specified area of the display module 150 for the memo area call. The electronic device 101 can output a memo area to the generated layer by generating a new layer on the existing layer outputted to the display 150 in outputting the memo area to the display module 150. [ When the electronic device 101 confirms that the selected object exists together at the time of calling the memo area, the electronic device 101 can output information about the selected object to a designated area of the layer displaying the memo area. As described above, the electronic device 101 is specified in an existing layer (e.g., the first layer) so that when a selected object is selected, a designated area associated with the selected object in the new layer (e.g., the second layer) A sound editing region, a sound reproducing region, or a sound editing region) is displayed. However, the present invention is not limited to the implementation of two or more layers (for example, the first layer and the second layer) (E.g., a memo area, an image editing area, a sound reproducing area, or a sound editing area) associated with an object selected in the first layer is divided into (or separated from) As shown in FIG. In the following description, the object selected in the existing layer is not limited to being displayed on a new layer. Instead of displaying an object selected in an existing layer, a specified area related to the object (e.g., a memo area, an image editing area, Area or sound editing area, etc.) can be displayed.

Figures 3A-3C illustrate operations for providing a memo area in the electronic device 101 according to various embodiments.

The electronic device 100 may include a speaker 340 capable of sounding, and may be a side (e.g., upper or lower side), an input device (305) or (307) which can include one button (301) or (303) and can input a command through a touch at a fixed position. Although not shown, the electronic device 100 includes at least one microphone 142 capable of inputting an external sound of the electronic device 100 to be exposed to the outside of the electronic device 100, can do. The electronic device 100 may include a display 150 on the front side and may display the UI operation of the electronic device 101 via the display 150.

The electronic device 100 may be connected to the speaker 340 at the same or other location, not shown for the speaker 340, button 301 or 303, or touch button 305 or 307. [ ), A button (301 or 303) or a touch button (305 or 307).

Hereinafter, various embodiments of the present invention will be described with reference to FIG.

3A, the electronic device 101 may invoke the memo area while outputting contents (e.g., a web page) linked to the address 311 and the specified address 311 specified on the display 150. [ According to one embodiment, the electronic device 101 may display a memo area by creating a layer separate from the layer including the content associated with the designated address 311 and the designated address 311. [ The memo area displayed on the new layer may be a plug-in type application that implements all or some functions of the memo application included in the electronic device 101. [

According to one embodiment, if the area displaying the memo function in the created layer is defined as an 'attachment area', the electronic device 101 can provide the address 311 specified in a designated area (for example, an edit area) outside the 'attachment area' (E.g., page address 321) for the content linked to the specified address 301. [ The electronic device 101 may drag (325) the designated address 311 information displayed in the 'editing area' of the new layer to the memo area to include (for example, attach) the designated address 311 information in the memo area. According to another embodiment, the electronic device 101 displays an attach icon 323 at a specified position in the 'edit area' that displays the address 301 specified in the new layer displaying the memo area and the information of the content linked to the specified address 311, (For example, information attached to the designated address 311 and the designated address 311) included in the 'editing area' can be included (for example, attached) in the memo area when the attachment icon is selected.

The electronic device 101 includes a storage menu 315 for storing information included in the memo area, a cancel menu 317 for exiting the memo area without saving the information contained in the memo area, Or an attachment menu 319 that may attach further data or data that may be obtained via a network communication connection. The electronic device 101 may store new data or existing data including the attached information when the storage menu 315 is selected in a state including information on the designated address 301 and contents connected to the designated address 301. [ The electronic device 101 may include the attached information in the header or body of the data.

3B, the electronic device 101 includes an address 311 assigned to the display 150, various objects connected to the specified address and displayed on the display 150, pictures displayed on the display module 150, Can be displayed. The area in which the object is displayed can be set as an 'editing area', as described above, and the electronic device 101 can select one or more objects from the objects displayed on the display 150. According to one embodiment, the electronic device 101 may sense the operation of selecting a designated address 311 displayed on the display 150 with a designated input means. The electronic device 101 can execute a program related to the attribute of the selected object when the object selected from the objects displayed in the 'editing area' is selected. According to one embodiment, the electronic device 101 may execute one or more programs capable of displaying text, if the selected object is text. Likewise, the electronic device 101 may execute a program capable of displaying an image if the selected object is an image. Similarly, when the selected object is sound data, the electronic device 101 can execute a program capable of outputting sound data. For example, when the electronic device 101 selects the address 311 specified in the objects displayed on the display 150, it can determine that the selected address 311 is composed of text. The electronic device 101 can determine a memo program capable of displaying text by referring to the memory 130 or the database and can display the memo program in the area designated on the display 150 of the electronic device 101. [ In displaying the memo program on the display 150, the electronic device 101 can divide the layer displaying the 'editing area' into two or more areas, and the divided one of the layers displaying the 'editing area' The area can be determined as an 'attachment area'. The electronic device 101 can change the shape and / or size of the 'editing area' in displaying the 'attached area' by dividing the layer in which the 'editing area' is displayed into two or more areas. The electronic device 101 can display the executed memo program in the 'attached area'. The electronic device 101 can display (333) the selected address 311 selected at the designated position of the displayed memo program. The electronic device 101 may select and edit (335) the designated address 333 displayed in the memo program. The electronic device 101 can display an icon 337 displayed with the specified address 333 displayed and can unmark (or delete) the corresponding data displayed in the memo program (e.g., the designated address 333). According to one embodiment, the electronic device 101 can unmark the memo program when there is no data displayed in the memo program displayed.

The electronic device 101 is not limited to the case where the selected object is text, but also can execute the associated program as described above even in the case of image or sound information. In addition, the selected object can be displayed in the executed program, and a menu for editing the displayed object can be provided.

3C, the electronic device 101 includes an electronic device 101 such as a handwriting input through a display module (e.g., a display module including a touch screen panel) 150, input via voice commands, a key pad, ), It is possible to input new information into the memo area displaying the attached information by one or more methods. The electronic device 101 may store the attached information and / or the input information together.

4 illustrates an operation for performing a memo function in the electronic device 101 according to various embodiments.

Referring to FIG. 4, the electronic device 101 may invoke a memo area while displaying a layer (e.g., a web page) containing one or more image data on the display 150. According to one embodiment, the electronic device 101 can display a memo area by creating a layer separate from the layer displaying the image 403. [ The electronic device 101 may also perform an operation of selecting the image output to the display 150 at the time of calling the memo area. According to one embodiment, the electronic device 101 may perform an input (e.g., an operation of touching twice with an input means) to call a memo area on an image 403 displayed on the display 150. [

According to one embodiment, if the area displaying the memo function in the created layer is defined as an 'attachment area', the electronic device 101 calls the memo area in a designated area (for example, an edit area) outside the 'attachment area' And information on the selected image 403 can be displayed. Here, the information about the image 403 displayed in the 'editing area' of the new layer may be a thumbnail image of the image 403 or the image 403 displayed on the existing layer.

The electronic device 101 is not limited to displaying the image 403 selected in conjunction with the memo area call operation in displaying an image acquired from an existing layer in a new layer for displaying the memo area, One or more of the image data or media data being displayed on the same layer as the image 405 may be displayed together.

The electronic device 101 may drag the image 403 displayed in the 'editing area' of the new layer to the memo area 325 to include the image 403 in the memo area (for example, attach). According to another embodiment, the electronic device 101 displays an attachment icon 323 at a specified position in the " editing area " displaying the image 403 in a new layer displaying the memo area or at a specified position in the image 403 If the attachment icon is selected, the data (for example, the image 403) included in the 'edit area' can be included in the memo area (for example, attached). The electronic device 101 may include an image 403 included in an existing layer that performs an operation of calling a memo area with an image included in the memo area, and may include a thumbnail image corresponding to the image .

When the image 403 is attached to the memo area among the image data (e.g., image 401, image 403 and image 405) displayed in the 'edit area' (E.g., 407) displayed on the display 403 and display other acquired images (e.g., 407) that were acquired with the mimic area calling operation.

In attaching the selected image data to the memo area, the electronic device 101 can be attached to a new memo area and attached to the memo area in which the data (e.g., 'I know her' text data 411) have. The electronic device can be set so that the area for displaying the attached data does not overlap with the area for displaying the existing input data when the data is attached to the memo area to which the data is input.

The electronic device 101 includes a storage menu 315 for storing information included in the memo area, a cancel menu 317 for exiting the memo area without saving the information contained in the memo area, Or an attachment menu 319 that may attach further data or data that may be obtained via a network communication connection. The electronic device 101 may store new data or existing data including the attached information when the storage menu 315 is selected with information on the image 403. [ The electronic device 101 may include the attached information in the header or body of the data.

FIG. 5 illustrates an operation for performing a memo function in the electronic device 101 according to various embodiments.

5, electronic device 101 may invoke a memo area with text data (e.g., e-book or web page) displayed on display 150. [ According to one embodiment, the electronic device 101 can select (501) some text data from the output text data and perform an operation to call the memo area in the selected text area 501. [ The electronic device 101 can display a memo area by generating a layer different from a layer outputting text data. The memo area displayed on the new layer may be a plug-in type application that implements all or some functions of the memo application included in the electronic device 101. [

According to one embodiment, if the area displaying the memo function in the created layer is defined as an 'attachment area', the electronic device 101 may select a text area (for example, an edit area) 501) (e.g., page address 321). The electronic device 101 drags (409) the 'editing area' displaying the selected text data 503 displayed in the 'editing area' of the new layer to the memo area and stores the selected text data 505 in the memo area For example, attachment). According to another embodiment, the electronic device 101 can display an attachment icon 323 at a specified position in an 'edit area' that displays text data 503 selected from a new layer displaying a memo area, (For example, information attached to the designated address 301 and the designated address 301) included in the 'editing area' can be included in the memo area (for example, attached). According to one embodiment, the electronic device 101 can reselect a part of the text data output to the 'editing area' and include the reselected text data in the memo area.

6 illustrates an operation for performing a memo function in the electronic device 101 according to various embodiments.

Referring to FIG. 6, the electronic device 101 may call a memo area while outputting a layer (e.g., an image viewer) including image data to the display 150. [ According to one embodiment, the electronic device 101 can display a memo area by generating a layer separate from the layer displaying the image data 601. [ The electronic device 101 may concurrently perform the operation 602 of selecting the image 601 output to the display 150 at the time of calling the memo area. According to one embodiment, the electronic device 101 may perform an input (e.g., an operation of touching twice with an input means) to call a memo area on an image 601 displayed on the display 150. [

According to one embodiment, if the area displaying the memo function in the created layer is defined as an 'attachment area', the electronic device 101 calls the memo area in a designated area (for example, an edit area) outside the 'attachment area' And information on the selected image 601 can be displayed. Here, the information about the image to be displayed in the 'editing area' of the new layer may be the image 601 displayed on the existing layer or the thumbnail image of the image 601.

The electronic device 101 can display a tool 607 that can edit the acquired image in a designated area of the 'editing area' in displaying an image acquired from an existing layer in a new layer displaying a memo area have. The electronic device 101 can edit the image 603 displayed in the " editing area " through a tool 607 for editing the image.

The electronic device 101 may drag (609) the image displayed in the 'editing area' of the new layer to the memo area to include (eg attach) the edited image 603 in the memo area. According to another embodiment, the electronic device 101 may display an attached icon () at a specified position of the " editing area " displaying the edited image 603 in a new layer displaying the memo area or at a specified position of the edited image 603 (Eg, edited image 603) included in the 'edit area' can be included (eg, attached) in the memo area when the attachment icon is selected. The electronic device 101 may include a thumbnail image corresponding to the image 603 edited with the image 605 included in the memo area.

FIG. 7 illustrates an operation for performing a memo function in the electronic device 101 according to various embodiments.

Referring to FIG. 7, the electronic device 101 can call the memo area while outputting a layer (for example, a video player) for playing media data on the display 150. [ According to one embodiment, the electronic device 101 may display a memo area by creating a layer separate from the layer displaying the media data 601 (e.g., a moving image, a moving image). The electronic device 101 may concurrently perform the operation 602 of selecting the image 701 output to the display 150 at the time of calling the memo area. According to one embodiment, the electronic device 101 may perform an operation of calling the memo area on the image 701 output in response to the playback of the media data displayed on the display 150. [

According to one embodiment, if the area displaying the memo function in the created layer is defined as an 'attachment area', the electronic device 101 calls the memo area in a designated area (for example, an edit area) outside the 'attachment area' The information on the image 701 at the time of performing the operation of displaying the image 701 can be displayed. Here, the information on the image to be displayed in the 'editing area' of the new layer may include one or more images 703 (for example, from the output image data 701 to the memo area) Or a thumbnail image of an image corresponding to a point in time when the memo area is called.

The electronic device 101 can display a tool 607 that can edit the acquired image in a designated area of the 'editing area' in displaying an image acquired from an existing layer in a new layer displaying a memo area have. The electronic device 101 can edit the image 703 displayed in the 'edit area' through a tool 607 for editing the image. The electronic device 101 selects the flicker icon (e.g., 711 or 713) displayed in the 'edit area' when there are two or more images obtained from the media data 701 at the time of calling the memo area, One or more images acquired with one image 703 may be displayed.

The electronic device 101 may drag (709) the image displayed in the 'editing area' of the new layer to the memo area to include (e.g. attach) the image 703 in the memo area. According to another embodiment, the electronic device 101 displays an attachment icon 323 at a specified position in the 'editing area' displaying the image 703 in a new layer displaying the memo area or at a designated location in the image 703 (For example, image 703) included in the 'edit area' can be included (for example, attached) in the memo area when the attachment icon is selected. The electronic device 101 may include a thumbnail image corresponding to the image 703 in the image 705 included in the memo area or may be a moving image composed of one or more images contained in the ' have.

FIG. 8 illustrates an operation for performing a memo function in the electronic device 101 according to various embodiments.

Referring to FIG. 8, the electronic device 101 may invoke the memo area while displaying a layer (e.g., a gallery application) displaying one or more images on the display 150. According to one embodiment, electronic device 101 may perform an operation to invoke a memo area with one or more images (e.g., 801, 803, 805, and 807) selected in the gallery application Can be performed. The electronic device 101 generates a separate layer from the one displaying the gallery application and one or more images (e.g., 801, 803, 805, and 807) can do.

According to one embodiment, if the area displaying the memo function in the created layer is defined as an 'attachment area', the electronic device 101 calls the memo area in a designated area (for example, an edit area) outside the 'attachment area' (E.g., 801, 803, 805, and 807) selected at the time of performing the operation of performing the operation shown in FIG. The electronic device 101 may display other selected images (e.g., 801, 805, and 807) centered around the specified (802) image 803 of the selected images, 821).

The electronic device 101 can display a tool 607 that can edit the acquired image in a designated area of the 'editing area' in displaying an image acquired from an existing layer in a new layer displaying a memo area have. The electronic device 101 may include the collapsible menu area 823 when the position to display the tool 607 for editing the acquired image overlaps with other objects.

The electronic device 101 can edit the image 821 displayed in the 'edit area' through a tool 607 for editing the image. The electronic device 101 is displayed with the image 703 displayed by the operation of selecting the turn icon (e.g., (811) or (813)) displayed in the 'edit area' Other acquired images can be displayed for editing. Here, the electronic device 101 displays an icon (e. G., 811 or (810)) that is one of the selected (e.g., 801, 805 and 807) 813), the image corresponding to the image 801 can be displayed as an image 823 so that the image corresponding to the image 801 can be edited.

The electronic device 101 may drag (815) the image displayed in the 'edit area' of the new layer to the memo area to include (e.g. attach) the image 803 in the memo area.

According to another embodiment, the electronic device 101 displays an attachment icon 323 at a specified position of the 'editing area' displaying the image 803 in a new layer displaying the memo area or at a specified position of the image 803 (For example, image 803) included in the 'edit area' can be included (for example, attached) in the memo area when the attachment icon is selected. The electronic device 101 may include the edited image in the memo area if the image 803 is edited.

The electronic device 101 may include a thumbnail image corresponding to the image 803 in the memo area and may be a thumbnail image of the edited image 803 if the image 803 is edited.

9 shows a flow of operations to perform a memo function in the electronic device 101 according to various embodiments.

Referring to FIG. 9, the electronic device 101 may invoke the memo area via the gesture or motion specified in the display 150 ON state, and may include one or more objects in the memo area being called.

At operation 901, the electronic device 101 may sense an operation to invoke the memo application in the display 150 on state. The electronic device 101 may select to include objects such as content, icons, text, and images that are output in one or more applications and / or applications that are outputting to the display 150 in the memo area. According to one embodiment, the electronic device 101 can select and designate one or more objects or ranges output to the display 150, and perform operations to invoke the memo application.

At operation 903, the electronic device 101 may output a memo area corresponding to the memo application being called to the display 150. In displaying the memo area, the electronic device 101 can generate and display a layer different from the layer in which the existing application was performed. A separate layer may be divided into two or more areas such as an 'attachment area' for displaying the memo area and an 'editing area' for displaying one or more objects selected from the layer where the existing application was executed.

The electronic device 101 may display one or more objects selected from the layer on which the existing application was executed on the layer displaying the memo area. According to one embodiment, when one or more images are selected from an existing application, the electronic device 101 can display the selected image in the 'editing area' of the layer displaying the memo area. In displaying the selected image, the electronic device 101 may provide a menu including one or more editing tools for editing the image. The electronic device 101 may provide a menu to switch to one or more images that could not be displayed if one or more images selected could not be displayed in the 'editing area'.

According to one embodiment, when a note area is displayed during reproduction of media data (e.g., moving picture) in an existing application, the electronic device 101 calls the note area in the 'edit area' of the layer displaying the note area It is possible to display one or more images obtained from a moving image on the basis of one point in time.

According to one embodiment, when an existing application that outputs a page including an address such as a web page is operated, the electronic device 101 can display address information in an 'editing area' of a layer displaying a memo area have.

According to one embodiment, when a range of text data is designated and selected in a conventional application that outputs a web page or a document, the electronic device 101 displays text data of a selected range in an 'editing area' of a layer displaying the memo area Can be displayed.

At operation 905, the electronic device 101 may attach one or more objects displayed in the 'editing area' to the memo area. According to one embodiment, the electronic device 101 may drag an 'editing area' into a memo area or select an attached icon displayed in the 'editing area' to attach an object such as text and images included in the editing area as a memo area can do. When the image displayed in the 'editing area' is edited, the electronic device 101 may be an edited image, and the 'editing area' may designate a part of the displayed image and attach it to the memo area You may.

The electronic device 101 may terminate the embodiment of FIG. 9 by performing an operation 905.

According to one embodiment, there is provided a method of operating an electronic device, the method comprising: displaying a first layer; selecting one or more objects in the first layer; invoking a first application; Displaying the first application and the selected object selected on the layer, and attaching all or a portion of the first object to the first application.

According to one embodiment, there is provided a method of operating an electronic device, the method comprising: displaying one or more objects in a first layer; selecting one or more objects from the one or more objects in the first layer; Displaying a memo application in a first area of a second layer and displaying the selected one or more objects in a second area of the second layer; and displaying at least one of the objects displayed in the second area Selecting one of the objects and moving or copying the selected at least one object to the editing area.

According to various embodiments, the operation of selecting the object of the first layer may be performed according to a predetermined input by the input means.

According to various embodiments, the object may include one or more of a web page, an address of the web page, an image, a text, a video, and an application icon.

According to various embodiments, the memo application may be an application for inputting content using one or more of a touch screen panel, a keypad, and a microphone, or a plug-in connected to the application.

According to various embodiments, when the object selected in the first layer includes an image, a menu for editing the image may be provided in the second area of the second layer.

According to various embodiments, the first area may be an editing area.

According to various embodiments, the second area may be an editing area or a non-editing area.

According to one embodiment, there is provided an electronic device comprising: a display for outputting one or more layers; a memory in which information of the outputting layer is stored; one or more objects in a first layer; Selecting one or more objects from the one or more objects, displaying a memo application in a first area of a second layer, displaying the selected one or more objects in a second area of the second layer A memo processing module for selecting at least one of the objects displayed in the second area and moving or copying the selected at least one object to the editing area, and one or more processors . &Lt; / RTI >

According to various embodiments, in the memo processing module, the operation of selecting the object of the first layer may select the object of the first layer according to a predetermined input by the input means.

According to various embodiments, the memo processing module may include one or more of a web page, an address of the web page, an image, a text, a moving image, and an application icon as the object.

According to various embodiments, the memo processing module may display the memo application for inputting content using one or more of a touch screen panel, a keypad, and a microphone on a second layer.

According to various embodiments, the memo processing module may provide a menu for editing the image in the second area of the second layer when the object selected in the first layer includes an image.

According to various embodiments, the memo processing module may provide the first area as an editable area.

According to various embodiments, the memo processing module may provide the second area as an editable area or an uneditable area.

According to one embodiment, the electronic device includes the steps of: displaying one or more objects on a first layer; selecting one or more of the objects from the one or more objects of the first layer; Displaying a memo application in a first area of the layer and displaying the selected one or more objects in a second area of the second layer, selecting at least one of the objects displayed in the second area, And an application or program for performing an operation of moving or copying the selected at least one object to the editing area.

FIG. 10 shows a block diagram of hardware 1000 in accordance with various embodiments. The hardware 1000 may constitute all or part of the electronic device 101 shown in Fig. 1, for example. 10, the hardware 1000 includes one or more processors 1010, a subscriber identification module (SIM) card 1014, a memory 1020, a communication module 1030, a sensor module 1040, a user input module 1050, a display module 1060, an interface 1070, an audio codec 1080, a camera module 1091, a power management module 1095, a battery 1096, an indicator 1097 or a motor 1098 .

The processor 1010 (e.g., the processor 120) may include one or more application processors (APs) 1011 or one or more communication processors (CP) The processor 1010 may be, for example, the processor 120 shown in FIG. 10, the AP 1011 and the CP 1013 are included in the processor 1010. However, the AP 1011 and the CP 1013 may be included in different IC packages. In one embodiment, the AP 1011 and the CP 1013 may be included in one IC package.

The AP 1011 may operate an operating system or an application to control a plurality of hardware or software components connected to the AP 1011, and may perform various data processing and calculations including multimedia data. The AP 1011 may be implemented as a system on chip (SoC), for example. According to one embodiment, the processor 1010 may further include a graphics processing unit (GPU) (not shown).

The CP 1013 can perform the function of managing a data link and converting a communication protocol in communication between an electronic device (for example, the electronic device 101) including the hardware 1000 and other electronic devices connected to the network have. The CP 1013 may be implemented as an SoC, for example. According to one embodiment, the CP 1013 may perform at least a portion of the multimedia control functions. The CP 1013 may perform terminal identification and authentication within the communication network using, for example, a subscriber identity module (e.g., SIM card 1014). Also, the CP 1013 may provide services such as voice call, video call, text message, or packet data to the user.

Also, the CP 1013 can control data transmission / reception of the communication module 1030. [ 10, components such as the CP 1013, the power management module 1095, and the memory 1020 are shown as separate components from the AP 1011. However, according to one embodiment, The AP 1011 may be implemented to include at least a portion of the above-described components (e.g., the CP 1013).

According to one embodiment, the AP 1011 or the CP 1013 may load and process commands or data received from at least one of non-volatile memory or other components connected to the AP 1011 or the CP 1013 to a volatile memory . In addition, the AP 1011 or the CP 1013 may receive data from at least one of the other components or store data generated by at least one of the other components in the nonvolatile memory.

The SIM card 1014 may be a card implementing the subscriber identity module and may be inserted into a slot formed at a specific location of the electronic device. The SIM card 1014 may include unique identification information (e.g., an integrated circuit card identifier (ICCID)) or subscriber information (e.g., international mobile subscriber identity (IMSI)).

The memory 1020 may include an internal memory 1022 or an external memory 1024. The memory 1020 may be, for example, the memory 130 shown in FIG. The built-in memory 1022 may be a nonvolatile memory such as a dynamic RAM (DRAM), a static RAM (SRAM), a synchronous dynamic RAM (SDRAM), or the like, For example, one time programmable ROM (OTPROM), programmable ROM (PROM), erasable and programmable ROM (EPROM), electrically erasable and programmable ROM (EEPROM), mask ROM, flash ROM, NAND flash memory, And may include at least one. According to one embodiment, the internal memory 1022 may take the form of a solid state drive (SSD). The external memory 1024 may be a flash drive such as a compact flash (CF), a secure digital (SD), a micro secure digital (SD), a mini secure digital (SD), an extreme digital A Memory Stick, and the like.

The communication module 1030 may include a wireless communication module 1031 or an RF module 1034. The communication module 1030 may be, for example, the communication module 170 shown in FIG. The wireless communication module 1031 may include, for example, a WiFi 1033, a bluetooth 1035, a GPS 1037, or a near field communication (NFC) 1039. For example, the wireless communication module 1031 may provide a wireless communication function using a radio frequency. Additionally or alternatively, the wireless communication module 1031 may communicate the hardware 1000 to a network (e.g., the Internet, a LAN, a WAN, a telecommunication network, a cellular network, plain old telephone service), or the like) or a modem.

The RF module 1034 can transmit and receive data, for example, an RF signal or a transmitted / received electronic signal. The RF module 1034 may include, for example, a transceiver, a power amplifier module (PAM), a frequency filter, or a low noise amplifier (LNA). The RF module 1034 may further include a component for transmitting and receiving electromagnetic waves in free space in a wireless communication, for example, a conductor or a lead wire.

The sensor module 1040 includes a gesture sensor 1040A, a gyro sensor 1040B, an air pressure sensor 1040C, a magnetic sensor 1040D, an acceleration sensor 1040E, a grip sensor 1040F, At least one of the sensor 1040G, the RGB sensor 1040H, the biometric sensor 1040I, the ON / humidity sensor 1040J, the illuminance sensor 1040K, or the UV sensor 1040M . The sensor module 1040 may measure a physical quantity or sense an operating state of the electronic device to convert the measured or sensed information into an electrical signal. Additionally / alternatively, the sensor module 1040 may be, for example, An electroencephalogram sensor (not shown), an electrocardiogram sensor (not shown), or a fingerprint sensor, for example, an E-nose sensor (not shown), an EMG sensor The sensor module 1040 may further include a control circuit for controlling at least one sensor included therein.

The user input module 1050 may include a touch panel 1052, a (digital) pen sensor 1054, a key 1056, or an ultrasonic input device 1058 . The user input module 1050 may be, for example, the input / output interface 140 shown in FIG. The touch panel 1052 can recognize a touch input in at least one of an electrostatic type, a pressure sensitive type, an infrared type, and an ultrasonic type. In addition, the touch panel 1052 may further include a controller (not shown). In the case of electrostatic type, proximity recognition is possible as well as direct touch. The touch panel 1052 may further include a tactile layer. In this case, the touch panel 1052 may provide a tactile response to the user.

The (digital) pen sensor 1054 can be implemented using the same or similar method as receiving the touch input of the user, or using a separate recognition sheet, for example. As the key 1056, for example, a keypad or a touch key may be used. The ultrasonic wave input device 1058 is a device that can confirm data by sensing a sound wave from a terminal to a microphone (e.g., a microphone 1088) through a pen that generates an ultrasonic signal, and is capable of wireless recognition. According to one embodiment, the hardware 1000 may use the communication module 1030 to receive user input from an external device (e.g., a network, a computer or a server) connected thereto.

The display module 1060 may include a panel 1062 or a hologram 1064. The display module 1060 may be, for example, the display 150 shown in FIG. The panel 1062 may be, for example, a liquid-crystal display (LCD) or an active-matrix organic light-emitting diode (AM-OLED). The panel 1062 may be embodied, for example, in a flexible, transparent or wearable manner. The panel 1062 may be formed of one module with the touch panel 1052. [ The hologram 1064 can display stereoscopic images in the air using interference of light. According to one embodiment, the display module 1060 may further include a control circuit for controlling the panel 1062 or the hologram 1064.

The interface 1010 may include, for example, a high-definition multimedia interface (HDMI) 1012, a universal serial bus (USB) 1014, a projector 1016 or a D-sub . Additionally or alternatively, the interface 1010 may include, for example, a secure digital (SD) / multi-media card (MMC) (not shown) or an IrDA (infrared data association;

The audio CODEC 1080 can convert voice and electric signals in both directions. The audio codec 1080 can convert audio information input or output through, for example, a speaker 1082, a receiver 1082, an earphone 1086, a microphone 1088, or the like.

The camera module 1091 is a device capable of capturing an image and a moving image. According to an embodiment, the camera module 1091 may include at least one image sensor (e.g., a front lens or a rear lens), an image signal processor (ISP) flash LED, not shown).

The power management module 1095 can manage the power of the hardware 1000. Although not shown, the power management module 1095 may include, for example, a power management integrated circuit (PMIC), a charger integrated circuit (IC), or a battery fuel gauge.

The PMIC can be mounted, for example, in an integrated circuit or a SoC semiconductor. The charging method can be classified into wired and wireless. The charging IC can charge the battery, and can prevent an overvoltage or an overcurrent from the charger. According to one embodiment, the charging IC may comprise a charging IC for at least one of a wired charging scheme or a wireless charging scheme. Examples of the wireless charging system include a magnetic resonance system, a magnetic induction system or an electromagnetic wave system, and additional circuits for wireless charging, for example, a coil loop, a resonant circuit, a rectifier, have.

The battery gauge can measure, for example, the remaining amount of the battery 1096, the voltage during charging, the current or the temperature. The battery 1096 may generate electricity to supply power, and may be, for example, a rechargeable battery.

The indicator 1097 may indicate a specific state of the hardware 1000 or a part thereof (e.g., the AP 1011), for example, a boot state, a message state, or a charged state. The motor 1098 can convert the electrical signal into mechanical vibration. The MCU 1099 can control the sensor module 1040.

Although not shown, the hardware 1000 may include a processing unit (e.g., a GPU) for mobile TV support. The processing device for supporting the mobile TV can process media data conforming to standards such as digital multimedia broadcasting (DMB), digital video broadcasting (DVB), or media flow. Each of the above-described components of the hardware according to the present invention may be composed of one or more components, and the name of the component may be changed according to the type of the electronic device. The hardware according to the present invention may be configured to include at least one of the above-described components, and some of the components may be omitted or further include other additional components. In addition, some of the components of the hardware according to the present invention may be combined into one entity, thereby performing the functions of the corresponding components before being combined.

The term " module " as used in the present invention may mean a unit including, for example, one or a combination of hardware, software, or firmware. A " module " may be interchangeably used with terms such as, for example, unit, logic, logical block, component or circuit. A " module " may be a minimum unit or a portion of an integrally constructed component. A " module " may be a minimum unit or a portion thereof that performs one or more functions. &Quot; Modules " may be implemented either mechanically or electronically. For example, a " module " in accordance with the present invention may be an application-specific integrated circuit (ASIC) chip, field-programmable gate arrays (FPGAs) or programmable- logic device).

According to various embodiments, at least a portion of a device (e.g., modules or functions thereof) or a method (e.g., operations) according to the present invention may be stored in a computer readable storage medium -readable storage media). The instructions, when executed by one or more processors (e.g., processor 101) 1, may cause the one or more processors to perform functions corresponding to the instructions. The computer readable storage medium may be, for example, the memory 102 (0). At least some of the programming modules may be implemented (e.g., executed) by, for example, the processor 101 1. At least some of the programming modules may include, for example, modules, applications, routines, sets of instructions and / or processes for performing one or more functions.

The programming module according to the present invention may include at least one or more of the above-described elements, some of which may be omitted, or may further include other additional elements. Operations performed by a programming module or other component in accordance with the present invention may be performed in a sequential, parallel, iterative, or heuristic manner. Also, some operations may be performed in a different order, omitted, or other operations may be added.

The computer-readable recording medium includes a magnetic medium such as a hard disk, a floppy disk and a magnetic tape, an optical recording medium such as a CD-ROM (Compact Disc Read Only Memory), a DVD (Digital Versatile Disc) Optical media such as a floppy disk and an application command such as a read only memory (ROM), a random access memory (RAM), a flash memory, Module) that is configured to store and perform the functions described herein. In addition, the application instructions may include machine language code such as those generated by the compiler, as well as high-level language code that may be executed by a computer using an interpreter or the like. The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the present invention, and vice versa.

It is to be understood that both the foregoing general description and the following detailed description of the present invention are exemplary and explanatory and are intended to provide further explanation of the invention as claimed. Therefore, the scope of the present invention should be construed as being included in the scope of the present invention without departing from the scope of the present invention.

101: Electronic device 150: Display module

Claims

A method of operating an electronic device,
Displaying one or more objects on a display;
Selecting at least some of the objects in the display and receiving designated user input;
Storing data associated with the one or more of the objects in response to receiving the user input; And
In response to receiving the user input, automatically executing at least one application configured to use the data.

2. The method of claim 1,
Further comprising displaying the data at a designated location on the display indicating the application.

3. The method of claim 2,
And after said displaying operation.

2. The method of claim 1,
Further comprising providing the application with the display to edit the data into the application.

The method of claim 1,
A web page displayed on the display, an address of the web page, an image, a text, a video image, and an application icon.

The method according to claim 1,
A memo program, an image editing program, a sound reproducing program, and a sound editing program.

In an electronic device,
A display that displays one or more objects;
Memory; And
At least one processor,
The processor
Receiving a designated user input for selecting at least a portion of the objects in the display, storing data associated with the one or more of the objects, and automatically executing at least one application configured to use the data Electronic device.

8. The apparatus of claim 7,
And displays the data at a designated position of the display indicating the application.

8. The apparatus of claim 7,
And deletes the associated data after the displaying operation.

8. The apparatus of claim 7,
And the application is displayed on the display to edit the data into the application.

8. The apparatus of claim 7,
And displaying one or more of the web page displayed on the display, the address of the web page, the image, the text, the image, and the application icon on the display.

8. The apparatus of claim 7,
A memo program, an image editing program, a sound reproducing program, and a sound editing program.

A method of operating an electronic device,
Displaying one or more objects on a first layer;
Selecting one or more of the one or more objects of the first layer;
Displaying a memo application in a first area of a second layer and displaying the selected one or more objects in a second area of the second layer;
Selecting at least one of the objects displayed in the second area; And
And moving or copying the selected at least one object to the editing area.

14. The method of claim 13, wherein the act of selecting the object of the first layer comprises:
Wherein the input is performed in accordance with a predetermined input by the input means.

14. The method of claim 13,
A web page, an address of the web page, an image, a text, a video, and an application icon.

14. The memo application according to claim 13,
Wherein the application is a plug-in connected to the application or an application for inputting content using one or more of a touch screen panel, a keypad, and a microphone.

14. The method of claim 13,
And if the object selected in the first layer includes an image, providing a menu for editing the image in the second region of the second layer.

14. The method of claim 13, wherein the first area is an editing area.

14. The method of claim 13, wherein the second region is an edit region or a non-edit region.

In an electronic device,
Displaying one or more objects on a first layer, selecting one or more of the one or more objects of the first layer, displaying a memo application on a first area of a second layer, Displaying the one or more objects in a second area of the second layer, selecting at least one of the objects displayed in the second area, and moving or copying the selected at least one object to the editing area A computer-readable recording medium storing an application or a program for processing.