KR20170018746A - Method for providing user interface and electronic device the same - Google Patents

Abstract

Various embodiments include a user interface, a memory, and one or more processors electrically coupled to the user interface and the memory. The one or more processors detect a touch drag for playing at least one music based on the user interface, identify a plurality of cells corresponding to the touch drag, and display a trace effect according to the touch drag in a region between two cells among the plurality of cells. Other embodiments are also possible. So, a visual effect can be provided according to a playing motion.

Description

TECHNICAL FIELD [0001] The present invention relates to a method of providing a user interface,

Various embodiments relate to a method and apparatus for providing a user interface according to music.

BACKGROUND ART [0002] With the recent development of digital technology, electronic devices capable of moving and communicating and processing personal information such as mobile communication terminals, personal digital assistants (PDAs), electronic notebooks, smart phones, personal computers, wearable devices, Are being released. Such electronic devices have various functions such as voice call and message transmission as well as functions such as photographing, e-mail transmission / reception, broadcast reproduction, Internet, instant messenger, dictionary, game and the like.

In addition, electronic devices provide a variety of functions for playing virtual instruments (such as keyboards, drums, etc.), composing music, or editing music through a variety of musical applications. Accordingly, the user can compose music by using a music application, or record music by directly playing the music, edit various music, and compose and listen to new music. These musical applications provide a metronome function that provides audio and visual effects for tempo (eg, pace, BPM). It also allows you to play different types of music (or instruments) in your music application.

Conventionally, a visual effect is not provided according to a touch operation of a user in a music application. For example, when a user continuously selects a plurality of cells in a music application, the user can not visually indicate which cell he / she has selected.

Various embodiments are directed to a method and apparatus for extracting colors of music elements selected in accordance with a continuous play operation in a music application to provide a visual effect according to a play operation.

Various embodiments are directed to a method and apparatus for representing a trace effect in a region between two cells among a plurality of cells selected in succession according to a touch drag.

Various embodiments are directed to a method and apparatus that can display a color that combines the colors of cells in a space between cells as well as display the colors of the cells when a plurality of cells are successively selected.

An electronic device according to various embodiments includes a display, a memory, and one or more processors electrically coupled to the display and the memory, wherein the one or more processors are configured to display, based on the user interface displayed on the display A touch drag for playing at least one piece of music, identifying a plurality of cells corresponding to the touch drag, and inserting a trace according to the touch drag in an area between two cells among the identified plurality of cells, Effect < / RTI >

According to various embodiments, an operating method of an electronic device includes: detecting a touch drag for playing at least one music based on a user interface; identifying a plurality of cells corresponding to the touch drag; And displaying the trace effect according to the touch drag in an area between two cells among the plurality of identified cells.

According to various embodiments, it is possible to extract the colors of the music elements selected in accordance with the continuous playing operation in the music application, and to provide the visual effect according to the playing operation.

According to various embodiments, a trace effect can be expressed according to a touch drag in an area between two cells among a plurality of consecutively selected cells.

According to various embodiments, when a plurality of cells are consecutively selected, not only the colors of the cells are displayed, but also a color combining the colors of the cells can be displayed in a space between the cells.

According to various embodiments, it can be expressed in various visual affordances according to the touch drag.

1 is a diagram schematically showing the configuration of an electronic device according to various embodiments.
Figures 2 and 3 are diagrams illustrating examples of a user interface of a music application according to various embodiments.
Figures 4-6 are illustrations to illustrate an example of the operation of playing a sound sample in an electronic device according to various embodiments.
7 is a flow chart illustrating a method of operation of an electronic device according to various embodiments.
8A and 8B show an example of displaying a trace effect according to various embodiments.
9 is a flow diagram illustrating a method for displaying a trace effect in accordance with various embodiments.
10 is a diagram illustrating an example of a trace effect according to various embodiments.
11 is a flow diagram illustrating a method for displaying a trace effect according to an input value of a touch drag according to various embodiments.
12 is a diagram illustrating an example of displaying a trace effect according to a touch area according to various embodiments.
13 is a diagram showing an example of displaying a trace effect according to the touch intensity according to various embodiments.
14 is a diagram showing an example of displaying a trace effect according to a touch speed according to various embodiments.
15 is a diagram illustrating an example of displaying a visual effect in accordance with various embodiments.

Various embodiments of the invention will now be described with reference to the accompanying drawings. It should be understood, however, that the description herein is not intended to limit the invention to the particular embodiments, but includes various modifications, equivalents, and / or alternatives of the embodiments of the invention . In connection with the description of the drawings, like reference numerals may be used for similar components. It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory and are intended to provide further explanation of the invention as claimed. Accordingly, the scope of the present invention should be construed as including all modifications or various other embodiments based on the technical idea of the present invention.

The various embodiments of the present invention relate to an electronic device that provides functions such as performance, composition, editing, recording, playback, and the like through a music application and a method of operation thereof. In the following description, the music application may include a mobile digital audio workstation (DAW) application. In various embodiments, a music application may include a first music (e.g., a project) whose performance or effect by at least one virtual instrument is composed of one package, and a second music (e.g., a project) : Sound samples) can be played independently or simultaneously.

In an embodiment of the present invention, the electronic device may be any information communication device, multimedia device, wearable device (e.g., a device capable of performing various music related operations based on a music application) according to various embodiments of the present invention All of which use one or more of various processors such as an application processor (AP), a communication processor (CP), a graphic processing unit (GPU), and a central processing unit (CPU) Device.

An electronic device according to an embodiment of the present invention may be, for example, a smartphone, a tablet personal computer, a mobile phone, a video phone, an e-book reader, Such as a personal computer (PC), a laptop personal computer, a netbook computer, a workstation, a server, a personal digital assistant (PDA), a portable multimedia player (PMP) A camera, or a wearable device (e.g., smart glasses, head-mounted-device, etc.), or a smart watch) have.

Also, in an embodiment of the present invention, the electronic device may be a smart home appliance. Smart home appliances include, for example, televisions, digital video disk players, refrigerators, air conditioners, vacuum cleaners, washing machines, set-top boxes, home automation control panels, (E.g., Samsung HomeSync ^TM , Apple TV ^TM , or Google TV ^TM ), a game console (e.g., Xbox ^TM , PlayStation ^TM ), or electronic frames. Also, in an embodiment of the present invention, the electronic device may include at least one of a navigation device or an internet of things.

In various embodiments, the electronic device may be a combination of one or more of the various devices described above. An electronic device according to some embodiments may be a flexible electronic device. In addition, the electronic device according to the embodiment of the present invention is not limited to the above-described devices, and may include a new electronic device according to technological advancement.

In addition, in the embodiment of the present invention, the term user may refer to a person using an electronic device or a device using an electronic device (e.g., an artificial intelligence electronic device). In an embodiment of the present invention, a module or a program module may include at least one of various components of the present invention, omit some of them, or may further include other additional components. Operations performed by modules, program modules, or other components in accordance with various embodiments may be performed in a sequential, parallel, iterative, or heuristic manner. Also, some operations may be performed in a different order, omitted, or other operations may be added.

Hereinafter, a user interface, a method, and an apparatus for visualizing a musical attribute of a component in a music application according to an embodiment of the present invention will be described with reference to the accompanying drawings. It should be noted, however, that the various embodiments of the present invention are not limited or limited by the following description, and can be applied to various embodiments based on the following embodiments. In the various embodiments of the present invention described below, a hardware approach will be described as an example. However, various embodiments of the present invention include techniques using both hardware and software, so that various embodiments of the present invention do not exclude a software-based approach.

1 is a view schematically showing a configuration of an electronic device according to an embodiment of the present invention.

1, an electronic device 100 according to various embodiments of the present invention includes a wireless communication unit 110, a user input unit 120, a touch screen 130, an audio processing unit 140, a memory 150, an interface unit 160, a camera module 170, 180, and a power supply 190. In various embodiments of the present invention, the electronic device 100 is not necessarily required to have the configurations shown in FIG. 1, but may have more configurations than the configurations shown in FIG. 1, or may be implemented with fewer configurations.

The wireless communication unit 110 may include one or more modules that enable wireless communication between the electronic device 100 and another external electronic device. In various embodiments, the wireless communication unit 110 may include a module (e.g., a local communication module, a telecommunications module, etc.) for communicating with surrounding external electronic devices. For example, the wireless communication unit 110 may include a mobile communication module 111, a wireless local area network (WLAN) module 113, a short range communication module 115, and a location calculation module 117.

The mobile communication module 111 may be a mobile communication network that includes a base station, an external electronic device, and various servers (e.g., an integration server, a provider server, a content server, an Internet server ), Or a cloud server (Cloud Server). The wireless signal may include a voice signal, a data signal, or various types of control signals. The mobile communication module 111 can transmit various data required for the operation of the electronic device 100 to an external device (e.g., a server or another electronic device) in response to a user request. In various embodiments, the mobile communication module 111 may transmit and receive wireless signals based on various communication schemes. For example, the communication scheme may include but is not limited to LTE (Long Term Evolution), LTE-A (LTE Advance), GSM (Global System for Mobile communication), EDGE Code Division Multiple Access (WCDMA), Wideband CDMA (WCDMA), Universal Mobile Telecommunications System (UMTS), or Orthogonal Frequency Division Multiple Access (OFDMA).

The wireless LAN module 113 may represent a module for forming a wireless LAN link with a wireless Internet connection and other external electronic devices. The wireless LAN module 113 may be built in or enclosed in the electronic device 100. As a wireless Internet technology, WiFi (Wireless Fidelity), Wibro (Wireless broadband), WiMax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access), or mmWave (millimeter wave) can be used. The wireless LAN module 113 may interwork with other external electronic devices connected to the electronic device 100 via a network (e.g., a wireless Internet network) to transmit various data of the electronic device 100 to an external device (e.g., an external electronic device or a server) , Or from outside. The wireless LAN module 113 may be kept on at all times or may be turned on according to the setting of the electronic device 100 or the user input.

The short-range communication module 115 may represent a module for performing short-range communication. (Bluetooth), Bluetooth Low Energy (BLE), Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), Zigbee, or NFC Near Field Communication) or the like can be used. The short range communication module 115 may be configured to transmit various data of the electronic device 100 to an external electronic device in cooperation with another external electronic device (e.g., external sound device) connected to the electronic device 100 through a network (e.g., a local area communication network) Can be received. The short-range communication module 115 may be kept on-state at all times, or may be turned on according to the setting of the electronic device 100 or the user input.

The position calculation module 117 is a module for acquiring the position of the electronic device 100, and may include a global position system (GPS) module as a representative example. The position calculation module 115 may measure the position of the electronic device 100 on the basis of triangulation. For example, the location calculation module 117 calculates latitude, longitude, and altitude by calculating distance information and time information from three or more base stations and then applying a trigonometric method to the calculated information, The current position information of the three-dimensional position can be calculated. Or the position calculation module 117 can calculate position information by continuously receiving position information of the electronic device 100 from three or more satellites in real time. The location information of the electronic device 100 can be obtained by various methods.

The user input unit 120 may generate input data for controlling the operation of the electronic device 100 in response to a user input. The user input unit 120 may include at least one input means for detecting various inputs of the user. For example, the user input unit 120 may include a key pad, a dome switch, a physical button, a touch pad (static / static), a jog & shuttle, and a sensor.

A part of the user input unit 120 may be implemented as a button on the outside of the electronic device 100, and some or all of the user input unit 120 may be implemented as a touch panel. The user input 120 may receive user input for initiating an operation of the electronic device 100 (e.g., visualization of the tempo progress information of components in a music application, etc.) according to various embodiments of the present invention, It is possible to generate an input signal according to the input.

The touch screen 130 represents an input / output device capable of simultaneously performing an input function and a display function, and may include a display 131 and a touch sensing unit 133. The touch screen 130 may provide an input / output interface between the electronic device 100 and the user, may transmit the touch input of the user to the electronic device 100, and may also include an intermediary role for displaying the output from the electronic device 100 to the user. The touch screen 130 may show a visual output to the user. The visual output may appear in the form of text, graphics, video, and combinations thereof. In the embodiment of the present invention, the touch screen 130 can display various screens according to the operation of the electronic device 100 through the display 131. The touch screen 130 displays an event based on at least one of touch, hovering, or air gesture from the user through the touch sensing unit 133 during display of a specific screen through the display 131 , A proximity event, a hovering event, and an air gesture event), and may transmit an input signal corresponding to the event to the controller 180. [

According to various embodiments of the present invention, the display 131 may display (output) various information processed in the electronic device 100. For example, when the electronic device 100 plays a plurality of components (e.g., first music, second music) in the music application, the display 131 displays a user interface Or a graphical user interface (GUI, graphical UI). According to various embodiments, the display 131 may display a user interface or a graphical user interface associated with an operation in which the electronic device 100 visualizes and displays musical attributes of a plurality of components in a music application.

The display 131 may support a screen display by a horizontal mode, a screen display by a vertical mode, or a screen display by a change between a horizontal mode and a vertical mode, depending on a rotation direction (or a set direction) of the electronic device 100. The display 131 may use various displays. In various embodiments, the display 131 may be a vended display. For example, the display 131 may include a bendable display that can bend, bend or speak without damage through a thin, flexible substrate such as paper.

The bendable display can be fastened to the housing (e.g., the body) to maintain a curved shape. In various embodiments, the electronic device 100 may be embodied in a display device such as a bendable display, such as a flexible display, which can flex and span freely. In various embodiments, the display 131 may be a liquid crystal display (LCD), a light emitting diode (LED) display, an organic light emitting diode (OLED) display, an active matrix OLED (AMOLED) Alternatively, the glass substrate wrapping the liquid crystal in electronic paper or the like can be replaced with a plastic film to give flexibility to fold and unfold. In various embodiments, the display 131 may extend and be fastened to at least one side (e.g., at least one of the left, right, top, and bottom sides) of the electronic device 100.

The touch sensing unit 133 may be seated on the display 131, and may sense a user input contacting or approaching the surface of the touch screen 130. The touch sensing unit 133 may receive a user input for initiating an operation related to the use of the electronic device 100 in the embodiment of the present invention, and may generate an input signal according to a user input. The user input may include a touch event or a proximity event that is input based on at least one of a single-touch, a multi-touch, a hovering, or an air gesture. For example, the user input may be a tap, a drag, a sweep, a swipe, a flick, a drag and drop, or a drawing gesture. (E.g., handwriting), etc.).

The touch sensing unit 133 may be configured to convert a pressure applied to a specific portion of the display 131 or a capacitance change occurring at a specific portion of the display 131 into an electrical input signal. The touch sensing unit 133 can detect a position and an area where an input means (e.g., a user finger, an electronic pen, etc.) touches or approaches the surface of the display 131. [ Also, the touch sensing unit 133 may be configured to detect the pressure at the time of touch according to the applied touch method. When there is a touch or proximity input to the touch sensing unit 133, the corresponding signal (s) may be transmitted to a touch screen controller (not shown). The touch screen controller (not shown) may process the signal (s) and then pass the corresponding data to the controller 180. Accordingly, the control unit 180 can confirm which area of the touch screen 130 is touched or in proximity, and can perform the function execution corresponding thereto.

Further, although not shown, the touch screen 130 may further include a pressure sensor. The pressure sensor may be provided on the entire display 131. The pressure sensor can calculate the touched intensity.

The audio processing unit 140 may transmit the audio signal received from the control unit 180 to a speaker (SPK) 141, and may transmit audio signals such as voice received from a microphone (MIC) 143 to the control unit 180 . The audio processor 140 converts the audio / sound data into audible sound through the speaker 141 under the control of the controller 180, and outputs the converted audio signal to the controller 180 after converting the audio signal such as voice received from the microphone 143 into a digital signal. The audio processing unit 140 may output an audio signal responsive to a user input according to audio processing information (e.g., effect sound, music file, etc.) inserted into the data.

The speaker 141 can receive audio data from the wireless communication unit 110 or output audio data stored in the memory 150. [ The speaker 141 may output an acoustic signal related to various operations (functions) performed in the electronic device 100. [ Although not shown in an embodiment of the present invention, the speaker 141 may be attachable and detachable to an earphone, headphone or head set via an external port to the electronic device 100 .

The microphone 143 can receive an external sound signal and process it as electrical sound data. The microphone 143 may be implemented with various noise reduction algorithms for eliminating noise generated in receiving an external sound signal. The microphone 143 may be responsible for inputting an audio stream such as a voice command (e.g., a voice command for starting a music application operation) or the like. The microphone 143 may include an internal microphone mounted on the electronic device 100 and an external microphone connected to the electronic device.

The memory 150 may store one or more programs to be executed by the control unit 180, and may perform a function for temporary storage of input / output data. The input / output data may include, for example, files such as moving images, images, photographs, and audio. The memory 150 plays the role of storing the acquired data, and the data acquired in real time can be stored in the temporary storage device, and the data determined to be stored can be stored in the long-storable storage device.

Memory 150 may include instructions for synchronizing the tempo progress information for each of a plurality of components (e.g., first music, second music) in various embodiments to perform the function of displaying visual effects with audio output instructions can be stored. In various embodiments, the memory 150 may be configured such that, at run time, the controller 180 (e.g., one or more processors) senses a touch drag for playing at least one piece of music based on the user interface, And may store instructions to identify a plurality of cells corresponding to a drag and to display a trace effect according to the touch drag in an area between two cells among the identified plurality of cells.

The memory 150 may store a program related to input and display control using the touch screen 130, a program associated with control of various operations (functions) of the electronic device 100, Various data generated by the user can be continuously or temporarily stored.

Memory 150 may include an extended memory (e.g., external memory) or an internal memory. The memory 150 may be a flash memory type, a hard disk type, a micro type, and a card type (e.g., an SD card (Secure Digital Card) or an XD card (eXtream Digital Card) A memory such as a dynamic random access memory (DRAM), a static random access memory (SRAM), a read only memory (ROM), a programmable ROM (PROM), an electrically erasable programmable read-only memory (EEPROM), a magnetic random access memory A storage medium of the type of at least one of a magnetic disk, an optical disk type of memory, and the like. The electronic device 100 may operate in association with a web storage that performs the storage function of the memory 150 over the Internet.

Memory 150 may store various software. For example, a software component may include an operating system software module, a communication software module, a graphics software module, a user interface software module, a Moving Picture Experts Group (MPEG) module and a camera software module, . A module, which is a software component, can also be expressed as a set of instructions, so a module is sometimes referred to as an instruction set. Modules can also be expressed as programs.

The operating system software module may include various software components for controlling general system operations. Control of this general system operation may mean, for example, memory management and control, power control and management, and the like. In addition, an operating system software module can also facilitate the communication between various hardware (devices) and software components (modules).

The communication software module may enable communication with other electronic devices such as a computer, a server, or a portable terminal through the wireless communication unit 110. The communication software module may be configured with a protocol structure corresponding to the communication method.

The graphics software module may include various software components for providing and displaying graphics on the touch screen 130. The term graphics refers to text, a web page, an icon, a digital image, video, animation, and the like .

The user interface software module may include various software components related to a user interface (UI). For example, how the state of the user interface is changed or under which conditions the change of the user interface state is made, and the like.

The MPEG module may include software components that enable processes and functions related to digital content (e.g., video, audio), such as creation, playback, distribution, and transmission of content.

The camera software module may include camera-related software components that enable camera-related processes and functions.

The application module may include a web browser including a rendering engine, an email, an instant message, word processing, keyboard emulation, an address book, ), Widgets, digital rights management (DRM), iris scans, context cognition, voice recognition, location based services, etc. can do. According to various embodiments of the present invention, the application module displays a representative color of a selected cell while displaying a sound sample corresponding to a selected cell, and displays a trace effect in an area between two cells ( Function) can be handled.

The interface unit 160 may receive data from other external electronic devices or may supply power to the internal configurations of the electronic device 100. The interface unit 160 may allow data in the electronic device 100 to be transmitted to another external electronic device. For example, a wired / wireless headphone port, an external charger port, a wired / wireless data port, a memory card port, an audio input / output port, a video input / Or the like may be included in the interface unit 160.

The camera module 170 represents a configuration for supporting the photographing function of the electronic device 100. [ The camera module 170 may capture an arbitrary subject under the control of the controller 180 and may transmit the photographed data (e.g., an image) to the display 131 and the controller 180. The camera module 170 may include one or more image sensors. For example, the camera module 170 may include a front sensor (e.g., a front camera) provided on the front side (e.g., the same plane as the display 131) of the electronic device 100 and a rear side A sensor (e.g., a rear camera).

The control unit 180 can control the overall operation of the electronic device 100. [ For example, the control unit 180 can perform various controls related to music play, metronome function processing, musical attribute visualization processing, voice communication, data communication, video communication, and the like. The controller 180 may be implemented as one or more processors, or the controller 180 may be referred to as a processor. For example, the control unit 180 may include a communication processor (CP), an application processor (AP), an interface (e.g., GPIO (general purpose input / output)) or an internal memory Or integrated into one or more integrated circuits. The application processor may execute various software programs to perform various functions for the electronic device 100, and the communication processor may perform processing and control for voice communication and data communication. Also, the controller 180 may execute a specific software module (instruction set) stored in the memory 150 to perform various specific functions corresponding to the module.

In various embodiments of the present invention, the controller 180 detects a touch drag for playing at least one music based on the user interface displayed on the display 131, and identifies a plurality of cells corresponding to the touch drag And displaying a trace effect according to the touch drag in an area between two cells among the plurality of identified cells. The control operation of the controller 180 according to various embodiments of the present invention will be described with reference to the following drawings.

The control unit 180 according to the embodiment of the present invention can control various operations related to the ordinary functions of the electronic device 100 in addition to the functions described above. For example, the control unit 180 can control its operation and screen display when executing a specific application. In addition, the controller 180 may receive input signals corresponding to various touch events or proximity event inputs supported by a touch-based or proximity-based input interface (e.g., the touch screen 130) and control the operation of the functions accordingly. In addition, the controller 180 may control transmission / reception of various data based on a wired communication or a wireless communication.

The power supply unit 190 may receive external power and internal power under the control of the controller 180 to supply power required for operation of the respective components. In the embodiment of the present invention, the power supply unit 190 can turn on / off the power to the display 131, the camera module 170 and the like under the control of the controller 180.

The various embodiments described herein may be implemented in a recording medium readable by a computer or similar device using software, hardware, or a combination thereof. According to a hardware implementation, the embodiments described in the present invention can be applied to various fields such as application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs) ), A processor, microcontrollers, microprocessors, and an electrical unit for carrying out other functions.

In an embodiment of the present invention, the recording medium may further include a step of detecting a touch drag for playing at least one music based on a user interface, an operation of identifying a plurality of cells corresponding to the touch drag, And a computer-readable recording medium storing a program for causing a computer to execute an operation of displaying a trace effect according to the touch drag in an area between two cells among the plurality of identified cells.

And in some cases the embodiments described herein may be implemented by the controller 180 itself. Also, according to a software implementation, embodiments such as the procedures and functions described herein may be implemented with separate software modules. Each of the software modules may perform one or more of the functions and operations described herein.

2 is a diagram showing an example of a user interface of a music application according to an embodiment of the present invention.

Referring to FIG. 2, reference numeral 200 denotes a user interface of a music application. The music application 200 may include a mobile digital audio workstation (DAW) application. The music application 200 may include a virtual musical instrument region 210 and an application region 220. The virtual musical instrument region 210 may provide information about virtual instruments pre-installed in the plug-in type. The application area 220 includes objects (e.g., icons and images) such as a virtual musical instrument application or an effector application that can be installed or downloaded by the music application 200, and download of the application at the bottom of the virtual musical instrument area 210 . In various embodiments, when a specific object (e.g., a particular musical instrument) is selected in the virtual musical instrument region 210, the virtual musical instrument region 210 may display a screen of an application associated with the selected object (e.g., , A virtual performance screen corresponding to an instrument such as a guitar, etc.). In addition, when a specific object is selected in the application area 220, the virtual instrument area 210 can be switched to a screen (for example, application information display and a screen for downloading) of an application related to the selected object.

The virtual musical instrument region 210 includes an object (e.g., an icon, an image) corresponding to a virtual musical instrument (e.g., drum 211, keyboard 213, looper 215, etc.) provided in a plug-in type via various various parties And an object 217 for identifying another musical instrument or application not displayed on the current screen.

The music application 200 may further include a project menu 219 and an information menu 221. In various embodiments, the project menu 219 may include a menu for displaying a list of pre-stored projects. In various embodiments, a project may represent an audio file that is produced in one package with performance and effects by at least one virtual instrument. For example, a project can contain a single composition result. In various embodiments, a project may be created when a user records and records a performance, composition or editing (e.g., track editing) using an external musical instrument that is wired or wirelessly connected to a virtual musical instrument or electronic device within the electronic device have. You can also select a specific project and create a new project by adjusting the start position, playing section, musical instrument or effect of the recorded track in the project (eg recorded audio file).

In various embodiments, the information menu 221 may represent a menu for identifying information associated with the music application 200, such as an update to the music application 200, an open source license, music application information, an introduction image, or terms of use.

The music application 200 may further provide information (e.g., name, Soundcamp) of the music application to the virtual musical instrument area 210. [

In various embodiments, a user may select (e.g., touch) an object corresponding to a virtual instrument in the virtual instrument region 210 to execute that virtual instrument. When the electronic device senses the selection of the virtual instrument by the user, it can execute the selected virtual instrument and display the associated screen interface. According to one embodiment, the user may select a corresponding object 211 for drum application execution (e.g., drum performance (or composing, editing, etc.)), You can display the associated screen interface. According to one embodiment, the user may select a corresponding object 215 for execution of a looper application (e.g., playing (or composing, editing, etc.) by a loop) And display a screen interface associated with the virtual looper application (or looper instrument).

In various embodiments, the looper application may represent a sub-application in a music application for music play (e.g., loop play) by multiple cells of the looper region. In various embodiments, the looper application may be referred to as a looper musical instrument in the form of a virtual instrument, such as a drum, piano, or the like. In various embodiments, its screen interface will be described as an example of a looper application.

3 is a diagram illustrating an example of a user interface of a music application in accordance with various embodiments of the present invention.

Referring to FIG. 3, FIG. 3 illustrates an example of a screen interface when the looper application 300 is executed among subapplications (e.g., musical instrument application, looper application, effect application, etc.) included in the music application in the electronic device . In various embodiments, the looper application 300 may be executed within the music application 200 in response to the selection of the looper object 215 in the screen interface of Fig.

In various embodiments, the looper application 300 may comprise a plurality of cells (e.g., multiple button objects with a particular arrangement) that import a sound sample (or a music sample) , Or may represent musical instruments or musical instrument software that generate and play sounds in at least one cell. In various embodiments, the looper application 300 may include an audio playback system capable of playing multiple sound samples (or audio loops) simultaneously. In various embodiments, a sound sample (or sample) can generally represent all of the sounds that are brought from the outside. For example, it may include a music file having an extension of wav, mp3, etc., and may be used as a drum sample, a vocal sample, or the like. In various embodiments, the loop is a kind of sample, which can represent a sample that is repeated continuously. For example, you can repeat the sample in units of music (for example, 4 bars, 8 bars, 16 bars, etc.).

3, the looper application 300 includes a basic control area 310 for overall control of the music application 200, a looper area 320 including a plurality of cells, a looper application 300, And a looper control area 330 for associated control.

In various embodiments, the basic control region 310 may represent an area that includes menus that allow to adjust the overall execution options (e.g., various functions or modes, etc.) of the music application 200. The basic control area 310 includes a play control object 311 including buttons (e.g., Transport Buttons) for functions such as section repeat, rewind, play, pause, and record, An object 315 capable of adjusting the equalizer of the virtual musical instruments constituting the project, an object 317 capable of setting the timbres of the genre or the virtual musical instruments, a metronome object 319 for the metronome function on / off An object 321 for adjusting the metronome related options (e.g., beats, BPM, volume, etc.), a track area 323 (or timeline area) providing the play state of the project (e.g., track progress) As shown in FIG.

In various embodiments, when the metronome object 319 is activated (on), the metronome function may operate. For example, the metronome function can output a regular metronome sound according to the set metronome related options (eg, beat, BPM, volume, etc.) (eg every beat timing). In addition, the metronome function can flicker the blinking object provided adjacent to the metronome object 319 itself or the metronome object 319 according to the metronome-related option (for example, lamp blinking method).

According to one embodiment, the metronome object 319 (e.g., a project metronome) may be "one-two-three-net, one-two-three-net , ... ", and the blinking speed can be adjusted to the project's speed (eg tempo, BPM). In various embodiments, the beat may be set to a variety of beats such as 4/4, 3/4, 6/8. In various embodiments, the speed (e.g., BPM) may range from, for example, BPM 40 to BPM 240, very slowly (BPM 40-) ) - Normal (BPM 108) - Slightly faster (BPM 120 ~) - Fast (BPM 168 ~) - Very fast (BPM 200 ~ BPM 240)

According to various embodiments, in looper application 300, project selection or switching can be made using basic control area 310, and also other instrument selections, play or play of selected instruments. In this case, the sound samples of at least one cell 340 selected in the looper region 320 of the looper application 300 and the sound of the selected project or musical instrument through the basic control region 310 can be output independently.

In various embodiments, the looper region 320 may represent a music task pane in which the plurality of buttons (hereinafter, cells) 340 are arranged, including sound samples of various genres. The user may select (e.g., touch) at least one cell in the looper region 320 to play a combination of various sound effects. In various embodiments, a loop may indicate that a melody, a beat, etc., is repeated in the same music pattern.

In the looper region 320, the plurality of cells 340 may be variously arranged in a matrix structure, for example, but not limited thereto. The plurality of cells 340 may import at least one sound sample (e.g., a sound sample of a musical instrument) to represent an object having at least one or more other musical attributes defined therein. The plurality of cells 340 may import the same musical instrument or genre on a row or column basis, and may import another musical instrument or genre based on the row or column. For example, the same musical instrument or genre can be imported for each row, and different musical instruments or genres can be imported for each column.

In various embodiments, each of the cells 340 may represent one or more visual effects corresponding to the defined musical attributes. According to one embodiment, a color light (e.g., a glow effect) may be output in at least some of the activated cells that play sound samples according to the selection among the cells 340, or the peripheral areas of the activated cells. In various embodiments, the looper region 320 may represent musical attributes (e.g., moods) of the sound samples imported into each cell through each of the cells 340 in a representative color. According to one embodiment, each row or column of cells 340 may be assigned the same color to represent the same mood.

In various embodiments, the looper control area 330 may represent an area containing menus capable of adjusting execution options (e.g., various functions or modes, etc.) of the looper application 300. The looper control area 330 includes a view object 331 for changing the view mode, a metronome object 333 that flickers regularly and sequentially according to options (e.g., beat, tempo (e.g., speed, BPM) (E.g., a metronome, a looper metronome), a recording object 335 for additional recording on a current project (e.g., a project being played in the background through the music application 200, or other instrument playing in the background) based on the looper application 300, And a setting object 337 that can adjust various options (e.g., loop genre, musical instrument, beat, BPM, and the like) related to the sound source 300 (e.g., looper area 320).

In various embodiments, the looper application 300 may represent a sub-application in a music application for music play (e.g., playing a loop) by multiple cells 340 of the loop region 320 and may include a virtual instrument such as a drum, piano, It can also be called a looper musical instrument.

Figures 4-6 are illustrations to illustrate an example of the operation of playing a sound sample in an electronic device according to various embodiments of the present invention.

Referring to FIG. 4, FIG. 4 illustrates a screen example before a looper application is executed and a play is performed. 4, the user can play a sound sample with various user inputs. For example, the user can select a cell by touch input as shown in FIG. Or the user can continuously select a plurality of cells with a drag input as shown in Fig.

In various embodiments, even when the Looper application is in a standby state (e.g., before playing a second music (e.g., at least one sound sample)), the first music (e.g., project) (For example, the project's audio output). In this case, the metronome function can be visually or auditorily provided by the metronome object 400 (hereinafter, referred to as a "project metronome") for the first music (eg, project). According to one embodiment, the project metronome 400 itself or the flashing object 450 for visual display of the metronome may be periodically blinked to match the tempo (or beat) of the project being played.

In various embodiments, the metronome object 400 or the blinking object 450 is for notifying the progress of the tempo (or beat) of the project, and will be referred to as a project metronome for convenience of explanation. For example, the project tempo progress can be displayed through the project metronome 400.

Here, since the looper application is in a standby state, the metronome object 410 (hereinafter, referred to as a "looper metronome") for the second music (e.g., a sound sample) may exist in a standby state without any additional auditory or visual output.

Referring to FIG. 5, the user can select a particular cell 510 in the looper region. According to one embodiment, a user may touch a specific cell 510 and select a particular cell 510. The electronic device can output the sound samples set in the cell 510 corresponding to the user selection. In various embodiments, the electronic device may provide a visual effect based on the musical attributes of the selected cell in response to the cell selection.

Referring to FIG. 6, a user may select a plurality of cells 610, 620, 630, 640, and 650 in the looper region. According to one embodiment, a user may enter a continuous playing action (e.g., a drag 600 (or swipe) sequentially passing through other cells 620, 630, 640, 650 after touch input in a particular cell 610). The electronic device may output the sound samples set in the plurality of cells 610, 620, 630, 640, 650 corresponding to the user selection. In various embodiments, the electronic device may provide a visual effect through each cell based on musical attributes of each of a plurality of selected cells in response to the cell selection. According to various embodiments, the cells comprising the looper region may have a representative color per column, and a selected plurality of cells (e.g., cells that output sound samples) may provide a visual effect of the performance operation with a respective representative color . For example, a visual effect may be to represent all or part of the cells that are circular in a representative color. For example, the electronic device can display the edge surrounding the circular cell as a representative color. Also, the electronic device can display a trace effect according to the touch drag in an area between two cells among the selected plurality of cells.

In various embodiments, at least one sound sample played according to user input may be played once, or at least one sound sample may be played repeatedly. Or at least one of the sound samples may be played while a user input (e.g., a touch or touch gesture) is maintained, and may stop playing at the time the user input is released.

In various embodiments, when at least one cell is selected in the looper region, as in the example of FIG. 5 or FIG. 6, the second music (e.g., a sound sample) Audio output). In various embodiments, the metronome function by the looper metronome may operate in response to playing of the sound sample. According to one embodiment, the looper metronome 410 may, for example, blink regularly according to the tempo (or beat) of the sound sample being played in accordance with the tempo (or beat) corresponding to the looper application. For example, the tempo progression of a sound sample can be displayed through the looper metronome 410.

According to various embodiments, an electronic device includes a display, a memory, and one or more processors electrically coupled to the display and the memory, wherein the one or more processors are based on a user interface displayed on the display A touch drag for playing at least one music is detected, a plurality of cells corresponding to the touch drag are identified, and an area between two cells among the plurality of identified cells is detected according to the touch drag And may be configured to display a trace effect.

Wherein the user interface includes a looper area for providing a plurality of cells in which a variety of music is set in a matrix structure, and outputs music set in one or more cells according to a user's selection among the plurality of cells And display representative colors set in the one or more cells.

The processor may be configured to determine a color of a trace effect in an area between the two cells based on at least one of musical attributes, music, or representative color of each of the two cells, and to display the trace effect in a determined color .

The color of the trace effect may be at least one of a representative color of the first cell, a representative color of the second cell, and a color obtained by mixing the representative color of the first cell and the representative color of the second cell.

The processor may be configured to determine the color of the trace effect to be the same as or similar to the representative color of the two cells, or to determine whether the color of the trace effect is the same as or similar to the mixed color of the representative colors of the two cells.

The processor may be configured to divide a region between the two cells into a plurality of regions and determine a color to be displayed as a trace effect in each divided region based on the representative color of the two cells.

The processor divides an area between the two cells into a first area, a second area, and a third area, determines a hue of a trace effect in a first area close to the first cell as a representative color of the first cell, The hue of the trace effect of the third region close to the second cell is determined as the representative hue of the second cell, and the hue of the trace effect of the second region, which is the center of the first region and the third region, And a representative color of the second cell is mixed with the representative color of the second cell.

Wherein the processor calculates at least one of an area, an intensity, and a velocity of the touch drag, and calculates an area, a saturation, or a brightness of the trace effect based on at least one of the calculated area, intensity, And may be configured to distinguish at least one or more than two.

The processor may be configured to remove an indication of the trace effect when the touch drag is released, a set time has elapsed, or a new user input is detected.

The processor can be configured to change the color of the trace effect displayed corresponding to the touch drag.

7 is a flow chart illustrating a method of operation of an electronic device according to various embodiments.

Referring to FIG. 7, at operation 701, the controller 180 may display a user interface. For example, the user can operate (user input) to execute the music application using the electronic device 100. [ In response to the operation of executing the music application of the user, the control unit 180 can execute the music application and process it to display the user interface corresponding to the music application to be executed. According to one embodiment, after executing the music application 200, the controller 180 may select the looper 215 to display a screen on which the looper application 300 is executed. For example, the control unit 180 can process to display the user interface corresponding to the above-described Fig. 3.

In operation 703, the controller 180 can detect the touch drag. For example, the touch drag may be an input for touching the touch screen 130 using a user's finger or an object (e.g., a touch pen), and moving the touch. The touch screen 130 displays a user interface on which the looper application 300 is executed. When the touch is moved, one or more cells included in the user interface can be selected. When the user interface is displayed on the touch screen 130, the control unit 180 recognizes the cell where the touch is input based on the position of the touch.

For example, when a touch is input on the cell, the control unit 180 identifies the cell to which the touch is input, outputs a sound sample (e.g., music) corresponding to the identified cell, and displays a representative color corresponding to the identified cell can do. As described above with reference to FIG. 3, each cell contains a sound sample. When a cell is selected, representative colors may be displayed according to musical attributes (e.g. musical instruments, moods, etc.) have. The control unit 180 may display the representative color of the first cell to which the touch is input first and detect the touch drag that moves from the first cell to the second cell while the touch is maintained. If the touch input on the first cell is released without being moved, the controller 180 may display only the representative color of the first cell.

In operation 703, the controller 180 may identify a plurality of cells corresponding to the detected touch drag. The controller 180 may identify the cells located on the path through which the touch moves. For example, referring to FIG. 6, the controller 180 can identify a plurality of cells 610 to 650 corresponding to a drag input sequentially passing through other cells 620, 630, 640, and 650 after touch input in a specific cell 610 have.

In operation 705, the controller 180 may display a trace effect according to the touch drag in an area between the identified plurality of cells. Here, the trace effect may be a visual representation of a trace of a touch in an area between two cells. For example, the control unit 180 may be a trace effect for displaying a trail of a loop shape in a region between a cell and a cell. In this case, the color is displayed in the area between the cell and the color of the cell in the movement path of the touch drag, so that the user can see the color change according to the touch drag, thereby causing visual interest.

According to various embodiments, when the touch drag moves from the first cell to the second cell, the control unit 180 controls the first and second cells using the representative color of the first cell and the representative color of the second cell, The trace effect can be displayed in the area. When the control unit 180 displays the trace effect associated with the representative color, the trace effect may be displayed in the same or similar color as the representative color. A hue similar to the representative hue may mean a hue having a different chroma or brightness. For example, the controller 180 may display the representative color of the first cell as a trace effect in an area between two cells. Alternatively, the controller 180 may display a color in which a representative color of the first cell and a representative color of the second cell are mixed, as a trace effect, in an area between two cells. For example, when the representative color of the first cell is red and the representative color of the second cell is yellow, the mixed color may be orange.

According to various embodiments, the controller 180 divides a region between two cells into a plurality of colors, and determines a color to be displayed as a trace effect in each divided region using the representative color of the first cell and the representative color of the second cell . For example, the control unit 180 divides an area between two cells into two parts (e.g., a first area and a second area), and displays a representative color of the first cell And the representative color of the second cell can be displayed as a trace effect in an area (for example, a second area) close to the second cell. Alternatively, the controller 180 may divide the area between two cells into three parts (e.g., a first area, a second area, a third area), and an area near the first cell (e.g., a first area) A representative color is displayed as a trace effect, and a representative color of the second cell is displayed as a trace effect in an area close to the second cell (for example, a third area), and the center area of the first area and the third area 2), a color obtained by mixing the representative color of the first cell and the representative color of the second cell can be displayed as a trace effect.

According to various embodiments, the controller 180 may determine a color to be displayed by the trace effect based on the musical attributes of each cell. Alternatively, the controller 180 may determine a color to be displayed by the trace effect based on a sound sample of each cell. For example, the controller 180 may determine a color in which the representative color of the first cell and the representative color of the second cell are mixed based on the sound sample of the first cell and the sound sample of the second cell. Even if the representative color of the first cell and the representative color of the second cell are the same, the saturation or brightness of the mixed color may vary depending on the sound sample.

According to various embodiments, the controller 180 may display the trace effect differently based on the input value of the touch drag. For example, the input value of the touch drag may be at least one of a touch area, a touch strength, or a combination of two or more. Accordingly, the controller 180 may provide different trace effects according to the input values of the touch drag. This will be described with reference to FIG. 11 which will be described later.

According to various embodiments, the controller 180 may display and remove the trace effect for a set time (e.g., one second). For example, the controller 180 may count the time when the trace effect is displayed, and may remove the displayed trace effect when the counted time has elapsed. Thus, the trace effect can be removed sequentially over time. Removing a trace effect may mean that the trace effect that was being displayed has been removed. For example, when the user sequentially touches and drags the cells to the first cell, the second cell, and the third cell, the trace effect displayed in the area between the first cell and the second cell is transferred between the second cell and the third cell The trace effect displayed in the area of the first region can be processed to disappear before the trace effect.

8A and 8B show an example of displaying a trace effect according to various embodiments.

Referring to FIG. 8A, the controller 180 may detect a first user input touching the first cell 810. At this time, the user can touch the first cell 810 and release the touch. The controller 180 may output a sound sample of the touched first cell 810 and display a representative color of the first cell 810. [ Then, the controller 180 may detect a second user input that touches the second cell 820. At this time, since the touch drag is not detected between the first cell 810 and the second cell 820, the controller 180 can process the area 811 between the first cell 810 and the second cell 820 so that the trace effect is not displayed. At this time, the user can touch the second cell 820 and move the touch to the third cell 830 and the fourth cell 840 without releasing the touch.

The controller 180 may display a trace effect in an area between two cells according to the touch drag when the touch drag to move from the second cell 820 to the fourth cell 840 is detected. For example, when a touch is moved from the second cell 820 to the third cell 830, the controller 180 may display a trace effect in an area 821 between the second cell 820 and the third cell 830. At this time, the trace effect may be at least one of a representative color of the second cell 820, a representative color of the third cell 830, and a representative color of the second cell 820 and a representative color of the third cell 830. For example, when the touched position is between the second cell 820 and the third cell 830, the controller 180 may display the representative color of the second cell 820 as the trace effect in the area 821. Alternatively, when the touched position approaches the third cell 830, the controller 180 may display the representative color of the second cell 820 and the representative color of the third cell 830 as the trace effect in the area 821, respectively.

Alternatively, if the touch location is located in the third cell 830, the controller 180 may display the representative color of the second cell 820 and the representative color of the third cell 830 as the trace effect in the area 821, respectively. At this time, the controller 180 may process the color of the representative color of the second cell 820 and the representative color of the third cell 830 to be displayed in the center of the area 821.

Also, when the touch dragging from the third cell 830 to the fourth cell 840 is detected, the controller 180 may display a trace effect in an area 831 between the third cell 830 and the fourth cell 840. In this case, the trace effect may be at least one of a representative color of the third cell 830, a representative color of the fourth cell 840, and a representative color of the third cell 830 and a representative color of the fourth cell 840. For example, if the touched position is between the third cell 830 and the fourth cell 840 (e.g., area 831), the controller 180 may display the representative color of the third cell 830 as the trace effect in area 831 . Alternatively, when the touched position approaches the fourth cell 840, the controller 180 may display the representative color of the third cell 830 and the representative color of the fourth cell 840 as the trace effect in the area 831, respectively.

Alternatively, when the touch position is located in the fourth cell 840, the controller 180 may display the representative color of the third cell 830 and the representative color of the fourth cell 840 as the trace effect in the area 831, respectively. At this time, the control unit 180 can process the color of the representative color of the third cell 830 and the representative color of the fourth cell 840 to be displayed in the center of the area 831.

In FIG. 8A, the trace effect may be expressed by overlapping two circles. However, the method of displaying the trace effect may vary, and the shape of the trace effect is not limited by the drawings.

The user can release the touch after dragging the touch from the second cell 820 to the fourth cell 840. When the touch is dragged through the fourth cell 840, the controller 180 may display the representative color of the fourth cell 840 in a region outside the fourth cell 840 as a trace effect.

According to various embodiments, the controller 180 may display a trace effect between two cells from the second cell 820 to the fourth cell 840 while the touch drag moves from the second cell 820 to the fourth cell 840, and the second cell 820 The touch effect dragged between the second cell 820 and the fourth cell 840 can be eliminated. Alternatively, when a new user input is detected, the controller 180 may process the trace effect displayed between the two cells from the second cell 820 to the fourth cell 840 to disappear. Alternatively, the controller 180 may process the trace effect to disappear after a predetermined time (e.g., 1 second, 3 seconds) has elapsed. At this time, the controller 180 may sequentially process the trace effect to disappear. That is, the previously displayed trace effect may disappear before the later displayed trace effect. For example, the trace effect shown in area 821 may disappear prior to the trace effect shown in area 831.

Referring to FIG. 8B, the controller 180 may detect a third user input touching the fifth cell 850. At this time, the user may touch the fifth cell 850 and move the touch to the seventh cell 870 while the touch is maintained. The controller 180 may display the trace effect in the area between the two cells according to the touch drag when the touch drag to move from the fifth cell 850 to the seventh cell 870 is detected. At this time, the controller 180 may not display the trace effect displayed between the two cells (for example, areas 821 and 831) from the second cell 820 to the fourth cell 840.

For example, when a touch is moved from the fifth cell 850 to the sixth cell 860, the controller 180 may display a trace effect in an area 851 between the fifth cell 850 and the sixth cell 860. The trace effect may be at least one of a representative color of the fifth cell 850, a representative color of the sixth cell 860, and a representative color of the fifth cell 850 and a representative color of the sixth cell 860. For example, if the touched position is between the fifth cell 850 and the sixth cell 860 (e.g., area 851), the controller 180 may display the representative color of the fifth cell 850 as the trace effect in area 851 . Alternatively, when the touched position approaches the sixth cell 860, the controller 180 may display the representative color of the fifth cell 850 and the representative color of the sixth cell 860 as the trace effect in the area 851, respectively.

Alternatively, when the touch position is located at the sixth cell 860, the controller 180 may display the representative color of the fifth cell 850 and the representative color of the sixth cell 860 as the trace effect in the area 851, respectively. At this time, the controller 180 may process the color of the representative color of the fifth cell 850 and the representative color of the sixth cell 860 to be displayed in the center of the area 851.

When the touch drag to move from the sixth cell 860 to the seventh cell 870 is detected, the controller 180 may display a trace effect in an area 861 between the sixth cell 860 and the seventh cell 870. In this case, the trace effect may be at least one of a representative color of the sixth cell 860, a representative color of the seventh cell 870, and a representative color of the sixth cell 860 and a representative color of the seventh cell 870. The trace effect displayed in the area 861 can be processed in the same manner as described above. That is, when the touched position is between the sixth cell 860 and the seventh cell 870 (for example, the area 861), the controller 180 may display the representative color of the sixth cell 860 as the trace effect in the area 861. Alternatively, when the touched position approaches the seventh cell 870, the controller 180 may display the representative color of the sixth cell 860 and the representative color of the seventh cell 870 as the trace effect in the area 861, respectively.

Alternatively, when the touch position is located at the seventh cell 870, the controller 180 may display the representative color of the sixth cell 860 and the representative color of the seventh cell 870 as the trace effect in the area 861, respectively. At this time, the control unit 180 can process colors such that a representative color of the sixth cell 860 and a representative color of the seventh cell 870 are displayed in the center of the area 861.

The manner in which the displayed trace effect is disappeared is the same as or similar to that described above.

9 is a flow diagram illustrating a method for displaying a trace effect in accordance with various embodiments.

Referring to FIG. 9, at operation 901, the controller 180 may receive a selection of a first cell. For example, when a touch is detected on the first cell, the controller 180 may determine that the first cell in which the touch is detected is selected. Upon receiving the selection of the first cell, the controller 180 outputs a sound sample (e.g., audio) corresponding to the first cell and displays a representative color corresponding to the first cell.

In operation 903, the controller 180 may detect a touch movement. For example, the control unit 180 can detect that the touch detected on the first cell moves without being released. If the touch detected on the first cell is released without moving, the controller 180 may display the representative color of the first cell and terminate the process.

When the touch movement is detected, the controller 180 determines and displays the representative color of the first cell as the color of the touch movement area in operation 905. That is, when the touch detected on the first cell moves out of the first cell, the control unit 180 may process the area on the movement path as a representative color of the first cell. That is, the touch moving region may be a region between the first cell and another cell. The controller 180 may display the representative color of the first cell in the touch movement area as a trace effect.

At operation 907, the controller 180 may receive the selection of the second cell. For example, the controller 180 may detect that the touch detected on the first cell moves to the second cell. If the touch is detected on the second cell, the controller 180 may determine that the second cell is selected. Upon receiving the selection of the second cell, the controller 180 outputs a sound sample (e.g., audio) corresponding to the second cell and displays a representative color corresponding to the second cell.

In operation 909, the controller 180 may determine the color of the touch movement area using the representative color of the first cell and the representative color of the second cell. That is, the controller 180 may determine that the area between the first cell and the second cell is a touch movement area. Since the touch detected in the first cell has moved to the second cell, the controller 180 can determine a color obtained by mixing the representative color of the first cell and the representative color of the second cell as the color of the touch movement region.

According to various embodiments, the controller 180 may divide the touch movement area into a plurality of areas, and determine a color to be displayed as a trace effect in each divided area using the representative color of the first cell and the representative color of the second cell have. For example, the controller 180 divides the touch moving area into two parts (e.g., first area and second area), and displays a representative color of the first cell in an area (e.g., a first area) close to the first cell The color of the trace effect can be determined, and the representative color of the second cell can be determined as the color of the trace effect in a region (for example, the second region) close to the second cell. Alternatively, the controller 180 may divide the touch movement area into three parts (e.g., first area, second area, third area), and represent the first cell in the area close to the first cell The hue of the second cell is determined as the color of the trace effect in the region close to the second cell (e.g., the third region), and the color of the trace effect is determined as the hue of the first region and the center region of the third region For example, the second area), a color obtained by mixing the representative color of the first cell and the representative color of the second cell may be determined as the color of the trace effect.

In operation 911, the controller 180 may change the color of the touch movement area and display it by using the determined color. For example, the controller 180 may display the mixed color in the touch movement area as a trace effect. Alternatively, the controller 180 may display at least one of the representative color of the first cell, the representative color of the second cell, and the mixed color in the touch movement area as a trace effect.

10 is a diagram illustrating an example of a trace effect according to various embodiments.

10 (a) illustrates an example of dragging a touch to the second cell 1020 while the user has touched the first cell 1010. FIG. The control unit 180 can process the corresponding color so that the corresponding color is displayed according to the order in which the touch is moved. For example, when the user touches the first cell 1010, the controller 180 may display the representative color of the first cell 1010. The control unit 180 may display the representative color of the first cell 1010 as a trace effect in the area 1010A when the touched position moves out of the first cell 1010 to the area 1010A between the first cell 1010 and the second cell 1020. [ At this time, the controller 180 may display the color of the trace effect in a higher or lower color than the representative color of the first cell 1010. Alternatively, the controller 180 may display the trace effect in a higher or lower color saturation than the representative color of the first cell 1010 based on the sound sample of the first cell 1010.

Here, when the saturation or brightness is described as "low" or "high", the saturation or brightness may be expressed as "light" or "dark".

Alternatively, the controller 180 may divide the area 1010A into the first area 1011 and the second area 1021, and display the color of the trace effect in the first area 1011 as the representative color of the first cell 1010. [ Here, the first region 1011 may be a region close to the first cell 1010, and the second region 1021 may be a region close to the second cell 1020.

The controller 180 may display the representative color of the second cell 1020 in the area 1010A as a trace effect when the touch is located on the second cell 1020. [ Alternatively, the controller 180 may display a color obtained by mixing the representative color of the first cell 1010 and the representative color of the second cell 1020 in the area 1010A as a trace effect. Alternatively, the controller 180 may determine the color of the trace effect to display in the region 1010A based on the sound sample of the first cell 1010 and the sound sample of the second cell 1020. [ For example, the controller 180 may adjust the saturation or brightness of the mixed color based on the sound sample of the first cell 1010 and the sound sample of the second cell 1020. Alternatively, the controller 180 may display the representative color of the first cell 1010 in the first area 1011 and the representative color of the second cell 1020 in the second area 1021. Alternatively, the controller 180 may display the first area 1011 in the mixed color, and determine the second area 1021 as the representative color of the second cell. Alternatively, the controller 180 displays the representative color of the first cell 1010 in the first area 1011, the representative color of the second cell 1020 in the second area 1021, and displays the representative color of the second cell 1020 in the overlapping area of the first area 1011 and the second area 1021 The representative color of the first cell 1010 and the representative color of the second cell 1020 may be mixed with each other.

10B illustrates an example in which a user has touched the first cell 1010 and dragged the second cell 1020 to the third cell 1030. For example, the control unit 180 may display the blended color as a trace effect in the area 1010A if the user moves the touch over the area 1010A. When the user moves the touch to the second cell 1020, the controller 180 displays the representative color of the first cell 1010 in the first region 1011, the representative color of the second cell 1020 in the second region 1021, The mixed color can be displayed in the area 1101-1. In this case, the blended color when the touch position is in the area 1010A and the blended color when the touch position is moved to the second cell 1020 may be the same or different. In other cases, the saturation or brightness of the mixed color can be adjusted differently.

The control unit 180 may display the representative color of the second cell 1020 as a trace effect in the area 1020A when the position of the touch is moved to the area 1020A between the second cell 1020 and the third cell 1030. [ At this time, the controller 180 may change the area 1010A displayed in the mixed color to the representative color of the first cell 1010. [ Alternatively, the controller 180 may change the saturation or brightness of the mixed color displayed in the area 1010A. The controller 180 may divide the area 1020A into the first area 1022 and the second area 1031 and display the color of the trace effect in the first area 1022 as the representative color of the second cell 1020. [ Here, the first region 1022 may be a region close to the second cell 1020, and the second region 1031 may be a region close to the third cell 1030.

If the touch is located on the third cell 1030, the controller 180 may display the representative color of the second cell 1020 as a trace effect in the area 1020A. Alternatively, the controller 180 may display a color obtained by mixing the representative color of the second cell 1020 and the representative color of the third cell 1030 in the area 1020A as a trace effect. Alternatively, the controller 180 may determine the color of the trace effect to be displayed in the area 1020A based on the sound sample of the second cell 1020 and the sound sample of the third cell 1030. [ For example, the controller 180 may adjust the saturation or brightness of the mixed color based on the sound sample of the second cell 1020 and the sound sample of the third cell 1030. Alternatively, the controller 180 may display the representative color of the second cell 1020 in the first area 1022 and the representative color of the third cell 1030 in the second area 1031. Alternatively, the controller 180 may display the first area 1022 in the mixed color and the second area 1031 in the third color. Alternatively, the controller 180 displays the representative color of the second cell 1020 in the first area 1022, the representative color of the third cell 1030 in the second area 1031, and displays the representative color of the third cell 1030 in the overlapping area of the first area 1022 and the second area 1031 1022-1. ≪ / RTI >

10C illustrates an example in which a user has touched the first cell 1010 and dragged the second cell 1020 to the fourth cell 1040. (b) and the fourth cell 1040 of (c) are arranged in the same column, the representative colors may be the same or similar. For example, the controller 180 may have a representative color of the fourth cell 1040 higher or lower than the representative color of the third cell 1030. [ Accordingly, the controller 180 may determine the color of the area 1020A between the second cell 1020 and the third cell 1030 to be equal to or different from the color of the area 1020B between the second cell 1020 and the fourth cell 1040. Alternatively, the controller 180 may determine the color of the area 1020B based on the sound sample of the second cell 1020 and the sound sample of the fourth cell 1040. This is because the controller 180 may be different from the color of the chromaticity area 1020A of the area 1020B because the sound samples of the third cell 1020 and the sound samples of the fourth cell 1040 are different. For example, the controller 180 displays the representative color of the second cell 1020 in the first area 1022, the representative color of the fourth cell 1040 in the second area 1041, and the first area 1022 and the second area 1041 overlap The representative color of the second cell 1020 and the representative color of the fourth cell 1040 can be displayed in a mixed color region 1022-2. That is, the mixed color of the overlapping region 1022-1 and the overlapping region 1022-2 may be the same or different.

11 is a flow diagram illustrating a method for displaying a trace effect according to an input value of a touch drag according to various embodiments.

Referring to FIG. 11, in operation 1101, the controller 180 may detect an input value of a touch drag. The touch drag may be an input for touching the touch screen 130 using a user's finger or an object (e.g., a touch pen), and moving the touch. That is, the touch dragging is described in the operation 703 of FIG. The input value may be at least one or a combination of a touch area, a touch strength, or a touch speed. Accordingly, when the touch drag is detected, the controller 180 can calculate the input value for the detected touch drag in real time.

In operation 1103, the controller 180 may determine a setting range corresponding to the input value. The setting range may be variously set based on the setting of the user or the setting of the electronic device 100. [ For example, the setting range may be set to high / low based on the reference value, to upper / middle / lower, to upper / middle / middle / middle / lower, or to 1 to 10. The control unit 180 can determine which setting range the detected input value corresponds to.

In operation 1105, the controller 180 can check the trace effect corresponding to the determined setting range. According to various embodiments, the trace effect can be variously expressed according to the setting range. For example, the controller 180 may set the area, size, saturation, and brightness of the trace effect differently according to the setting range. When the input value is the touch area, the trace effect can be distinguished between a case of touching with a narrow area and a case of touching with a wide area. Alternatively, when the input value is the touch strength, the trace effect can be distinguished between a case of touching with a large strength and a case of touching with a small strength. Alternatively, when the input value is the touch speed, the trace effect in the case of touching at a high speed and in the case of touching at a low speed can be distinguished.

According to various embodiments, the controller 180 may set different trace effects according to the combination of the touch area, the touch strength, and the touch speed. For example, the controller 180 can be configured to distinguish the trace effect when the touch area is wide, the touch strength is small, the touch area is narrow, and the touch strength is large. The control unit 180 can be configured to distinguish the case where the touch area is wide and the touch speed is slow, the trace effect when the touch area is narrow and the touch strength is fast. Alternatively, the control unit 180 may be configured to distinguish the case where the touch strength is strong and the touch speed is high, and the trace effect when the touch strength is weak and the touch speed is low.

According to various embodiments, operations 1101 through 1105 of FIG. 11 may be performed as included in operation 703 of FIG. 7 above.

In operation 1107, the controller 180 may display the trace effect. For example, the control unit 180 narrowly displays the trace effect when touched with a small area, and can display the trace effect widely when touched with a large area. Alternatively, when the touch panel is touched with a small area, the controller 180 can narrow the area of the trace effect and display the trace effect with a low saturation and brightness. When the touch panel is touched with a large area, the controller 180 can increase the area of the trace effect and display the trace effect with high saturation and brightness. Alternatively, the controller 180 may display a high level of saturation and brightness of the trace effect when touched with a large intensity, and may display a low saturation and brightness of the trace effect when touched with a small intensity. Alternatively, the control unit 180 may process the trace effect to display additional visual effects while displaying the saturation and brightness of the trace effect with high intensity. The additional visual effect may be one that is displayed with the trace effect and that is visually indicative of an effect distinct from the trace effect. Alternatively, the controller 180 may process the trace effect to display additional visual effects while displaying a low saturation and brightness of the trace effect when touched with a small intensity.

According to various embodiments, the controller 180 can set various saturation or brightness for the representative color of each cell according to the setting range. For example, when the input value is a touch area, a representative color of a cell in a case of touching with a narrow area and a case of touching in a wide area can be distinguished. Alternatively, when the input value is the touch strength, the representative color of the cell when touched with a large intensity and the representative color of the cell when touched with a small intensity can be distinguished. Alternatively, when the input value is the touch speed, the representative color of the cell when touched at a high speed may be distinguished from the case of being touched at a high speed.

For example, if the touch panel is touched with a small area, the controller 180 may display the saturation or brightness of the representative color of the cell at a low level, and may display the saturation or brightness of the representative color of the cell at a high level. Or vice versa. The controller 180 may display the saturation or brightness of the representative color of the cell at a high level when touched with a large intensity and may display the saturation or brightness of the representative color of the cell at a low level when touched at a small intensity. The controller 180 may display the saturation or brightness of the representative color of the cell at a high speed when touched at a high speed and may display the saturation or brightness of the representative color of the cell at a low level when touched at a slow speed. The controller 180 may set the saturation or brightness of the representative color of the cell to be different according to the combination of the touch area, the touch intensity, and the touch speed.

12 is a diagram illustrating an example of displaying a trace effect according to a touch area according to various embodiments.

Fig. 12 (a) shows an example of a trace effect displayed when the user touches a small area. For example, the control unit 180 can calculate the area A on the portion that the user touches, using the radius r1. When touching the area A, the control unit 180 can confirm the setting range corresponding to the area A and confirm the representative color or the trace effect of the cell corresponding to the setting range. The control unit 180 may display the representative colors 1210A, 1220A, 1230A, and 1240A of the identified cells, respectively, and display the identified trace effects in the regions 1211A, 1221A, and 1231A between the two cells. According to various embodiments, the superimposed region 1211-1 in region 1211A may be represented by a color that is a mixture of the representative color of the first cell 1210A and the representative color of the second cell 1220A. The area 1221-1 superimposed in the area 1221A can be displayed in a color in which the representative color of the second cell 1220A and the representative color of the third cell 1230A are mixed. The overlapped area 1231-1 in the area 1231A can be displayed in a color in which the representative color of the third cell 1230A and the representative color of the fourth cell 1240A are mixed.

Fig. 12 (b) shows an example of a trace effect displayed when the user touches a large area. For example, the control unit 180 can calculate the area B on the portion that the user touches, using the radius r2. When touching the area B, the control unit 180 can confirm the setting range corresponding to the area B and confirm the representative color or trace effect of the cell corresponding to the setting range. The controller 180 may display the representative colors 1210B, 1220B, 1230B, and 1240B of the identified cells, respectively, and display the identified trace effects on the regions 1211B, 1221B, and 1231B between the two cells. According to various embodiments, the superimposed area 1211-2 in the area 1211B may be displayed in a mixed color of the representative color of the first cell 1210B and the representative color of the second cell 1220B. The overlapped area 1221-2 in the area 1221B can be displayed in a color in which the representative color of the second cell 1220B and the representative color of the third cell 1230B are mixed. The overlapped area 1231-2 in the area 1231B can be displayed in a color in which the representative color of the third cell 1230B and the representative color of the fourth cell 1240B are mixed.

Comparing FIGS. 12A and 12B, the representative colors 1210A, 1220A, 1230A, and 1240A of the cells and the representative colors 1210B, 1220B, 1230B, and 1240B of the cells may have different saturation or lightness. For example, the representative colors 1210A, 1220A, 1230A, and 1240A of the cell may have higher saturation or brightness than the representative colors 1210B, 1220B, 1230B, and 1240B of the cell. Or vice versa. Similarly, the trace effects 1211A, 1221A, and 1231A and the trace effects 1211B, 1221B, and 1231B may have different areas, saturation, or brightness. That is, the trace effects 1211A, 1221A, and 1231A have less area than the trace effects 1211B, 1221B, and 1231B, and may have low saturation or lightness. Or vice versa. In (a), the overlap areas 1211-2, 1221-2, and 1231-2 in the overlap areas 1211-1, 1221-1, and 1231-1 and 1231-1 may have different areas, saturation, or brightness. The overlap areas 1211-1, 1221-1, and 1231-1 have an area smaller than that of the overlap areas 1211-2, 1221-2, and 1231-2, and may have low saturation or lightness. Or vice versa.

According to various embodiments, as the touch area is different, the representative color of the cell, the trace effect, the area of the overlap area within the trace effect, and the saturation or brightness may be different from each other.

13 is a diagram showing an example of displaying a trace effect according to the touch intensity according to various embodiments.

Referring to FIG. 13, there is shown an example of a trace effect displayed when a user strongly touches a large area. For example, the control unit 180 may calculate the area B of the area touched by the user using the radius r2, and calculate the touch intensity using the pressure sensor or the touch sensing unit 133. [ The controller 180 can confirm the setting range corresponding to the area B and the intensity S and confirm the representative color or the trace effect of the cell corresponding to the setting range when the area B and the intensity S are touched. The controller 180 may display representative colors 1310, 1320, 1330, and 1340 of the identified cells, respectively, and display the identified trace effects in the inter-cell areas 1311, 13221, and 1331 between the two cells. According to various embodiments, the overlapped area 11311A in the area 1311 may be displayed in a color in which the representative color of the first cell 1310 and the representative color of the second cell 1320 are mixed. The overlapped area 1321A in the area 1321 can be displayed in a color in which the representative color of the second cell 1320 and the representative color of the third cell 1330 are mixed. The overlapped area 1331A in the area 1331 can be displayed in a color in which the representative color of the third cell 1330 and the representative color of the fourth cell 1340 are mixed. In addition, the control unit 180 can process the additional visual effect 1350 to display it. For example, the additional visual effect 1350 displays a polka dot pattern around the cell, so you can express the feeling of splashing water as you play. This additional visual effect is not limited by Fig. 13, but may be expressed in various ways depending on the implementation.

Comparing FIG. 12B and FIG. 13, the representative colors 1210B, 1220B, 1230B, and 1240B of the cells and the representative colors 1310, 1320, 1330, and 1340 of the cells may have different saturation or lightness. For example, the representative colors 1310, 1320, 1330, and 1340 of the cell may have higher saturation or brightness than the representative colors 1210B, 1220B, 1230B, and 1240B of the cell. Or vice versa. Similarly, trace effects 1211B, 1221B, and 1231B and trace effects 1311, 1321, and 1331 may have different area, saturation, or brightness. That is, the trace effects 1311, 1321, and 1331 have areas larger than the trace effects 1211B, 1221B, and 1231B, and may have high saturation or lightness. Or vice versa. The overlap areas 1211-2, 1221-2, and 1231-2 and the overlap areas 1311A, 1321A, and 1331A may have different areas, saturation, or brightness. For example, the overlap areas 1311A, 1321A, and 1331A have an area smaller than that of the overlap areas 1211-2, 1221-2, and 1231-2, and may have low saturation or lightness. Or vice versa.

According to various embodiments, as the touch intensity is different, the representative color of the cell, the trace effect, the area of the overlap area within the trace effect, the saturation or the brightness may be different from each other.

14 is a diagram showing an example of displaying a trace effect according to a touch speed according to various embodiments.

14 (a) shows an example of a trace effect displayed when the user touches at a slow speed. For example, the control unit 180 can calculate the touch speed based on the touch position that changes according to time (e.g., t1, t2). The lengths t1 and t2 shown in FIG. 9A can be interpreted as the distance the touch has moved. The direction of the arrow may be the direction in which the touch moves. The control unit 180 can confirm the set range at the calculated touch speed and confirm the representative color or trace effect of the cell corresponding to the set range. The controller 180 may display the representative colors 1410, 1420, 1430, and 1440 of the identified cells, respectively, and display the identified trace effects in the regions 1411A, 1421A, and 1431A between the two cells. According to various embodiments, the superimposed region 1411-1 in the region 1431A may be represented by a color in which the representative color of the first cell 1410 and the representative color of the second cell 1420 are mixed. The area 1421-1 superimposed in the area 1421A can be displayed in a color in which the representative color of the second cell 1420 and the representative color of the third cell 1430 are mixed. The area 1431-1 overlapped in the area 1431A can be displayed in a color in which the representative color of the third cell 1430 and the representative color of the fourth cell 1440 are mixed.

FIG. 14 (b) shows an example of a trace effect displayed when the user touches at a high speed. For example, the control unit 180 can calculate the touch speed based on the touch position that changes according to time (e.g., t'1, t'2). The length of t'1 and t'2 shown in FIG. 5B can be interpreted as the distance traveled by the touch. (b) is longer than the lengths of t1 and t2 shown in (a), it can be understood that the distance moved at the same time is larger.

The control unit 180 can confirm the set range at the calculated touch speed and confirm the representative color or trace effect of the cell corresponding to the set range. The controller 180 may display representative colors 1410, 1420, 1430, and 1440 of the identified cells, respectively, and display the identified trace effects in the inter-cell areas 1411B, 1421B, and 1431B. According to various embodiments, the superimposed area 1411-2 in the area 1431B may be displayed in a mixed color of the representative color of the first cell 1410 and the representative color of the second cell 1420. [ The overlapped area 1421-2 in the area 1421B can be displayed in a color in which the representative color of the second cell 1420 and the representative color of the third cell 1430 are mixed. The overlapped area 1431-2 in the area 1431B can be displayed in a color in which the representative color of the third cell 1430 and the representative color of the fourth cell 1440 are mixed.

14A and 14B, the representative colors 1410, 1420, 1430 and 1440 of the cells may have the same or different saturation or brightness. For example, the representative color of the cell shown in (a) may be higher in saturation or brightness than the representative color of the cell shown in (b). Or vice versa. Similarly, trace effects 1411A, 1421A, 1431A and trace effects 1411B, 1421B, 1431B may have different areas, saturation, or brightness. That is, the trace effects 1411A, 1421A, and 1431A have less area than the trace effects 1411B, 1421B, and 1431B, and may have low saturation or lightness. Or vice versa. In (a), the overlap areas 1411-2, 1421-2, and 1431-2 in the overlap areas 1411-1, 1421-1, and 1431-1 and (b) may have different areas, saturation, or brightness. The overlap areas 1411-1, 1421-1, and 1431-1 have an area smaller than that of the overlap areas 1411-2, 1421-2, and 1431-2, and may have low saturation or lightness. Or vice versa.

According to various embodiments, as the touch speeds differ, the representative color of the cell, the trace effect, the area of the overlap area within the trace effect, the saturation or brightness may be different from each other.

15 is a diagram illustrating an example of displaying a visual effect in accordance with various embodiments.

Referring to FIG. 15, an example of a user interface capable of setting an effect on music included in a music application is shown. For example, the control unit 180 may switch the looper region to the effect setting window and display the effect setting window on the looper region in response to a user operation. The effect setting window can be configured to include an effect input pad (eg, a chaos pad) for effect setting by user input. The user can select a specific effect object by touching the effect input pad, and the controller 180 can set the effect corresponding to the selected effect object (e.g., create an effect based on the option corresponding to the effect object).

At this time, the controller 180 can divide the effect input pad into a plurality of areas based on the x-axis and the y-axis. For example, the controller 180 may divide the area into a plurality of areas 1510, 1520, 1530, and 1540, and may provide different visual effects depending on which area the user touches. For example, the controller 180 may process at least one of the area, saturation, and brightness of the visual effect from the area 1510 to the area 1540 to increase. That is, the visual effect 1511 displayed when the user touches the area 1510 may be smaller than the visual effect 1541 displayed when the user touches the area 1540.

According to various embodiments, an operating method of an electronic device includes: detecting a touch drag for playing at least one music based on a user interface; identifying a plurality of cells corresponding to the touch drag; And displaying the trace effect according to the touch drag in an area between two cells among the plurality of identified cells.

The user interface includes a looper area for providing a plurality of cells in which a variety of music is set in a matrix structure and outputs music set in one or more cells selected by the user among the plurality of cells , And display the representative color set in the one or more cells.

Wherein the displaying comprises: determining a color of a trace effect in an area between the two cells based on at least one of a musical attribute, a music, or a representative color of each of the two cells; and displaying the trace effect in the determined color . ≪ / RTI >

The color of the trace effect may be at least one of a representative color of the first cell, a representative color of the second cell, and a color obtained by mixing the representative color of the first cell and the representative color of the second cell.

The determining operation may include determining the color of the trace effect to be the same as or similar to the representative color of the two cells, or determining the color of the trace effect to be the same as or similar to the mixed color of the representative colors of the two cells.

Wherein the displaying operation includes: dividing an area between the two cells into a plurality of areas; determining a color to be displayed as a trace effect in each of the divided areas based on a representative color of the two cells; And displaying the trace effect.

The operation of dividing the area between the two cells into the first area, the second area and the third area, the color of the trace effect of the first area close to the first cell is determined as the representative color of the first cell The color of the trace effect of the third area closer to the second cell is determined as the representative color of the second cell, and the color of the trace effect of the second area, which is the center of the first area and the third area, And determining a color obtained by mixing the representative color of the cell and the representative color of the second cell.

The displaying operation may include calculating at least one of an area, an intensity, and a velocity of the touch drag, and calculating an area, an intensity, and a velocity of the touch drag based on at least one of the calculated area, Saturation, or brightness of the at least one of the at least one of the display may include.

The method may further include determining whether the touch drag is released, whether an elapsed time has elapsed, whether a new user input is detected or not, and if the touch drag is released, If it is detected, removing the indication of the trace effect.

The operating method may further include changing the color of the displayed trace effect in response to the touch drag.

It is to be understood that both the foregoing general description and the following detailed description of the present invention are exemplary and explanatory and are intended to provide further explanation of the invention as claimed. Accordingly, the scope of the present invention should be construed as being included in the scope of the present invention, all changes or modifications derived from the technical idea of the present invention.

100: Electronic device
120: user input unit 130: touch screen
131: display 133: touch sensing unit
140: audio processor 150: memory
180: control unit (processor)
300: Looper application
310: Basic control area 320: Looper area
330: looper control area 340: cell (Cell)

Claims (20)

In an electronic device,
display,
Memory, and
The display, and one or more processors electrically coupled to the memory,
The one or more processors,
A touch drag for playing at least one music is detected based on a user interface displayed on the display,
Identifies a plurality of cells corresponding to the touch drag,
And to display the trace effect according to the touch drag in an area between two cells of the identified plurality of cells.
The apparatus of claim 1,
And a looper region for providing a plurality of cells in which a variety of music are set respectively in a matrix structure,
And output music set to one or more cells of the plurality of cells according to a user's selection and display a representative color set in the one or more cells.
2. The apparatus of claim 1,
Determine a color of a trace effect in an area between the two cells based on at least one of musical attributes, music, or representative color of each of the two cells, and display the trace effect in a determined color.
The method of claim 3,
Wherein the color of the trace effect is at least one of a representative color of the first cell, a representative color of the second cell, and a color obtained by mixing a representative color of the first cell and a representative color of the second cell.
4. The apparatus of claim 3,
Wherein the color of the trace effect is determined to be equal to or similar to the representative color of the two cells, or to be equal to or similar to the mixed color of the representative colors of the two cells.
2. The apparatus of claim 1,
And divides the area between the two cells into a plurality of colors and determines a color to be displayed as a trace effect in each of the divided areas based on the representative color of the two cells.
7. The apparatus of claim 6,
The color of the trace effect in the first area close to the first cell is determined as the representative color of the first cell, Wherein the color of the trace effect of the first area and the second area of the second area is determined as the representative color of the first cell and the color of the trace effect of the third area is determined as the representative color of the second cell, And a representative color of the second cell.
2. The apparatus of claim 1,
Calculating at least one of an area, an intensity, and a velocity of the touch drag; calculating at least one of an area, a saturation, and a brightness of the trace effect based on at least one of the calculated area, intensity, And to distinguish between the two.
2. The apparatus of claim 1,
And to remove the indication of the trace effect when the touch drag is released, a set time has elapsed, or a new user input is detected.
2. The apparatus of claim 1,
And change the color of the displayed trace effect in response to the touch drag.
A method of operating an electronic device,
Detecting a touch drag for playing at least one music based on a user interface,
An operation of identifying a plurality of cells (Cells) corresponding to the touch drag, and
And displaying the trace effect according to the touch drag in an area between two cells of the identified plurality of cells.
12. The apparatus of claim 11,
And a looper region for providing a plurality of cells in which a variety of music are set respectively in a matrix structure,
Outputting music set in one or more cells of the plurality of cells according to a user's selection, and displaying a representative color set in the one or more cells.
12. The method of claim 11,
Determining a color of a trace effect in an area between the two cells based on at least one of a musical attribute, music, or representative color of each of the two cells; and
And displaying the trace effect in the determined color.
14. The method of claim 13,
Wherein the color of the trace effect is at least one of a representative color of the first cell, a representative color of the second cell, and a color obtained by mixing a representative color of the first cell and a representative color of the second cell.
14. The method of claim 13,
Determining the color of the trace effect to be the same as or similar to the representative color of the two cells, or determining the color of the trace effect to be the same as or similar to the mixed color of the two cells.
12. The method of claim 11,
An operation of dividing a region between the two cells into a plurality of regions,
Determining a color to be displayed as a trace effect in each of the divided regions based on a representative color of the two cells; and
And displaying the trace effect in the determined color.
17. The method of claim 16,
Dividing an area between the two cells into a first area, a second area, and a third area;
The color of the trace effect in the first region close to the first cell is determined as the representative color of the first cell and the color of the trace effect in the third region close to the second cell is determined as the representative color of the second cell, And a color of a trace effect of a first area and a second area of the third area is determined as a color obtained by mixing a representative color of the first cell and a representative color of the second cell.
12. The method of claim 11,
Calculating at least one of an area, an intensity, and a velocity of the touch drag; and
Displaying the at least one or more of the area, the saturation, or the brightness of the trace effect differentially based on at least one or two or more combinations of the calculated area, intensity, or speed.
12. The method of claim 11,
Determining whether the touch drag is released, whether a predetermined time has elapsed, and whether a new user input is detected or not; and
Further comprising removing an indication of the trace effect when the touch drag is released, a set time has elapsed, or a new user input is detected.
12. The method of claim 11,
Further comprising changing the color of the displayed trace effect in response to the touch drag.

Images