US20140003610A1 - Method of reproducing sound source of terminal and terminal thereof - Google Patents

Method of reproducing sound source of terminal and terminal thereof Download PDF

Info

Publication number
US20140003610A1
US20140003610A1 US13/891,900 US201313891900A US2014003610A1 US 20140003610 A1 US20140003610 A1 US 20140003610A1 US 201313891900 A US201313891900 A US 201313891900A US 2014003610 A1 US2014003610 A1 US 2014003610A1
Authority
US
United States
Prior art keywords
input
sound source
reproducing
terminal
termination
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US13/891,900
Other languages
English (en)
Inventor
Dohyeon KIM
Donghyuk Lee
Dongchang Lee
Wonsuk Chang
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Samsung Electronics Co Ltd
Original Assignee
Samsung Electronics Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Samsung Electronics Co Ltd filed Critical Samsung Electronics Co Ltd
Assigned to SAMSUNG ELECTRONICS CO., LTD. reassignment SAMSUNG ELECTRONICS CO., LTD. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: CHANG, WONSUK, KIM, DOHYEON, LEE, DONGCHANG, LEE, DONGHYUK
Publication of US20140003610A1 publication Critical patent/US20140003610A1/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00—Circuits for transducers, loudspeakers or microphones
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
    • H04S7/30—Control circuits for electronic adaptation of the sound field
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16—Sound input; Sound output
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2499/00—Aspects covered by H04R or H04S not otherwise provided for in their subgroups
    • H04R2499/10—General applications
    • H04R2499/11—Transducers incorporated or for use in hand-held devices, e.g. mobile phones, PDA's, camera's
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2400/00—Details of stereophonic systems covered by H04S but not provided for in its groups
    • H04S2400/11—Positioning of individual sound objects, e.g. moving airplane, within a sound field

Definitions

  • the present invention relates generally to a method of reproducing a sound source of a terminal and a terminal thereof, and more particularly, to a method of reproducing a sound source which changes a reproducing attribute of a sound source based on input information and reproducing the changed sound source to provide an effect sound, and a terminal thereof.
  • a terminal such as a smart phone or a tablet PC provides a suitable effect sound. For example, upon starting touch input, the terminal starts reproducing a sound source with respect to an effect sound. Upon termination of the touch input, the terminal terminates reproducing the sound source.
  • the present invention has been made to address at least the above problems and disadvantages, and provides at least the advantages described below.
  • a method of reproducing a sound source of a terminal which changes a reproducing attribute of the sound source with respect to an effect sound based on touch input information and reproduces the changed sound source, and a terminal thereof, are provided.
  • the present invention further provides a method of reproducing a sound source of a terminal capable of actively determining a reproduced time of the sound source through hovering, and a terminal thereof.
  • a method of reproducing a sound source includes detecting generation of an input; extracting at least one sampling point with respect to the input while the input continues; analyzing input information based on the at least one sampling point; determining a reproducing attribute with respect to a sound source corresponding to the input information based on the input information; and reproducing the sound source corresponding to the input information according to the determined reproducing attribute.
  • a terminal includes an input unit configured to detect an input; a controller configured to reproduce a sound source corresponding to input information of the input; and a sound output unit configured to output a sound according to the reproducing of the sound source, wherein the controller is further configured to extract at least one sampling point with respect to the input, analyze input information based on the at least one sampling point, determine a reproducing attribute with respect to a sound source corresponding to the input information based on the input information, and reproduce the sound source corresponding to the input information according to the determined reproducing attribute.
  • FIG. 1 is a block diagram illustrating a configuration of a terminal for implementing a method of reproducing a sound source according to an embodiment of the present invention
  • FIG. 2 is a flowchart illustrating a method of reproducing a sound source according to an embodiment of the present invention
  • FIG. 3 is a diagram illustrating an example of linked inputs
  • FIG. 4 is a flowchart illustrating a method of reproducing a sound source corresponding to generation of an input according to an embodiment of the present invention
  • FIG. 5 is a diagram illustrating an example of a detected input
  • FIG. 6 is a diagram illustrating an example of an extracted result of a sampling point
  • FIG. 7 is a diagram illustrating an example of a scheme analyzing an input angle
  • FIG. 8 is a diagram illustrating an example of changing a frequency attribute of a sound source
  • FIG. 9 is a diagram illustrating an example of changing a volume attribute of a sound source
  • FIG. 10 is a flowchart illustrating a method of reproducing a sound source corresponding to termination of an input according to an embodiment of the present invention
  • FIG. 11 is a diagram illustrating a first embodiment which reproduces a sound source according to the present invention.
  • FIG. 12 is a diagram illustrating a second embodiment which reproduces a sound source according to the present invention.
  • FIG. 13 is a diagram illustrating a third embodiment which reproduces a sound source according to the present invention.
  • FIG. 14 is a diagram illustrating a fourth embodiment which reproduces a sound source according to the present invention.
  • FIG. 15 is a diagram illustrating a fifth embodiment which reproduces a sound source according to the present invention.
  • the present invention is applicable to reproduce a sound source of a terminal which provides a sound source reproducing function such as an effect sound.
  • the present invention is applicable to various devices or services using reproduction of a sound source, as well as general electronic terminals such as a smart phone, a portable terminal, a mobile terminal, a Personal Digital Assistant (PDA), a Portable Multimedia Player (PMP) terminal, a notebook computer, a Note Pad, a Wibro terminal, a smart PC, and a smart refrigerator as a terminal reproducing a sound source.
  • general electronic terminals such as a smart phone, a portable terminal, a mobile terminal, a Personal Digital Assistant (PDA), a Portable Multimedia Player (PMP) terminal, a notebook computer, a Note Pad, a Wibro terminal, a smart PC, and a smart refrigerator as a terminal reproducing a sound source.
  • PDA Personal Digital Assistant
  • PMP Portable Multimedia Player
  • FIG. 1 is a block diagram illustrating a configuration of a terminal for implementing a method of reproducing a sound source according to an embodiment of the present invention.
  • the terminal 100 may include an input unit 110 , a controller 120 , a memory 130 , a display unit 140 , and a sound output unit 150 .
  • the input unit 110 receives an operation signal of a user for controlling an operation of the terminal 100 , and includes a touch sensor 111 and a proximity sensor 112 .
  • the touch sensor 111 detects a touch input of the user.
  • the touch sensor 111 may have a type of a touch film, a touch sheet or a touch pad or may have a type of a Touch Screen Panel (TSP) in connection with the display unit 140 .
  • the touch sensor 111 detects a touch input and transfers a detected touch signal to the controller 120 .
  • the controller 140 analyzes the touch signal to perform an operation corresponding to the analyzed touch signal. Information corresponding to the detected touch signal may be displayed on the display unit 140 .
  • the touch sensor 111 receives an operation signal according to the touch input of the user by various input means.
  • the touch sensor 111 may receive an operation signal according to a hand of the user, a physical tool, a stylus pen, and an operation button which may be included in the stylus pen.
  • the proximity sensor 112 detects presence, approach, motion, direction, speed, and a shape of an object occurring at a detection surface of the input unit 110 using an electromagnetic force without a mechanical contact.
  • the proximity sensor 112 may be one of a transmission photoelectric sensor, a direct reflection photoelectric sensor, a mirror reflection photoelectric sensor, a high frequency oscillating proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor.
  • the input unit 110 may be configured to perform functions of the touch sensor 111 and the proximity sensor 112 using an Electro Magnetic Resonance (EMR) pad.
  • EMR Electro Magnetic Resonance
  • the input unit 110 detects generation, maintenance, and termination of one of the touch input and the proximity input which are independently or sequentially generated.
  • the input unit 110 detects locations (coordinates) of the touch input and the proximity input, and pressure.
  • the controller 120 controls an overall operation of constituent elements to operate the terminal 100 .
  • the controller 120 reproduces a sound source for providing various effect sounds corresponding to the detected input from the input unit 110 .
  • the controller 120 includes a sampling point extractor 121 , an input information analyzer 122 , and a sound source changer 123 .
  • the sampling point extractor 121 extracts a sampling point with respect to the detected input from the input unit 110 .
  • the sampling point represents a generated location (coordinates) of the input.
  • the sampling point extractor 121 extracts at least one sampling point with respect to the input while the input continues. Further, the sampling point extractor 121 extracts at least one sampling point corresponding to a preset period while the input continues.
  • the input information analyzer 122 analyzes input information based on the sampling point extracted by the sampling point extractor 121 .
  • the input information analyzer 122 may analyze input information including at least one of input speed, an input angle, and pressure based on at least one sampling point.
  • the sound source changer 123 changes a reproducing attribute of a sound source stored in the memory 130 based on the input information.
  • the sound source changer 123 determines a reproducing attribute including at least one of reproducing speed, a frequency, a volume, a reproducing start time, a reproducing termination time, and presence of repeated reproducing of the sound source based on the input information.
  • the sound source changer 123 changes a reproducing attribute of the stored sound source according to the determined reproducing attribute.
  • the sound source changer 123 modulates the stored sound source according to the determined reproducing attribute and may temporarily or permanently store the modulated sound source.
  • the controller 120 extracts a sampling point with respect to the detected input from the input unit 110 through the sampling point extractor 121 , and analyzes the input information through the input information analyzer 122 .
  • the controller 120 determines a reproducing attribute with respect to a sound source corresponding to the input and the input information based on the analyzed input information through the sound source changer 123 , and reproduces the sound source according to the determined reproducing attribute.
  • controller 120 A detailed operation of the controller 120 will be described below.
  • the memory 130 stores programs or commands for the terminal 100 .
  • the controller 120 performs the programs or the commands stored in the memory 130 .
  • the memory 130 may include a storage medium having at least one type of a flash memory, a hard disk, a multimedia card micro, a memory card (for example, an SD or XD memory), RAM (Random Access Memory), SRAM (Static Random Access Memory), ROM (Read-Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM (Programmable Read-Only Memory), MRAM (Magnetic RAM), a magnetic disc, and an optical disc.
  • a storage medium having at least one type of a flash memory, a hard disk, a multimedia card micro, a memory card (for example, an SD or XD memory), RAM (Random Access Memory), SRAM (Static Random Access Memory), ROM (Read-Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM (Programmable Read-Only Memory), MRAM (Magnetic RAM), a magnetic disc, and an optical disc.
  • the memory 130 stores a sound source received from the outside or supplied upon manufacture of the terminal.
  • the memory 130 stores sound source information associated with the sound source.
  • the sound source information includes a title, a file size, a provider, a copy writer of the sound source, and input information corresponding to the sound source.
  • the input information may include at least one of an input type, such as a pen or eraser input, a type of pen, color and thickness of the pen, and whether the input is a generation, maintenance, or termination input, speed and an angle of the input, and pressure.
  • the memory 130 may temporarily or permanently store the sampling point extracted from the sampling point extractor 121 and a sound source changed through the sound source changer 123 .
  • the memory 130 may store data, equations, thresholds, and preset values necessary to analyze the input information or determine a reproducing attribute of the sound source.
  • the display unit 140 displays (outputs) information processed by the terminal 100 .
  • the display unit 140 may display a User Interface (UI) or a Graphic User Interface (GUI) associated with a memo function.
  • UI User Interface
  • GUI Graphic User Interface
  • the display unit 140 may display the UI or the GUI corresponding to the detected input from the input unit 110 .
  • the display unit 140 may display a track with respect to the detected input.
  • the display unit 140 may include at least one of a Liquid Crystal Display (LCD), a Thin Film Transistor LCD (TFT LCD), an Organic Light-Emitting Diode (OLED), a flexible display, and a 3D display.
  • LCD Liquid Crystal Display
  • TFT LCD Thin Film Transistor LCD
  • OLED Organic Light-Emitting Diode
  • flexible display and a 3D display.
  • the display unit 140 may have a mutual layer structure with a touch sensor constituting the input unit 110 and act as a touch screen. In this case, the display unit 140 acting as the touch screen performs a function of an input device.
  • the sound output unit 150 outputs a sound from the sound source reproduced by the controller 120 . For example, if a sound source associated with a received call signal sound, a received message sound, and an effect sound is reproduced, the sound output unit 150 may output a sound caused by reproducing the sound source to the outside.
  • the sound output unit 150 outputs various effect sounds corresponding to the input.
  • the sound output unit 150 may output a start sound, a frictional sound, and a termination sound reproduced by the controller 120 .
  • constituent elements shown in FIG. 1 are not essential, a terminal 100 having more or less constituent elements may be implemented.
  • FIG. 2 is a flowchart illustrating a method of reproducing a sound source according to an embodiment of the present invention. Referring to FIG. 2 , the method of reproducing the sound source may be achieved by a following sequence.
  • the terminal 100 detects generation of an input at step 210 .
  • the terminal 100 detects the generation of the input by the user.
  • the terminal 100 may detect generation of at least one of a touch input and a proximity input (referred to as hovering) which are independently or sequentially generated.
  • the touch input may be generated by a physical tool or a pen, and may have different control signals according to an operation button included in the pen.
  • the proximity input may be generated by a finger, the physical tool, or the pen as it approaches the terminal 100 .
  • the terminal 100 detects the generation of the input.
  • the terminal 100 may detect independently generated touch input or proximity input, and detects at least one of the touch input and the proximity input which are sequentially generated. For example, referring to FIG. 3 , when a finger approaches the terminal 100 within a threshold distance to detect generation of proximity input, and the finger touches the terminal 100 , the terminal 100 detects the generation of the touch input.
  • the terminal 100 performs an operation to be described below corresponding to one of a first detected input or a later detected input of the touch input and the proximity input which are sequentially detected.
  • the terminal 100 determines input information with respect to the detected input. For example, the terminal 100 detects a location of the input, a type of the input (e.g., pen or eraser input, a type of pen, color and thickness of the pen), and pressure.
  • a type of the input e.g., pen or eraser input, a type of pen, color and thickness of the pen
  • the terminal 100 performs an operation with respect to a sound source corresponding to the input information. For example, the terminal 100 performs preceding operations for reproducing including search, loading, and reproducing-initialization of a sound source corresponding to the input information.
  • the terminal 100 reproduces the sound source corresponding to the input information.
  • the terminal 100 may reproduce the sound source corresponding to the input information with an optional volume.
  • the terminal 100 may reproduce the sound source corresponding to the input information of the proximity input with a volume of 0. Accordingly, although the user does not substantially touch the terminal 100 , as the input approaches the terminal 100 , reproduction of the sound source may be prevented from being delayed in the terminal 100 when the touch is achieved by reproducing the sound source corresponding to the proximity input in advance.
  • the terminal 100 reproduces a sound source corresponding to the generation of the input.
  • the terminal 100 determines whether the generation of the input is detected in step 211 .
  • the terminal 100 determines whether there is a sound source corresponding to the generation of the input in step 212 .
  • the sound source corresponding to the generation of the input may be a frictional start sound.
  • the terminal 100 When there is the sound source corresponding to the generation of the input, the terminal 100 reproduces the sound source corresponding to the generation of the input.
  • the terminal 100 may reproduce the sound source corresponding to the generation of the input when the generation of the input is detected or when an optional time elapses after the generation of the input is detected.
  • the terminal 100 determines whether the optional time elapses in step 213 . If the generation of the input is detected, the terminal 100 determines whether the optional time elapses.
  • the terminal 100 reproduces the sound source in step 214 .
  • the optional time may be set and stored in the terminal 100 or may be a randomly selected time.
  • the terminal 100 may determine the optional time using a function based on a detected time of the generation of the input, a generated location of the input, presence of a linked input, and application information in which the input is generated.
  • the terminal 100 may extract a sampling point (to be described below) by a next operation as the generation of the input is detected. Accordingly, the terminal may reproduce music corresponding to the generation of the input simultaneously with extraction of the sampling point.
  • the terminal 100 extracts the sampling point in step 220 .
  • the terminal 100 may extract at least one sampling point with respect to the input while the generated input continues.
  • the sampling point represents a location (or coordinates) in which the input is detected. That is, referring to FIG. 5 , when a user input with respect to lowercase letter “a” is generated, the terminal 100 extracts an input location at an optional moment of the sampling point while the input continues to form a track in the shape “a”.
  • the terminal 100 may extract at least one sampling point corresponding to a preset period.
  • the terminal 100 may repeatedly extract the sampling point every preset time period or every frequency period. For example, the terminal 100 may extract the sampling point during a period of 60 Hz.
  • the terminal 100 may extract at least one sampling point during an optional period while the input continues to form the track. As shown in FIG. 5 , the terminal 100 extracts 11 sampling points for forming the track including a sampling point of an input generation start point 10 and a sampling point of a termination point 60 which is finally extracted before the input is terminated according to the generation of the input.
  • the input may have various input speeds and pressures according to a writing habit and a writing type, and an input track intended by the user.
  • the extracted sampling point may have an optional interval, a relative location, and an angle according to input speed and an input track.
  • the terminal 100 analyzes the input information in step 230 .
  • the terminal 100 analyzes the input information based on the at least one extracted sampling point.
  • the input information may include at least one of an input type, an input location (coordinates), input speed, an input angle, and pressure.
  • the terminal 100 may analyze an input location of the sampling point as two-dimensional coordinates or three-dimensional coordinates.
  • the terminal 100 may present a point in which touch input is generated as the two-dimensional coordinates, or present a point in which the input is generated using a distance between the terminal 100 and the input as the three-dimensional coordinates in a case of proximity input.
  • the terminal 100 analyzes the input speed based on an interval and an extracted period of the sampling point.
  • the sampling point may be represented as illustrated in FIG. 6 .
  • the sampling point may have an optional interval according to the input speed. Referring to FIG. 6 , while the letter “a” is input, a track is slowly input so that an interval of the sampling point may be narrow during a first period 20 and a third period 40 , and the track is rapidly input so that an interval of the sampling point may be wide during a second period 30 and a fourth period 50 .
  • the terminal 100 may analyze a straight interval of the extracted sampling point corresponding to a preset period, and may analyze the input speed based on the period and the interval.
  • the preset period is a frequency period f and an interval is one pixel
  • input speed v may be analyzed by the following Equation (1).
  • the terminal 100 may analyze the input angle based on at least three sampling points.
  • the sampling point during the second period 30 among inputs shown in FIG. 5 may be exaggerated as shown in FIG. 7 .
  • the sampling point may have an optional relative location according to a writing habit and a writing type, and an input track intended by the user. Accordingly, an angle 70 formed by three sampling points may be determined.
  • the terminal 100 determines the angle 70 formed by the sampling point based on the extracted sampling point. In this case, the terminal 100 determines an angle between sequentially extracted sampling points or an angle between selected sampling points at an optional interval. For example, the terminal 100 may determine the angle between the sampling points based on a reference sampling point and third and sixth extracted sampling points after the reference sampling point is extracted.
  • the terminal 100 determines whether there is a sound source corresponding to the input information in step 240 .
  • the terminal 100 determines whether there is a sound source corresponding to the input information based on the input information.
  • the terminal 100 may determine whether there is the sound source corresponding to the input information including at least one of an input type (e.g., pen or eraser input, a type of pen, color and thickness of the pen), an input location, input speed, an input angle, and pressure.
  • the sound source corresponding to the input information may be a frictional sound, a writing sound, and a sound of a typewriter.
  • the sound source corresponding to the input information may be one of a plurality of sound sources modulated with respect to the same sound source to have different frequencies, volumes, and reproduced lengths according to the input speed, the input angle, and the pressure.
  • the terminal searches for a sound source stored in the terminal 100 or a sound source downloadable through a web server.
  • the terminal 100 determines whether there is the sound source based on the sound source stored associated with the sound source.
  • the sound source information includes a title, a file size, a provider, a copy writer of the sound source, and input information corresponding to the sound source.
  • the terminal 100 determines a reproducing attribute of the sound source in step 250 .
  • the terminal 100 determines the reproducing attribute including at least one of reproducing speed, a frequency, a volume, a reproducing start time, a reproducing termination time, and presence of repeated reproduction with respect to the sound source corresponding to the input information.
  • the terminal 100 may increase or reduce the frequency attribute of the sound source based on the input information.
  • the terminal 100 may change the frequency attribute of the sound source based on at least one of input speed, an input angle, and pressure.
  • the terminal 100 may increase the frequency of the sound source. If the frequency of the sound source is higher than the threshold, an audio pitch may become higher and reproducing speed of the sound source may become faster according to a modulation scheme of the sound source. Accordingly, the terminal 100 may rapidly reproduce the sound source according to the input information so that a more natural effect sound may be provided.
  • the terminal 100 may reduce the frequency of the sound source.
  • Equation (2) A proportional expression with respect to an example of change in the frequency as illustrated above may be expressed by the following Equation (2).
  • the terminal 100 may determine the reproducing speed of the sound source by changing the frequency attribute of the sound source. Further, the terminal 100 may determine the reproducing attribute or use a modulation scheme for preventing the change in a volume by reflecting the change in the volume due to the change in the frequency attribute of the sound source.
  • the terminal 100 may increase or reduce a volume of the sound source based on the input information. For example, the terminal 100 may change a volume attribute of the sound source based on at least one of the input speed, the input angle, and the pressure. When the input speed is greater than a threshold, the input angle is less than a threshold, or the pressure is less than a threshold, the terminal may increase the volume of the sound source.
  • the terminal 100 may reduce the volume of the sound source.
  • Equation (3) A proportional expression with respect to an example of the change in the volume as illustrated above may be expressed by the following Equation (3).
  • the terminal 100 may determine whether to repeatedly reproduce the sound source while the input continues, and may determine whether to repeatedly reproduce the sound source according to a reproducing attribute determined corresponding to the input information.
  • the terminal 100 may modulate a sound source to optionally or permanently store the modulated sound source when the input is detected or based on a determined reproducing attribute.
  • the terminal 100 may maintain an original sound source, and separately store the modulated sound source, and store the modulated sound source associated with the input information.
  • the terminal 100 reproduces the sound source in step 260 .
  • the terminal 100 reproduces the sound source according to the determined reproducing attribute.
  • the terminal 100 modulates the sound source corresponding to the input information according to the determined reproducing attribute and reproduces the modulated sound source.
  • the terminal 100 reproduces the modulated sound source to have the determined reproducing attribute.
  • the terminal 100 When an optional time elapses after the input is detected, the terminal 100 reproduces the sound source.
  • the optional time may be set and stored in the terminal 100 or be a randomly selected time.
  • the terminal 100 may determine the optional time using a function based on a detected time of the input, a location of the input, and application information in which the input is generated.
  • the terminal 100 determines a reproducing start time based on the input information upon determination of the reproducing attribute. That is, the terminal 100 determines a reproducing start time when an optional time elapses after the input is detected. When the reproducing start time comes, the terminal 100 reproduces the sound source.
  • the terminal 100 may apply various effects to reproduce the sound source.
  • the terminal 100 may reproduce the sound source according to effects such as fade in, fade out, echo, and vibration.
  • the terminal 100 may modulate the sound source so that the foregoing effects are applied to the sound source or may control input/output specifications to apply the effects.
  • the terminal 100 determines whether termination of the input is detected in step 270 .
  • the terminal 100 detects the termination of the input by the user. For example, when the input no longer continues so that an input signal is not generated, the terminal 100 may detect that the input is terminated. For example, the terminal 100 may detect termination of at least one of a touch input and a proximity input (hovering) which are independently or sequentially generated. When an input tool no longer makes contact with the terminal 100 or the input tool is located greater than a threshold distance which the terminal 100 recognizes as the approach of the input tool, the terminal 100 detects the termination of the input.
  • the terminal 100 detects termination of the touch input and the proximity input which are independently or sequentially generated.
  • the terminal 100 may perform an optional operation corresponding to one of first detected termination or later detected termination of the touch input and the proximity input which are sequentially detected.
  • the terminal 100 continuously extracts a sampling point, analyzes the input information to determine a reproducing attribute of the sound source, and repeatedly reproduces the sound source according to the determined attribute.
  • the terminal 100 terminates reproduction of the sound source in step 280 . If the termination of the input is detected, the terminal 100 terminates a reproduced sound source or a repeatedly reproduced sound source. In this case, when the termination of the input is detected or a randomly selected time elapses after the termination of the input is detected, the terminal 100 terminates the reproducing of the sound source. That is, the terminal 100 maintains reproduction of the sound source for the optional time although the input is terminated to remove the disconnect felt by the user when the reproducing of the sound source is suddenly terminated.
  • the optional time may be set and stored in the terminal 100 or may be a randomly selected time.
  • the terminal 100 determines the optional time using a function based on a detected time of the termination of the input and application information in which the input is terminated.
  • the terminal 100 may perform an operation with respect to the sound source corresponding to the termination of the input.
  • the terminal 100 may reproduce the sound source corresponding to the termination of the input.
  • the terminal 100 detects the termination of the input in step 291 .
  • the terminal 100 determines whether there is a sound source corresponding to the termination of the input in step 292 .
  • the sound source corresponding to the termination of the input may include a frictional termination sound.
  • the terminal 100 If there is a sound source corresponding to the termination of the input, the terminal 100 reproduces the sound source corresponding to the termination of the input. When the termination of the input is detected or when an optional time elapses after the termination of the input is detected, the terminal 100 reproduces the sound source corresponding to the termination of the input.
  • the terminal 100 may determine whether the optional time elapses in step 293 . If the termination of the input is detected, the terminal 100 determines whether the optional time elapses. When the optional time elapses, the terminal 100 reproduces the sound source in step 294 .
  • the optional time may be set and stored in the terminal 100 or may be a randomly selected time.
  • the terminal 100 may determine the optional time using a function based on a detected time of the generation of the input, a generation location of the input, presence of a linked input, and application information in which the input is generated.
  • FIG. 11 is a diagram illustrating a first embodiment which reproduces a sound source according to the present invention.
  • a terminal 100 detects generation of an input.
  • the terminal 100 detects a touch input or a proximity input by the user.
  • the terminal 100 determines the input information to reproduce a sound source corresponding to input information.
  • the terminal 100 may extract 10 sampling points for forming the track including a sampling point of an input generation start point 10 and a sampling point of a termination point 60 which is finally extracted before the input is terminated during a period according to the generation of the input while the input continues.
  • the terminal analyzes the input information based on the extracted sampling point.
  • the terminal 100 may analyze input speed and an input angle based on a length between the sampling points, an angle, and pressure. For example, the terminal 100 may analyze input speed based on a narrow interval between the sampling points during a first period 20 of the extracted sampling point, and analyze input speed based on a wide interval between the sampling points during a second period 30 . According to the analysis result, the input speed during the first period 20 becomes lower than that during the second period 30 .
  • the terminal 100 determines a reproducing attribute of the sound source corresponding to the input information based on the analyzed input information. For example, the terminal 100 may increase a frequency of a sound source during the first period 20 having relatively lower input speed. Further, the terminal 100 may reduce a frequency of a sound source during the second period 30 having relatively higher input speed. The terminal 100 repeatedly reproduces the sound source according to the determined reproducing attribute, until the terminal 100 detects termination of the input. The terminal 100 terminates the reproducing of the sound source corresponding to the input according to the termination of the input.
  • FIG. 12 is a diagram illustrating a second embodiment which reproduces a sound source according to the present invention.
  • a terminal 100 detects generation of an input.
  • the terminal 100 detects generation of a touch input or a proximity input by the user.
  • the terminal 100 reproduces a sound source 1 corresponding to the generation of the input.
  • the sound source 1 corresponding to the generation of the input may include a friction start sound.
  • the terminal 100 may extract 11 sampling points for forming the track including a sampling point of an input generation start point 10 according to the generation of the input during a period while the input continues and a sampling point of a termination point 60 finally extracted before the input is terminated.
  • the terminal 100 analyzes input information based on the extracted sampling points, and determines a reproducing attribute of a sound source corresponding to the input information based on the analyzed information.
  • the terminal 100 may repeatedly reproduce the sound source according to the determined reproducing attribute.
  • the sound source corresponding to the input information may be a frictional sound, a writing sound, and a sound of a typewriter.
  • the terminal 100 detects termination of the input.
  • the terminal 100 detects termination of a touch input or a proximity input. If the termination of the input is detected, the terminal 100 terminates the reproducing of the sound source corresponding to the input according to the termination of the input.
  • the terminal 100 may terminate the reproducing of the sound source corresponding to the input information and then reproduce the sound source 2 corresponding to the termination of the input.
  • the sound source 2 corresponding to the termination of the input may include a frictional termination sound.
  • FIG. 13 is a diagram illustrating a third embodiment which reproduces a sound source according to the present invention.
  • the terminal 100 detects generation of the input.
  • the terminal 100 detects generation of linked inputs in which touch inputs are sequentially generated after the proximity input.
  • the terminal 100 If generation of the proximity input is detected, the terminal 100 reproduces a sound source 1 corresponding to the generation of the input. If sequential generation of touch input is detected after generation of the proximity input, the terminal 100 reproduces the sound source 1 corresponding to the generation of the input.
  • the terminal 100 extracts a plurality of sampling points of a proximity input generation point 11 and a touch input generation point 10 while linked touch inputs continue after detection of the proximity input.
  • the terminal 100 analyzes input information based on the extracted sampling point, and determines whether there is a sound source corresponding to the input information based on the analyzed input information. When there is a sound source, the terminal reproduces a corresponding sound source. For example, the terminal 100 may reproduce a first sound source 3 during a first period 20 having relatively lower input speed, and may reproduce a second source 4 during a second period having relatively higher input speed.
  • the terminal 100 detects termination of the input.
  • the terminal 100 detects termination of linked inputs in which proximity input is terminated after the terminal 100 terminates the touch input.
  • the terminal 100 terminates the reproducing of the sound source corresponding to the input information according to the termination of the input.
  • the terminal 100 may terminate reproducing of the sound source corresponding to the input information when termination of the touch input or the proximity input is detected.
  • the terminal 100 terminates the reproducing of the sound source corresponding to the input information, and may reproduce a sound source 2 corresponding to the termination of the input.
  • the terminal 100 reproduces the sound source 2 corresponding to the termination of the input when termination of the touch input or the proximity input is detected.
  • reproducing of a start sound and a termination sound according to detection of input generation or termination upon the generation of the linked inputs may be variously changed according to an embodiment of the present invention, the reproducing time point or the termination time point of the sound source is not limited to the foregoing example.
  • FIG. 14 is a diagram illustrating a fourth embodiment which reproduces a sound source according to the present invention.
  • the terminal 100 detects generation of the input.
  • the terminal 100 detects generation of a touch input or a proximity input by the user.
  • the terminal 100 extracts at least one sampling point while the input continues, and analyzes the input information based on the extracted sampling point.
  • the terminal 100 determines a reproducing attribute of a sound source corresponding to the input information based on the analyzed input.
  • the terminal 100 may determine a reproducing attribute including at least one of reproducing speed, a frequency, a volume, a reproducing start time, a reproducing termination time of the sound source, and presence of repeated reproducing based on the input information. For example, the terminal 100 may increase a frequency of a sound source during the first period 20 having relatively lower input speed. Further, the terminal 100 may reduce a frequency of a sound source during the second period 30 having relatively higher input speed.
  • the terminal 100 may repeatedly reproduce a sound source according to the determined reproducing attribute.
  • the terminal 100 reproduces a sound source corresponding to generation of the input when an optional time t elapses after the generation of the input is detected.
  • the optional time t may be set and stored in the terminal 100 or be a randomly selected time.
  • the terminal 100 determines the optional time using a detected time of the input generation and a generated location of the input.
  • the terminal 100 detects the termination of the input.
  • the terminal 100 terminates the reproducing of the sound source corresponding to the input information according to termination of the input.
  • the terminal 100 terminates the reproducing of the sound source when the optional time elapses after the termination of the input is detected.
  • the terminal 100 may continue the reproducing of the sound source for the optional time after the input is terminated.
  • the terminal 100 terminates a reproducing termination time upon determination of the reproducing attribute, and terminates the reproducing of the sound source at the determined reproducing termination time.
  • the reproducing termination time may be a time when the optional time t elapses after the termination of the input is detected.
  • the terminal 100 terminates the reproducing of the sound source corresponding to the input information, and reproduces a sound source 2 corresponding to the termination of the input.
  • the terminal 100 reproduces the sound source 2 corresponding to the termination of the input when the optional time is elapses after the termination of the input is detected.
  • the optional time is as illustrated above.
  • reproducing of a start sound and a termination sound according to detection of input generation or termination may be variously changed according to the embodiment, the reproducing time point or the termination time point of the sound source is not limited to the foregoing example.
  • FIG. 15 is a diagram illustrating a fifth embodiment which reproduces a sound source according to the present invention.
  • a terminal 100 detects generation of an input.
  • the terminal 100 detects generation of linked inputs in which touch input is sequentially generated after a proximity input.
  • the terminal 100 reproduces a sound source 1 corresponding to the generation of the input. If generation of sequential touch inputs is detected after the generation of the proximity input, the terminal 100 reproduces the sound source 1 corresponding to the generation of the input.
  • the terminal 100 extracts a plurality of sampling points of a proximity input generation point 11 and a touch input generation point 10 while linked touch inputs continue after detection of the proximity input.
  • the terminal 100 analyzes input information based on the extracted sampling point.
  • the terminal 100 determines whether there is a sound source corresponding to the input information based on the analyzed input information. When there is the sound source, the terminal may reproduce a corresponding sound source. For example, the terminal 100 reproduces a first sound source 3 during a first period 20 having relatively lower input speed, and may reproduce a second sound source 4 during a second period having relatively higher input speed.
  • the terminal 100 detects termination of the input.
  • the terminal 100 detects termination of linked inputs in which proximity input is terminated after the terminal 100 terminates the touch input.
  • the terminal 100 terminates the reproducing of the sound source corresponding to the input information according to the termination of the input.
  • the terminal 100 may terminate reproducing of the sound source corresponding to the input information when termination of the touch input or the proximity input is detected.
  • the terminal 100 terminates the reproducing of the sound source corresponding to the input information, and may reproduce a sound source 2 corresponding to the termination of the input.
  • the terminal 100 reproduces the sound source 2 corresponding to the termination of the input when termination of the touch input or the proximity input is detected.
  • the terminal 100 may reproduce a sound source 2 corresponding to termination of the input prior to an optional time after termination of the proximity input is detected. That is, the terminal 100 determines a termination time of the proximity input based on termination of the touch input or reproduces a sound source corresponding to termination of the proximity input before the termination of the proximity input is detected.
  • reproducing of a start sound and a termination sound according to detection of input generation or termination upon the generation of the linked inputs may be variously changed according to the embodiment, the reproducing time point or the termination time point of the sound source is not limited to the foregoing example.
  • the method of reproducing a sound source of a terminal and a terminal thereof according to the present invention provides an effect which the user can intuitively feel by reproducing a sound source so that one sound source corresponds to a writing track by an input.
  • the method of reproducing a sound source of a terminal and a terminal thereof according to the present invention ensures real time provision of the effect sound and removes the disconnect between the input and the effect sound by minimizing delay of the effect sound upon writing by the input.
US13/891,900 2012-06-28 2013-05-10 Method of reproducing sound source of terminal and terminal thereof Abandoned US20140003610A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR1020120069704A KR20140002900A (ko) 2012-06-28 2012-06-28 단말의 음원 재생 방법 및 그 단말
KR10-2012-0069704 2012-06-28

Publications (1)

Publication Number Publication Date
US20140003610A1 true US20140003610A1 (en) 2014-01-02

Family

ID=49778195

Family Applications (1)

Application Number Title Priority Date Filing Date
US13/891,900 Abandoned US20140003610A1 (en) 2012-06-28 2013-05-10 Method of reproducing sound source of terminal and terminal thereof

Country Status (2)

Country Link
US (1) US20140003610A1 (ko)
KR (1) KR20140002900A (ko)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109975795A (zh) * 2017-12-28 2019-07-05 北京京东尚科信息技术有限公司 一种声源追踪方法和装置
US20190304452A1 (en) * 2016-07-22 2019-10-03 Sony Corporation Information processing apparatus, information processing method, and program

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6311092B1 (en) * 1996-09-18 2001-10-30 Sony Corporation Recording apparatus, reproducing apparatus, and recording and/or reproducing apparatus
US20050103187A1 (en) * 2002-01-24 2005-05-19 Bodlaender Maarten P. Music retrieval system for joining in with the retrieved piece of music
US20100295805A1 (en) * 2009-05-19 2010-11-25 Samsung Electronics Co., Ltd. Method of operating a portable terminal and portable terminal supporting the same
US20120250896A1 (en) * 2011-03-30 2012-10-04 Yamaha Corporation Audio signal controller

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6311092B1 (en) * 1996-09-18 2001-10-30 Sony Corporation Recording apparatus, reproducing apparatus, and recording and/or reproducing apparatus
US20050103187A1 (en) * 2002-01-24 2005-05-19 Bodlaender Maarten P. Music retrieval system for joining in with the retrieved piece of music
US20100295805A1 (en) * 2009-05-19 2010-11-25 Samsung Electronics Co., Ltd. Method of operating a portable terminal and portable terminal supporting the same
US20120250896A1 (en) * 2011-03-30 2012-10-04 Yamaha Corporation Audio signal controller

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20190304452A1 (en) * 2016-07-22 2019-10-03 Sony Corporation Information processing apparatus, information processing method, and program
US10878814B2 (en) * 2016-07-22 2020-12-29 Sony Corporation Information processing apparatus, information processing method, and program
CN109975795A (zh) * 2017-12-28 2019-07-05 北京京东尚科信息技术有限公司 一种声源追踪方法和装置

Also Published As

Publication number Publication date
KR20140002900A (ko) 2014-01-09

Similar Documents

Publication Publication Date Title
US11740727B1 (en) Devices, methods, and graphical user interfaces for manipulating user interface objects with visual and/or haptic feedback
US10534524B2 (en) Method and device for controlling reproduction speed of multimedia content
US8810535B2 (en) Electronic device and method of controlling same
CN104035672B (zh) 用于通过检测摩擦手势提供预览的移动设备及其控制方法
US9804766B2 (en) Electronic device and method of displaying playlist thereof
US20120169609A1 (en) Methods and apparatuses for facilitating content navigation
US20090187842A1 (en) Drag and Drop User Interface for Portable Electronic Devices with Touch Sensitive Screens
US10331297B2 (en) Device, method, and graphical user interface for navigating a content hierarchy
CN108885505B (zh) 具有交互式内容元素的直观文档导航
KR20170057823A (ko) 에지 스크린을 통한 터치 입력 방법 및 전자 장치
US11567725B2 (en) Data processing method and mobile device
JP2018506803A (ja) 湾曲ディスプレイとのユーザ相互作用のためのシステム及び方法
KR20160024583A (ko) 전자 장치 및 드로잉 기능 제공 방법
KR102346565B1 (ko) 다중 스테이지 사용자 인터페이스
KR20160053675A (ko) 전자 칠판 장치 및 그 제어 방법
US20130227463A1 (en) Electronic device including touch-sensitive display and method of controlling same
US20140003610A1 (en) Method of reproducing sound source of terminal and terminal thereof
KR20140029096A (ko) 복수의 페이지 표시 방법 및 이를 위한 단말
KR20160038413A (ko) 콘텐츠 탐색 장치 및 콘텐츠 탐색 방법
WO2023230753A1 (zh) 快捷批注方法、装置、交互平板及存储介质

Legal Events

Date Code Title Description
AS Assignment

Owner name: SAMSUNG ELECTRONICS CO., LTD., KOREA, REPUBLIC OF

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:KIM, DOHYEON;LEE, DONGHYUK;LEE, DONGCHANG;AND OTHERS;REEL/FRAME:030459/0045

Effective date: 20130401

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION