WO2012167393A1 - Method for motion-dependent navigation in continuous data streams along visual structures - Google Patents

Method for motion-dependent navigation in continuous data streams along visual structures Download PDF

Info

Publication number
WO2012167393A1
WO2012167393A1 PCT/CH2012/000124 CH2012000124W WO2012167393A1 WO 2012167393 A1 WO2012167393 A1 WO 2012167393A1 CH 2012000124 W CH2012000124 W CH 2012000124W WO 2012167393 A1 WO2012167393 A1 WO 2012167393A1
Authority
WO
WIPO (PCT)
Prior art keywords
visual representation
method according
characterized
sound
relative
Prior art date
Application number
PCT/CH2012/000124
Other languages
German (de)
French (fr)
Inventor
Markus Cslovjecsek
Original Assignee
Markus Cslovjecsek
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority to CH00952/11A priority Critical patent/CH705069A1/en
Priority to CH952/11 priority
Application filed by Markus Cslovjecsek filed Critical Markus Cslovjecsek
Publication of WO2012167393A1 publication Critical patent/WO2012167393A1/en

Links

Classifications

    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10HELECTROPHONIC MUSICAL INSTRUMENTS
    • G10H1/00Details of electrophonic musical instruments
    • G10H1/36Accompaniment arrangements
    • G10H1/40Rhythm
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object or an image, setting a parameter value or selecting a range
    • G06F3/04847Interaction techniques to control parameter settings, e.g. interaction with sliders, dials
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10HELECTROPHONIC MUSICAL INSTRUMENTS
    • G10H1/00Details of electrophonic musical instruments
    • G10H1/0091Means for obtaining special acoustic effects
    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11BINFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/02Editing, e.g. varying the order of information signals recorded on, or reproduced from, record carriers
    • G11B27/031Electronic editing of digitised analogue information signals, e.g. audio or video signals
    • G11B27/034Electronic editing of digitised analogue information signals, e.g. audio or video signals on discs
    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11BINFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/102Programmed access in sequence to addressed parts of tracks of operating record carriers
    • G11B27/105Programmed access in sequence to addressed parts of tracks of operating record carriers of operating discs
    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11BINFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/34Indicating arrangements
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10HELECTROPHONIC MUSICAL INSTRUMENTS
    • G10H2210/00Aspects or methods of musical processing having intrinsic musical character, i.e. involving musical theory or musical parameters or relying on musical knowledge, as applied in electrophonic musical tools or instruments
    • G10H2210/155Musical effects
    • G10H2210/195Modulation effects, i.e. smooth non-discontinuous variations over a time interval, e.g. within a note, melody or musical transition, of any sound parameter, e.g. amplitude, pitch, spectral response, playback speed
    • G10H2210/241Scratch effects, i.e. emulating playback velocity or pitch manipulation effects normally obtained by a disc-jockey manually rotating a LP record forward and backward
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10HELECTROPHONIC MUSICAL INSTRUMENTS
    • G10H2210/00Aspects or methods of musical processing having intrinsic musical character, i.e. involving musical theory or musical parameters or relying on musical knowledge, as applied in electrophonic musical tools or instruments
    • G10H2210/375Tempo or beat alterations; Music timing control
    • G10H2210/385Speed change, i.e. variations from preestablished tempo, tempo change, e.g. faster or slower, accelerando or ritardando, without change in pitch
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10HELECTROPHONIC MUSICAL INSTRUMENTS
    • G10H2220/00Input/output interfacing specifically adapted for electrophonic musical tools or instruments
    • G10H2220/091Graphical user interface [GUI] specifically adapted for electrophonic musical instruments, e.g. interactive musical displays, musical instrument icons or menus; Details of user interactions therewith
    • G10H2220/096Graphical user interface [GUI] specifically adapted for electrophonic musical instruments, e.g. interactive musical displays, musical instrument icons or menus; Details of user interactions therewith using a touch screen

Abstract

The invention relates to a computer-based method for navigating in continuous data streams, in particular in sound recordings. In said method, data streams are played back relative to the motion of a finger, of a defined point on a screen, or of another input medium along a visual structure, specifically in accordance with direction, speed, and pressure. Thus, the sound recording is played back forward or backward and with frequency modulation relative to the speed of the motion, as with an old open reel tape or a vinyl record. By means of a method for pitch control, the change in the frequency can also be compensated.

Description

 TITLE:

 METHOD FOR MOVING DEPENDENT NAVIGATION IN CONTINUOUS DATA STREAMS ALONG VISUAL STRUCTURES

STATE OF THE ART:

Body movements, in particular finger gestures for controlling functions and data via touch-sensitive surfaces but also for non-contact control of devices are known. "Devices, Methods, and Graphical User Interfaces for Accessibility Using a Touch Sensitive Surface" (US2010 / 0309147) or a "Method and Device for a Touchless Interface" (US2008 / 0048878). The gesture-based navigation of reading systems for the visually impaired is also known: "Voice-output reading System with

Gesture based navigation "(US006115482 A).

 These applications control discrete data, a whole spoken word as in Systems d'aide a l'apprentissage de la lecture (FR2840092), an image, a document, a time, a function, or a discrete location in a larger data continuum , In this way, searching and fast-forwarding and rewinding work in one

Piece of music or a video sequence on an iPod according to the "Method and Apparatus for Accelerated Scrolling" (WO03 / 036457 A2).

 Navigating in a data continuum is known as a "virtual phonograph"

(US2010 / 0318204) and is described for DJ's popular "scratching". Here, however, the output is due to a movement of the virtual record. Although the playback is also reproduced here relative to the movement of the finger, but by the, moved by the finger turntable at the position of the pickup. The vinyl record or other "sound recording medium" has no structure, which

Inferences allowed on the course of the synchronized playback.

The patent "Musical Instrument having a Ribbed Surface" (US 7317157 B2) discloses a mechanical method for producing tones by means of ribbed surfaces

described. The description mentions how this method can be simulated on a computer screen. The present invention differs in that this method is implemented on a touch-sensitive surface and that both the data stream relative to a pointing means and the pointing means can move relative to the data stream. In addition, the new method allows the use of different data streams (eg, noises to symphonies) and various visual representations (see Figures 1-7). DESCRIPTION OF THE INVENTION:

A method on a touch screen for navigating in a data stream, in particular a sound recording by relative movement of a pointing means, in particular a finger along a visual representation of the data stream. Here, the visual representation is a data stream, e.g. deposited a continuous soundtrack, which is flexibly connected to one or more anchors with the visual representation. The method is characterized in that the stored data stream is played back relative to the movement of the finger, which means e.g. the soundtrack can be played forwards, backwards, faster and slower, but also in sections or in modified pitch. Instead of controlling with fingers, the control can also be done with a pen, a mouse or another pointing device. In this case, both the pointing means can move relative to the visual representation as well as the visual representation can be moved relative to the point marked by the pointing means point on the screen. When using multiple fingers, multiple streams can be played independently.

LIST OF FIGURES:

FIG. 1: Graphic

 FIG 2: text and picture

 FIG. 3: sequence of pictures and musical notation

 4 shows a plan

 5: a score

 6 shows a surface structure of a material

7 shows a photograph

EMBODIMENT OF THE INVENTION:

A method on a touch screen or other environment, such as an iPhone or iPad, an imaged mousepad, e-paper or laser-scanned area, for navigating in a data stream, in particular sound recording by relative movement of a pointing means, in particular a finger along one visual representation of a data stream. In this case, both the pointing means relative to the visual representation and the visual representation can be moved relative to the point marked by the pointing means on the screen.

The visual representation is a continuous soundtrack deposited, which is flexibly connected to one or more anchors with the visual representation. This allows the visual representation to be linked to the associated data stream, e.g. Moving, enlarging, reducing and rotating a soundtrack on the screen, but also cutting, editing and recombining.

The audio track can be any audio recording, from the spoken word, any musical instruments and the sung song to the symphony, from the animal sound to the machine noise and thunder rumble. The recording is possible via microphone, line input or directly from the internet or computer.

The visual representation can be any visual structure, in particular a graphic [1], an image [2] or a text [3], a series of images [4] or a musical notation [5], a certain distance on a map [8] , a score (Figure 5), a surface texture of a material (Figure 6), a photograph (Figure 7), or combinations thereof. The visual

Presentation can be both static and dynamic. For the playback of the sound track, the relative movement of the play position to the visual structure is decisive.

The method is characterized in that in a sound sequence, this is played relative to the speed of the movement, which means that the tempo of the soundtrack being played is controlled by the speed of the relative finger movement. Depending on the relative movement, the soundtrack can thus be played both forwards and backwards, as well as in whole or in sections, which means that the beginning or the end of the sound sequence at an arbitrary position, eg. in a voice recording in the middle of a word, can lie.

The playback speed can change the pitch proportionally, inversely proportional or disproportionately, which opens up many possibilities for creative design with the existing sound material. The pitch of the played soundtrack can also remain unchanged, which is especially important when playing a piece of music. The forward and Reverse playback of the soundtrack is also possible automatically. By the "position of the pointing means, the finger pressure or with Accessibility [6] any parameter, such as pitch, volume and effects can be influenced or set. A cursor [7] can display the exact playback position.

Multiple soundtracks can be played simultaneously or synchronously. Thus, the user can intuitively realize a polyphonic design, from simple polyphony, a canon to the symphony or a free sound collage. The described method can also be used in combination with known methods for the reproduction of discrete data.

The fact that when using a soundtrack any acoustic sources can be used, there are possibilities of all conceivable sound and

Sound combinations. Connected to the visual presentation, the user has visual reminders that support creative play.

Capture, save and edit functions [9] can be used to save, import, cut, edit and recombine sequences. Individual recordings or entire compositions can be exchanged with other users via e-mail or e-platforms.

Claims

CLAIMS:
Claim 1: A method on a, touch screen for navigating in a data stream, in particular a sound recording by moving a pointing means, in particular a finger along a visual representation of which the continuous data stream, in particular a soundtrack, deposited
characterized in that the data stream is played relative to the Zeigentittelbewegung and both the pointing means relative to the visual representation as well as the visual representation relative to the point marked by the pointing means point on the screen can be moved.
Claim 2: A method according to claim 1
characterized in that the data stream, in particular a sound sequence, can be played both forwards and backwards as well as completely or in sections.
Claim 3: A process according to claims 1 or 2,
characterized in that when playing a sound sequence, the pitch is maintained regardless of the speed of the relative finger movement or the playback speed.
Claim 4: A method according to claims 1 or 2,
characterized in that when playing a sound sequence, the speed of the relative finger movement or the playback speed changes the pitch.
Claim 5: A method according to any one of claims 1-4,
characterized in that the visual representation may be any visual representation, in particular an image, a graphic, a text, a notation, a plan, a structure, a photograph or combinations thereof.
Claim 6: A method according to any one of claims 1-5,
characterized in that the soundtrack with one or more anchors is flexibly connected to the visual representation and thus the visual representation with the associated sound track on the screen displaceable, zoomable, reducible and rotatable, as well as separable into sections, editable and can be recombined.
Claim 7: A method according to any one of claims 1-6, characterized in that at the same time multiple tracks can be played independently or synchronized.
Claim 8: A method according to any one of claims 1-7,
characterized in that as the acoustic phenomenon for the soundtrack a spoken text, a sung text, an instrumental melody, a rhythm, several melodies played by the same or different instruments, an animal voice, a nature sound or sound, a technical sound sequence, a sound sequence or combinations of which it can be used.
Claim 9: Computer program product containing the software for performing the method according to any one of claims 1-8.
Claim 10: Electronic device with installed software for carrying out the
Method according to one of claims 1-8.
PCT/CH2012/000124 2011-06-06 2012-06-05 Method for motion-dependent navigation in continuous data streams along visual structures WO2012167393A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CH00952/11A CH705069A1 (en) 2011-06-06 2011-06-06 A method of motion-dependent link in continuous data streams along visual structures.
CH952/11 2011-06-06

Publications (1)

Publication Number Publication Date
WO2012167393A1 true WO2012167393A1 (en) 2012-12-13

Family

ID=46551334

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CH2012/000124 WO2012167393A1 (en) 2011-06-06 2012-06-05 Method for motion-dependent navigation in continuous data streams along visual structures

Country Status (2)

Country Link
CH (1) CH705069A1 (en)
WO (1) WO2012167393A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2765573A1 (en) * 2013-02-08 2014-08-13 Native Instruments GmbH Controlling a multimedia storage playback by a finger position, speed & direction on a touchscreen displaying zoomed dual timelines for scratch effect.

Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6115482A (en) 1996-02-13 2000-09-05 Ascent Technology, Inc. Voice-output reading system with gesture-based navigation
US6275222B1 (en) * 1996-09-06 2001-08-14 International Business Machines Corporation System and method for synchronizing a graphic image and a media event
WO2003036457A2 (en) 2001-10-22 2003-05-01 Apple Computer, Inc. Method and apparatus for accelerated scrolling
FR2840092A1 (en) 2002-05-22 2003-11-28 Florent Henri Jean Staes Reading instruction system has touch screen and plays sound to match word touched by finger
US7317157B2 (en) 2002-01-21 2008-01-08 Cstools Gmbh Musical instrument having a ribbed surface
US20080048878A1 (en) 2006-08-24 2008-02-28 Marc Boillot Method and Device for a Touchless Interface
EP1942401A1 (en) * 2007-01-05 2008-07-09 Apple Inc. Multimedia communication device with touch screen responsive to gestures for controlling, manipulating and editing of media files
WO2010034063A1 (en) * 2008-09-25 2010-04-01 Igruuv Pty Ltd Video and audio content system
US20100309147A1 (en) 2009-06-07 2010-12-09 Christopher Brian Fleizach Devices, Methods, and Graphical User Interfaces for Accessibility Using a Touch-Sensitive Surface
US20100318204A1 (en) 2009-06-16 2010-12-16 Kyran Daisy Virtual phonograph
US20110058056A1 (en) * 2009-09-09 2011-03-10 Apple Inc. Audio alteration techniques

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8984431B2 (en) * 2009-03-16 2015-03-17 Apple Inc. Device, method, and graphical user interface for moving a current position in content at a variable scrubbing rate
GB2473066A (en) * 2009-09-01 2011-03-02 Release Consulting Ltd Electronic apparatus for displaying and controlling a scrolling musical notation sequence

Patent Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6115482A (en) 1996-02-13 2000-09-05 Ascent Technology, Inc. Voice-output reading system with gesture-based navigation
US6275222B1 (en) * 1996-09-06 2001-08-14 International Business Machines Corporation System and method for synchronizing a graphic image and a media event
WO2003036457A2 (en) 2001-10-22 2003-05-01 Apple Computer, Inc. Method and apparatus for accelerated scrolling
US7317157B2 (en) 2002-01-21 2008-01-08 Cstools Gmbh Musical instrument having a ribbed surface
FR2840092A1 (en) 2002-05-22 2003-11-28 Florent Henri Jean Staes Reading instruction system has touch screen and plays sound to match word touched by finger
US20080048878A1 (en) 2006-08-24 2008-02-28 Marc Boillot Method and Device for a Touchless Interface
EP1942401A1 (en) * 2007-01-05 2008-07-09 Apple Inc. Multimedia communication device with touch screen responsive to gestures for controlling, manipulating and editing of media files
WO2010034063A1 (en) * 2008-09-25 2010-04-01 Igruuv Pty Ltd Video and audio content system
US20100309147A1 (en) 2009-06-07 2010-12-09 Christopher Brian Fleizach Devices, Methods, and Graphical User Interfaces for Accessibility Using a Touch-Sensitive Surface
US20100318204A1 (en) 2009-06-16 2010-12-16 Kyran Daisy Virtual phonograph
US20110058056A1 (en) * 2009-09-09 2011-03-10 Apple Inc. Audio alteration techniques

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2765573A1 (en) * 2013-02-08 2014-08-13 Native Instruments GmbH Controlling a multimedia storage playback by a finger position, speed & direction on a touchscreen displaying zoomed dual timelines for scratch effect.
US10496199B2 (en) 2013-02-08 2019-12-03 Native Instruments Gmbh Device and method for controlling playback of digital multimedia data as well as a corresponding computer-readable storage medium and a corresponding computer program

Also Published As

Publication number Publication date
CH705069A1 (en) 2012-12-14

Similar Documents

Publication Publication Date Title
US9579586B2 (en) Remote controlled vehicle with a handheld display device
KR101976071B1 (en) Information processing apparatus, computer readable recording medium, and control method
US10031921B2 (en) Methods and systems for storage of media item metadata
US9792027B2 (en) Managing playback of synchronized content
US9142201B2 (en) Distribution of audio sheet music within an electronic book
US9612627B2 (en) Head-mounted display apparatus for navigating a virtual environment
US9360997B2 (en) Content presentation and interaction across multiple displays
US9529516B2 (en) Scrolling virtual music keyboard
US9207844B2 (en) Methods and devices for touch-based media creation
JP5552947B2 (en) Information processing apparatus, display control method, and display control program
RU2604435C2 (en) Method and apparatus for controlling touch screen using timeline bar, recording medium with program for same recorded therein, and user terminal having same
US10120565B2 (en) Methods and devices for presenting interactive media items
KR101702823B1 (en) Device, method, and graphical user interface for moving a current position in content at a variable scrubbing rate
JP5735128B2 (en) Augmented reality system
US9430128B2 (en) Method and apparatus for controls based on concurrent gestures
US9972297B2 (en) Sound processing device, sound data selecting method and sound data selecting program
US7774706B2 (en) System and method for mixing media content
EP2530677B1 (en) Method and apparatus for controlling a display of multimedia content using a timeline-based interface
US8977963B1 (en) In place expansion of aggregated views
KR101191550B1 (en) Media player with imaged based browsing
US9183887B2 (en) Interactive multimedia apparatus
US9524753B2 (en) Teleprompter tool for voice-over tool
US5799280A (en) Recording method and apparatus and audio data user interface
Snibbe et al. Haptic techniques for media control
JP5666122B2 (en) Display information control apparatus and method

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 12738014

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase in:

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 12738014

Country of ref document: EP

Kind code of ref document: A1