WO2023107063A1 - System that plays music according to the emotion in the sentence read with the eye tracking system - Google Patents

System that plays music according to the emotion in the sentence read with the eye tracking system Download PDF

Info

Publication number
WO2023107063A1
WO2023107063A1 PCT/TR2022/051411 TR2022051411W WO2023107063A1 WO 2023107063 A1 WO2023107063 A1 WO 2023107063A1 TR 2022051411 W TR2022051411 W TR 2022051411W WO 2023107063 A1 WO2023107063 A1 WO 2023107063A1
Authority
WO
WIPO (PCT)
Prior art keywords
music
eye tracking
book
emotion
tracking system
Prior art date
Application number
PCT/TR2022/051411
Other languages
English (en)
French (fr)
Inventor
Eyüp Burak Ceyhan
Mertkan SİNOPLU
Original Assignee
Bartin Üni̇versi̇tesi̇
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Bartin Üni̇versi̇tesi̇ filed Critical Bartin Üni̇versi̇tesi̇
Publication of WO2023107063A1 publication Critical patent/WO2023107063A1/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013Eye tracking input arrangements
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16Sound input; Sound output
    • G06F3/167Audio in a user interface, e.g. using voice commands for navigating, audio feedback

Definitions

  • This invention relates to the eye tracking system that enables the user to listen to the music related to the emotions in the part of the book being read, and the system that plays music according to the emotion in the sentence read.
  • audio books As another study on audiobooks, Philips (2007) mentioned in his research that with the advent of portable cassette players, the first steps of audiobooks have been taken and people's interest in this type of book is increasing day by day. In addition, there is a subgenre of audio books called audio books, and he emphasized that these books are specially made for visually impaired people.
  • This invention is a system that plays music according to the emotion in the sentence read with the eye tracking system, and its feature is that it is a new technology.
  • the invention in order to realize all the objectives mentioned above and which will emerge from the detailed description below; With the help of eye tracking devices that are placed on the top of the physical book or the mobile or desktop platform where the book is read, or that can be worn like glasses, the reader listens to the predetermined music related to the feeling of the section being read. In addition, the user can choose the music for certain feelings before starting the book. In this way, it is thought that the pleasure of the user from reading books will be increased and the rate of reading books, which is very low today, can be increased.
  • Eye tracking systems can be examined in two categories as software and hardware.
  • eye tracking devices follow the physical movements of the eye with infrared rays (Akgiil and Giine ⁇ , 2019).
  • the necessary calibrations are made and the place where the eye is looking is calculated.
  • the developed system is planned to be implemented as two different versions.
  • the device can be worn as glasses and eye tracking can be performed and the desired music can be played without the need for a different system thanks to the speakers or headphones on the device.
  • the device is attached to the book and eye tracking is performed through this device.
  • music related to speakers and headphones can be played on the device that can be attached to the book.
  • the user can buy whichever product he or she finds more suitable.
  • readers with hearing difficulties can also use the developed system efficiently.
  • the aim of the invention is to make the reader listen to the previously determined music related to the feeling of the part being read with the help of eye tracking devices placed on the upper part of the physical book or the platform where the book is read or worn in the form of glasses.
  • the user can choose the music for certain feelings before starting the book. In this way, it is aimed to increase the pleasure of the reader from reading books.
  • since it is a system in which books and music will be combined it is thought that people who do not normally have the habit of reading books may also be interested in the system that is the subject of the invention and the rate of reading books can be increased. It is thought that the music used in the movies will directly give the audience the feeling of the movie, and the music to be used for the book will help to give the emotions of the book to the reader, and since it is much more interesting, its commercial value will be high.
  • Figure 1 The subject of the invention is the schematic view of the operation of the system.
  • the system developed in the subject of the invention can be automatically optimized for different books.
  • the subject of the invention is the device that can perform eye tracking by wearing glasses and the desired music plays music without the need for a different system thanks to the speakers or headphones on the device.
  • the device subject to the invention can be attached to the book and eye tracking can be done through this device.
  • the invention can be put on the book and the music related to the speaker and headphones is played on the device.
  • the invention is a system that enables the user to listen to the music related to the emotions in the part of the book being read.
  • the basic steps in the invention are as follows:

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • General Health & Medical Sciences (AREA)
  • Headphones And Earphones (AREA)
  • User Interface Of Digital Computer (AREA)
PCT/TR2022/051411 2021-12-06 2022-12-05 System that plays music according to the emotion in the sentence read with the eye tracking system WO2023107063A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
TR2021/019123A TR2021019123A2 (tr) 2021-12-06 2021-12-06 Göz taki̇p si̇stemi̇ i̇le okunan cümledeki̇ duyguya göre müzi̇k çalan si̇stem
TR2021/019123 2021-12-06

Publications (1)

Publication Number Publication Date
WO2023107063A1 true WO2023107063A1 (en) 2023-06-15

Family

ID=85114350

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/TR2022/051411 WO2023107063A1 (en) 2021-12-06 2022-12-05 System that plays music according to the emotion in the sentence read with the eye tracking system

Country Status (2)

Country Link
TR (1) TR2021019123A2 (tr)
WO (1) WO2023107063A1 (tr)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2006100645A2 (en) * 2005-03-24 2006-09-28 Koninklijke Philips Electronics, N.V. Immersive reading experience using eye tracking
US20150082136A1 (en) * 2013-09-18 2015-03-19 Booktrack Holdings Limited Playback system for synchronised soundtracks for electronic media content
EP3040812A1 (en) * 2014-12-29 2016-07-06 Immersion Corporation Systems and methods for generating haptic effects based on eye tracking

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2006100645A2 (en) * 2005-03-24 2006-09-28 Koninklijke Philips Electronics, N.V. Immersive reading experience using eye tracking
US20150082136A1 (en) * 2013-09-18 2015-03-19 Booktrack Holdings Limited Playback system for synchronised soundtracks for electronic media content
EP3040812A1 (en) * 2014-12-29 2016-07-06 Immersion Corporation Systems and methods for generating haptic effects based on eye tracking

Also Published As

Publication number Publication date
TR2021019123A2 (tr) 2021-12-21

Similar Documents

Publication Publication Date Title
Szarkowska Text-to-speech audio description: towards wider availability of AD
Fryer An introduction to audio description: A practical guide
Jones et al. ONTRACK: Dynamically adapting music playback to support navigation
Hendrikse et al. Movement and gaze behavior in virtual audiovisual listening environments resembling everyday life
Taylor Music in the world: Selected essays
Lopez et al. Seeing films through sound: Sound design, spatial audio, and accessibility for visually impaired audiences
Stahl The roaring navigator: a group guide for the zoo with shared auditory landmark display
CN110992970A (zh) 音频合成方法及相关装置
CN110915240B (zh) 向用户提供交互式音乐创作的方法
Sodnik et al. Spatial auditory human-computer interfaces
Yang et al. Audio augmented reality: A systematic review of technologies, applications, and future research directions
Dibben The intimate singing voice: Auditory spatial perception and emotion in pop recordings
Warren et al. Navigation via continuously adapted music
Indans et al. Towards an audio-locative mobile application for immersive storytelling
Gunn On recording performance or speech, the cry, and the anxiety of the fix
Lilliestam Research on music listening: From typologies to interviews with real people
Önen The Voice as a Narrative Element in Documentary Films
Huwiler Radio drama adaptations: An approach towards an analytical methodology
Wang Radio Culture in Cold War Hong Kong
Ishida Sounds and Sighs:“Voice Porn” for Women
WO2023107063A1 (en) System that plays music according to the emotion in the sentence read with the eye tracking system
Hennig Natural user interfaces and accessibility
Barton et al. Immersive negotiations: Binaural perspectives on site-specific sound
Lopez et al. The Design of an Audio Film: Portraying Story, Action and Interaction through Sound.
Frith et al. Make a sound garden grow: Exploring the new media potential of social soundscaping

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22904826

Country of ref document: EP

Kind code of ref document: A1