WO2023107063A1 - System that plays music according to the emotion in the sentence read with the eye tracking system - Google Patents
System that plays music according to the emotion in the sentence read with the eye tracking system Download PDFInfo
- Publication number
- WO2023107063A1 WO2023107063A1 PCT/TR2022/051411 TR2022051411W WO2023107063A1 WO 2023107063 A1 WO2023107063 A1 WO 2023107063A1 TR 2022051411 W TR2022051411 W TR 2022051411W WO 2023107063 A1 WO2023107063 A1 WO 2023107063A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- music
- eye tracking
- book
- emotion
- tracking system
- Prior art date
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/013—Eye tracking input arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/16—Sound input; Sound output
- G06F3/167—Audio in a user interface, e.g. using voice commands for navigating, audio feedback
Definitions
- This invention relates to the eye tracking system that enables the user to listen to the music related to the emotions in the part of the book being read, and the system that plays music according to the emotion in the sentence read.
- audio books As another study on audiobooks, Philips (2007) mentioned in his research that with the advent of portable cassette players, the first steps of audiobooks have been taken and people's interest in this type of book is increasing day by day. In addition, there is a subgenre of audio books called audio books, and he emphasized that these books are specially made for visually impaired people.
- This invention is a system that plays music according to the emotion in the sentence read with the eye tracking system, and its feature is that it is a new technology.
- the invention in order to realize all the objectives mentioned above and which will emerge from the detailed description below; With the help of eye tracking devices that are placed on the top of the physical book or the mobile or desktop platform where the book is read, or that can be worn like glasses, the reader listens to the predetermined music related to the feeling of the section being read. In addition, the user can choose the music for certain feelings before starting the book. In this way, it is thought that the pleasure of the user from reading books will be increased and the rate of reading books, which is very low today, can be increased.
- Eye tracking systems can be examined in two categories as software and hardware.
- eye tracking devices follow the physical movements of the eye with infrared rays (Akgiil and Giine ⁇ , 2019).
- the necessary calibrations are made and the place where the eye is looking is calculated.
- the developed system is planned to be implemented as two different versions.
- the device can be worn as glasses and eye tracking can be performed and the desired music can be played without the need for a different system thanks to the speakers or headphones on the device.
- the device is attached to the book and eye tracking is performed through this device.
- music related to speakers and headphones can be played on the device that can be attached to the book.
- the user can buy whichever product he or she finds more suitable.
- readers with hearing difficulties can also use the developed system efficiently.
- the aim of the invention is to make the reader listen to the previously determined music related to the feeling of the part being read with the help of eye tracking devices placed on the upper part of the physical book or the platform where the book is read or worn in the form of glasses.
- the user can choose the music for certain feelings before starting the book. In this way, it is aimed to increase the pleasure of the reader from reading books.
- since it is a system in which books and music will be combined it is thought that people who do not normally have the habit of reading books may also be interested in the system that is the subject of the invention and the rate of reading books can be increased. It is thought that the music used in the movies will directly give the audience the feeling of the movie, and the music to be used for the book will help to give the emotions of the book to the reader, and since it is much more interesting, its commercial value will be high.
- Figure 1 The subject of the invention is the schematic view of the operation of the system.
- the system developed in the subject of the invention can be automatically optimized for different books.
- the subject of the invention is the device that can perform eye tracking by wearing glasses and the desired music plays music without the need for a different system thanks to the speakers or headphones on the device.
- the device subject to the invention can be attached to the book and eye tracking can be done through this device.
- the invention can be put on the book and the music related to the speaker and headphones is played on the device.
- the invention is a system that enables the user to listen to the music related to the emotions in the part of the book being read.
- the basic steps in the invention are as follows:
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- General Health & Medical Sciences (AREA)
- Headphones And Earphones (AREA)
- User Interface Of Digital Computer (AREA)
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TR2021/019123A TR2021019123A2 (tr) | 2021-12-06 | 2021-12-06 | Göz taki̇p si̇stemi̇ i̇le okunan cümledeki̇ duyguya göre müzi̇k çalan si̇stem |
TR2021/019123 | 2021-12-06 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2023107063A1 true WO2023107063A1 (en) | 2023-06-15 |
Family
ID=85114350
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/TR2022/051411 WO2023107063A1 (en) | 2021-12-06 | 2022-12-05 | System that plays music according to the emotion in the sentence read with the eye tracking system |
Country Status (2)
Country | Link |
---|---|
TR (1) | TR2021019123A2 (tr) |
WO (1) | WO2023107063A1 (tr) |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2006100645A2 (en) * | 2005-03-24 | 2006-09-28 | Koninklijke Philips Electronics, N.V. | Immersive reading experience using eye tracking |
US20150082136A1 (en) * | 2013-09-18 | 2015-03-19 | Booktrack Holdings Limited | Playback system for synchronised soundtracks for electronic media content |
EP3040812A1 (en) * | 2014-12-29 | 2016-07-06 | Immersion Corporation | Systems and methods for generating haptic effects based on eye tracking |
-
2021
- 2021-12-06 TR TR2021/019123A patent/TR2021019123A2/tr unknown
-
2022
- 2022-12-05 WO PCT/TR2022/051411 patent/WO2023107063A1/en unknown
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2006100645A2 (en) * | 2005-03-24 | 2006-09-28 | Koninklijke Philips Electronics, N.V. | Immersive reading experience using eye tracking |
US20150082136A1 (en) * | 2013-09-18 | 2015-03-19 | Booktrack Holdings Limited | Playback system for synchronised soundtracks for electronic media content |
EP3040812A1 (en) * | 2014-12-29 | 2016-07-06 | Immersion Corporation | Systems and methods for generating haptic effects based on eye tracking |
Also Published As
Publication number | Publication date |
---|---|
TR2021019123A2 (tr) | 2021-12-21 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
Szarkowska | Text-to-speech audio description: towards wider availability of AD | |
Fryer | An introduction to audio description: A practical guide | |
Jones et al. | ONTRACK: Dynamically adapting music playback to support navigation | |
Hendrikse et al. | Movement and gaze behavior in virtual audiovisual listening environments resembling everyday life | |
Taylor | Music in the world: Selected essays | |
Lopez et al. | Seeing films through sound: Sound design, spatial audio, and accessibility for visually impaired audiences | |
Stahl | The roaring navigator: a group guide for the zoo with shared auditory landmark display | |
CN110992970A (zh) | 音频合成方法及相关装置 | |
CN110915240B (zh) | 向用户提供交互式音乐创作的方法 | |
Sodnik et al. | Spatial auditory human-computer interfaces | |
Yang et al. | Audio augmented reality: A systematic review of technologies, applications, and future research directions | |
Dibben | The intimate singing voice: Auditory spatial perception and emotion in pop recordings | |
Warren et al. | Navigation via continuously adapted music | |
Indans et al. | Towards an audio-locative mobile application for immersive storytelling | |
Gunn | On recording performance or speech, the cry, and the anxiety of the fix | |
Lilliestam | Research on music listening: From typologies to interviews with real people | |
Önen | The Voice as a Narrative Element in Documentary Films | |
Huwiler | Radio drama adaptations: An approach towards an analytical methodology | |
Wang | Radio Culture in Cold War Hong Kong | |
Ishida | Sounds and Sighs:“Voice Porn” for Women | |
WO2023107063A1 (en) | System that plays music according to the emotion in the sentence read with the eye tracking system | |
Hennig | Natural user interfaces and accessibility | |
Barton et al. | Immersive negotiations: Binaural perspectives on site-specific sound | |
Lopez et al. | The Design of an Audio Film: Portraying Story, Action and Interaction through Sound. | |
Frith et al. | Make a sound garden grow: Exploring the new media potential of social soundscaping |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 22904826 Country of ref document: EP Kind code of ref document: A1 |