TWM463955U - Personalized emotion detection and scenario feedback device - Google Patents

Personalized emotion detection and scenario feedback device Download PDF

Info

Publication number
TWM463955U
TWM463955U TW102203684U TW102203684U TWM463955U TW M463955 U TWM463955 U TW M463955U TW 102203684 U TW102203684 U TW 102203684U TW 102203684 U TW102203684 U TW 102203684U TW M463955 U TWM463955 U TW M463955U
Authority
TW
Taiwan
Prior art keywords
sound
unit
tone
database
image
Prior art date
Application number
TW102203684U
Other languages
Chinese (zh)
Inventor
Pei-Ru Lin
Xuan-Ru Chen
Original Assignee
Univ Southern Taiwan Sci & Tec
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Univ Southern Taiwan Sci & Tec filed Critical Univ Southern Taiwan Sci & Tec
Priority to TW102203684U priority Critical patent/TWM463955U/en
Publication of TWM463955U publication Critical patent/TWM463955U/en

Links

Landscapes

  • User Interface Of Digital Computer (AREA)

Description

個人化情緒偵測及情境回饋裝置 Personalized emotion detection and situation feedback device

本創作係有關於一種個人化情緒偵測及情境回饋裝置,尤其是指一種能經由辨識使用者情緒進而轉換影像或旋律情境,讓使用者之情緒能夠得到舒緩之裝置。 This creative department is about a personalized emotion detection and situation feedback device, especially a device that can change the image or melody context by recognizing the user's emotions, so that the user's emotions can be relieved.

隨著社會的進步與多元化,個人要扮演的角色也愈來愈多,而時間和精力也因此被分割得益發瑣碎。然而,社會價值與規範賦予每一種角色的要求並未減少,因此人們常承受極大的壓力。當遭受壓力時,身體會釋放激素,使得心跳加快、血壓升高、呼吸加速,並出現全身肌肉緊繃等症狀;因此,若長期處於壓力中,可能會造成失眠、疲勞、情緒失控等負面影響。 As society progresses and diversifies, individuals have to play more and more roles, and time and energy are divided into trivialities. However, social values and norms have not reduced the requirements for each role, so people are often under great pressure. When subjected to stress, the body releases hormones, which accelerates the heartbeat, raises blood pressure, accelerates breathing, and causes muscle tension in the body; therefore, if it is under stress for a long time, it may cause negative effects such as insomnia, fatigue, and emotional loss of control. .

以情緒失控而言,太過於亢奮或沮喪都有可能導致破壞生活品質及損害身體健康之情形,甚至可能在當下做出錯誤或難以彌補、莫名的錯誤決定或錯誤行為;因此,若能透過分析說話之聲調,以辨識情緒狀態,並適時給予和緩之回饋影像或旋律,使情緒得以舒緩,避免因為情緒失控所導致之缺失。 In the case of emotional out of control, too much excitement or frustration can lead to the destruction of quality of life and damage to health, and may even make mistakes or irreparable mistakes, inexplicable wrong decisions or wrong behaviors; therefore, if through analysis The tone of the voice to identify the emotional state, and timely give back to the image or melody to ease the emotions, to avoid the loss caused by emotional out of control.

目前用於調劑情緒常見的方式除運動、旅遊之外,藉由互動式的聲光娛樂方式也在科技蓬勃發展的今日深受矚目。例如我國 公告第M430778號,其揭露一種互動式的麥克風,係當麥克風接收到聲音後,透過音頻辨識模組,辨識音頻並轉換為電子訊號,再將電子訊號轉換為指令,用於燈光閃爍、動作、釋出氣味等任意組合的表現方式來呈現。再如我國公開第200814718號,該案係揭露一種多媒體裝置之情境模擬系統及其處理方法,主要運用輪廓偵測裝置將一個影像分離為數個前景影像與數個背景影像,並分別儲存為前景影像和背景影像,再利用影像混合器將該前景影像與該背景影像合成為一個影像,再將影像傳輸到遠端多媒體裝置。 In addition to sports and tourism, the current methods for adjusting emotions are also attracting attention in today's booming technology through interactive sound and light entertainment. Such as China Announcement No. M430778, which discloses an interactive microphone that, after receiving a sound from a microphone, recognizes the audio and converts it into an electronic signal through an audio recognition module, and then converts the electronic signal into an instruction for flashing, motion, The expression of any combination such as odor is released to present. Another example is China Public Publication No. 200814718, which discloses a context simulation system for multimedia devices and a processing method thereof, which mainly uses an outline detection device to separate an image into a plurality of foreground images and a plurality of background images, and respectively store them as foreground images. And the background image, and then using the image mixer to combine the foreground image and the background image into one image, and then transmitting the image to the remote multimedia device.

今,本創作人鑒於智慧型手機、平板電腦、筆記型電腦、家用電腦…等電子產品的應用程式推陳出新,以及現代人對於軟體的功能也求新求變,不止著重於聲音上,在情境表達上也很重要之情形下,因而創作出本創作之裝置。 Today, the creators have made innovations in the application of electronic products such as smart phones, tablet computers, notebook computers, home computers, etc., as well as modern people’s functions for software, and they are not only focused on sound, but also in context. It is also important to create a device for this creation.

本創作之主要目的,係提供一種個人化情緒偵測及情境回饋裝置,主要是針對電子產品之使用者講述之內容進行收音,並進行聲波分析,於經辨識後選取出與之對應的聲音色調的預設影像或旋律,且予以顯示或撥放,達到該電子產品能貼近使用者個人化的情境呈現與情境轉換,讓使用者之情緒能夠得到舒緩者。 The main purpose of this creation is to provide a personalized emotional detection and situation feedback device, which mainly collects the content told by the user of the electronic product, and performs sound wave analysis to select the corresponding sound tone after recognition. The preset image or melody is displayed or played, so that the electronic product can be close to the user's personalized situational presentation and contextual conversion, so that the user's emotions can be relieved.

上述本創作之主要目的與功效,是由以下之具體技術手段所達成:一種個人化情緒偵測及情境回饋裝置,係於一電子產品內至 少包括一收音單元、一聲波分析單元、一情緒色調資料庫、一辨識聲音色調單元、一影像及/或聲音資料庫以及輸出單元;其中,該收音單元與該聲波分析單元電性連接,該聲波分析單元、該情緒色調資料庫、該影像及/或聲音資料庫、及該輸出單元與該辨識聲音色調單元電性連接,透過該收音單元進行收音,並由該聲波分析單元對所收集之使用者談話的聲音進行聲波分析,分析的結果能在情緒色調資料庫中得到與之對應的聲音色調,經辨識聲音色調單元辨識所屬聲音色調後,再從影像資料庫中選取對應該聲音色調之預設影像及/或旋律,而將選取的影像及/或旋律由撥放單元撥放。 The main purpose and effect of the above creations are achieved by the following specific technical means: a personalized emotional detection and context feedback device, which is in an electronic product to Included is a sound receiving unit, a sound wave analyzing unit, an emotional tone database, an identification sound tone unit, an image and/or sound database, and an output unit; wherein the sound unit is electrically connected to the sound wave analysis unit, The sound wave analysis unit, the emotional tone database, the image and/or sound database, and the output unit are electrically connected to the recognized sound tone unit, and the sound is collected by the sound pickup unit, and collected by the sound wave analysis unit. The sound of the user's conversation is analyzed by sound wave. The result of the analysis can obtain the corresponding sound tone in the emotional tone database. After the recognized sound tone unit recognizes the tone of the sound, the corresponding tone of the sound is selected from the image database. The image and/or melody is preset, and the selected image and/or melody is played by the playback unit.

如上所述之個人化情緒偵測及情境回饋裝置,其中,該裝置主要應用於手機、平板電腦、筆記型電腦或家用電腦…等電子產品。 The personalized emotion detection and situation feedback device as described above, wherein the device is mainly applied to electronic products such as mobile phones, tablet computers, notebook computers or home computers.

如上所述之個人化情緒偵測及情境回饋裝置,其中,該聲波分析單元分析之項目包括振幅、頻率及震盪。 The personalized emotion detection and situation feedback device as described above, wherein the items analyzed by the sound wave analysis unit include amplitude, frequency and oscillation.

(1)‧‧‧收音單元 (1) ‧‧‧ radio unit

(2)‧‧‧聲波分析單元 (2) ‧‧‧Sonic analysis unit

(3)‧‧‧情緒色調資料庫 (3) ‧ ‧ emotional tone database

(4)‧‧‧辨識聲音色調單元 (4) ‧‧‧ Identifying the sound tone unit

(5)‧‧‧影像及/或聲音資料庫 (5) ‧‧‧Image and/or sound database

(6)‧‧‧輸出單元 (6)‧‧‧Output unit

第一圖:本創作之個人化情緒偵測及情境回饋裝置的架構方塊圖 The first picture: the block diagram of the personalized emotional detection and situation feedback device of this creation

第二圖:本創作之個人化情緒偵測及情境回饋裝置的運作流程示意圖 Figure 2: Schematic diagram of the operation process of the personalized emotion detection and situation feedback device of this creation

為令本創作之技術手段、創作目的及達成功效有更完整及清楚的揭露,茲於下詳細說明之,並請一併參閱揭示之圖式及元件 符號。 In order to make the technical means, creative purpose and achievement of this creation more complete and clear, please elaborate below, and please refer to the disclosed drawings and components. symbol.

請參看第一圖所示,其係揭示本創作個人化情緒偵測及情境回饋裝置的方塊架構圖。 Please refer to the first figure, which reveals the block diagram of the creative personality detection and situation feedback device.

本創作之個人化情緒偵測及情境回饋裝置係設置於一電子產品內,該電子產品可為手機、平板電腦、筆記型電腦或家用電腦…等;該個人化情緒偵測及情境回饋裝置至少包括一收音單元(1)、一聲波分析單元(2)、一情緒色調資料庫(3)、一辨識聲音色調單元(4)、一影像及/或聲音資料庫(5)以及輸出單元(6);其中:該收音單元(1)與該聲波分析單元(2)電性連接,該聲波分析單元(2)、該情緒色調資料庫(3)、該影像及/或聲音資料庫(5)及該輸出單元(6)與該辨識聲音色調單元(4)電性連接;該收音單元(1)為設在電子產品上之吸音孔,以透過該收音單元(1)進行使用者談話聲音的收音動作;該聲波分析單元(2),係針對所收集之使用者談話的聲音進行聲波分析,該聲波分析單元(2)分析之項目包括振福、頻率及震盪,藉由聲波之振幅大小、頻率與震盪快慢,分析得知目前之情緒狀態,在本創作所揭露圖式的第一圖中,顯示情緒狀態為喜、怒、哀、樂四種;該情緒色調資料庫(3),於該資料庫中建入多類別之情緒預測模型,在本創作所揭露圖式的第一圖中,係建立分別代表喜、怒、哀、樂四種情緒狀態之色調,其中分別以橘色(或粉色) 系、暗沉色系、藍色系及鮮豔色系之色調代表喜、怒、哀、樂四種情緒狀態;該辨識聲音色調單元(4),透過分析結果而在情緒色調資料庫(3)中得到與之對應的聲音色調,再經該辨識聲音色調單元(4)辨識,以確認所屬聲音色調為何;該影像及/或聲音資料庫(5),係儲存對應聲音色調之預設影像及/或旋律,當該辨識聲音色調單元(4)辨識得知使用者談話的聲音屬於何種聲音色調後,便至該影像及/或聲音資料庫(5)中選取對應所辨識之聲音色調的預設影像及/或旋律;該輸出單元(6),係接收自該影像及/或聲音資料庫(5)中所選取之預設影像及/或旋律,並將選取的影像及/或旋律進行撥放;其中,該輸出單元(6)可為影像顯示元件或聲音撥放元件。 The personalized emotional detection and context feedback device of the present invention is disposed in an electronic product, which can be a mobile phone, a tablet computer, a notebook computer or a home computer, etc.; the personalized emotion detection and situation feedback device is at least The utility model comprises a sounding unit (1), an acoustic wave analysis unit (2), an emotional tone database (3), an identification sound tone unit (4), an image and/or sound database (5) and an output unit (6). The radio unit (1) is electrically connected to the sound wave analysis unit (2), the sound wave analysis unit (2), the emotion tone database (3), the image and/or sound database (5) And the output unit (6) is electrically connected to the identification sound tone unit (4); the sound collection unit (1) is a sound absorption hole provided on the electronic product, and the user talks sound through the sound pickup unit (1). The sound wave analysis unit (2) performs sound wave analysis on the collected voice of the user, and the sound wave analysis unit (2) analyzes the items including vibration, frequency and oscillation, by the amplitude of the sound wave, Frequency and oscillating speed, analysis and analysis of the current situation The state, in the first picture of the schema disclosed in this creation, shows the emotional state as four kinds of happiness, anger, sorrow, and music; the emotional tone database (3), which establishes multi-category emotion prediction in the database. The model, in the first picture of the schema disclosed in this creation, establishes the tones representing the four emotional states of joy, anger, sadness, and joy, respectively, in orange (or pink). The shades of the system, the dark color, the blue color, and the vivid color represent the four emotional states of joy, anger, sadness, and music; the identified sound tone unit (4), through the analysis results in the emotional tone database (3) The sound tones corresponding to the sound are obtained, and then recognized by the recognized sound tone unit (4) to confirm the hue of the associated sound; the image and/or sound database (5) stores the preset image corresponding to the tone of the sound and / or melody, when the recognized sound tone unit (4) recognizes the sound tone of the user's conversation, then selects the tone of the corresponding sound from the image and/or sound database (5). Preset image and/or melody; the output unit (6) receives preset images and/or melody selected from the image and/or sound database (5), and selects the selected image and/or melody The display unit (6) can be an image display component or a sound playback component.

使用時,係先建立一情緒色調資料庫(3),將各種情緒做色調分類,本創作於此係以「喜」、「怒」、「哀」、「樂」為實施例說明,令「喜」、「怒」、「哀」、「樂」四種情緒狀態對應的情緒色調為:喜→橘色或粉色系,怒→偏暗沉的色系,哀→藍色系,樂→較鮮豔的色系;接著以聲波分析單元(2)針對所收集的聲波進行振幅、頻率、震盪分析;再對照於情緒色調資料庫中所屬的聲音色調,找出能緩和使用者情境之色系,並從影像資料庫中篩選合適的影像及/或旋律,將之以該輸出單元(6)顯示及/或播放。 In use, an emotional tone database (3) is created to classify various emotions. The creations are described in the following examples: "Happiness", "Angry", "Amour" and "Le". The emotional moods of the four emotional states of hi, anger, sorrow, and music are: hi → orange or pink, anger → dark color, mourning → blue, music → Bright color; then, the sound wave analysis unit (2) performs amplitude, frequency, and oscillation analysis on the collected sound waves; and then compares the color tone of the sound in the emotional tone database to find the color system that can alleviate the user's situation. The appropriate image and/or melody is filtered from the image database and displayed and/or played by the output unit (6).

以上所舉者僅係本創作之部份實施例,並非用以限制本創作,致依本創作之創意精神及特徵,稍加變化修飾而成者,亦應包括在本專利範圍之內。 The above are only some of the examples of this creation, and are not intended to limit the creation of this creation. It should be included in the scope of this patent, based on the creative spirit and characteristics of this creation.

綜上所述,本創作實施例確能達到所預期之使用功效,又其所揭露之具體構造,不僅未曾見諸於同類產品中,亦未曾公開於申請前,誠已完全符合專利法之規定與要求,爰依法提出新型專利之申請,懇請惠予審查,並賜准專利,則實感德便。 In summary, the present embodiment can achieve the expected use efficiency, and the specific structure disclosed therein has not been seen in similar products, nor has it been disclosed before the application, and has fully complied with the provisions of the Patent Law. And the request, the application for a new type of patent in accordance with the law, please forgive the review, and grant the patent, it is really sensible.

(1)‧‧‧收音單元 (1) ‧‧‧ radio unit

(2)‧‧‧聲波分析單元 (2) ‧‧‧Sonic analysis unit

(3)‧‧‧情緒色調資料庫 (3) ‧ ‧ emotional tone database

(4)‧‧‧辨識聲音色調單元 (4) ‧‧‧ Identifying the sound tone unit

(5)‧‧‧影像及/或聲音資料庫 (5) ‧‧‧Image and/or sound database

(6)‧‧‧輸出單元 (6)‧‧‧Output unit

Claims (3)

一種個人化情緒偵測及情境回饋裝置,係於一電子產品內至少包括一收音單元、一聲波分析單元、一情緒色調資料庫、一辨識聲音色調單元、一影像及/或聲音資料庫以及輸出單元;其中,該收音單元與該聲波分析單元電性連接,該聲波分析單元、該情緒色調資料庫、該影像及/或聲音資料庫及該輸出單元與該變識聲音色調單元電性連接,透過該收音單元進行收音,並由該聲波分析單元對所收集之使用者談話的聲音進行聲波分析,分析的結果能在情緒色調資料庫中得到與之對應的聲音色調,經辨識聲音色調單元辨識所屬聲音色調後,再從影像資料庫中選取對應該聲音色調之預設影像及/或旋律,而將選取的影像及/或旋律由撥放單元撥放。 A personalized emotion detection and situation feedback device includes at least one radio unit, a sound wave analysis unit, an emotion tone database, an identification sound tone unit, an image and/or sound database, and an output in an electronic product. a unit, wherein the sound unit is electrically connected to the sound wave analysis unit, the sound wave analysis unit, the emotion tone database, the image and/or sound database, and the output unit are electrically connected to the variable sound tone unit. The sound is collected by the sounding unit, and the sound wave analysis unit performs sound wave analysis on the collected voice of the user, and the result of the analysis can obtain the corresponding sound color in the emotional tone database, and the identified sound tone unit is recognized. After the sound tone is selected, the preset image and/or melody corresponding to the sound tone is selected from the image database, and the selected image and/or melody is played by the playback unit. 如申請專利範圍第1項所述之個人化情緒偵測及情境回饋裝置,其中,該電子產品為手機、平板電腦、筆記型電腦或家用電腦其中之一。 The personalized emotional detection and situation feedback device described in claim 1, wherein the electronic product is one of a mobile phone, a tablet computer, a notebook computer or a home computer. 如申請專利範圍第1或2項所述之個人化情緒偵測及情境回饋裝置,其中,該聲波分析單元分析之項目包括振幅、頻率及震盪。 The personalized emotion detection and situation feedback device according to claim 1 or 2, wherein the item analyzed by the sound wave analysis unit includes amplitude, frequency and oscillation.
TW102203684U 2013-02-27 2013-02-27 Personalized emotion detection and scenario feedback device TWM463955U (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW102203684U TWM463955U (en) 2013-02-27 2013-02-27 Personalized emotion detection and scenario feedback device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW102203684U TWM463955U (en) 2013-02-27 2013-02-27 Personalized emotion detection and scenario feedback device

Publications (1)

Publication Number Publication Date
TWM463955U true TWM463955U (en) 2013-10-21

Family

ID=49773056

Family Applications (1)

Application Number Title Priority Date Filing Date
TW102203684U TWM463955U (en) 2013-02-27 2013-02-27 Personalized emotion detection and scenario feedback device

Country Status (1)

Country Link
TW (1) TWM463955U (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI681315B (en) * 2016-11-30 2020-01-01 英華達股份有限公司 Data transmission system and method thereof

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI681315B (en) * 2016-11-30 2020-01-01 英華達股份有限公司 Data transmission system and method thereof

Similar Documents

Publication Publication Date Title
CN110853618B (en) Language identification method, model training method, device and equipment
CN106874265B (en) Content output method matched with user emotion, electronic equipment and server
US11941323B2 (en) Meme creation method and apparatus
US8847884B2 (en) Electronic device and method for offering services according to user facial expressions
TW201909171A (en) Session information processing method and apparatus, and electronic device
WO2019128558A1 (en) Analysis method and system of user limb movement and mobile terminal
WO2020253128A1 (en) Voice recognition-based communication service method, apparatus, computer device, and storage medium
KR20100062207A (en) Method and apparatus for providing animation effect on video telephony call
CN105930035A (en) Interface background display method and apparatus
KR101108114B1 (en) System and method for analyzing continuous sound, expressing emotion and producing communication about pet dog
US20190013020A1 (en) Electronic device-awakening method and apparatus, device and computer-readable storage medium
CN109712644A (en) Method based on speech recognition emotional change control LED display effect, the apparatus and system for controlling LED display effect
US20190371319A1 (en) Method for human-machine interaction, electronic device, and computer-readable storage medium
CN108174236A (en) A kind of media file processing method, server and mobile terminal
CN108115695A (en) A kind of emotional color expression system and robot
CN112165627B (en) Information processing method, device, storage medium, terminal and system
CN111601215A (en) Scene-based key information reminding method, system and device
CN114630135A (en) Live broadcast interaction method and device
CN110111795B (en) Voice processing method and terminal equipment
CN113538628A (en) Expression package generation method and device, electronic equipment and computer readable storage medium
WO2017143951A1 (en) Expression feedback method and smart robot
CN212588503U (en) Embedded audio playing device
CN109686359A (en) Speech output method, terminal and computer readable storage medium
CN104754110A (en) Machine voice conversation based emotion release method mobile phone
TWM463955U (en) Personalized emotion detection and scenario feedback device

Legal Events

Date Code Title Description
MM4K Annulment or lapse of a utility model due to non-payment of fees