WO2016072699A1

WO2016072699A1 - Internet of things (iot)-based smart audio device

Info

Publication number: WO2016072699A1
Application number: PCT/KR2015/011700
Authority: WO
Inventors: 윤지영
Original assignee: 윤지영
Priority date: 2014-11-03
Filing date: 2015-11-03
Publication date: 2016-05-12
Also published as: KR101625900B1; KR20160051350A

Abstract

A smart audio device according to the present invention comprises: a communication unit communicating with an external device through wired or wireless means; an input unit for receiving audio from a user or the surroundings; a control unit for playing back a sound source received from the external device through the communication unit; a storage unit for storing data received from the external device according to commands from the control unit; and an audio output unit for outputting the played back sound source according to commands from the control unit. The smart audio device, in connection with the external device, provides an IoT-based consolidated entertainment environment.

Description

IoT-based smart sound device

The present invention relates to a sound device, and more particularly, to a sound device operated in conjunction with an external object.

In everyday life, the use of audio equipment, speakers, etc. are very frequent, and the use of singing cycles is also made a lot.

General karaoke cycle is installed in the indoor space, such as the house or karaoke, and when you select the desired song to output the lyrics and accompaniment sound according to it helps the user to sing and have fun.

On the other hand, the use of portable devices or mobile devices has also exploded in recent years, and the utilization rate of smart phones and wireless speakers is increasing.

In recent years, the concept of the Internet of Things (IoT) has emerged, some experimental products are being introduced, and IoT-related products are expected to be introduced in more proportions in daily life along with the spread of mobile devices.

However, to date, the Internet of Things has only been shown in a few areas, such as medical and health, compared to what is being talked about, and no attempt has been made on products that have a direct and high impact on our daily lives.

An object of the present invention is to provide an intelligent sound device that combines the concept of the karaoke cycle and the Internet of Things that is located in a large area of our daily life.

Specifically, the purpose is to provide a mobile karaoke cycle that can be operated anywhere by interlocking with a mobile phone, a microphone, a TV and the like.

Furthermore, another object of the present invention is to provide a portable song cycle that analyzes user preferences and preferences and recommends optimal songs in association with a smart phone and / or an external center based on the user's selection history data.

The smart sound apparatus according to the present invention includes a communication unit for communicating with an external device in a wired or wireless manner, an input unit for receiving a user or surrounding sound, a control unit for reproducing a sound source received from the external device through the communication unit, and And a storage unit for storing data received from the external device according to the instructions of the controller, and a sound output unit for outputting the reproduced sound source according to the instructions of the controller.

According to the present invention, it is possible to provide a song sound that can be enjoyed by the user anytime and anywhere by converting a song cycle cycle familiar to everyday life into a mobile type and interworking with an external device based on the IoT.

This enables the creation of an IoT-based integrated entertainment environment that interoperates with peripheral devices. The IoT can become more commonplace and provide a more basic platform for various entertainment solutions.

1 is a conceptual view of the operation of the smart sound device according to the present invention

2 is a structural diagram of a smart sound device according to the present invention.

3 is a conceptual view of operation of the smart sound device according to the present invention.

BRIEF DESCRIPTION OF THE DRAWINGS The above and other objects, advantages and features of the present invention, and methods of achieving them will be apparent with reference to the embodiments described below in detail with the accompanying drawings.

However, the present invention is not limited to the embodiments disclosed below, but may be implemented in various forms, and only the following embodiments are provided to those skilled in the art to which the present invention pertains. It is merely provided to easily inform the configuration and effects, the scope of the present invention is defined by the description of the claims.

Meanwhile, the terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. In this specification, the singular also includes the plural unless specifically stated otherwise in the phrase. As used herein, “comprises” and / or “comprising” refers to the presence of one or more other components, steps, operations and / or devices in which the mentioned components, steps, operations and / or devices are described. Or does not exclude addition.

The smart sound apparatus of the present invention basically has a speaker function, an image output function, and a semi-period function (for example, a midi file playback function), and has a processing function such as user preference analysis and an interworking function with a peripheral external device.

1 is a diagram illustrating a basic operation concept of a smart sound device according to the present invention.

The smart sound device 100 downloads various sound sources from the external server 300 through the intelligent portable terminal 200 such as a smart phone, and then reproduces the downloaded sound sources and outputs them to the speaker.

It is connected to the microphone 400 by wire or wirelessly and receives a song that the user sings and amplifies it and outputs it to the speaker.

In addition, an image output device such as a beam projector is provided and outputs an image stored therein or an image received from the intelligent portable terminal 200.

In another embodiment, the output of the image may be transmitted to an external device (eg, a TV or a display device of a fixed song half-cycle) for output.

On the other hand, the smart sound apparatus 100 may record the user's song and store it internally or upload it to the external server 300, and also stores the user's selection history data and uploads it to the external server 300.

The intelligent portable terminal 200 installs a dedicated app to download a sound source from the external server 300 and provides it to the smart sound device 100.

The lyrics data is also received from the external server 300 and the smart sound device 100 expresses the lyrics data on its own display window as the smart sound device 100 plays the sound source, or transmits the sound data together with the sound source data to the smart sound device 100 and the smart sound device. Let the 100 output the sound source and lyrics at the same time.

In addition, the intelligent mobile terminal 200 may control the smart sound device 100 through a dedicated app. For example, the intelligent mobile terminal 200 may be configured to tune a tone, a sound field, or control the volume of the smart sound device 100.

Furthermore, in accordance with the sound source that is transmitted to the smart sound device 100 to be reproduced, the picture or video stored in the self 200 is displayed on its own display window, or the stored image data is transmitted to the smart sound device 100 so that the sound device is Video data is reproduced and output.

In addition, the intelligent mobile terminal 200 manages the user's selection history data through a dedicated app and transmits it to the remote server or analyzes the user's preferences and transmits it to the smart sound apparatus 100 or the external server 300. It can be used for future selection of songs.

The external server 300 stores various sound sources and downloads them according to the request of the intelligent portable terminal 200.

In addition, the user's music selection history data is received from the smart sound apparatus 100 or the intelligent portable terminal 200, and the user's music preference is calculated based on the user's music preferences.

The calculation of music preferences can be configured to classify songs that the user sings or listens to by place and time zone, and to grasp the characteristics of the favorite genre, favorite composer, and favorite singer by time zone by place based on this classification.

For example, when a user sings in an entertainment area in the evening and music that he enjoys listening to or listening to in a residential area (or user's house) late at night, the genre, composer, and singer of these music are identified. Identify the type of music.

Meanwhile, the music preference calculation of the user may be performed by the smart sound apparatus 100 or the intelligent portable terminal 200 as well as the external server 300.

As such, a key feature of the smart sound device 100 according to the present invention is that the work that can be performed by itself, the work that can be performed or overflowed with their computing power is linked to the peripheral or remote external device This is an IoT-based device that requests processing from external devices and receives the results.

When the external server 300 determines the user music preference, the external server 300 generates a recommended music list for each time zone according to the request of the smart sound apparatus 100 or the intelligent portable terminal 200, and then generates the recommended music list by the smart sound apparatus 100 or the intelligent portable. Transmit to the terminal 200.

In the generation of the recommended music list, when there is a recommendation music request in a situation other than the classified or identified place or time zone, the external server 300 extracts and provides the most suitable recommendation music through various inference methods.

For example, it was found that a user prefers exciting music in the evening and calm music at night, and when requesting recommended music in the middle of the day, it is difficult to extract time-specific characteristics, and based on other characteristics (place, favorite composer, etc.) Select the recommended music.

Or, by collecting the music history data of the various users to grasp the common music taste common to the various users, and after grasping the music taste for each user group, recommendation for the case where there is no preference information of a specific user based on this taste information You can create a music list.

The identification and identification of the user is performed through a unique number of each device, such as a telephone number or H / W device number of the intelligent portable terminal 200, a serial number of the smart sound device 100, and the like.

The location and time of playing the song selected by the user may be identified and included in the user selection history data by using a positioning function and a timer built in the intelligent mobile terminal 200.

The data transmission method between the smart sound device 100, the intelligent portable terminal 200, and the external server 300 basically takes a wireless communication method.

For example, the smart sound device 100 and the intelligent portable terminal 200 use a short range wireless communication method such as Bluetooth, infrared, RF, WiFi, WiFi-Direct, and the intelligent portable terminal 200 and the external server 300 are mobile. It is preferable to use a communication network, but the present invention is not limited thereto. Of course, various communication methods can be used, and it is natural that they can be connected to each other by wire.

When the smart sound device 100 of the present invention transmits and receives data with the external server 300, it basically indirectly transmits and receives through the intelligent mobile terminal 200.

That is, after the user operates the intelligent mobile terminal 200 to access the external server 300, the sound source data is downloaded from the user, transferred to the smart sound device 100 again, and the intelligent mobile terminal 200 is uploaded. It takes a manner of transmitting the data from the smart sound device 100 to the external server 300 by operating.

However, according to the main feature of the present invention, the smart sound device 100 of the present invention transmits and receives data with a remote external device such as an external server 300 by itself controlling the intelligent portable terminal 200 without a user's operation. can do.

For example, the smart sound device 100 may execute a dedicated app installed in the intelligent portable terminal 200 to control the dedicated app to directly communicate with a remote external device such as an external server 300. In this case, the intelligent portable terminal 200 serves as a communication terminal of the smart sound device 100.

In addition, the smart sound device 100 directly communicates with an external device within a communication distance of the communication device provided by the smart sound device 100 directly through a wired / wireless communication method such as WiFi-Direct and Bluetooth.

In this way, the smart sound device 100 according to the present invention may function as an IoT-based integrated entertainment device.

When the smart sound apparatus 100 includes a user interface unit (not shown) such as an input button or a touch screen, an integrated entertainment environment according to the intention of the user may be more flexibly constructed.

Hereinafter, the structure of the smart sound device 100 according to the present invention will be described in more detail with reference to FIG. 2.

The smart sound device 100 includes a communication unit 110, an input unit 120, a control unit 130, a storage unit 140, a sound output unit 150, and an image output unit 160, and a user such as a touch screen. It may further include an interface unit (not shown).

The communication unit 110 is a short-range wireless communication module, such as Bluetooth, infrared, RF, WiFi, WiFi-Direct, and communicates with a mobile terminal, TV, karaoke half-cycle. The communication unit 110 may be a mobile communication module or a wired communication unit as well as a short range wireless communication module.

The input unit 120 includes a microphone terminal that includes a microphone or can be connected to the microphone. When the microphone is included, the input unit 120 can directly receive a user's voice. When the microphone terminal includes an microphone terminal, the microphone terminal is wired or wireless. Is connected to and receives the user's voice from the microphone.

The controller 130 plays a sound source file input through the communication unit and includes a sound source reproduction chip (eg, a midi chip) for this purpose. In addition, the user's voice input from the microphone is added to the sound source file and stored in the storage unit 140.

In addition, the user selection music history data generation, user music preference calculation, communication with the external device or interworking control, and outputs the sound by controlling the audio output unit 150 and the image control unit 160 to output the corresponding image To control.

The storage unit 140 stores sound source data, recording data, user selection history data, and user music preference data according to the instructions of the controller 130. In addition, an image received from an external device such as the intelligent mobile terminal 200 may be stored.

The sound output unit 150 and the image control unit 160 output the reproduced sound and the microphone input sound according to the instructions of the control unit 130, and output an image.

The image controller 160 may be a beam projector or a display panel. In addition, it is preferable to be configured to perform the role of lighting by outputting light having various colors and flickering period as well as image display.

As described above, the smart sound device 100 of the present invention directly communicates freely with an external device located within the communication distance of the communication unit 110 that is provided by WiFi-Direct, Bluetooth, etc. It can also communicate directly with a remote device located outside the street through a nearby external device.

For example, the smart sound device 100 may execute a dedicated app installed in the intelligent portable terminal 200 and control the dedicated app to directly communicate with a remote external device such as an external server 300. In this case, the intelligent portable terminal 200 serves as a communication terminal of the smart sound device 100.

3 is a diagram illustrating that the smart sound device 100 according to the present invention operates in conjunction with a peripheral external device.

The smart sound device 100 transmits image data to display the image stored in the display panel of the TV or transmitted from another external device (eg, an intelligent mobile terminal or an external server) in cooperation with the TV 500.

In this case, the image is displayed in accordance with the music to be reproduced, and the lyrics data is transmitted and the lyrics are expressed in accordance with the music to be reproduced.

It is preferable that the smart sound apparatus 100 performs the synchronization of the reproduced music and the image or the lyrics.

The controller of the smart sound apparatus 100 may classify the image data, select an image that best matches the music to be reproduced, and display the image.

When the image data includes metadata, the genre, time signature of the music reproduced by reading the contents of the metadata (genre, star, director, etc. in the case of film; classification of shooting location, landscape, person, etc. in the case of photograph), It is preferable to compare the information with the singer, the composer, and the like, and to control the expression of the optimal image in consideration of the user preference.

For example, when an exciting dance music is played, a comedy or an action movie is displayed, and when a calm ballad music is played, a landscape or a portrait may be sequentially displayed.

When converting a picture into a slide show method, it is desirable to adjust a fade out time or a change interval of a picture according to the beat of music.

As another embodiment, even in the singing practice station may be implemented to have a communication function to the fixed karaoke period 600 and M2M (Machine to Machine).

Providing function, when you sing in the song practice, the smart sound device (100) in accordance with the song selected in the half cycle lights up to match the mood of the song, the picture stored in yourself (the picture is received from the smartphone Storage) or by transmitting a video to the singing group cycle 600 by WiFi direct to use as a wallpaper and to store the music, it can function as a smart auxiliary device linked with the singing group cycle.

To this end, the fixed karaoke cycle 600 delivers the music being played to the smart sound device 100 in a streaming manner, or the smart sound device 100 collects the music being played through the input unit 120 or the microphone 400. It outputs the light or transmits the image data corresponding to the music during playback to the singing group cycle 600 to be used as the background screen.

In addition, the smart sound apparatus 100 according to the present invention has a function of automatically uploading recorded music or stored images to various SNS sites such as a music site or Facebook.

For example, when music is recorded, the user accesses the SNS site based on the previously set SNS login information and / or procedure, and uploads music and / or image data of the user.

As described above, when the SNS site server is in the communication range of its communication unit, it is uploaded directly, and when it is out of the communication range, it is controlled by an external device having a remote communication function and uploaded as a relay device.

Although the configuration of the present invention has been described in detail above, it is only an example and it is obvious that the technical spirit and protection scope of the present invention will be determined by the following claims.

Claims

Communication unit for communicating with an external device in a wired or wireless manner,

An input unit for receiving a user or surrounding sound;

A control unit for reproducing a sound source received from the external device through the communication unit;

A storage unit which stores data received from the external device according to the instruction of the controller;

Smart sound device including a sound output unit for outputting the reproduced sound source in accordance with the instructions of the controller.
The method of claim 1, wherein the communication unit

Smart audio device that is a short-range wireless communication module including at least one of Bluetooth, infrared, RF, WiFi and WiFi-Direct.
The method of claim 1,

Further comprising an image output unit for outputting an image or light,

The controller controls the image output unit to select and output an image or light in accordance with the reproduced sound source.
The method of claim 1, wherein the control unit,

Smart communication device for performing a direct communication with the external device within the communication distance of the communication unit, and a communication with the remote external device located outside the communication distance through the external device within the communication distance.
The method of claim 1, wherein the control unit,

And extracting image data corresponding to a sound source being reproduced from the storage unit and transmitting the image data to a peripheral external device.
The method of claim 1, wherein the control unit,

And determining the sound source being played by the external device, extracting image data corresponding to the sound source, and transmitting the extracted image data to the external device.
The method of claim 1, wherein the control unit,

Smart sound device that classifies songs that the user sings or listens to by place and time, and calculates music preferences by grasping the characteristics of the favorite genre, favorite composer, and favorite singer by time and location based on the classification.
The method of claim 1, wherein the input unit

Smart sound device that includes a microphone that includes a microphone or a wired or wireless connection to an external microphone.