KR20160051350A - Smart Audio apparatus based on IoT - Google Patents

Abstract

According to the present invention, a smart sound device comprises: a communication unit configured to communicate with an external device through a wire or wirelessly; a microphone terminal configured to receive a sound from a microphone; a control unit configured to reproduce a sound source received from the external device through the communication unit; a storage unit configured to store data received from the external device in accordance with an instruction of the control unit; and a sound output unit configured to output the reproduced sound source in accordance with the instruction of the control unit. The smart sound device provides an integrated entertainment environment based on IoT in connection with the external device.

Description

[0001] The present invention relates to an Internet based smart sound apparatus,

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an acoustic device, and more particularly, to an acoustic device operated in conjunction with an external object.

In daily life, the use of audio equipment and speakers is very frequent, and the use of a karaoke machine is also common.

Typical song karaoke is installed in an indoor space such as a house or a karaoke, so that if you select the song you want, it outputs lyrics and accompaniment sound to help the user sing songs.

On the other hand, the use of portable devices or mobile devices has exploded recently, and the utilization rates of smart phones and wireless speakers are increasing.

In recent years, the concept of Internet of Things (IoT) has emerged and some experimental products are being introduced. In addition to the spread of mobile devices, it is expected that more and more Internet related products will be introduced in everyday life.

However, to date, the Internet of things has been shown to be only a few experimental products in only a few areas such as healthcare and health, and there is no attempt to directly and productively influence our daily lives.

It is an object of the present invention to provide an intelligent acoustic apparatus that combines a karaoke machine and a thing Internet concept that are located in a large area of our daily life.

More specifically, the present invention aims to provide a portable song player capable of operating anywhere, in cooperation with a mobile phone, a microphone, and a TV.

It is another object of the present invention to provide a portable song karaoke machine that analyzes user preferences and preferences in cooperation with a smartphone and / or an external center based on the user's song selection history data, and recommends optimal songs.

A smart acoustic apparatus according to the present invention includes a communication unit for communicating with an external device in a wired or wireless manner, a microphone terminal for receiving sound from a microphone, a control unit for reproducing the sound source received from the external device through the communication unit, A storage unit for storing data received from the external device according to an instruction from the control unit, and an audio output unit for outputting the reproduced sound source according to an instruction from the control unit.

According to the present invention, it is possible to convert a song half-time machine familiar to daily life into a mobile type, and to provide a song sound that can be enjoyed by a user at any time, anywhere,

Through this, it is possible to build an integrated entertainment environment based on IoT that is linked to peripheral devices, and the Internet of Things can be more widely used and provide a basic platform for a variety of entertainment solutions.

1 is a conceptual diagram illustrating the operation of a smart acoustic apparatus according to the present invention.
2 is a structural view of a smart acoustic apparatus according to the present invention.
3 is a conceptual view illustrating operation of a smart acoustic apparatus according to the present invention.

BRIEF DESCRIPTION OF THE DRAWINGS The above and other objects, advantages and features of the present invention and methods of achieving them will be apparent from the following detailed description of embodiments thereof taken in conjunction with the accompanying drawings.

The present invention may, however, be embodied in many different forms and should not be construed as being limited to the exemplary embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, And advantages of the present invention are defined by the description of the claims.

It is to be understood that the terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. In the present specification, the singular form includes plural forms unless otherwise specified in the specification. &Quot; comprises "and / or" comprising ", as used herein, unless the recited component, step, operation, and / Or added.

The smart sound device of the present invention basically has a speaker function, a video output function, a half-period function (for example, a midi file playback function), and has a processing function such as user preference analysis and a function of interlocking with peripheral devices.

1 is a diagram showing a basic operation concept of a smart acoustic apparatus according to the present invention.

The smart sound device 100 downloads various sound sources from the external server 300 through the intelligent portable terminal 200 such as a smart phone, and then reproduces the downloaded sound sources and outputs them to the speakers.

Connected to the microphone 400 by wire or wireless, receives a song called by the user, amplifies the song, and outputs the amplified song to the speaker.

In addition, a video projector such as a beam projector is provided, and the image stored therein or the image received from the intelligent portable terminal 200 is output through the image output device.

In another embodiment, the output of the image may be transmitted to an external device (e.g., a display device of a TV or a fixed song karaoke machine) and output.

Meanwhile, the smart sound device 100 can record the user's song and store the song therein or upload it to the external server 300, and also store the user's selection history data and upload it to the external server 300.

The intelligent portable terminal 200 installs a dedicated app to download a sound source from the external server 300, and provides the sound source to the smart acoustic device 100.

The ladder data is also transmitted to the external server 300, and the lyric data is displayed as a display window of the lyric sound device 100 according to the playback of the sound source by the smart sound device 100, or transmitted together with the sound source data to the smart sound device 100, (100) simultaneously outputs the sound source and the lyrics.

Also, the intelligent portable terminal 200 can control the smart acoustic device 100 through a dedicated application. For example, the intelligent portable terminal 200 can be configured to perform tuning of the tone color and sound field of a smart sound device, volume control, and the like.

Furthermore, in accordance with the sound source transmitted and reproduced to the smart sound apparatus 100, the smart sound apparatus 100 may display the stored tempo- rary image or moving image stored in the self-image display apparatus 200 in its own display window or transmit the stored image data to the smart sound apparatus 100, And reproduces and outputs the video data.

Also, the intelligent portable terminal 200 manages the selection history data of the user through the dedicated application and transmits the selected selection history data to the remote server or analyzes the user's preference of the user to the smart sound device 100 or the external server 300 It can be used for recommendation of later selection.

The external server 300 stores various sound sources and downloads them according to the request of the intelligent portable terminal 200. [

Also, the user's preference history data is received from the smart sound device 100 or the intelligent portable terminal 200, and the user's music preference is calculated based on the preference history data, and a recommended music list is generated and provided based on the calculated preference.

 The calculation of the music preference can be configured to classify the songs that the user likes or listens to according to the place and the time zone, and to grasp the characteristics of the favorite genre, preferred composer, and favorite singer by the time zone based on the classification.

For example, if a user enjoys singing in a nightlife area in the evening and music in a residential area (or a user's house) that he / she likes or listens to in the middle of the night is grasped and the genre, composer, The type of music can be grasped.

It is a matter of course that the music preference of the user can be performed not only by the external server 300 but also by the smart sound device 100 or the intelligent portable terminal 200.

As described above, a key characteristic of the smart acoustic apparatus 100 according to the present invention is that it can process its own tasks and perform tasks that can not be performed or performed by its own computing power. And it is an IoT-based device that requests an external device for processing and receives the result.

When the user's music preference is determined, the external server 300 generates a recommended music list for each time zone according to a request of the smart sound device 100 or the intelligent portable terminal 200, and transmits it to the smart sound device 100 or intelligent portable To the terminal 200.

When generating a recommended music list, the external server 300 extracts and provides the best matching music through a variety of reasoning methods when there is a request for a recommended music in a place other than a place and time zone already classified and grasped.

For example, it has been found that some users prefer music that is exciting in the evening and quiet music in the middle of the night. In the case of requesting recommended music in the middle of the day, it is difficult to extract characteristics by time, Recommended music is selected.

Alternatively, the selection history data of a plurality of users are collected to grasp a universal music taste common to a plurality of users, and a musical taste per user group is grasped. Then, based on the taste information, a recommendation A music list can be generated.

The distinction and specification of the user is performed through the unique number of each device, such as the phone number or H / W device number of the intelligent portable terminal 200, and the serial number of the smart sound device 100.

The place and time for playing the song selected by the user can be grasped by using the locating function and the timer built in the intelligent portable terminal 200 and included in the user's selection history data.

The data transmission method between the smart acoustic device 100, the intelligent portable terminal 200 and the external server 300 basically takes a wireless communication system.

For example, the smart acoustic device 100 and the intelligent portable terminal 200 use a short-range wireless communication method such as Bluetooth, infrared, RF, WiFi, and WiFi-Direct, and the intelligent portable terminal 200 and the external server 300 But it is needless to say that various communication methods can be used, and it is natural that they can be mutually connected by wire.

The smart acoustic apparatus 100 of the present invention basically performs indirect transmission through the intelligent portable terminal 200 when transmitting / receiving data to / from the external server 300.

That is, the user operates the intelligent portable terminal 200 to access the external server 300, downloads the sound source data from the external server 300, transmits the sound source data to the smart sound device 100, And transmits the data to the external server 300 by operating the intelligent portable terminal 200. [

According to an important feature of the present invention, the smart acoustic apparatus 100 of the present invention controls the intelligent portable terminal 200 to transmit data to a remote external device, such as the external server 300, It can transmit and receive.

For example, the smart sound device 100 can directly communicate with a remote external device such as the external server 300 by controlling a dedicated application installed in the intelligent portable terminal 200 and controlling the dedicated app. In this case, the intelligent portable terminal 200 serves as a communication terminal of the smart acoustic device 100.

In addition, the smart acoustic device 100 can freely communicate directly with an external device within a communication distance of the communication device itself through WiFi-Direct, Bluetooth, or the like.

Accordingly, the smart acoustic device 100 according to the present invention can function as an integrated entertainment device based on IoT.

If the smart sound apparatus 100 includes a user interface unit (not shown) such as an input button or a touch screen, the integrated entertainment environment according to the intention of the user can be formed more flexibly.

Hereinafter, the structure of the smart acoustic apparatus 100 according to the present invention will be described in detail with reference to FIG.

The smart acoustic apparatus 100 includes a communication unit 110, a microphone terminal 120, a control unit 130, a storage unit 140, an acoustic output unit 150, and an image output unit 160, And may further include a user interface unit (not shown).

The communication unit 110 is a short-range wireless communication module such as Bluetooth, infrared, RF, WiFi, or WiFi-Direct, and communicates with a portable terminal, a TV, a karaoke machine or the like. The communication unit 110 may be a mobile communication module or a wired communication unit as well as a short-range wireless communication module.

The microphone terminal 120 is wired or wirelessly connected to a microphone to receive user's voice from a microphone.

The control unit 130 reproduces a sound source file input through the communication unit and includes a chip (for example, a midi chip) dedicated for sound reproduction. In addition, the user's voice inputted from the microphone is added to the sound source file and is stored in the storage unit 140. [

In addition, it is also possible to generate user selection history data, calculate a user's music preference, communicate with an external device or perform interlocking control, and control the sound output unit 150 and the image control unit 160 to output sound, .

The storage unit 140 stores sound source data, recording data, user selection history data, and user music preference data according to an instruction from the control unit 130. [ In addition, an image received from an external device such as the intelligent portable terminal 200 can be stored.

The sound output unit 150 and the image control unit 160 output the sound to be reproduced and the sound to be micro-input according to an instruction from the control unit 130, and output an image.

The image controller 160 may be a beam projector or a display panel. In addition, it is preferable that the display device is configured to be capable of performing a role of illumination by outputting light having various colors and blinking cycles as well as image display.

As described above, the smart acoustic apparatus 100 of the present invention directly communicates directly with external devices within the communication range of the communication unit 110, such as WiFi-Direct, Bluetooth, and the like, It is possible to communicate directly with a remote device located outside, through an external device located nearby.

For example, the smart sound device 100 invokes a dedicated app installed in the intelligent portable terminal 200 and controls the dedicated app to directly communicate with a remote external device such as the external server 300. [ In this case, the intelligent portable terminal 200 serves as a communication terminal of the smart acoustic device 100.

FIG. 3 is a diagram illustrating that the smart acoustic apparatus 100 according to the present invention operates in conjunction with an external peripheral device.

The smart sound device 100 transmits image data to display on the display panel of the TV in cooperation with the TV 500 or to display images received from another external device (for example, an intelligent portable terminal or an external server).

In this case, the image is displayed in accordance with the music to be reproduced, and the lyrics data is transmitted and the lyrics are displayed in accordance with the music to be reproduced.

It is preferable that the smart sound apparatus 100 performs synchronization between the playback music and the image or lyrics.

It is preferable that the controller of the smart acoustic apparatus 100 classifies the image data and selects and displays the image that best matches the music to be reproduced.

When the metadata includes the metadata, the content of the metadata (genre, star, director, etc., in the case of a movie, and classification of the shooting location, landscape, Singer, composer, and the like, and to display the optimal image in consideration of the user's preference.

For example, in the case of playing exciting dance music, it is possible to display a comedy or an action movie, and to control a landscape or portrait photograph to be sequentially displayed when calm ballad music is played back.

When converting a picture into a slide show mode, it is preferable to adjust the fade-out time in accordance with the beat of the music or to adjust the picture change period.

As another embodiment, the song playing field may be implemented to have the fixed song playing unit 600 and the M2M communication function.

As a providing function, when a song is sang in the song practice area, the smart sound device 100 illuminates the light according to the song atmosphere according to the song selected at the half-time, and the photo stored in the self Or a moving picture can be transmitted as a WiFi direct message to the song ringer 600 so that it can be used as a background image, and music can be stored, thereby functioning as a smart auxiliary device linked to the song ringer.

For this purpose, the fixed song half-pitcher 600 transmits the music being played back to the smart sound apparatus 100 in a streaming manner, or the smart sound apparatus 100 collects the music being played through the microphone 400, Or the image data to be attached to the music during reproduction is transmitted to the song half-pitcher 600 so that it can be used as a background picture.

In addition, the smart acoustic apparatus 100 according to the present invention has a function of automatically uploading recorded music or music recorded on various SNS sites such as music sites and Facebook.

For example, when the music is recorded, the music and / or image data of the user is uploaded by accessing the corresponding SNS site based on the SNS login information and / or the procedure set in advance.

As described above, if the SNS site server is located at the communication distance of its own communication unit, the SNS site server directly uploads the external site, and if there is a distance outside the communication distance, controls the external device having the remote communication function around the SNS site server.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed embodiments, but, on the contrary, is intended to cover various modifications and equivalent arrangements included within the spirit and scope of the appended claims.

Claims (7)

A communication unit for communicating with an external device in a wired or wireless manner,
A microphone terminal for receiving sound from a microphone,
A control unit for reproducing a sound source received from the external device through the communication unit,
A storage unit for storing data received from the external device according to an instruction from the control unit;
A sound output unit for outputting the reproduced sound source in accordance with an instruction from the control unit,
/ RTI >
The communication device according to claim 1,
Bluetooth, Infrared, RF, WiFi, WiFi-Direct.
The method according to claim 1,
Further comprising a video output section for outputting video or light,
Wherein the control unit controls the image output unit to select an image or light according to the reproduced sound source.
The apparatus of claim 1,
Wherein the communication unit communicates directly with an external device within a communication distance of the communication unit and performs communication with an external device located outside the communication distance through the external device within the communication distance.
The apparatus of claim 1,
And the image data corresponding to the sound source being reproduced is extracted from the storage unit, and the image data is transmitted to an external device in the vicinity.
The apparatus of claim 1,
Wherein the external device identifies a sound source being reproduced, extracts image data corresponding to the sound source, and transmits the extracted image data to the external device.
The apparatus of claim 1,
The music preference is calculated by classifying the songs that the user enjoys or listens to according to the place and the time zone, and recognizes the characteristics of the preferred genre, the preferred composer, and the favorite singer according to the time zone according to the category.

Images