CN110815243A

CN110815243A - Intelligent voice bilingual early education robot

Info

Publication number: CN110815243A
Application number: CN201911118264.6A
Authority: CN
Inventors: 李鑫
Original assignee: SHENZHEN BOYUE DOMESTIC GOODS CO Ltd
Current assignee: SHENZHEN BOYUE DOMESTIC GOODS CO Ltd
Priority date: 2019-11-14
Filing date: 2019-11-14
Publication date: 2020-02-21

Abstract

The invention discloses an intelligent voice bilingual early education robot which comprises a robot main body structure, wherein the robot main body structure is provided with the following modules: the network connection module is used for realizing network connection; the expression lamp module is used for displaying different expressions according to the current state of the robot; the watchdog module is used for monitoring whether the system is halted or restarting the system after the thread enters a dead loop; the playing module is used for playing voice; the data transmission module is used for realizing data transmission; the control module is used for transmitting commands to the module to enable the module to work; the network connection module comprises a data connection sub-module and a Bluetooth function sub-module; the data connection submodule is connected with the Ali voice cloud and the WeChat and is used for requesting cloud songs and contents and learning English; the Bluetooth function sub-module is used for playing sound and MIC wind recording, and has a classic Bluetooth function and a network distribution function.

Description

Intelligent voice bilingual early education robot

Technical Field

The invention relates to the technical field of intelligent voice equipment, in particular to an intelligent voice bilingual early education robot.

Background

Along with the high-speed development of the internet industry, AI is more and more close to people's life, and more intelligent equipment adopts image recognition technology, face recognition technology, voice interaction technology etc. and current VR, intelligent house all are fine artificial intelligence product. With the increasing maturity of the intelligent industry, the early education industry also needs to carry an opportunity of AI, and equipment is directly controlled through intelligent voice to achieve the function of man-machine interaction learning. When the traditional single local playing or Bluetooth connection playing is carried out, the player only has one control, equipment comprising a plurality of playing modes does not exist in the prior art, strict logic is needed for distinguishing different playing control rights to realize the playing of the plurality of modes, so that the function of randomly switching the playing can be achieved, in addition, the problem of asynchronously calling the playing and recording functions is also needed to be solved for achieving the purpose, and the player cannot simultaneously support the playing and recording functions; in a networking state, the system is also required to be compatible with various internet protocols such as HTTP, TCP/IP, websocket and the like, so that long connection of H5 is ensured, and the operation experience of a user is enhanced.

The information disclosed in this background section is only for enhancement of understanding of the general background of the invention and should not be taken as an acknowledgement or any form of suggestion that this information forms the prior art already known to a person skilled in the art.

Based on the reasons, the applicant provides an intelligent voice bilingual early education robot, and aims to solve the problems.

Disclosure of Invention

In order to meet the requirements, the invention aims to provide an intelligent voice bilingual early education robot which can request cloud songs through voice, request cloud songs and contents through a wechat public number and learn English at the cloud.

In order to achieve the purpose, the invention adopts the following technical scheme:

the utility model provides an intelligence pronunciation bilingual early education robot, includes the robot major structure, the robot major structure is installed following module:

the network connection module is used for realizing network connection;

the expression lamp module is used for displaying different expressions according to the current state of the robot;

the watchdog module is used for monitoring whether the system is halted or restarting the system after the thread enters a dead loop;

the playing module is used for playing voice;

the data transmission module is used for realizing data transmission;

the control module is used for transmitting commands to the module to enable the module to work;

the network connection module comprises a data connection sub-module and a Bluetooth function sub-module; the data connection submodule is connected with the Ali voice cloud and the WeChat and is used for requesting cloud songs and contents and learning English; the Bluetooth function sub-module is used for playing sound and MIC wind recording, and has a classic Bluetooth function and a network distribution function.

In one possible embodiment, the network connection module includes a violet light spreading chip 5981C chip and a violet light spreading chip 5856Q32 chip.

In one possible implementation, the violet exhibition 5981C chip is externally connected with a TF card through an SDIO interface, and is used for locally playing an MP3 song.

In one possible embodiment, the ultraviolet light exhibition 5856Q32 chip is in data connection with the playing module, and the ultraviolet light exhibition 5856Q32 chip decodes the obtained data and then plays the sound through the playing module.

In one possible embodiment, the expression lamp module comprises at least 6 LED lamps, and the LED lamps are controlled to be turned on and off through the GPIO to realize different expression displays.

In one possible embodiment, the playback module includes a sound box.

In one possible embodiment, the data transmission module includes a download module, and the download module is used for enabling the robot to obtain data from a remote server or a remote server.

In one possible embodiment, the data transmission module includes an uploading module, and the uploading module is configured to transmit data information of the robot to a cloud or a remote server.

In one possible implementation, the control module is connected to a key submodule, and the key submodule is used for controlling a playing sequence, connecting WeChat and starting Bluetooth.

In one possible implementation mode, the control module is connected with a dialogue question-answer module, the dialogue question-answer module is connected with a voice cloud server, the dialogue question-answer module monitors user voice in real time, the dialogue question-answer module starts a recording file format algorithm and stores user voice files, after a user stops, the dialogue question-answer module transmits the user voice files to a cloud end, the cloud end identifies the user voice files into characters through voice, searches for and matches the best answer content in a database, and sends the characters to a playing module of the robot to play.

Compared with the prior art, the invention has the beneficial effects that: the intelligent bilingual early education robot adopting the scheme adopts a 5981C and 5856Q32 double-chip design with sharp ultraviolet exhibition, wherein the 5981C chip is internally provided with a WIFI and MCU unit and can realize a network connection function, the 5856Q32 chip comprises a Bluetooth/BLE and Codec function and can realize sound playing and MIC wind recording as well as classical Bluetooth and network distribution functions, and the network connection and data transmission functions of the robot are realized; in addition, the 5981C chip is externally connected with a TF card through an SDIO interface, so that MP3 songs can be played locally, and the 5981C chip can be connected with an Ali voice cloud after networking, so that cloud songs can be requested through voices; the cloud songs and contents are requested through the WeChat public number, and English can be learned at the cloud;

on the other hand, the robot is provided with a plurality of LED lamps, the LED lamps are controlled through GPIO, interactive expressions of the robot are achieved, the interest of children in the education process can be greatly improved, and convenience can be brought to teaching.

By integrating all the modules recorded by the scheme, the early education robot realizes the following functions:

① the robot can request content and intelligent question and answer by voice, and support continuous conversation;

② playing online audio content under networking conditions;

③ can play local T card audio, can download update resources through usb, and has memory playing function;

④ can chat by WeChat and send words to story machine by WeChat;

⑤ can be pushed and remotely controlled by WeChat public numbers;

⑥ the robot has interactive expression, and the expression lamp can be turned on or off to flash.

The invention is further described below with reference to the accompanying drawings and specific embodiments.

Drawings

FIG. 1 is a block diagram of an embodiment of an intelligent bilingual early education robot according to the present invention;

FIG. 2 is a schematic diagram of the starting expression of the expression lamp module of FIG. 1;

FIG. 3 is a schematic diagram of a playing facial expression of the facial expression light module of FIG. 1;

FIG. 4 is a schematic view of the expression in the connection of the expression lamp module of FIG. 1;

FIG. 5 is a schematic drawing of an open expression of the expression light module of FIG. 1;

FIG. 6 is a schematic diagram of a lost expression of the expression light module of FIG. 1;

FIG. 7 is a schematic view of a conventional expression of the expression lamp module of FIG. 1;

FIG. 8 is a schematic view of a pause expression of the expression light module of FIG. 1;

fig. 9 is a schematic diagram of a recorded expression of the expression lamp module of fig. 1.

Detailed Description

In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention will be described in detail with reference to the accompanying drawings and the detailed description.

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

In the description herein, references to the description of the term "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., mean that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. In this specification, the schematic representations of the terms used above should not be understood to necessarily refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Furthermore, various embodiments or examples described in this specification can be combined and combined by those skilled in the art.

On one hand, the structure shown in fig. 1 is a schematic diagram of a module composition of an intelligent voice bilingual early education robot, and includes a main body structure of the robot, where the following modules are installed:

a network connection module 100 for implementing network connection;

the expression lamp module 200 is used for displaying different expressions according to the current state of the robot;

the watchdog module 300 is used for monitoring whether the system is halted or restarting the system after a thread enters a dead loop;

a playing module 400, configured to play voice;

a data transmission module 500, configured to implement data transmission;

the control module 600 is used for transmitting commands to the modules to enable the modules to work;

the network connection module 100 comprises a data connection sub-module 101 and a Bluetooth function sub-module 102; the data connection submodule 101 is connected with the Ali voice cloud and the WeChat and is used for requesting cloud songs and contents and learning English; the bluetooth function sub-module 102 is used for playing sound and MIC wind recording, and functions of classical bluetooth and network distribution.

Specifically, the main structure of the robot may be a structure customized or designed according to the user's requirements, and is intended to implement the functions of the network connection module 100, the expression lamp module 200, the watchdog module 300, the playing module 400, the data transmission module 500, and the control module 600, so as to achieve the purpose of teaching the robot in the early stage of the present invention.

As an embodiment of the control module 600, the control module 600 further includes 4 work sub-modules:

a factory sub-module 601, a test sub-module 602, an aging sub-module 603, and a normal use sub-module 604 are recovered, wherein the sub-modules can be started by buttons connected to the control module 600, and the number of the buttons can be 1 or a combination of several buttons.

Specifically, the factory sub-module 601 is restored:

songs downloaded by a user, collected songs, memorized user names and passwords of a wireless network, downloaded contents in a Shaanchai English menu, daily recommended contents, memorized information in the using process of the user and the like can be deleted, and the system can be automatically restarted after the deletion;

test sub-module 602:

when mainly being the production of mill, the function of test product mainly includes the TF card, the ear lamp, the expression lamp, the button, loudspeaker, the WIFI networking, the broadcast is connected to the bluetooth, functions such as recording satisfy the flowing water test of producing the line.

The aging submodule 603:

mainly aiming at the research and development test and the factory production, the device is used for testing the stability of products, playing for a long time, testing on line for long connection and the like;

normal use submodule 604:

the method is mainly used for initializing the functions of a local TF card after a knob is turned to start up, reading some stored information in an internal flash, initializing necessary information for communication with a server and functional configuration information of GPIO (general purpose input/output), and starting an ear lamp and an expression lamp; secondly, initializing information of a playing module, needing to start a playing thread and a data transmission thread, initializing contents in a local file TF, establishing list information in each file, setting the content playing in the local TF as default, initializing a key function, and starting a network connection thread; finally, a logic decision loop (e.g., while) includes inter-thread communication, device sleep management, USB power insertion detection, battery level detection, ear light control, watchdog monitoring, and the like, and when a specific turn-on condition is reached, the function is enabled.

As a possible implementation, the control module 600 may also be coupled to an ear light module.

As a preferred embodiment, the network connection module 100 includes a violet light spreading chip 5981C chip and a violet light spreading chip 5856Q32 chip.

In order to realize the functions of the violet exhibition sharp 5981C chip and the violet exhibition sharp 5856Q32 chip, in this embodiment, the violet exhibition sharp 5981C chip is externally connected with a TF card through an SDIO interface, and is used for locally playing an MP3 song. The WIFI and MCU unit is arranged in the ultraviolet sharp 5981C chip, and a network connection function can be realized.

In order to realize the functions of the aforementioned violet light exhibition sharp 5981C chip and the violet light exhibition sharp 5856Q32 chip, in this embodiment, the violet light exhibition sharp 5856Q32 chip is in data connection with the playing module 400, and the violet light exhibition sharp 5856Q32 chip decodes the obtained data and then plays the sound through the playing module 400.

In a preferred embodiment, the expression lamp module 200 comprises at least 6 LED lamps, and the LED lamps are controlled to be turned on and off by the GPIO to realize different expression displays. Specifically, the LED lamps are divided into 2 groups, three groups in total, and are arranged in an upper-middle-lower mode;

to show the interaction effect:

FIG. 2 shows a start-up expression- -display is cycled during start-up;

FIG. 3 shows the expression playing- -the song playing process is displayed in a loop;

as shown in fig. 4, the expression in the connection is displayed circularly in the process of network connection or bluetooth connection;

as shown in fig. 5, it is a happy expression-the network connection is successful or the bluetooth connection is successful and then the display is circulated;

as shown in fig. 6, the expression of loss-cycle display after network connection failure or bluetooth connection failure;

FIG. 7 shows a conventional emoticon- -the Bluetooth connection does not play the display;

FIG. 8 shows a pause expression- -display when playing is paused;

FIG. 9 shows a recorded expression- -displayed when recording is turned on;

as a possible embodiment, the watchdog module 300 is mainly used to monitor whether the system is dead or not, or after a thread executed in the system enters a dead loop, the purpose of restarting the device may be achieved by resetting the watchdog. The watchdog module 300 may be implemented by an anti-deadlock loop program and a program for restarting a system in the prior art, which may be implemented in a manner of multiple threads or a single thread in a robot system.

In one possible implementation, the playback module 400 includes a sound box. Wherein, the playing module 400 is intended to play the data from the ultraviolet light sharp 5856Q32 chip after soft decoding.

In one possible embodiment, the data transmission module 500 includes a download module 501, and the download module 501 is used to enable the robot to obtain data from a remote server. The data transmission module 500 includes an uploading module 502, and the uploading module 502 is configured to transmit data information of the robot to a cloud or a remote server.

Specifically, after the robot is powered on and networked, whether information/information needing to be downloaded exists is inquired through an HTTP request, then downloading is requested through a downloading thread, the information/information is downloaded to the local for playing or storing, and after the downloading is completed, the downloading thread is quitted, so that the downloading function is completed.

In one possible embodiment, the control module 600 is connected to a key sub-module 605, and the key sub-module 605 is used to control the playing sequence, connect the WeChat, and start the Bluetooth.

Specifically, the key sub-module 605 may include the following keys:

catalog/Collection: short press-switching to a system track menu, automatically playing contents under categories, and sequencing the switching to a. my collection-self-defining-root directory; long press-play system category or download category, the function is: adding and storing; when playing the song under the category of 'my collection', the function is to cancel the collection;

English/FM: short press-switching to an online English song menu and automatically playing contents under the category; long press-switch to FM function;

and (3) voice: short press-wake up interruption, enter continuous conversation; long press-recording and sending to the cloud;

WeChat: short press-receiving the message sent by the WeChat; long press-recording and sending to the cloud;

the first song is: short press-last bend; long press-play/pause;

the following one: short press-next bend; long press-enter/exit bluetooth mode.

In one possible implementation, the control module 600 is connected to a dialogue question and answer module 606, the dialogue question and answer module 606 is connected to a voice cloud server, the dialogue question and answer module 606 monitors the voice of the user in real time, the dialogue question and answer module starts a recording file format algorithm and stores the voice file of the user, after the user stops, the dialogue question and answer module 606 transmits the voice file of the user to the cloud, the cloud identifies the voice file of the user into characters, searches for and matches the best answer content in the database, and sends the best answer content to the playing module 400 of the robot for playing.

Specifically, the implementation of continuous dialog function & intelligent question answering: after the robot is started to connect with a network, a voice cloud server needs to be connected, after connection is successful, a voice key is pressed for a short time to enter a continuous conversation, a beep prompt tone is played and then recording is started, a microphone is started at the moment, a user speaks, then a recording file format algorithm is started after the voice of the user is detected, a voice file of the user is stored, after the user stops, the voice file is sent to a cloud end, the cloud end identifies the file into characters through voice, then related contents are searched in a database, the best answer contents are matched and sent back to an equipment end to be played, the file automatically enters a conversation mode again after being played, the beep prompt tone is played first and then the recording is started, and the process is repeated; the question and answer content in the process is an intelligent question and answer, a massive resource library is collected at the cloud, and the main contents are as follows: encyclopedia question-answering, one hundred thousand reasons, national poetry, songbirds, nursery rhymes, jokes, primary school courses, english, alarm clocks, reminders, weather queries, question-answering games, password wrapping, and the like.

In another aspect, to implement the functions of the network connection module 100, the emoticon module 200, the watchdog module 300, the playing module 400, the data transmission module 500, and the control module 600, in the implementation software, the overall software design includes the following threads:

1. main thread (for realizing the function of the control module 600)

2. Network connection thread (mainly used for realizing the function of the network connection module 100)

3. Expression lamp control thread (mainly used for realizing the function of the expression lamp module 200)

4. Watchdog thread (mainly used for realizing the function of watchdog module 300)

5. Player thread (mainly used for realizing the function of the play module 400)

6.5981C and 5856Q32 data communication thread playing thread (mainly used for realizing the functions of the data connection sub-module 101 and the Bluetooth function sub-module 102)

7. Server communication thread- -content cloud communication/H5 end control (mainly for realizing the function of the network connection module 100 communicating with the server)

8. The functions of downloading thread, OTA, micro chat, downloading, TTS, habit reminding and the like are public (mainly used for realizing the function of the downloading module 501)

9. A ali voice communication thread; (function for realizing network connection module 100 and Ali voice cloud communication)

Wherein, the communication processing among threads: the method mainly comprises the steps of communication interaction processing between a main thread and a server-side communication thread, including processing of an expressive lamp, processing of a distribution network/network state, playing processing, downloading confirmation, downloading of an English menu, heartbeat sending, OTA (over the air) upgrading processing and the like.

Processing of the ear lamp: the method comprises the steps of flashing when a network is distributed, normally lighting in a normal play mode and turning off a shutdown lamp.

And (3) control processing of playing: the content is played in 3 categories, one is a song in the local TF card, one is a cue tone (in Flash), and finally a web song (URL link). Different folders are required to be established for local songs, and an initialization file list of each folder is stored in a UARF file and comprises song names, the total number of songs and the like; the prompt tone is actually an MP3 song stored in flash, is similar to a local song and is stored in a different place; the network song is special and needs to be downloaded and played at the same time. The data transmitted during the player processing is transmitted in a data stream mode through serial ports of 5981C and 5856Q32, and currently, only the formats of MP3, M4A, AMR, WAV, AAC and the like are supported.

Network connection threading

The method mainly comprises the steps of realizing the network distribution and the networking after the network distribution, storing WIFI account passwords into a flash, starting an SDK (software development kit) of an equipment terminal of the Ali after the network distribution, connecting functions of a voice cloud server of the Ali and the like, logging in a content cloud and acquiring recommended URL (uniform resource locator) content every day through HTTP (hyper text transport protocol) requests, and starting a thread of server/H5 communication.

Expression lamp control thread

The function of expression lamp is through 3 GPIOs 6 lamps about controlling respectively, for real time control, so independent thread is controlled, mainly has 8 kinds of circumstances, and the demonstration of expression lamp is different, including the start, the broadcast, the pause, join in marriage the net, the bluetooth is connected, is happy, loses the dropout, conventional, recording etc..

Watchdog thread

The method mainly aims to monitor whether the system is halted or not, or after the thread enters dead loop, the purpose of restarting the equipment can be achieved through watchdog reset.

Play thread

Mainly, music files with different formats are processed in different soft decoding modes in a distinguishing way.

The 5981C chip and the 5856Q32 chip implement data communication threads;

and (3) playing mode: the file coded by the playing thread is transmitted to the 5856Q32 chip for playing.

Recording mode: and receiving 5856 sound files recorded by the Q32 chip, and uploading the sound files to the cloud.

Bluetooth/BLE mode: and receiving 5856Q32 data transmitted by the chip, wherein the data is mainly a WIFI account password.

Server/H5 communication thread

Mainly, after a login server acquires that a device (namely, the early education robot) is bound by a micro-credit user, a long connection is established through a websocket protocol, then, the service and device end sent by an H5 end are waited to send information of the device end to an H5 end, heartbeat and the like, and if communication is abnormal, the connection can be reestablished.

Downloading threads

After the network is started, whether information/information needing to be downloaded exists is inquired through an HTTP request, then downloading is requested through a downloading thread, the information/information is downloaded to the local for playing or storing, and then the downloading thread is quitted after the downloading is finished, so that the downloading function is finished.

Ali voice communication thread

The Ali voice processing function is that Ali provides an SDK, the SDK is added into a program, when network connection is normal, the SDK program of an Ali device end is initialized, and then connection (SSL protocol) of an Ali voice cloud server is requested through a unique identification code (device MAC address), so that long connection service is established. If the voice and micro-chat functions need to be used, the processing is carried out through the keys, and during the processing, a voice file needs to be uploaded to the Ali cloud server to identify the use of the voice on-demand function and the micro-chat function, so that the user can freely order songs and the micro-chat function.

Various other modifications and changes may be made by those skilled in the art based on the above-described technical solutions and concepts, and all such modifications and changes should fall within the scope of the claims of the present invention.

Claims

1. The utility model provides an intelligence pronunciation bilingual early education robot, includes the robot major structure, its characterized in that, the robot major structure is installed following module:

the network connection module is used for realizing network connection;

the playing module is used for playing voice;

the data transmission module is used for realizing data transmission;

2. The intelligent voice bilingual early education robot of claim 1, wherein the network connection module comprises a purple light exhibition sharp 5981C chip and a purple light exhibition sharp 5856Q32 chip.

3. The intelligent voice bilingual early education robot according to claim 2, wherein the purple light exhibition sharp 5981C chip is externally connected with a TF card through an SDIO interface for locally playing MP3 songs.

4. The intelligent voice bilingual early education robot of claim 2, wherein the violin exhibition sharp 5856Q32 chip is in data connection with the playing module, and the violin exhibition sharp 5856Q32 chip decodes the obtained data and then plays the sound through the playing module.

5. The intelligent voice bilingual early education robot according to claim 1, wherein the expression lamp module comprises at least 6 LED lamps, and the LED lamps are controlled to be turned on and off through the GPIO to realize different expression displays.

6. The intelligent voice bilingual early education robot according to claim 1, wherein the playing module comprises a sound.

7. The intelligent voice bilingual early education robot according to claim 1, wherein the data transmission module comprises a download module for realizing that the robot acquires data from a remote or remote server.

8. The intelligent voice bilingual early education robot according to claim 1, wherein the data transmission module comprises an uploading module, and the uploading module is used for transmitting data information of the robot to a cloud or a remote server.

9. The intelligent voice bilingual early education robot according to claim 1, wherein the control module is connected with a key submodule for controlling the playing sequence, connecting WeChat and starting Bluetooth.

10. The intelligent voice bilingual early education robot according to claim 1, wherein the control module is connected with a dialogue question-answer module, the dialogue question-answer module is connected with a voice cloud server, the dialogue question-answer module monitors user voice in real time, the dialogue question-answer module starts a recording file format algorithm and stores user voice files, the dialogue question-answer module transmits the user voice files to a cloud after a user stops, the cloud identifies the user voice files into characters through voice recognition, searches for and matches the best answer content in a database, and sends the best answer content to a playing module of the robot for playing.