CN113573152A

CN113573152A - Body-sensing entertainment equipment

Info

Publication number: CN113573152A
Application number: CN202110832751.XA
Authority: CN
Inventors: 李奥; 周跃兵; 吴国杰; 范广祥
Original assignee: Aimyunion Technology Ltd
Current assignee: Aimyunion Technology Ltd
Priority date: 2021-07-22
Filing date: 2021-07-22
Publication date: 2021-10-29
Anticipated expiration: 2041-07-22
Also published as: CN113573152B

Abstract

The application relates to a body feeling amusement device, include: the system comprises a sound system, at least one camera and a circuit module; the camera is arranged on a box body of the motion sensing entertainment equipment and is connected with the circuit module; the sound system is used for playing the playing audio data and the voice prompt output by the circuit module; the camera is used for capturing a real-time action image of the action of a user in front of the sound system according to the played audio data; the circuit module is used for outputting playing audio data to the sound system for playing, receiving the real-time action image, acquiring limb action data of a user according to the real-time action image, comparing and analyzing the limb action data according to prestored reference action data, and generating a voice prompt according to a comparison and analysis result and outputting the voice prompt to the sound system for playing. According to the technical scheme, real-time and quick somatosensory interactive feedback can be given to the user, accuracy judgment, training guidance, action error correction and the like of various high-speed movement actions are achieved, and entertainment application experience of the user is improved.

Description

Body-sensing entertainment equipment

Technical Field

The application relates to the technical field of entertainment equipment, in particular to somatosensory entertainment equipment.

Background

In the existing entertainment equipment, a television, a sound box of sound equipment or an intelligent terminal is generally adopted for use, for example, the television provides a video display function, the sound box is generally used for providing an audio playing function, along with the technical development, some intelligent functions and networking application functions are also added on the traditional sound equipment of the television and the sound equipment, for example, the television adopts a television box with network camera shooting, the sound box adopts intelligent voice technologies such as voice sound equipment, and the like, and the voice interaction between a user and the sound box of the sound equipment can be realized; some sound equipment can also be connected to a television and a sound box to use a camera, and the functions of video call, picture taking and the like are realized through the camera; these intelligent technologies provide assistance to the user in music entertainment, shopping experience, information acquisition, etc.

However, in practical applications, the applicant finds that in most of body-feeling entertainment scenes with limb movements, such as entertainment scenes of games, fitness, dance training and the like, the requirements for body-feeling feedback are high, and the existing television, sound equipment loudspeaker boxes or intelligent terminals and the like are utilized, so that the equipment is complex in construction and single in function, and the sound equipment is difficult to provide the required intelligent body-feeling feedback auxiliary function for the entertainment process of users.

Disclosure of Invention

The application provides entertainment device is felt to body of integration can be in the amusement scene of limbs motion, and it is supplementary and quick body sense feedback function to provide more intellectuality for the user.

A motion-sensing entertainment device, comprising: the system comprises a sound system, at least one camera and a circuit module; the camera is arranged on a box body of the motion sensing entertainment equipment and is connected with the circuit module;

the sound system is used for playing the playing audio data and the voice prompt output by the circuit module;

the camera is used for shooting a real-time action image of a user in front of the sound system, which acts according to the played audio data;

the circuit module is used for outputting the playing audio data to the sound system for playing, receiving the real-time action image shot by the camera, acquiring the limb action data of the user according to the real-time action image, comparing and analyzing the limb action data according to the prestored reference action data, and generating a voice prompt according to the comparison and analysis result and outputting the voice prompt to the sound system for playing.

The above technical scheme of this application has following beneficial effect:

the technical scheme of the application provides an integrated somatosensory entertainment device, an audio playing function is realized through a sound system, a real-time action image of a user is captured through a camera, an audio data processing function is realized through a circuit module, limb action data of the user are obtained according to the real-time action image shot by the camera, and the limb action data are contrastively analyzed according to prestored reference action data to generate a voice prompt which is output to the sound system to be played; the technical scheme can be suitable for most entertainment scenes with limb movement, particularly entertainment scenes such as games, fitness and dance training, real-time and quick somatosensory interactive feedback can be given to the user, particularly accuracy judgment, training guidance, action error correction and the like of various high-speed movement actions of the user are carried out, and the entertainment application experience of the user is improved.

In one embodiment, the circuit module comprises a motion capture algorithm processing module and a system motherboard;

the camera is used for shooting real-time motion images of a user, generating a video stream and transmitting the video stream to the motion capture algorithm processing module;

the motion capture algorithm processing module is used for converting the video stream into frame pictures with a set frame rate, calculating a motion track of a user from the frame pictures by using a motion capture algorithm, and forming limb motion data of the user;

the system mainboard is used for outputting the playing audio data, comparing and analyzing the limb action data according to prestored reference action data, and generating the voice prompt to be output to the sound system for playing.

In one embodiment, the comparing and analyzing the limb motion data according to the pre-stored reference motion data comprises:

subtracting the limb action data from prestored reference action data to obtain action deviation data, and generating an error correction voice prompt according to the action deviation data;

and judging the limb action data by using pre-stored reference action data to obtain the score value of the user, and generating a scoring voice prompt according to the score value.

In one embodiment, the camera is further configured to receive a notification message sent by the system motherboard through a network protocol, and convert an output video format of the camera into an improved format when the real-time action image does not need to be displayed;

wherein the improved format comprises: only the gray component format, resolution are reduced to only satisfy the current application function and/or the video coding rate is reduced to only satisfy the current application function.

In one embodiment, the sound system includes an audio processing circuit and a speaker unit; the loudspeaker unit is arranged on the front surface of the box body;

the audio processing circuit is used for receiving playing audio data output by the system mainboard, carrying out sound effect processing, and outputting the playing audio data and the voice prompt to the loudspeaker unit for playing after power amplification.

In one embodiment, the audio processing circuit comprises: the digital signal processor comprises a DSP chip, a digital-to-analog conversion chip and a power amplifier module which are connected in sequence; the DSP chip is connected with the system mainboard, and the power amplifier module is connected with the loudspeaker unit;

the DSP chip is used for performing sound effect processing on the played audio data output by the system mainboard;

the digital-to-analog conversion chip is used for converting the played audio data and the voice prompt into analog signals;

and the power amplification module is used for amplifying the power of the played audio data and the voice prompt and then outputting the amplified audio data and the voice prompt to the loudspeaker unit for playing.

In one embodiment, the audio processing circuit further includes a wireless microphone receiving module connected to the DSP chip, and configured to receive a voice signal of a wireless microphone and transmit the voice signal to a system motherboard or to the DSP chip.

In one embodiment, the system main board is further configured to acquire playing audio data selected by a user, identify a music category style to which the playing audio data belongs, and determine a corresponding sound effect mode according to the music category style; acquiring sound effect configuration parameters according to the sound effect mode and sending the sound effect configuration parameters to the DSP chip;

and the DSP chip is also used for carrying out corresponding sound effect processing on the played audio data according to the sound effect configuration parameters.

In one embodiment, the sound effect configuration parameters include: one or more of volume adjustment parameters, filter parameters, compression ratio, start/recovery time.

In one embodiment, the system main board is further configured to switch to a karaoke mode when the microphone is turned on, and send a sound effect configuration file to the DSP chip; receiving voice information input by a microphone, performing semantic analysis on the voice information, and executing corresponding instruction operation;

the DSP chip is also used for receiving the sound effect configuration file, starting an internal microphone channel switch and setting a reverberation effect according to the sound effect configuration file.

In one embodiment, the system mainboard is further provided with a motion capture peripheral interface for connecting with external motion capture equipment; the motion capture equipment is used for detecting the step motion data of a user and sending the step motion data to the system mainboard;

the system mainboard is also used for receiving the step action data, comparing and analyzing the limb action data and the step action data according to the prestored reference action data, and generating a voice prompt according to the comparison and analysis result and outputting the voice prompt to the sound system for playing.

In one embodiment, the system motherboard is further configured to randomly generate a light-on signal to control an unbound motion capture device to light on; the action capturing equipment is used for controlling the camera to collect video data and identifying the light-up signal; calculating the spatial position of the motion capture equipment, and binding the spatial relation between the motion capture equipment and each camera video;

the motion capture equipment moves to the use position according to the user requirement, and all the motion capture equipment is shot by at least one camera.

In one embodiment, the system motherboard is further configured to perform spatial coordinate modeling on the bound motion capture device and the camera; receiving signal data of a bound motion capture device and collecting motion capture devices to be bound; converting the distance between the motion capture equipment to be bound and each bound motion capture equipment according to the signal data, and calculating the space coordinate of the motion capture equipment to be bound through trilateral or triangular positioning algorithms and the like; and according to the spatial coordinates, calculating the spatial relationship between the motion capture equipment to be bound and the videos of the cameras, and determining the binding relationship between the motion capture equipment and the cameras according to the spatial relationship and by combining the video data acquired by the cameras.

In one embodiment, the system main board is further provided with a video signal interface for connecting an external display device;

or

The system mainboard is also provided with a microphone peripheral interface for connecting an external microphone;

or

The system mainboard is also used for receiving an operation instruction input by a user through a key of the microphone and executing a function corresponding to the operation instruction;

or

The system mainboard is also connected with an infrared receiving module and used for receiving a control signal of an infrared remote controller; or

The system mainboard is also connected with a Bluetooth module and used for receiving a Bluetooth remote controller;

or

The system mainboard is also connected with a voice recognition module and used for recognizing voice signals input by a user through a pickup microphone.

In one embodiment, the system motherboard is further connected to a power module, the power module comprising: the power supply comprises a switching power supply, a power supply switching circuit, a power supply management chip, an inverter circuit, a power supply detection circuit and an MCU (microprogrammed control unit);

the switching power supply is connected with a 220V alternating current power supply and is connected to the MCU through the power supply switching circuit, and the power supply management chip is connected with the switching power supply and the battery and is connected to the power supply switching circuit through the inverter circuit; and the MCU is connected to a 220V alternating current power supply through the power supply detection circuit and outputs a power supply to the system mainboard.

In one embodiment, a rotating base is arranged at the bottom of the box body and used for rotating the box body to control the camera to track the motion position of a user for shooting.

In one embodiment, the motion capture algorithm processing module is further configured to calculate an absolute spatial relationship between the user motion trajectory and the real-time motion image, predict pre-displacement data of a user according to the absolute spatial relationship, and send the pre-displacement data to the system motherboard;

the system mainboard is also used for outputting a driving signal to the rotating base according to the pre-displacement data, driving the rotating base to rotate and controlling the camera to track the motion position of the user.

In one embodiment, the swivel base comprises: the device comprises a bottom shell, a rotating motor, a motor control circuit board, a base surface cover, an auxiliary pulley and a motor shaft sleeve;

the motor shaft sleeve is fastened with the box body through a base connecting piece, the base connecting piece is connected with the motor shaft sleeve through a buckle, and the electric rotating base is connected with the box body into a whole;

and the motor control circuit board is used for receiving the driving signal output by the system mainboard and driving the rotating motor to rotate.

In one embodiment, the front part of the box body is provided with a panel with holes; wherein, the camera is installed on any hole site of foraminiferous panel.

In one embodiment, the camera head is secured to the perforated panel by a shock absorbing structure.

In one embodiment, the shock-absorbing structure includes: the connecting structure comprises a screw, a first soft damping piece, a connecting stud and a second soft damping piece;

the first flexible damping piece is clamped on a PCB hole position of the camera; the connecting stud penetrates through the second soft damping piece and is fixed on the panel with the hole; the screw passes through the first soft damping piece to be fixed on the connecting stud.

In one embodiment, the perforated panel is fixed at the front part of the box body, wherein the perforated panel is flexibly connected with the box body through a third soft shock absorption piece.

In one embodiment, the sound system is in mono mode, wherein

The loudspeaker unit comprises a full-frequency loudspeaker, and at least one passive vibrating diaphragm is arranged on the front surface or the back surface of the box body;

or

The loudspeaker unit comprises a medium-high sound loudspeaker and a medium-low sound loudspeaker, and at least one passive vibrating diaphragm is arranged on the front surface or the back surface of the box body;

or

The loudspeaker unit comprises a medium-high sound loudspeaker and a medium-low sound loudspeaker, and the back of the box body is provided with an inverter tube.

In one embodiment, the sound system is in a binaural mode, wherein

The loudspeaker unit comprises a left-channel full-frequency loudspeaker and a right-channel full-frequency loudspeaker, and two passive diaphragms are arranged on the front side or the back side of the box body;

or

The loudspeaker unit comprises a left sound channel middle-high loudspeaker, a left sound channel middle-low loudspeaker, a right sound channel middle-high loudspeaker and a right sound channel middle-low loudspeaker; two passive diaphragms are arranged on the front side or the back side of the box body;

or

The loudspeaker unit includes high-pitched loudspeaker in the left sound channel and low-pitched loudspeaker in the left sound channel to and high-pitched loudspeaker in the right sound channel and low-pitched loudspeaker in the right sound channel, the back of box is equipped with two paraphase pipes.

In one embodiment, the sound system is in 2.1 channel mode; wherein

The loudspeaker unit comprises a woofer, a left channel full-frequency loudspeaker and a right channel full-frequency loudspeaker; the back of the box body is provided with two passive diaphragms or two phase-reversing tubes;

or

The loudspeaker unit comprises a woofer, a left channel full-frequency loudspeaker and a right channel full-frequency loudspeaker which are divided by two frequencies; two passive diaphragms or two inverter tubes are arranged on the back surface of the box body.

Additional aspects and advantages of the present application will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the present application.

Drawings

The foregoing and/or additional aspects and advantages of the present application will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:

FIG. 1 is a schematic diagram of a motion sensing entertainment device of an embodiment;

FIG. 2 is a schematic diagram of the structure of a circuit module of one embodiment;

FIG. 3 is a flow chart of camera output video format control;

FIG. 4 is an electrical block diagram of a motion-sensing entertainment device of one embodiment;

FIG. 5 is a schematic diagram of a power module;

FIG. 6 is an external motion capture device connection diagram;

FIG. 7 is a schematic diagram of a single camera pairing scheme;

FIG. 8 is a schematic diagram of a pairing scheme for two cameras

FIG. 9 is a schematic diagram of a binding scheme between a camera and a motion capture device;

FIG. 10 is an exploded view of the motion sensing entertainment device hardware configuration of one embodiment;

FIG. 11 is a schematic view of a perforated panel construction;

FIG. 12 is a schematic imaging view of a camera;

FIG. 13 is a schematic view of the shock absorbing structure mounting of the camera head;

FIG. 14 is a schematic view of the third soft shock absorber installation;

FIG. 15 is a schematic view of a fixed anchor;

FIG. 16 is a side schematic view of the mounting swivel base;

FIG. 17 is a swivel mount control schematic;

FIG. 18 is a schematic view of a rotary base structure according to an embodiment;

FIG. 19 is a schematic view showing a rotation state of the rotating base;

FIG. 20 is a schematic view of a mono installation of the sound system;

FIG. 21 is a schematic view of a two channel installation of the sound system;

FIG. 22 is a schematic diagram of a 2.1 channel audio system of an embodiment;

FIG. 23 is a schematic diagram of a 2.1 channel audio system of another embodiment;

FIG. 24 is a schematic view of an external microphone;

FIG. 25 is a schematic diagram of a multi-person application scenario for a single motion-sensing entertainment device;

fig. 26 is a schematic diagram of a multi-person application scenario of a plurality of motion sensing entertainment devices.

Detailed Description

Reference will now be made in detail to embodiments of the present application, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the drawings are exemplary only for the purpose of explaining the present application and are not to be construed as limiting the present application.

As used herein, the singular forms "a", "an", "the" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms "comprises" and/or "comprising," when used in this specification, specify the presence of stated features, integers, steps, or operations, but do not preclude the presence or addition of one or more other features, integers, steps, operations, or groups thereof.

In the technical scheme of the application, referring to fig. 1, fig. 1 is a schematic structural diagram of a motion sensing entertainment device of an embodiment, and the sound box mainly comprises a sound system, at least one camera and a circuit module; the camera is arranged on the box body of the motion sensing entertainment equipment, and can acquire a user motion image in front of the motion sensing entertainment equipment.

For the sound system, the function is used for playing the audio data and the voice prompt output by the circuit module; for example, when playing music, the user can select the music to be played and play the music through the sound system.

The camera is used for shooting a real-time action image generated by the action of a user in front of the motion sensing entertainment equipment in the playing process of playing audio data; for example, in a scene with limb movement, a user performs movements such as games, dancing, body building and the like under the guidance of played audio, and real-time action images of the user are rapidly shot through a camera.

The circuit module is mainly used for realizing an information processing function and outputting playing audio data to a sound system for playing, for example, outputting dance music of different styles such as rock, disco, square dance, Taiji and the like selected by a user to audio equipment for playing during dance training; or may choose to enter karaoke mode to provide the user with a karaoke experience.

Meanwhile, the circuit module also receives a real-time action image shot by the camera, acquires limb action data of the user according to the real-time action image, and quickly shoots real-time motion data of the user through the camera, so that the limb action of the user can be quickly fed back; then, the body action data is contrastingly analyzed according to the prestored reference action data, and a voice prompt is generated according to the contrastingly analyzed result and is output to the sound system for playing.

As an embodiment, when the limb motion data is contrastively analyzed according to the pre-stored reference motion data; the body motion data can be differenced with prestored reference motion data to obtain motion deviation data, and an error correction voice prompt is generated according to the motion deviation data.

For example, when the Taiji music is played, the user exercises the Taiji action along with the music rhythm and the guide information, the comparison of the body action data is carried out, and then the comparison result with the standard action is provided for the user in a voice prompt mode, so that the user can be prompted to correct the error action, the real-time interactive feedback is given to the user, and the entertainment application experience of the user is improved.

In addition, the body action data can also be judged by utilizing prestored reference action data to obtain the score value of the user, and a scoring voice prompt is generated according to the score value.

For example, when dance music is played, a user finishes dance work in the music playing process, and scores can be given to the dance training process of the user through comparison of body motion data, so that a user training result can be fed back accurately and quickly; furthermore, during the game, the point of points of the user can be judged through the comparison of the body motion data, so that the points can be calculated quickly.

Of course, in practical applications, besides the above listed scenarios, applications in more scenario modes may also be performed based on the limb motion data, and details are not repeated here.

In order to make the technical solutions of the present application clearer, the following description is made with reference to more embodiments.

In one embodiment, referring to fig. 2, fig. 2 is a schematic structural diagram of a circuit module according to an embodiment, and the circuit module may structurally include a motion capture algorithm processing module and a system motherboard; the motion capture algorithm processing module can be realized based on an independent chip and circuit, and the computing capacity can be improved, high-speed user limb motions can be captured, and user application experience is improved by independently arranging the motion capture algorithm processing module.

In the application process, a camera shoots a real-time motion image of a user and generates a video stream, and the video stream is transmitted to the motion capture algorithm processing module; converting the video stream into frame pictures with a set frame rate (such as not more than 120 frames/s) by a motion capture algorithm processing module, and calculating a motion track of a user from the frame pictures by using a motion capture algorithm to form body motion data of the user; the system mainboard is used as the core of the motion sensing entertainment equipment and is used for outputting and playing audio data, such as music selected by a user; and comparing and analyzing the obtained body action data according to prestored reference action data, and finally generating a voice prompt and outputting the voice prompt to a sound system for playing.

In an embodiment, the motion sensing entertainment device of the present application may further control a data output format of the camera according to an access state of the external display device or a video display state of the user, and the system motherboard notifies the camera to change an output format and a resolution of video acquisition in real time, specifically, the changed output video format is an improved format, and a normal output video format before the change is a conventional format, as shown in fig. 3, where fig. 3 is a control flow chart of the camera output video format, the control scheme is as follows:

and s1, starting the camera application and shooting the video image.

s2, judging whether the external display device is accessed currently and the user video needs to be displayed; if so, s3 is executed, otherwise s4 is executed.

And s3, informing the camera in real time through the network protocol to output the video data in the conventional format.

s4, the camera is informed in real time through the network protocol to change to the output improved format, so that the resolution, encoding and the like of the output video are reduced to only meet the current application function.

And s5, operating the camera application program to output the video data until the camera application program is closed.

In addition, during the output of the video data in the improved format, if the current system is connected to an external display device and a user video needs to be displayed, the camera is informed to output the video data in the conventional format.

For current application functions, including but not limited to tracking user motion trajectory or location functions required in a currently running application, the output video in the improved format is modified as follows:

(1) the video acquisition format is changed into a YUV400 format only with a gray component Y;

(2) the resolution is reduced to only meet the current application function;

(3) the video coding rate is reduced to only meet the current application function.

According to the scheme of the embodiment, when the external display equipment is accessed and the user video needs to be displayed, the camera is informed to output the video data in the conventional format in real time through the network protocol, and when the external display equipment is not accessed or the external display equipment is accessed but the user video does not need to be displayed, the camera is informed to change the output improved format through the network protocol in real time, so that the resolution, the coding and the like of the output video are reduced to only meet the current application function, the video format is intelligently controlled, the data processing amount is reduced, and the bandwidth occupation and the transmission delay are reduced.

With continued reference to fig. 2, as an example, for a sound system, it mainly includes an audio processing circuit and a speaker unit; the loudspeaker unit is arranged on the front surface of the box body; the audio processing circuit is mainly used for receiving playing audio data output by a system mainboard, carrying out sound effect processing, carrying out power amplification on the playing audio data and a voice prompt, and outputting the amplified playing audio data and the voice prompt to the loudspeaker unit for playing.

In the embodiment, the motion capture algorithm processing module is independently arranged to capture high-speed user limb motions, the system main board is matched with the audio processing circuit, the system main board realizes related functions of system control, analysis processing and the like, the audio processing circuit is mainly responsible for processing audio data, and the data processing efficiency and the sound effect processing effect are improved.

The above embodiments set forth the electrical structures of the circuit module and the speaker device, and in order to make the electrical structures of the motion sensing entertainment device of the present application clearer, the following embodiments are further described.

In one embodiment, as described with reference to fig. 4, fig. 4 is an electrical structure diagram of a motion sensing entertainment device of an embodiment; for the audio processing circuit, may include:

a DSP (Digital Signal Processing) chip, a Digital-to-analog conversion chip and a power amplifier module which are connected in sequence; the DSP chip is connected with the system mainboard, and the power amplifier module is connected with the loudspeaker unit.

For the DSP chip, the main function is to carry out sound effect processing on the played audio data output by the system mainboard; the digital-to-analog conversion chip is used for converting the played audio data and the voice prompt into analog signals; and the power amplification module is used for amplifying the power of the played audio data and the voice prompt and then outputting the amplified audio data and the voice prompt to the loudspeaker unit for playing.

Furthermore, the audio processing circuit can also comprise a wireless microphone receiving module connected with the DSP chip, and is used for receiving the voice signal of the wireless microphone and transmitting the voice signal to a system mainboard or the DSP chip.

Specifically, the voice signal of wireless microphone can be directly given DSP chip to handle the back and send to loudspeaker unit and play, also can regard as control signal to input and handle in the system mainboard.

With continued reference to fig. 3, as an embodiment, a video signal interface is further disposed on the system motherboard, and the video signal interface is used for connecting an external display device, such as a television, a projector, and the like. Furthermore, a microphone peripheral interface, an infrared receiving module, a Bluetooth module, a voice recognition module and the like can be further arranged on the system mainboard.

The microphone peripheral interface can be connected with an external microphone, a user can input operation instructions through keys of the microphone, and a system mainboard executes functions corresponding to the operation instructions; for example, the volume of the microphone is increased or decreased through a key on the microphone; increasing or decreasing the volume of the music; cutting songs; the first yeast and the next yeast; original singing and accompanying singing are switched; mute and the like.

The infrared receiving module can receive a control signal of the infrared remote controller; the Bluetooth module can receive a Bluetooth remote controller (such as a wristwatch, a bracelet, a U-section microphone integrating Bluetooth transmission and the like); the voice recognition module may recognize a voice signal input by a user.

For the power supply of the motion sensing entertainment device, as shown in fig. 5, fig. 5 is a schematic structural diagram of a power supply module, and a built-in power supply (battery power supply system) or an external power supply can be adopted. The power module includes: the power supply comprises a switching power supply, a power supply switching circuit, a power supply management chip, an inverter circuit, a power supply detection circuit and an MCU (microprogrammed control unit); the power management chip is connected with the switching power supply and the battery and is connected to the power switching circuit through the inverter circuit; the MCU is connected to a 220V alternating current power supply through the power supply detection circuit and outputs a power supply to the system mainboard.

In the power supply circuit, the power supply switching circuit selects to switch on a switch power supply or a battery to supply power to a system mainboard according to the control of the MCU; the MCU detects whether to access a 220V alternating current power supply through a power supply detection circuit; the power supply management chip can manage the power supply of the battery, and the power supply of the battery is input into the power supply switching circuit after passing through the inverter circuit.

In one embodiment, in order to meet outdoor and mobile use requirements, the power supply scheme can be implemented, when the mobile terminal is started, the MCU detects whether a 220V alternating current power supply is connected or not through the power supply detection circuit, if the 220V alternating current power supply is not connected, the power supply switching circuit is controlled to automatically switch to a mode in which a battery supplies power, at the moment, in order to meet long-time use requirements, the MCU can cut off a Bluetooth module, a power amplifier and an MCU power supply circuit, close power-consuming parts including circuit power supplies related to video, and shield and display output (such as HDMI), WIFI, a camera and other functions; when the MCU detects that the 220V alternating current power supply is accessed, the MCU power supply switching circuit switches to the switching power supply to supply power, and simultaneously the inverter circuit is closed, at the moment, the switching power supply can charge the battery through the power management chip, and controls all the component functions to enter normal work.

In addition, a motion capture peripheral interface can be further arranged on the system mainboard of the motion sensing entertainment equipment and used for being connected with external motion capture equipment, and the motion capture equipment can detect the step motion data of the user and send the step motion data to the system mainboard for use; the motion capture device may be a dance mat, a dance pedal, or the like; for the connection mode, a wired connection mode, such as a USB connection mode, or a wireless connection mode, such as a Bluetooth, WiFi, 2.4G/5.8G connection mode, can be adopted; referring to fig. 6, fig. 6 is a schematic diagram of an external motion capture device connection, where the left diagram is a wired connection and the right diagram is a wireless connection.

It should be noted that the motion sensing entertainment device can be connected with a plurality of motion capture devices, the camera can shoot real-time motion images of a plurality of users at the same time, and the system main board can respectively perform corresponding processing on the real-time motion images of the users; for example, in a game, a plurality of users can play the game at the same time, thereby greatly increasing interactivity and interestingness.

For the use of external motion capture equipment, the system mainboard can receive the step motion data, contrasts and analyzes the limb motion data and the step motion data according to the prestored reference motion data, and generates a voice prompt according to the contrasted and analyzed result and outputs the voice prompt to the sound system for playing.

In the embodiment, the body motion data of the user is captured by the camera, the step motion data of the user is captured by external motion capture equipment, and the motion process of the user is subjected to three-dimensional feedback detection by combining the two data; greatly improve the accuracy of judgment of games and dances and improve the experience of games and dances.

As shown in fig. 6, for example, after a user selects a dance song, the dance is completed on the dance pedal, in the process of dancing, external motion capture equipment can detect the step motion data of the user, meanwhile, the limb motion data of the user can be obtained through camera shooting, and the system mainboard can perform analysis processing according to the two motion data; therefore, the functions of game judgment score, dance score, Taiji error correction and the like can be realized for the limb movement of the user.

In the above embodiment, the motion sensing entertainment device needs to pair one or more cameras and one or more external motion capture devices in a single-machine scene (in this embodiment, a dance pedal is taken as an example); when a somatosensory motion of a user is evaluated, an evaluation system (including motion trail evaluation and motion position evaluation) evaluates one user, and an evaluation result needs to be calculated by combining data collected by a motion capture device corresponding to the user and a corresponding camera, so that the somatosensory entertainment device not only needs to pair the camera and the motion capture device, but also needs to bind the camera and the motion capture device.

In general, if a conventional manual matching manner is adopted, completing pairing and binding work for each device results in a large operation workload of a user, and for facilitating pairing and binding, reference is made to fig. 7 and 8, where fig. 7 is a schematic diagram of a pairing scheme of a single camera, and fig. 8 is a schematic diagram of a pairing scheme of two cameras. When this application is felt entertainment equipment's camera and outside action and is caught equipment and match, adopt following pairing scheme:

(1) the improvement of the body feeling entertainment equipment paired camera and the motion capture equipment uses a paired camera to pair other equipment, and an imaging unique identifier exists in each equipment body;

(2) when the motion sensing entertainment equipment is switched to an automatic pairing mode, the paired cameras can send the collected video data to the motion sensing entertainment equipment, the motion sensing entertainment equipment analyzes and identifies in real time to obtain a unique identifier, and equipment pairing is automatically completed after the unique identifier is successfully identified.

In one embodiment, after the motion sensing entertainment device and the device are paired, the binding between the camera and the motion capture device needs to be completed, and in order to reduce the workload required for binding, the binding scheme may be as follows:

(1) moving the motion capture device to a use position as required by a user;

(2) placing the cameras to positions where the user and the motion capture equipment can be shot, and ensuring that all the motion capture equipment is shot by at least one camera;

(3) the motion sensing entertainment equipment randomly generates a light-on signal;

(4) the motion sensing entertainment equipment controls an unbound motion capture equipment to light up;

(5) the motion sensing entertainment equipment acquires video data through the camera and identifies motion capture equipment of the light-up signal;

(6) the motion sensing entertainment equipment calculates the spatial position of the motion capture equipment and binds the spatial relation between the motion capture equipment and each camera video.

As an embodiment, further, when the camera and the motion capture device are bound, a camera angle problem may occur or an obstacle may block the camera, so that the camera cannot collect a light-on signal of the motion capture device, and the binding fails.

In order to improve the binding accuracy and success rate, referring to fig. 9, fig. 9 is a schematic diagram of a binding scheme between a camera and a motion capture device, where the left side is a binding scheme of a single camera, and the right side is a binding scheme of two cameras, and the binding scheme of the present application may further be as follows:

(1) performing space coordinate modeling on the bound motion capture equipment and the camera;

(2) the method comprises the steps that a bound motion capture device collects signal data (such as 2.4G/5.8G wireless signals) of a motion capture device to be bound and transmits the data to a motion sensing entertainment device;

(3) the motion sensing entertainment equipment converts the distance between the motion capture equipment to be bound and each bound motion capture equipment according to the signal data, and calculates the space coordinate of the motion capture equipment to be bound through trilateral or triangular positioning algorithms and the like;

(4) the motion sensing entertainment equipment calculates the spatial relationship between the motion capture equipment to be bound and each camera video according to the spatial coordinates, and accurately determines the binding relationship between the motion capture equipment and each camera according to the spatial relationship and by combining the video data acquired by the cameras.

The embodiment provides a matching and binding scheme of the motion sensing entertainment equipment, the camera and the motion capture equipment, greatly improves matching and binding efficiency, and improves user experience.

In order to make clearer the structural characteristics of the motion sensing entertainment device of the present application, a hardware structure of the motion sensing entertainment device is described below with reference to several embodiments.

Referring to fig. 10, fig. 10 is an exploded view of a hardware structure of a motion sensing entertainment device of an embodiment; in the embodiment, the front part of the box body of the motion sensing entertainment equipment is provided with a panel with holes; the camera is arranged on any hole position of the panel with the hole, and the high pitch loudspeaker in the loudspeaker unit can also be arranged on the hole position; referring to fig. 11, fig. 11 is a schematic structural view of a panel with holes, on which a plurality of circular holes are arranged, and a camera and a speaker unit (tweeter) can be fitted to any circular hole on the panel; for example, 1-2 cameras can be matched on the circular hole; in addition, combine selecting of loudspeaker unit, 1 ~ 2 tweeters of adaptation on foraminiferous panel, can satisfy different functions, different cost demands, realize the modularization collocation of body feeling amusement equipment.

In the above embodiment, referring to fig. 12, fig. 12 is a schematic imaging diagram of cameras, in which the left side is an imaging diagram of a single camera and the right side is a dual-camera imaging diagram; the video data that single camera was gathered is two-dimensional imaging, because user's actual environment is three-dimensional space, and when single camera and camera were in static, the two-dimensional video data of gathering can lead to the serious loss of one of them dimension data, if compensate through the algorithm, can produce a large amount of calculations, makes system performance decline, leads to unable assurance data processing real-time.

According to the technical scheme, the two or more cameras are arranged, the video data at different angles are obtained from different positions, and then the three-dimensional space data can be efficiently obtained by combining the video data through a relatively simple algorithm, so that the operation time of the system is relatively reduced, the response speed of the system is increased, and the experience effect is further optimized.

With continued reference to fig. 10, which shows a 2.1 channel sound system design, the horn unit includes a woofer, a tweeter, a left channel tweeter, and a tweeter, a phase reversal tube is provided in the back plate of the cabinet; a horn mesh is arranged between the horn unit and the panel with the holes; the pickup microphone and the voice recognition module are arranged at the top of the box body, so that voice signals can be conveniently captured; the infrared receiving module is arranged at the front part of the box body, so that infrared signals can be received conveniently; the power supply and the power amplifier module are arranged on a PCB board card, and a shielding case is arranged between the system mainboard and the power amplifier module to avoid mutual interference; furthermore, the motion capture algorithm processing module can be arranged on the shielding case, and a motion capture peripheral interface, a microphone peripheral interface, an external power supply interface and the like can be arranged at the rear part of the back plate.

For the camera, preferably, the camera is fixed on the perforated panel through a shock absorption structure; for the shock-absorbing structure, may include: the connecting structure comprises a screw, a first soft damping piece, a connecting stud and a second soft damping piece; referring to fig. 13, fig. 13 is a schematic view showing the installation of a shock-absorbing structure of the camera head; the upper view is an exploded view of the entire mounting structure, and the lower view is an exploded view of the first soft cushioning member mounting structure; as shown in the figure, the first soft shock absorbing piece is clamped on a hole position of a PCB of the camera, the connecting stud penetrates through the second soft shock absorbing piece to be fixed on the panel with the hole, and the screw penetrates through the first soft shock absorbing piece to be fixed on the connecting stud.

Furthermore, the perforated panel and the box body can be flexibly connected through a third flexible shock absorbing member, as shown in fig. 14, fig. 14 is a schematic view of the installation of the third flexible shock absorbing member, and as shown in the figure, the third flexible shock absorbing member can be adhered to the box body.

In the above embodiment, because the camera is built-in the audio amplifier, the vibrations of loudspeaker unit during operation can arouse resonance with the box, can arouse the vibrations of camera simultaneously, according to this, has designed the shock-absorbing structure who is connected between camera and the box, and the camera does not have the scheme of direct mount on the box, has reduced the coupling relation between camera and the box from this, has promoted the shooting effect.

The box body design of the motion sensing entertainment equipment can adopt a conventional fixed type foot margin, as shown in fig. 15, fig. 15 is a schematic view of the fixed type foot margin, and in the design of the front foot margin and the rear foot margin, a front foot margin is higher than the rear foot margin, so that an upward tilt angle of 20 degrees can be formed; in practical application, the foot form can be designed according to the requirement, for example, a scheme with an adjustable upward inclination angle is designed.

Further, in order to achieve comprehensive and accurate capturing of motion images of a user by the motion sensing entertainment device, a rotating base can be further arranged below the box body of the motion sensing entertainment device, as shown in fig. 16, fig. 16 is a schematic side view of the rotating base; through electronic rotating base combination lower margin form, body feels amusement equipment can rotate at the certain extent to can be in the use, shoot with control camera tracking user's motion position through rotating the box, realize carrying out location tracking to the user and shoot the function.

In one embodiment, when the user is subjected to positioning tracking shooting, an absolute spatial relationship between a motion track of the user and a real-time motion image can be calculated through a motion capture algorithm processing module, pre-displacement data of the user are predicted according to the absolute spatial relationship, and the pre-displacement data are sent to a system main board; carry out corresponding processing by the system mainboard, according to displacement data output drive signal send to rotating base in advance, drive rotating base rotates to control the camera and track user's motion position, also can guarantee simultaneously that loudspeaker unit points to the user all the time, guaranteed the audio playback effect.

Referring to fig. 17, fig. 17 is a schematic view of a control of a rotating base, an electric part of which includes a rotating electric machine and a motor control circuit board; in the control process, firstly, a camera (a wide-angle camera can be adopted) shoots a real-time video of a user, a video stream is obtained and output to a motion capture algorithm processing module, the independent processing capacity of the motion capture algorithm processing module is utilized, frame rate conversion is firstly carried out on the video stream, a human body skeleton motion track is calculated by utilizing a frame picture, then the absolute spatial relationship between the human body skeleton motion track of the user and a real-time motion image is calculated, so that pre-displacement data of the user is predicted, the pre-displacement data is sent to a system main board, the system main board compiles the pre-displacement data into a driving signal by processing the pre-displacement data, the driving signal is sent to a motor control circuit board, and the motor control circuit board drives a rotating motor to operate, so that the purpose of tracking the motion position of the user is achieved.

In the embodiment, the motion position of the user is tracked, so that the user can be always positioned at the central position of the real-time motion image, the limb motion of the user can be shot better, the situation that the user exceeds the shooting range and cannot capture the motion image in the motion is avoided, the all-dimensional shooting function of the motion sensing entertainment equipment is improved, and the using effect of the motion sensing entertainment equipment is ensured.

In one embodiment, the motion sensing entertainment device can also measure the distance from the user to the motion sensing entertainment device through the camera, and the system mainboard automatically adjusts the volume of the sound system according to the measured distance, for example, the user can always keep a comfortable listening sound pressure of 80-85dBSPL to perform dance, fitness, games and the like through measuring the distance and adjusting the volume.

Referring to fig. 18, fig. 18 is a schematic view of a rotating base structure according to an embodiment, the rotating base including: the device comprises a bottom shell, a rotating motor, a motor control circuit board, a base surface cover, an auxiliary pulley and a motor shaft sleeve; the motor shaft sleeve is fastened with the box body through the base connecting piece, the base connecting piece is connected with the motor shaft sleeve through a buckle, the electric rotating base is connected with the box body into a whole, and the motor control circuit board is connected to the rotating motor through a signal line and a power line and is connected with a system mainboard.

In the control process, the system main board sends a driving signal to the motor control circuit board, and the motor control circuit board drives the rotating motor to rotate after receiving the driving signal, so that the function of tracking the motion position of a user is realized.

As for the turning state of the swivel base, as shown with reference to fig. 19, fig. 19 is a schematic view of the turning state of the swivel base; through camera discernment user movement track, it is rotatory that drive rotating base's motor is not more than 0.1rad/s with angular velocity, automatic tracking user position to guarantee that the user is when apart from product 1.5 meters distance, transversely be less than the central position of the internal picture of the speed of moving of 1 meter/second, in addition, because loudspeaker unit also follows rotating base and tracks user position, thereby guarantee loudspeaker sound production axis and point to the user all the time, let the user obtain the best sound all the time and experience.

In order to improve the audio playing effect of the motion sensing entertainment device, the sound system can be installed in multiple installation forms, and the sound system is explained in multiple installation forms in combination with the embodiment.

In one embodiment, the sound system is designed in mono mode; referring to fig. 20, fig. 20 is a schematic view of a mono installation form of the sound system; the installation that single track satisfies "full frequency loudspeaker unit + passive vibrating diaphragm", "two frequency division loudspeaker unit + passive vibrating diaphragm" and "two frequency division loudspeaker unit + inverted tube" three kinds of forms specifically includes as follows:

(1) the loudspeaker unit comprises a full-frequency loudspeaker, and at least one passive vibrating diaphragm is arranged on the front surface or the back surface of the box body; wherein, the full frequency horn can be 1.5-4 inches, and the number can be 1-4; the passive diaphragms can be 2-5 inches, the number of the passive diaphragms can be 1-2, and the passive diaphragms can be arranged on the front face or the back face of the box body.

(2) The loudspeaker unit comprises a middle-high sound loudspeaker and a middle-low sound loudspeaker, and at least one passive vibrating diaphragm is arranged on the front surface or the back surface of the box body; wherein, the middle and high-sound loudspeaker unit can be 0.75-2 inches; the midbass horn can be 2.5-5 inches; the passive diaphragm can be 2-5 inches and can be arranged on the front or the back of the box body.

(3) The loudspeaker unit comprises a middle-high sound loudspeaker and a middle-low sound loudspeaker, and the back of the box body is provided with an inverter tube; wherein, the middle and high-sound loudspeaker unit can be 0.75-2 inches; the midbass horn can be 2.5-5 inches; the maximum size of the opening of the inverter tube can be 30 mm-100 mm.

In one embodiment, the sound system is designed in a binaural mode; referring to fig. 21, fig. 21 is a schematic view of a two-channel installation of the sound system; the installation of "full loudspeaker unit of dual channel + passive vibrating diaphragm", "two frequency division loudspeaker units of dual channel + inverted phase tube" three kinds of forms is satisfied to the dual channel, specifically includes as follows:

(1) the loudspeaker comprises a dual-channel dual-frequency-division loudspeaker unit and a passive vibrating diaphragm, wherein the loudspeaker unit comprises a left-channel full-frequency loudspeaker and a right-channel full-frequency loudspeaker, and the front side or the back side of a box body is provided with the two passive vibrating diaphragms; wherein, the full frequency loudspeaker of each sound channel can be 1.5-4 inches, the quantity can be 1-4; the passive diaphragms can be 2-5 inches, the number of the passive diaphragms can be 1-2, and the passive diaphragms can be arranged on the front face or the back face of the box body.

(2) The loudspeaker unit comprises a left sound channel middle-high loudspeaker, a left sound channel middle-low loudspeaker, a right sound channel middle-high loudspeaker and a right sound channel middle-low loudspeaker; two passive diaphragms are arranged on the front side or the back side of the box body; the middle and high-sound horn unit of each sound channel can be 0.75-2 inches; the midbass loudspeaker can be 2.5-5 inches, and can be a double-voice-coil midbass loudspeaker (one loudspeaker unit meets the double-sound-channel output); the passive vibrating diaphragm is 2-5 inches and can be arranged on the front side or the back side of the box body.

(3) The loudspeaker unit comprises a left sound channel middle-high sound loudspeaker, a left sound channel middle-low sound loudspeaker, a right sound channel middle-high sound loudspeaker and a right sound channel middle-low sound loudspeaker, and the back of the box body is provided with two phase reversal pipes; wherein, the high-sound horn unit in each sound channel can be 0.75-2 inches; the midbass loudspeaker can be 2.5-5 inches, and can be a double-voice-coil midbass loudspeaker (one loudspeaker unit meets the double-sound-channel output); the maximum size of the opening of the inverter tube can be 30 mm-100 mm.

Based on the above two-channel design scheme, the present application adopts a 2.1 two-channel design, and in one embodiment, the two channels may adopt a full-range speaker unit design, as shown in fig. 22, fig. 22 is a schematic diagram of a 2.1-channel audio system of one embodiment, and a scheme of "2.1 channel + passive diaphragm" (fig. a) or "2.1 channel + inverter tube" (fig. b) is adopted.

In another embodiment, in which two channels may be used in a two-channel design, as shown in fig. 23, fig. 23 is a schematic diagram of a 2.1 channel audio system of another embodiment, using a "2.1 channel + passive diaphragm" (fig. a) or a "2.1 channel + inverter tube" (fig. b) scheme.

The motion sensing entertainment equipment is particularly suitable for dance scenes, different dance styles selected by different users are different, and common dance styles comprise Chinese dance, rock and roll, disco, square dance, hip hop, HI-POP, Taiji and other dance styles; in order to facilitate a user to quickly search for needed dance music, the motion sensing entertainment equipment can be internally provided with a plurality of sound effect modes, so that different song categories are automatically matched with the corresponding sound effect modes.

In the foregoing embodiment, a relevant introduction is made for the system motherboard and the DSP chip to cooperate with each other to implement the required functions, and in order to make clearer the automatic matching of the corresponding sound effect mode functions of the present application, in the following embodiment, description is made in conjunction with the interactive processing of the system motherboard and the DSP chip.

In one embodiment, a system main board acquires playing audio data selected by a user, identifies a music type style to which the playing audio data belongs, and determines a corresponding sound effect mode according to the music type style; acquiring sound effect configuration parameters according to the sound effect mode and sending the sound effect configuration parameters to the DSP chip; and the DSP chip performs corresponding sound effect processing on the played audio data according to the sound effect configuration parameters. For the sound effect configuration parameters, the following can be included: volume adjustment parameters, filter parameters, compression ratio, start/recovery time, etc.

The automatic matching process for the two dance styles "disco" and "tai chi" is described below in connection with a 2.1 binaural sound system as an example:

(1) when a user selects a 'disco' dance style, a system mainboard (for example, through an RS232 communication port) sends sound effect configuration parameters (for example, bass volume is increased by 6dB, 80Hz is increased by 6dB, Q value is 1, the volume of a full-frequency loudspeaker box channel (a left loudspeaker and a right loudspeaker) is attenuated by 1dB, a HISHIFT filter is opened, the frequency of the parameter is 3KHZ, the amplitude of the parameter is 2, the Q value of the parameter is 1, meanwhile, a bass channel amplitude limiter is opened, the parameter is configured to be a threshold value of 3dB, the compression ratio is 10:1, the starting time is 10ms, and the recovery time is 200ms), and the DSP chip carries out corresponding sound effect processing on played music according to the sound effect configuration parameters.

Through the sound effect configuration parameters, the sound effect configuration parameters can be suitable for the characteristics of strong and light dance in disco, 4/4 beats without being weighted and sounding like a metronome, and simple lyrics and tunes, so that the dance style can be automatically matched, and a user can obtain better application experience.

(2) When a user selects the category of the 'Taiji' style songs, the system mainboard sends sound effect configuration parameters to the DSP chip (for example, a high-pass filter is turned on, the frequency is set to be 80Hz, the order is two, the volume of a bass channel is attenuated by 3dB, the frequency of a bass channel low-pass filter is changed from default 120Hz to 500Hz, an EQ frequency point parameter is turned on for a full-frequency sound box channel (a left loudspeaker and a right loudspeaker), the frequency is set to be 250HZ, the amplitude of the Q value is +3dB, a second EQ frequency point is turned on, the parameter is set to be 600Hz, the amplitude of the Q value is 0.5dB and is +2dB), a third EQ frequency point is turned on, the parameter is set to be 6.3KHz, and the amplitude of the Q value is 1 and is +3 dB.

Through the configuration parameters of the loudspeaker box, the music box can adapt to the characteristics of Taiji style songs, and the motion sensing entertainment equipment can send full, pleasant, clear and transparent Taiji music, so that a user can obtain better application experience.

In another embodiment, the motion sensing entertainment device can also be provided with a karaoke mode automatic matching scheme, when the system mainboard detects that the microphone is turned on, the system mainboard automatically switches to the karaoke mode, sends a sound effect configuration file to the DSP chip, turns on a microphone channel switch in the DSP chip and turns on a reverberation effect. Meanwhile, the system motherboard may also receive control information sent by the microphone and perform corresponding operations, for example: the user can make a voice song request through the microphone.

For example: the user can realize the fast song-selecting operation by the keys on the microphone of the user, and can also realize the volume increase and decrease of the microphone by the keys on the microphone; increasing or decreasing the volume of the music; cutting songs; the first yeast and the next yeast; original singing and accompanying singing are switched; mute, etc.

When the microphone function is used, the microphone function can be used after the wireless microphone receiving modules are paired; meanwhile, as shown in fig. 24, fig. 24 is a schematic diagram of an external microphone, and the motion sensing entertainment device may also be externally connected with an extended wired or wireless microphone system through a configured general-purpose interface (such as a USB interface) with an audio input function.

According to the somatosensory entertainment equipment, a single camera or a plurality of cameras can be arranged, and the recognition rate is improved through cooperation of the plurality of cameras; meanwhile, the motion sensing entertainment equipment can also support linkage and cooperation of multiple equipment and multiple cameras, and by combining the connected external motion capture equipment, accurate identification of multiple users in a scene is captured in an all-round mode, meanwhile, multiple sound boxes form full-scene immersive sound listening feelings, and more shocking sound experience is brought to the users.

Referring to fig. 25, fig. 25 is a schematic view of a multi-person application scenario of a single motion-sensing entertainment device; in the figure, each somatosensory entertainment device is provided with one camera or a plurality of cameras, a plurality of persons use the somatosensory entertainment device to conduct somatosensory entertainment sports at the same time, and the somatosensory entertainment device can be interconnected with motion capturing devices of the plurality of persons, so that the somatosensory entertainment sports are conducted.

Referring to fig. 26, fig. 26 is a schematic view of a multi-person application scenario of a plurality of motion sensing entertainment devices; each body feeling entertainment device in the figure can be provided with one camera or a plurality of cameras, a plurality of persons can use the body feeling entertainment devices to conduct body feeling entertainment sports, and each body feeling entertainment device can be interconnected with the action capturing devices of the persons, so that the body feeling entertainment sports are conducted.

By integrating the embodiments, the motion sensing entertainment equipment provided by the application is an integrated intelligent equipment integrating a sound system (a loudspeaker unit, a power amplifier module, a digital-to-analog conversion module and the like), a system mainboard, a camera, an action capture algorithm processing module, a voice recognition module and the like, and a user can finish high-speed movement AI judgment games, fitness training, dance guidance and the like by using the equipment, so that excellent application experience can be provided for the user in entertainment activities.

The foregoing is only a partial embodiment of the present application, and it should be noted that, for those skilled in the art, several modifications and decorations can be made without departing from the principle of the present application, and these modifications and decorations should also be regarded as the protection scope of the present application.

Claims

1. A motion-sensing entertainment device, comprising: the system comprises a sound system, at least one camera and a circuit module; the camera is arranged on a box body of the motion sensing entertainment equipment and is connected with the circuit module;

2. The motion-sensing entertainment device of claim 1, wherein the circuit module comprises a motion capture algorithm processing module and a system motherboard;

3. The motion-sensing entertainment device according to claim 1 or 2, wherein the comparative analysis of the limb motion data according to pre-stored reference motion data comprises:

4. The motion-sensing entertainment device according to claim 1 or 2, wherein said camera is further configured to receive a notification message sent by said system motherboard via a network protocol, and convert an output video format of said camera into an improved format when said real-time motion image does not need to be displayed;

5. The motion-sensing entertainment device of claim 2, wherein the sound system comprises an audio processing circuit and a speaker unit; the loudspeaker unit is arranged on the front surface of the box body;

6. The motion-sensing entertainment device of claim 5, wherein the audio processing circuit comprises: the digital signal processor comprises a DSP chip, a digital-to-analog conversion chip and a power amplifier module which are connected in sequence; the DSP chip is connected with the system mainboard, and the power amplifier module is connected with the loudspeaker unit;

7. The motion-sensing entertainment device according to claim 6, wherein said audio processing circuit further comprises a wireless microphone receiving module connected to said DSP chip for receiving a voice signal of a wireless microphone and transmitting said voice signal to a system board or to said DSP chip.

8. The motion-sensing entertainment device according to claim 6, wherein the system motherboard is further configured to obtain playing audio data selected by a user, identify a music category style to which the playing audio data belongs, and determine a corresponding sound effect mode according to the music category style; acquiring sound effect configuration parameters according to the sound effect mode and sending the sound effect configuration parameters to the DSP chip;

9. The motion-sensing entertainment device of claim 8, wherein the audio-effect configuration parameters comprise: one or more of volume adjustment parameters, filter parameters, compression ratio, start/recovery time.

10. The motion-sensing entertainment device of claim 7, wherein the system motherboard is further configured to switch to karaoke mode when the microphone is turned on, sending a sound effect configuration file to the DSP chip; receiving voice information input by a microphone, performing semantic analysis on the voice information, and executing corresponding instruction operation;

11. The motion-sensing entertainment device according to claim 2, wherein the system motherboard further comprises a motion-sensing peripheral interface for connecting to an external motion-sensing device; the motion capture equipment is used for detecting the step motion data of a user and sending the step motion data to the system mainboard;

12. The motion-sensing entertainment device of claim 11, wherein the system motherboard is further configured to randomly generate a light-up signal to control an unbound motion capture device to light up; the action capturing equipment is used for controlling the camera to collect video data and identifying the light-up signal; calculating the spatial position of the motion capture equipment, and binding the spatial relation between the motion capture equipment and each camera video;

13. The motion-sensing entertainment device of claim 12, wherein the system motherboard is further configured to model spatial coordinates of the bound motion capture device and camera; receiving signal data of a bound motion capture device and collecting motion capture devices to be bound; converting the distance between the motion capture equipment to be bound and each bound motion capture equipment according to the signal data, and calculating the space coordinate of the motion capture equipment to be bound through trilateral or triangular positioning algorithms and the like; and according to the spatial coordinates, calculating the spatial relationship between the motion capture equipment to be bound and the videos of the cameras, and determining the binding relationship between the motion capture equipment and the cameras according to the spatial relationship and by combining the video data acquired by the cameras.

14. The motion-sensing entertainment device according to claim 2, wherein a video signal interface is further provided on the system motherboard for connecting to an external display device;

or

The system mainboard is also connected with an infrared receiving module and used for receiving a control signal of an infrared remote controller;

or

15. The motion-sensing entertainment device of claim 2, wherein the system motherboard is further coupled to a power module, the power module comprising: the power supply comprises a switching power supply, a power supply switching circuit, a power supply management chip, an inverter circuit, a power supply detection circuit and an MCU (microprogrammed control unit);

16. The motion sensing entertainment device of claim 2, wherein a rotating base is disposed at a bottom of the box for rotating the box to control the camera to track a moving position of a user for shooting.

17. The motion-sensing entertainment device of claim 12, wherein the motion capture algorithm processing module is further configured to calculate an absolute spatial relationship between the motion trajectory of the user and the real-time motion image, predict pre-displacement data of the user according to the absolute spatial relationship, and send the pre-displacement data to the system motherboard;

18. The motion-sensing entertainment device of claim 17, wherein the rotating base comprises: the device comprises a bottom shell, a rotating motor, a motor control circuit board, a base surface cover, an auxiliary pulley and a motor shaft sleeve;

19. The motion-sensing entertainment device according to claim 1, wherein a perforated panel is provided in a front portion of the case; wherein, the camera is installed on any hole site of foraminiferous panel.

20. The motion-sensing entertainment device of claim 19, wherein the camera is secured to the perforated panel by a shock absorbing structure.

21. The motion-sensing entertainment device of claim 20, wherein the shock absorbing structure comprises: the connecting structure comprises a screw, a first soft damping piece, a connecting stud and a second soft damping piece;

22. The motion-sensing entertainment device of claim 20, wherein the perforated panel is affixed to a front portion of the housing, and wherein the perforated panel is flexibly coupled to the housing by a third flexible shock absorbing member.

23. The motion-sensing entertainment device of claim 4, wherein the sound system is in mono mode, wherein

or

24. The motion-sensing entertainment device of claim 4, wherein the sound system is in a binaural mode, wherein

or

25. The motion-sensing entertainment device of claim 24, wherein the sound system is in a 2.1 channel mode; wherein

or