CN108961865A - A kind of naked eye 3D interaction training system and method for frame drum - Google Patents
A kind of naked eye 3D interaction training system and method for frame drum Download PDFInfo
- Publication number
- CN108961865A CN108961865A CN201810879892.5A CN201810879892A CN108961865A CN 108961865 A CN108961865 A CN 108961865A CN 201810879892 A CN201810879892 A CN 201810879892A CN 108961865 A CN108961865 A CN 108961865A
- Authority
- CN
- China
- Prior art keywords
- training
- cloud
- management platform
- displaying
- frame drum
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B5/00—Electrically-operated educational appliances
- G09B5/06—Electrically-operated educational appliances with both visual and audible presentation of the material to be studied
- G09B5/065—Combinations of audio and video presentations, e.g. videotapes, videodiscs, television systems
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B15/00—Teaching music
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B5/00—Electrically-operated educational appliances
- G09B5/08—Electrically-operated educational appliances providing for individual presentation of information to a plurality of student stations
Abstract
The present invention relates to Three-dimensional Display field, especially a kind of naked eye 3D for frame drum interacts training system and method.The naked eye 3D interaction training system for frame drum includes that at least one trains mutual subsystem, at least one displaying study subsystem and cloud management platform；The mutual subsystem of training is connect with cloud management Platform communication, and the displaying study subsystem is connect with cloud management Platform communication.The present invention overcomes the deficiencies in the prior art, remote teaching may be implemented, reduce the time of having a rest for occupying child as far as possible, child is allowed to learn frame drum with being in 3 D stereo, and interact by communication between child and teacher, allow child its more fully grasp main points that frame drum taps.
Description
Technical field
The present invention relates to Three-dimensional Display field, especially a kind of naked eye 3D for frame drum interacts training system and side
Method.
Background technique
With the increasingly raising of people's living standard, music becomes important composition indispensable in our daily lifes
Part, and be directed to for numerous teenagers, pop music is their favorite；And be directed to for numerous parents, allow them
Child's learning music for can for after employment another option be provided, can also mould the sentiment of child.In view of
This, people are more and more burning hoter to the study of musical instrument at present, and frame drum is wherein important component part, and child is in study frame drum
When, the correlated curriculum of frame drum in the training school or mechanism of profession can only be got at mostly, but so can be occupied significantly
Child is few in number to be in the time, and also less safe on the road of training structure back and forth, and masses' teaching can not be to abundant
Student must be helped effectively to grasp the main points of frame drum percussion.
Summary of the invention
For the defects in the prior art, the present invention provides a kind of for the naked eye 3D interaction training system of frame drum and side
Method overcomes the deficiencies in the prior art, and remote teaching may be implemented, and child is allowed more fully to grasp wanting for frame drum percussion
Neck.
To achieve the goals above, in a first aspect, a kind of naked eye 3D for frame drum provided by the invention interacts training
System includes that at least one trains mutual subsystem, at least one displaying study subsystem and cloud management platform；The training
Mutual subsystem is connect with cloud management Platform communication, and the displaying study subsystem and the cloud manage Platform communication
Connection.
Second aspect, a kind of naked eye 3D interaction training system for frame drum provided by the invention includes training mutual mover
System shows that study subsystem and cloud manage platform, cloud management platform respectively with the mutual subsystem of the training and
The displaying study subsystem communication connection；The mutual subsystem of training includes that the first interactive device and first show device,
The displaying study subsystem includes the second interactive device and second shows device, and described includes that the first interactive device passes through wirelessly
Network is connect with cloud management Platform communication, and described first shows that device manages platform by wireless network and the cloud
Communication connection, second interactive device manage Platform communication with the cloud by wireless network and connect, and described second shows
Device manages Platform communication with the cloud by wireless network and connect；First interactive device obtains lecturer and utilizes frame drum
The training information is sent to cloud management platform, the cloud by training information when being played, first interactive device
The training information is distributed to the second displaying device by end pipe platform, and described second shows that device carries out the training information
3D shows that the second displaying device includes projector and projection display screen, and the projector passes through wireless network and the cloud
The communication connection of end pipe platform, the projection display screen is set to the light end out of the projector, and the projector is all
Output light is distributed on the projection display screen, and the projector receives the picture signal of cloud management platform output and will
Described image signal is denoised, is amplified, and then drives the directive property light source built in it to issue directive property light, and pass through display
It is projected by projection lens to the separate projector side of the projection display screen, is provided on the projection display screen more after chip
A pixel array, the pixel of the projection display screen is corresponding with the sub-pix of each multi-view image in the directive property light, uses
It is formed on the front space of the projection display screen after incident multi-view image signal to be carried out to Spatial transmission and assembles view
Point obtains stereo-picture and carries out 3D displaying；Second interactive device obtains the interactive information of student and believes the interaction
Breath is sent to cloud management platform, and the interactive information is transmitted to the first displaying device by the cloud management platform.
As a kind of preferred embodiment of the application, first interactive device includes loudspeaker, microphone and depth
Video camera.
As a kind of preferred embodiment of the application, described first shows that device includes mobile phone.
As a kind of preferred embodiment of the application, second interactive device includes loudspeaker, microphone and camera shooting
Head.
As a kind of preferred embodiment of the application, the directive property light source be include R, G, B three-color light source.
As a kind of preferred embodiment of the application, the display chip includes dmd chip.
As a kind of preferred embodiment of the application, the single pixel in the pixel array is nanometer diffraction grating.
The third aspect, a kind of naked eye 3D interaction Training Methodology for frame drum provided by the invention are described to be directed to shelf
Bulging naked eye 3D interacts Training Methodology, and the naked eye 3D suitable for being directed to frame drum described in second aspect of the present invention interacts training
System, the naked eye 3D interaction training system for frame drum include training mutual subsystem, showing study subsystem and cloud
End pipe platform, the cloud management platform connect with the mutual subsystem of the training and displaying study subsystem communication respectively
It connects；The mutual subsystem of the training includes the first interactive device and first shows device, and the displayings study subsystem includes the
Two interactive devices and second show device, and described includes that the first interactive device is logical by wireless network and cloud management platform
Letter connection, the first displaying device manage Platform communication with the cloud by wireless network and connect, the second interaction dress
It sets and is connect by wireless network with cloud management Platform communication, described second shows that device passes through wireless network and the cloud
The communication connection of end pipe platform, which comprises the steps of:
First interactive device obtains training information when lecturer is played using frame drum, the first interaction dress
It sets and the training information is sent to cloud management platform；
The training information is distributed to the second displaying device by the cloud management platform, and described second shows device to institute
It states training information and carries out 3D displaying；Described second shows that device includes projector and projection display screen, and the projector passes through nothing
Gauze network is connect with cloud management Platform communication, and the projection display screen is set to the light end, and institute out of the projector
All output lights for stating projector are distributed on the projection display screen, and the projector receives cloud management platform output
Picture signal and described image signal is denoised, is amplified, then drive directive property light source built in it to issue directive property
Light, and by being projected by projection lens to the separate projector side of the projection display screen, the projection after display chip
Multiple pixel arrays are provided on display screen, each multi-view image in the pixel of the projection display screen and the directive property light
Sub-pix is corresponding, for will be incident multi-view image signal carry out it is empty in the front of the projection display screen after Spatial transmission
Between upper formed assemble viewpoint, obtain stereo-picture and simultaneously carry out 3D displaying；
Second interactive device obtains the interactive information of student and the interactive information is sent to cloud management platform,
The interactive information is transmitted to the first displaying device by the cloud management platform.
The beneficial effects of the present invention are: remote teaching may be implemented, as far as possible the present invention overcomes the deficiencies in the prior art
The time of having a rest for occupying child is reduced, allows child to learn frame drum with being in 3 D stereo, and by between child and teacher
Communication interaction, allow child its more fully grasps frame drum tap main points.
Detailed description of the invention
Fig. 1 is the block diagram that first embodiment of the invention interacts training system for the naked eye 3D of frame drum；
Fig. 2 is the block diagram that second embodiment of the invention interacts training system for the naked eye 3D of frame drum；
Fig. 3 is the schematic diagram for the second displaying device that the present invention second is implemented；
Fig. 4 is the flow chart that third embodiment of the invention interacts Training Methodology for the naked eye 3D of frame drum.
Specific embodiment
Specific embodiments of the present invention are described more fully below, it should be noted that the embodiments described herein is served only for illustrating
Illustrate, is not intended to restrict the invention.In the following description, in order to provide a thorough understanding of the present invention, a large amount of spies are elaborated
Determine details.It will be apparent, however, to one skilled in the art that: this hair need not be carried out using these specific details
It is bright.In other instances, in order to avoid obscuring the present invention, well known circuit, software or method are not specifically described.
Throughout the specification, meaning is referred to " one embodiment ", " embodiment ", " example " or " example "
: a particular feature, structure, or characteristic described in conjunction with this embodiment or example is comprised at least one embodiment of the invention.
Therefore, the phrase " in one embodiment ", " in embodiment ", " example " occurred in each place of the whole instruction
Or " example " is not necessarily all referring to the same embodiment or example.Furthermore, it is possible in any suitable combination and or sub-portfolio will be specific
Feature, structure or characteristic combine in one or more embodiment or examples.In addition, those of ordinary skill in the art should manage
Solution, diagram is provided to the purpose of explanation provided herein, and diagram is not necessarily drawn to scale.
As shown in Figure 1, interacting training system for the naked eye 3D of frame drum shown in the first embodiment of the present invention
Mutual subsystem 100, at least one displaying study subsystem 300 and cloud, which are trained, including at least one manages platform 200；It is described
It trains mutual subsystem 100 to communicate to connect with cloud management platform 200, the displaying study subsystem 300 and the cloud
End pipe platform 200 communicates to connect.
The present embodiment overcomes the deficiencies in the prior art, and remote teaching may be implemented, reduce occupy stopping for child as far as possible
The time is ceased, child is allowed to learn frame drum with being in 3 D stereo, and is interacted by the communication between child and teacher, allows child
Its main points for more fully grasping frame drum percussion.
As shown in Fig. 2, training system is interacted for the naked eye 3D of frame drum shown in the second embodiment of the present invention,
Including training mutual subsystem, showing study subsystem and cloud manages platform, the cloud management platform respectively with the training
Mutual subsystem is instructed to connect with displaying study subsystem communication；The mutual subsystem of the training include the first interactive device and
First shows that device, the displaying study subsystem include that the second interactive device and second show device, and described includes the first friendship
Mutual device manages Platform communication with the cloud by wireless network and connect, and described first shows that device passes through wireless network and institute
Cloud management Platform communication connection is stated, second interactive device manages Platform communication by wireless network and the cloud and connects
It connects, the second displaying device manages Platform communication with the cloud by wireless network and connect；First interactive device obtains
The training information is sent to cloud by training information when lecturer being taken to play using frame drum, first interactive device
Platform is managed, the training information is distributed to the second displaying device by the cloud management platform, and described second shows device pair
The training information carries out 3D displaying.
As shown in figure 3, described second shows that device includes projector 1 and projection display screen 2, the projector 1 passes through nothing
Gauze network is connect with cloud management Platform communication, and the projection display screen 2 is set to the light end out of the projector 1, and
All output lights of the projector 1 are distributed on the projection display screen 2, and it is defeated that the projector 1 receives flexible wire
Described image signal is simultaneously denoised, is amplified by picture signal out, is then driven the directive property light source built in it to issue and is directed toward
Property light, and by being projected by projection lens to 1 side of separate projector of the projection display screen 2 after display chip, it is described
Multiple pixel arrays, each visual angle in the pixel of the projection display screen 2 and the directive property light are provided on projection display screen 2
The sub-pix of image is corresponding, for carrying out after Spatial transmission incident multi-view image signal in the projection display screen 2
Front, which is spatially formed, assembles viewpoint, obtains stereo-picture and carries out 3D displaying；Second interactive device obtains student's
The interactive information is simultaneously sent to cloud management platform by interactive information, and the cloud management platform forwards the interactive information
Device is shown to first.
In the present embodiment, first interactive device includes loudspeaker, microphone and depth camera.Further, institute
Stating the first interactive device and can be configured with network module described in network module includes but is not limited to GSM network module, the depth
Degree video camera and microphone are to acquire the action message and voice messaging that tap frame drum when teacher's teaching, the action message
Cloud can be given to manage platform with remote transmission using the GSM network module with voice messaging, cloud management platform according to
The action message obtains velocity information when teacher taps frame drum by transformation matrix and taps the position of frame drum drum surface
Confidence breath, the velocity information and the location information are sent to the second displaying device by the cloud management platform, and are led to
It crosses the second displaying device to show the velocity information and the location information, when student passes through the second interactive device
When statement into question, the query that the loudspeaker plays student facilitates teacher to answer.
Wherein, when the cloud management platform obtains teacher's percussion frame drum by transformation matrix according to the action message
Velocity information specifically include: using the algorithm based on computer vision ranging principle to depth camera different moments collect
The action message arrived carries out relative position estimation, it is therefore an objective to convert world coordinate system for the point under depth camera coordinate system
Under, to obtain the three-dimensional coordinate of each position in three-dimensional environment.Further, for the point under depth camera, pass through
Its position (u, v) in two dimensional image and its depth information d are obtained, so the pixel coordinate [u, v, d] of each point.?
In depth camera, the pixel coordinate of point is converted to the three-dimensional coordinate [x, y, z] of depth camera coordinate system, column specific as follows
Shown in formula:
X=(u-cx)×zlfx,
Y=(v-cy)×fy,
Z=dls.
Next the three-dimensional coordinate [x, y, z] under depth camera coordinate system is converted into world coordinate system with translation matrix
Under three-dimensional coordinate [x1,y1,z1], shown in column formula specific as follows:
Show that the three-dimensional coordinate [x_r, y_r, z_r] under frame drum coordinate system indicates by transformation matrix, it is specific as follows
Shown in column formula:
In the present embodiment, described first shows that device includes mobile phone.Specifically, when student needs to interact with teacher
When, it only need to include but is not limited to text, picture and voice by the second interactive device edition and interaction information, the interactive information,
The interactive information is sent to cloud management platform by second interactive device after the completion of editor, and the cloud manages platform
First interactive device is transmitted to after storing to the information, the mobile phone is on its mobile phone display screen to picture and text
Word is shown, and is broadcasted using the loudspeaker in built in mobile phone or the first interactive device to voice messaging.
In the present embodiment, second interactive device includes loudspeaker, microphone and camera.
It, can also be with microphone typing voice messaging, the rear second interaction dress when student needs to interact with teacher
It sets and the voice messaging is sent to cloud management platform, the cloud management platform is transmitted to after storing to the information
The mobile phone, the mobile phone show picture and text on its mobile phone display screen, and utilize in the first interactive device
Loudspeaker voice messaging is broadcasted.Similarly the loudspeaker in second interactive device can be used to play saying for teacher
The relevant voice messaging of class, the camera is for obtaining the grasp journey that the picture of student facilitates teacher to judge student to frame drum
Degree.
In the present embodiment, the cloud management platform includes but is not limited to server or server cluster, the server
User store academics and students' dealing communication various data, using the cloud management platform can to entire training process into
Row monitoring, convenient subsequent retrospect.
In the present embodiment, the directive property light source be include R, G, B three-color light source.
R, G, B three-color light source is used to can guarantee in the image information of stereoscopic display as color image, fidelity is high, more has
The gimmick of the percussion frame drum of teacher is accurately watched conducive to student.
In the present embodiment, the display chip includes dmd chip.
800,000 to 1,000,000 face small mirrors are arranged on the dmd chip close and numerously, and each small mirror is ok
10 degree are flipped independently in positive and negative directions, and can be with overturning each second 65000 times.Light source passes through these primary reflecting mirrors to projection screen
Image is directly formed on curtain, optical path is also comparatively simple, and volume is smaller.
In the present embodiment, the single pixel in the pixel array is nanometer diffraction grating.
Wherein nanometer diffraction grating pixel can be using ultraviolet continuous emptying frequency photoetching technique and nano impression system
Make.It should be pointed out that in the present embodiment, can be produced using photolithography method in projection display screen surface etch each
The nanometer grating being differently directed, then the template that can be used in coining is made, nanometer light is then imprinted out by nano impression batch
The pixel array of the composition of grid, wherein it is real can to plate metal in transmissive type projection display screen surface for reflective projection display screen
It is existing.
As shown in figure 4, Training Methodology is interacted for the naked eye 3D of frame drum shown in the third embodiment of the present invention,
Training Methodology is interacted for the naked eye 3D of frame drum described in needle, suitable for being directed to frame drum described in second embodiment of the invention
Naked eye 3D interact training system, the naked eye 3D interaction training system for frame drum includes the mutual subsystem of training, exhibition
Dendrography practises subsystem and cloud and manages platform, the cloud management platform respectively with the mutual subsystem of the training and the displaying
Learn subsystem communication connection；The mutual subsystem of training includes that the first interactive device and first show device, the displaying
Learning subsystem includes that the second interactive device and second show device, and described includes that the first interactive device passes through wireless network and institute
Cloud management Platform communication connection is stated, described first shows that device manages Platform communication by wireless network and the cloud and connects
It connects, second interactive device manages Platform communication with the cloud by wireless network and connect, and described second shows that device is logical
It crosses wireless network to connect with cloud management Platform communication, the naked eye 3D interaction Training Methodology for frame drum includes such as
Lower step:
S1, the first interactive device obtain training information when lecturer is played using frame drum, the first interaction dress
It sets and the training information is sent to cloud management platform.
S2, cloud manage platform and the training information are distributed to the second displaying device, and described second shows device to institute
It states training information and carries out 3D displaying.
The second displaying device includes projector and projection display screen, and the projector passes through wireless network and the cloud
The communication connection of end pipe platform, the projection display screen is set to the light end out of the projector, and the projector is all
Output light is distributed on the projection display screen, and the projector receives the picture signal of cloud management platform output and will
Described image signal is denoised, is amplified, and then drives the directive property light source built in it to issue directive property light, and pass through display
It is projected by projection lens to the separate projector side of the projection display screen, is provided on the projection display screen more after chip
A pixel array, the pixel of the projection display screen is corresponding with the sub-pix of each multi-view image in the directive property light, uses
It is formed on the front space of the projection display screen after incident multi-view image signal to be carried out to Spatial transmission and assembles view
Point obtains stereo-picture and carries out 3D displaying；
S3, the second interactive device obtain the interactive information of student and the interactive information are sent to cloud management platform,
The interactive information is transmitted to the first displaying device by the cloud management platform.
In the present embodiment, first interactive device includes loudspeaker, microphone and depth camera.Further, institute
Stating the first interactive device and can be configured with network module described in network module includes but is not limited to GSM network module, the depth
Degree video camera and microphone are to acquire the action message and voice messaging that tap frame drum when teacher's teaching, the action message
Cloud can be given to manage platform with remote transmission using the GSM network module with voice messaging, cloud management platform according to
The action message obtains velocity information when teacher taps frame drum by transformation matrix and taps the position of frame drum drum surface
Confidence breath, the velocity information and the location information are sent to the second displaying device by the cloud management platform, and are led to
It crosses the second displaying device to show the velocity information and the location information, when student passes through the second interactive device
When statement into question, the query that the loudspeaker plays student facilitates teacher to answer.
Wherein, when the cloud management platform obtains teacher's percussion frame drum by transformation matrix according to the action message
Velocity information specifically include: using the algorithm based on computer vision ranging principle to depth camera different moments collect
The action message arrived carries out relative position estimation, it is therefore an objective to convert world coordinate system for the point under depth camera coordinate system
Under, to obtain the three-dimensional coordinate of each position in three-dimensional environment.Further, for the point under depth camera, pass through
Its position (u, v) in two dimensional image and its depth information d are obtained, so the pixel coordinate [u, v, d] of each point.?
In depth camera, the pixel coordinate of point is converted to the three-dimensional coordinate [x, y, z] of depth camera coordinate system, column specific as follows
Shown in formula:
X=(u-cx)×zlfx,
Y=(v-cy)×fy,
Z=dls.
Next the three-dimensional coordinate [x, y, z] under depth camera coordinate system is converted into world coordinate system with translation matrix
Under three-dimensional coordinate [x1,y1,z1], shown in column formula specific as follows:
Show that the three-dimensional coordinate [x_r, y_r, z_r] under frame drum coordinate system indicates by transformation matrix, it is specific as follows
Shown in column formula:
In the present embodiment, described first shows that device includes mobile phone.Specifically, when student needs to interact with teacher
When, it only need to include but is not limited to text, picture and voice by the second interactive device edition and interaction information, the interactive information,
The interactive information is sent to cloud management platform by second interactive device after the completion of editor, and the cloud manages platform
First interactive device is transmitted to after storing to the information, the mobile phone is on its mobile phone display screen to picture and text
Word is shown, and is broadcasted using the loudspeaker in built in mobile phone or the first interactive device to voice messaging.
In the present embodiment, second interactive device includes loudspeaker, microphone and camera.
It, can also be with microphone typing voice messaging, the rear second interaction dress when student needs to interact with teacher
It sets and the voice messaging is sent to cloud management platform, the cloud management platform is transmitted to after storing to the information
The mobile phone, the mobile phone show picture and text on its mobile phone display screen, and utilize in the first interactive device
Loudspeaker voice messaging is broadcasted.Similarly the loudspeaker in second interactive device can be used to play saying for teacher
The relevant voice messaging of class, the camera is for obtaining the grasp journey that the picture of student facilitates teacher to judge student to frame drum
Degree.
In the present embodiment, the directive property light source be include R, G, B three-color light source.
R, G, B three-color light source is used to can guarantee in the image information of stereoscopic display as color image, fidelity is high, more has
The gimmick of the percussion frame drum of teacher is accurately watched conducive to student.
In the present embodiment, the display chip includes dmd chip.
800,000 to 1,000,000 face small mirrors are arranged on the dmd chip close and numerously, and each small mirror is ok
10 degree are flipped independently in positive and negative directions, and can be with overturning each second 65000 times.Light source passes through these primary reflecting mirrors to projection screen
Image is directly formed on curtain, optical path is also comparatively simple, and volume is smaller.
In the present embodiment, the single pixel in the pixel array is nanometer diffraction grating.
Wherein nanometer diffraction grating pixel can be using ultraviolet continuous emptying frequency photoetching technique and nano impression system
Make.It should be pointed out that in the present embodiment, can be produced using photolithography method in projection display screen surface etch each
The nanometer grating being differently directed, then the template that can be used in coining is made, nanometer light is then imprinted out by nano impression batch
The pixel array of the composition of grid, wherein it is real can to plate metal in transmissive type projection display screen surface for reflective projection display screen
It is existing.
It needs to be illustrated, the tool of the unmentioned naked eye 3D interaction training system for frame drum in the present embodiment
Body composition and its advantages, and substantially similar described in first or second embodiments of the invention, details are not described herein.
Finally, it should be noted that the above embodiments are only used to illustrate the technical solution of the present invention., rather than its limitations；To the greatest extent
Pipe present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that: its according to
So be possible to modify the technical solutions described in the foregoing embodiments, or to some or all of the technical features into
Row equivalent replacement；And these are modified or replaceed, various embodiments of the present invention technology that it does not separate the essence of the corresponding technical solution
The range of scheme should all cover within the scope of the claims and the description of the invention.
Claims (9)
1. a kind of naked eye 3D for frame drum interacts training system, it is characterised in that: train interaction subsystem including at least one
System, at least one displaying study subsystem and cloud manage platform；The mutual subsystem of training and the cloud manage platform
Communication connection, the displaying study subsystem are connect with cloud management Platform communication.
2. a kind of naked eye 3D for frame drum interacts training system, it is characterised in that: including training mutual subsystem, showing and learn
It practises subsystem and cloud manages platform, the cloud management platform learns with the mutual subsystem of the training and the displaying respectively
Subsystem communication connection；The mutual subsystem of training includes the first interactive device and first shows device, the displaying study
Subsystem includes the second interactive device and second shows device, and described includes that the first interactive device passes through wireless network and the cloud
The communication connection of end pipe platform, the first displaying device manage Platform communication with the cloud by wireless network and connect, institute
It states the second interactive device and is connect by wireless network with cloud management Platform communication, described second shows that device passes through wirelessly
Network is connect with cloud management Platform communication；First interactive device obtains when lecturer is played using frame drum
The training information is sent to cloud management platform by training information, first interactive device, and the cloud management platform will
The training information distributes to the second displaying device, and described second shows that device carries out 3D displaying to the training information, described
Second displaying device includes projector and projection display screen, and the projector manages platform by wireless network and the cloud and leads to
Letter connection, the projection display screen is set to the light end out of the projector, and all output lights of the projector are divided equally
On the projection display screen, the projector receives the picture signal of cloud management platform output and by described image signal cloth
Denoised, amplified, directive property light source built in it is then driven to issue directive property light, and by after display chip by projecting
Camera lens is projected to the separate projector side of the projection display screen, is provided with multiple pixel arrays on the projection display screen,
The pixel of the projection display screen is corresponding with the sub-pix of each multi-view image in the directive property light, for by incident view
Angle picture signal forms convergence viewpoint after carrying out Spatial transmission on the front space of the projection display screen, obtains perspective view
Picture simultaneously carries out 3D displaying；Second interactive device obtains the interactive information of student and the interactive information is sent to cloud pipe
The interactive information is transmitted to the first displaying device by platform, the cloud management platform.
3. the naked eye 3D according to claim 2 for frame drum interacts training system, it is characterised in that: described first hands over
Mutual device includes loudspeaker, microphone and depth camera.
4. the naked eye 3D according to claim 2 for frame drum interacts training system, it is characterised in that: first exhibition
Showing device includes mobile phone.
5. the naked eye 3D according to claim 2 for frame drum interacts training system, it is characterised in that: described second hands over
Mutual device includes loudspeaker, microphone and camera.
6. the naked eye 3D according to claim 2 for frame drum interacts training system, it is characterised in that: the directive property
Light source be include R, G, B three-color light source.
7. the naked eye 3D according to claim 2 for frame drum interacts training system, it is characterised in that: the display core
Piece includes dmd chip.
8. the naked eye 3D according to claim 2 for frame drum interacts training system, it is characterised in that: the pixel battle array
Single pixel in column is nanometer diffraction grating.
9. a kind of naked eye 3D for frame drum interacts Training Methodology, the naked eye 3D interaction Training Methodology for frame drum is suitable
Naked eye 3D for being directed to frame drum described in claim 2-8 any one interacts training system, described for frame drum
It includes training mutual subsystem, showing that learning subsystem and cloud manages platform, the cloud pipe that naked eye 3D, which interacts training system,
Platform is connect with the mutual subsystem of the training and displaying study subsystem communication respectively；The mutual subsystem of training
Show that device, the displaying study subsystem include that the second interactive device and second show dress including the first interactive device and first
It sets, described includes that the first interactive device is connect by wireless network with cloud management Platform communication, and described first shows dress
It sets and is connect by wireless network with cloud management Platform communication, second interactive device passes through wireless network and the cloud
The communication connection of end pipe platform, the second displaying device manage Platform communication with the cloud by wireless network and connect,
It is characterized in that, includes the following steps:
First interactive device obtains training information when lecturer is played using frame drum, and first interactive device will
The training information is sent to cloud management platform；
The training information is distributed to the second displaying device by the cloud management platform, and described second shows device to the training
It instructs information and carries out 3D displaying；Described second shows that device includes projector and projection display screen, and the projector passes through wireless network
Network is connect with cloud management Platform communication, and the projection display screen is set to the light end, and the throwing out of the projector
All output lights of shadow instrument are distributed on the projection display screen, and the projector receives the figure of cloud management platform output
It denoised, amplified as signal and by described image signal, the directive property light source built in it is then driven to issue directive property light,
And by being projected by projection lens to the separate projector side of the projection display screen, the projection display screen after display chip
On be provided with multiple pixel arrays, the sub-pix of each multi-view image in the pixel of the projection display screen and the directive property light
It is corresponding, for incident multi-view image signal to be carried out after Spatial transmission the shape on the front space of the projection display screen
At viewpoint is assembled, obtains stereo-picture and carry out 3D displaying；
Second interactive device obtains the interactive information of student and the interactive information is sent to cloud management platform, described
Cloud manages platform and the interactive information is transmitted to the first displaying device.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810879892.5A CN108961865A (en) | 2018-08-03 | 2018-08-03 | A kind of naked eye 3D interaction training system and method for frame drum |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810879892.5A CN108961865A (en) | 2018-08-03 | 2018-08-03 | A kind of naked eye 3D interaction training system and method for frame drum |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108961865A true CN108961865A (en) | 2018-12-07 |
Family
ID=64467862
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810879892.5A Pending CN108961865A (en) | 2018-08-03 | 2018-08-03 | A kind of naked eye 3D interaction training system and method for frame drum |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108961865A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111833677A (en) * | 2020-08-12 | 2020-10-27 | 河南理工大学 | Art design multimedia teaching system and method thereof |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN202487010U (en) * | 2011-10-24 | 2012-10-10 | 山东大学 | Military boxing on-line teaching system based on internet platform |
| KR20150097050A (en) * | 2014-02-17 | 2015-08-26 | 경북대학교 산학협력단 | learning system using clap game for child and developmental disorder child |
| CN105425409A (en) * | 2016-01-19 | 2016-03-23 | 苏州苏大维格光电科技股份有限公司 | Projection type naked-eye 3D display device and color display device thereof |
| CN106056633A (en) * | 2016-06-07 | 2016-10-26 | 速感科技（北京）有限公司 | Motion control method, device and system |
| CN106128174A (en) * | 2016-08-18 | 2016-11-16 | 四川以太原力科技有限公司 | Limbs teaching method based on virtual reality and teaching system |
| CN205881226U (en) * | 2016-05-30 | 2017-01-11 | 湖南广播电视大学 | Virtual reality teaching system based on degree of depth learning algorithm |
| CN106803366A (en) * | 2016-12-30 | 2017-06-06 | 武汉市马里欧网络有限公司 | Children's dancing study system and method based on AR |
| CN107067879A (en) * | 2017-04-07 | 2017-08-18 | 济宁学院 | A kind of intelligent Piano Teaching system |
| CN107103801A (en) * | 2017-04-26 | 2017-08-29 | 北京大生在线科技有限公司 | Long-range three-dimensional scenic interactive education system and control method |
-
2018
- 2018-08-03 CN CN201810879892.5A patent/CN108961865A/en active Pending
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN202487010U (en) * | 2011-10-24 | 2012-10-10 | 山东大学 | Military boxing on-line teaching system based on internet platform |
| KR20150097050A (en) * | 2014-02-17 | 2015-08-26 | 경북대학교 산학협력단 | learning system using clap game for child and developmental disorder child |
| CN105425409A (en) * | 2016-01-19 | 2016-03-23 | 苏州苏大维格光电科技股份有限公司 | Projection type naked-eye 3D display device and color display device thereof |
| CN205881226U (en) * | 2016-05-30 | 2017-01-11 | 湖南广播电视大学 | Virtual reality teaching system based on degree of depth learning algorithm |
| CN106056633A (en) * | 2016-06-07 | 2016-10-26 | 速感科技（北京）有限公司 | Motion control method, device and system |
| CN106128174A (en) * | 2016-08-18 | 2016-11-16 | 四川以太原力科技有限公司 | Limbs teaching method based on virtual reality and teaching system |
| CN106803366A (en) * | 2016-12-30 | 2017-06-06 | 武汉市马里欧网络有限公司 | Children's dancing study system and method based on AR |
| CN107067879A (en) * | 2017-04-07 | 2017-08-18 | 济宁学院 | A kind of intelligent Piano Teaching system |
| CN107103801A (en) * | 2017-04-26 | 2017-08-29 | 北京大生在线科技有限公司 | Long-range three-dimensional scenic interactive education system and control method |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111833677A (en) * | 2020-08-12 | 2020-10-27 | 河南理工大学 | Art design multimedia teaching system and method thereof |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109887096A (en) | Utilize the education and instruction information processing system and its teaching method of virtual reality technology | |
| US8066378B2 (en) | Three-dimensional internal back-projection system and method for using the same | |
| US9538167B2 (en) | Methods, systems, and computer readable media for shader-lamps based physical avatars of real and virtual people | |
| US8628196B2 (en) | Display device and display method | |
| CN206224381U (en) | Using the 3D virtual reality interactive education systems of high definition 3D head-mounted displays | |
| CN209183027U (en) | A kind of education teaching system based on VR virtual reality | |
| US20120077172A1 (en) | Presentation system | |
| CN207460391U (en) | Projector equipment with camera function | |
| CN108428375A (en) | A kind of teaching auxiliary and equipment based on augmented reality | |
| CN208985412U (en) | Wisdom education physical environment system | |
| CN106560733A (en) | Aerial imaging element, aerial imaging display device, and application of aerial imaging display device | |
| CN208298402U (en) | A kind of CAD instructional device and system based on line holographic projections | |
| CN107657841A (en) | A kind of CAD instructional devices and system based on line holographic projections | |
| CN108961865A (en) | A kind of naked eye 3D interaction training system and method for frame drum | |
| CN102444298B (en) | Screen dancing room system | |
| CN106205242A (en) | Three-dimensional geographical projector equipment | |
| CN107122040A (en) | A kind of interactive system between artificial intelligence robot and intelligent display terminal | |
| Kuratate et al. | Mask-bot''-a life-size talking head animated robot for AV speech and human-robot communication research | |
| CN207216694U (en) | A kind of virtual reality system for safety of student education | |
| CN112351358B (en) | 360-degree free three-dimensional type three-dimensional display sound box based on face detection | |
| CN115581350A (en) | Immersive interactive system | |
| CN212847205U (en) | Article display platform for e-commerce teaching | |
| CN106205241A (en) | Multi-functional geographical teaching equipment | |
| CN211037976U (en) | Immersive remote live panorama teaching device of arc curtain on a large scale | |
| CN203773905U (en) | Box for laser demonstration |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20181207 |