CN114007098A - Method and device for generating 3D holographic video in intelligent classroom - Google Patents
Method and device for generating 3D holographic video in intelligent classroom Download PDFInfo
- Publication number
- CN114007098A CN114007098A CN202111298028.4A CN202111298028A CN114007098A CN 114007098 A CN114007098 A CN 114007098A CN 202111298028 A CN202111298028 A CN 202111298028A CN 114007098 A CN114007098 A CN 114007098A
- Authority
- CN
- China
- Prior art keywords
- image
- video segment
- display board
- holographic
- teaching
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 35
- 238000012937 correction Methods 0.000 claims description 14
- 238000009877 rendering Methods 0.000 claims description 14
- 239000000463 material Substances 0.000 claims description 5
- 235000013311 vegetables Nutrition 0.000 claims description 2
- 230000008569 process Effects 0.000 abstract description 8
- 230000002829 reductive effect Effects 0.000 abstract description 5
- 238000004590 computer program Methods 0.000 description 8
- 238000010586 diagram Methods 0.000 description 8
- 238000012545 processing Methods 0.000 description 6
- 230000006870 function Effects 0.000 description 5
- 230000004927 fusion Effects 0.000 description 5
- 230000002452 interceptive effect Effects 0.000 description 5
- 230000003287 optical effect Effects 0.000 description 4
- 230000004044 response Effects 0.000 description 4
- 238000004891 communication Methods 0.000 description 3
- 238000001514 detection method Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000000644 propagated effect Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 230000000670 limiting effect Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 230000002441 reversible effect Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 239000002023 wood Substances 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/2187—Live feed
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B5/00—Electrically-operated educational appliances
- G09B5/02—Electrically-operated educational appliances with visual presentation of the material to be studied, e.g. using film strip
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/106—Processing image signals
- H04N13/156—Mixing image signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/81—Monomedia components thereof
- H04N21/816—Monomedia components thereof involving special video data, e.g 3D video
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Business, Economics & Management (AREA)
- Physics & Mathematics (AREA)
- Educational Administration (AREA)
- Educational Technology (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Processing Or Creating Images (AREA)
Abstract
The disclosure provides a method and a device for generating a 3D holographic video in an intelligent classroom. The method comprises the following steps: acquiring a first 3D holographic video segment of a teaching teacher and a demonstration manuscript image for demonstrating teaching information; generating a three-dimensional display board model for demonstrating the teaching information based on the demonstration manuscript image; acquiring a holographic display board image comprising a display board image based on the three-dimensional display board model; and fusing each frame of 3D holographic video image in the first 3D holographic video segment with the holographic display board image to generate a second 3D holographic video segment interacted between the whole body image and the display board image of the teaching teacher. And a virtual scene of the teaching process of the teaching teacher is created through the second 3D holographic video segment, so that the virtual scene is closer to a real scene, the distance sense of the students to remote teaching is reduced, and the real feeling and the enthusiasm of participating in the teaching are improved.
Description
Technical Field
The disclosure relates to the field of display, in particular to a method and a device for generating a 3D holographic video in an intelligent classroom.
Background
With the development of computer technology, live broadcasting teaching based on the internet is started to rise, and a panoramic intelligent blackboard combined with a multimedia technology is produced along with live broadcasting teaching.
The panoramic intelligent blackboard integrates a display desktop and a blackboard into a whole. When the panoramic intelligent blackboard is used for live broadcasting teaching, the display desktop comprises two fixed display areas, namely a whole-body image area for displaying a teaching teacher and a display text area (such as a display area of a presentation), the panoramic intelligent blackboard is usually arranged in a classroom, and students learn the teaching content of the teaching teacher in remote live broadcasting through the panoramic intelligent blackboard arranged in the classroom. The physical surface of the panoramic intelligent blackboard can also be used as a blackboard.
However, the panoramic intelligent blackboard is adopted for off-site live broadcasting teaching, so that the students and the teaching often have unreality and distance, the teaching experience of the students is poor, and the learning enthusiasm of the students is influenced.
Therefore, the present disclosure provides a method for generating a 3D holographic video in an intelligent classroom to solve one of the above technical problems.
Disclosure of Invention
An object of the present disclosure is to provide a method, an apparatus, a medium, and an electronic device for generating a 3D holographic video in an intelligent classroom, which can solve at least one of the above-mentioned technical problems. The specific scheme is as follows:
according to a specific implementation manner of the present disclosure, in a first aspect, the present disclosure provides a method for generating a 3D holographic video in an intelligent classroom, including:
acquiring a first 3D holographic video segment of a teaching teacher and a demonstration manuscript image for demonstrating teaching information, wherein the first 3D holographic video segment is a 3D holographic video segment of a whole body image of the teaching teacher synchronously photographed by the demonstration manuscript image in a demonstration time period during teaching;
generating a three-dimensional display board model for demonstrating the teaching information based on the demonstration manuscript image;
acquiring a holographic display board image comprising a display board image based on the three-dimensional display board model;
and fusing each frame of 3D holographic video image in the first 3D holographic video segment with the holographic display board image to generate a second 3D holographic video segment interacted between the whole body image and the display board image of the teaching teacher.
According to a specific embodiment of the present disclosure, in a second aspect, the present disclosure provides an apparatus for generating a 3D holographic video in an intelligent classroom, including:
the material acquisition unit is used for acquiring a first 3D holographic video segment of a teaching teacher and a demonstration manuscript image for demonstrating teaching information, wherein the first 3D holographic video segment is a 3D holographic video segment of a whole body image of the teaching teacher synchronously photographed by the demonstration manuscript image in a demonstration time period in teaching;
the model generating unit is used for generating a three-dimensional display board model for demonstrating the teaching information based on the demonstration manuscript image;
the image acquisition unit is used for acquiring a holographic display board image comprising a display board image based on the three-dimensional display board model;
and the video generation unit is used for fusing each frame of 3D holographic video image in the first 3D holographic video segment with the holographic display board image to generate a second 3D holographic video segment interacted between the whole body image and the display board image of the teaching teacher.
According to a third aspect, the present disclosure provides a computer-readable storage medium, on which a computer program is stored, which when executed by a processor, implements the method for generating 3D holographic video in an intelligent classroom as described in any of the above.
According to a fourth aspect thereof, the present disclosure provides an electronic device, comprising: one or more processors; a storage device for storing one or more programs which, when executed by the one or more processors, cause the one or more processors to implement the generation method for 3D holographic video in an intelligent classroom as described in any of the above.
Compared with the prior art, the scheme of the embodiment of the disclosure at least has the following beneficial effects:
the disclosure provides a method and a device for generating a 3D holographic video in an intelligent classroom. The method and the device utilize the first 3D holographic video segment and the demonstration manuscript image for demonstrating teaching information to carry out interactive fusion to generate a second 3D holographic video segment. And a virtual scene of the teaching process of the teaching teacher is created through the second 3D holographic video segment, so that the virtual scene is closer to a real scene, the distance sense of the students to remote teaching is reduced, and the real feeling and the enthusiasm of participating in the teaching are improved.
Drawings
Fig. 1 shows a flow chart of a generation method for 3D holographic video in an intelligent classroom according to an embodiment of the present disclosure;
FIG. 2 shows a schematic diagram of a movable blackboard model according to an embodiment of the present disclosure;
fig. 3 shows a block diagram of elements of a generating apparatus for 3D holographic video in an intelligent classroom according to an embodiment of the present disclosure;
fig. 4 shows a schematic diagram of an electronic device connection structure provided in accordance with an embodiment of the present disclosure.
Detailed Description
To make the objects, technical solutions and advantages of the present disclosure clearer, the present disclosure will be described in further detail with reference to the accompanying drawings, and it is apparent that the described embodiments are only a part of the embodiments of the present disclosure, rather than all embodiments. All other embodiments, which can be derived by one of ordinary skill in the art from the embodiments disclosed herein without making any creative effort, shall fall within the scope of protection of the present disclosure.
The terminology used in the embodiments of the present disclosure is for the purpose of describing particular embodiments only and is not intended to be limiting of the disclosure. As used in the disclosed embodiments and the appended claims, the singular forms "a", "an", and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise, and "a plurality" typically includes at least two.
It should be understood that the term "and/or" as used herein is merely one type of association that describes an associated object, meaning that three relationships may exist, e.g., a and/or B may mean: a exists alone, A and B exist simultaneously, and B exists alone. In addition, the character "/" herein generally indicates that the former and latter related objects are in an "or" relationship.
It should be understood that although the terms first, second, third, etc. may be used in the embodiments of the present disclosure, these descriptions should not be limited to these terms. These terms are only used to distinguish one description from another. For example, a first could also be termed a second, and, similarly, a second could also be termed a first, without departing from the scope of embodiments of the present disclosure.
The words "if", as used herein, may be interpreted as "at … …" or "at … …" or "in response to a determination" or "in response to a detection", depending on the context. Similarly, the phrases "if determined" or "if detected (a stated condition or event)" may be interpreted as "when determined" or "in response to a determination" or "when detected (a stated condition or event)" or "in response to a detection (a stated condition or event)", depending on the context.
It is also noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that an article or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such article or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in the article or device in which the element is included.
It is to be noted that the symbols and/or numerals present in the description are not reference numerals if they are not labeled in the description of the figures.
Alternative embodiments of the present disclosure are described in detail below with reference to the accompanying drawings.
Example 1
The embodiment provided by the disclosure is an embodiment of a generation method for a 3D holographic video in an intelligent classroom.
The embodiments of the present disclosure are described in detail below with reference to fig. 1.
Step S101, a first 3D holographic video segment of a teaching teacher and a demonstration manuscript image demonstrating teaching information are obtained.
The demonstration manuscript means that a teaching teacher makes a static file of course contents into a dynamic slide so as to assist teaching and provide students with browsing in the course of teaching. For example, microsoft's PowerPoint file (PPT file for short). The embodiment of the disclosure acquires the content of each slide in the PPT file in the form of acquiring a presentation image.
The 3D holographic video, namely the video shot by the special shooting equipment of the 3D holographic video, can carry out psychological suggestion on human eyes physiologically based on the depth sense of the scene, so that the result can be closer to the real scene. When giving lessons, the 3D holographic video shooting equipment is adopted to collect the whole body images of the lessons giving teachers, and 3D holographic videos of the lessons giving teachers are generated.
The first 3D holographic video segment is a 3D holographic video segment of a whole body image of the teaching teacher, which is shot synchronously in a demonstration time period by the demonstration manuscript image in the teaching. In the teaching, teaching teachers organize teaching around the presentation files, and the teaching content of each presentation file image after introduction and explanation can be turned over to the next presentation file image for explanation, so that the teaching method and the teaching system of the teaching are based on the demonstration time period of each presentation file image in the teaching as the basis for dividing the 3D holographic video of the teaching teachers, and the 3D holographic video of the teaching teachers is divided into a plurality of 3D holographic video sections according to the demonstration time period of each presentation file image.
In some embodiments, the method further comprises the steps of:
and S100-1, responding to the trigger of the starting demonstration information of the demonstration manuscript image during teaching, and acquiring the image identification information of the demonstration manuscript image and the video segment identification information of the first 3D holographic video segment.
It can be understood that, when each slide in the presentation starts presentation, the embodiment of the present disclosure obtains presentation start information, where the presentation start information may be a page turning instruction for the presentation (for example, a page turning instruction issued by a page turning pen or a keyboard), may also be a presentation start instruction for the presentation (for example, a play instruction issued by a page turning pen or a keyboard), and may also be generated by capturing two front and rear images from a device for presenting the presentation and determining a difference between the two front and rear images. And when the starting demonstration information of the current demonstration manuscript image is obtained, starting to save the first 3D holographic video segment. And when the ending demonstration information of the current demonstration manuscript image is obtained, ending the storage of the first 3D holographic video segment. The end presentation information may be start presentation information of a next presentation image, or play end information of the presentation.
Meanwhile, image identification information is generated for the demonstration manuscript image, and video segment identification information is generated for the first 3D holographic video segment, so that the corresponding relation between the image identification information and the video segment identification information is established. The image identification information comprises name information and saving path information of the presentation image, and the video segment identification information comprises name information and saving path information of the first 3D holographic video segment.
And S100-2, adding the corresponding relation between the image identification information and the video segment identification information to the identification information queue.
In the teaching, each demonstration manuscript image of the demonstration manuscript used by a teaching teacher acquires a corresponding 3D holographic video segment in a demonstration time period according to a demonstration sequence. And sequentially adding the corresponding relation between the image identification information of each presentation image and the video segment identification information of the corresponding 3D holographic video segment to the identification information queue. And 3D holographic video segments are played in sequence according to the arrangement sequence in the identification information queue, so that the original teaching process of the teaching teacher can be restored.
In this embodiment, an identification information queue is used to store a correspondence between the image identification information of the presentation image and the video segment identification information of the first 3D holographic video segment. Meanwhile, the demonstration sequence information among the demonstration manuscript images and the playing sequence information among the 3D holographic video segments are saved. Therefore, the dependence on the marking time point is avoided, the data storage capacity is reduced, and the data processing efficiency is improved.
Further, based on the above specific embodiment, the acquiring the first 3D holographic video segment of the lecturer and the presentation image demonstrating the lecture information includes the following steps:
step S101-1, acquiring image identification information of the presentation image and video segment identification information of the first 3D holographic video segment from an identification information queue.
And S101-2, acquiring the presentation image according to the image identification information, and acquiring the first 3D holographic video segment according to the video segment identification information.
When the course is prerecorded, the demonstration manuscript image and the first 3D holographic video segment corresponding to the demonstration manuscript image can be conveniently and quickly acquired online through the step, the data processing capacity is improved, the smoothness of 3D holographic video playing in an intelligent classroom is guaranteed, and more online class listening terminals are supported.
And S102, generating a three-dimensional display board model for demonstrating the teaching information based on the demonstration manuscript image.
The three-dimensional display board model is a rendered three-dimensional network model for displaying teaching information in the presentation images, for example, the three-dimensional display board model is a rendered three-dimensional network model, the three-dimensional network model is constructed into a movable blackboard model, as shown in fig. 2, the movable blackboard model is provided with a support and a blackboard arranged on the support, pulleys are arranged at the feet of the support, and the teaching information in the presentation images is displayed on the blackboard surface of the movable blackboard model.
The three-dimensional display board model can rotate at any angle and be watched.
Further, the generating of the three-dimensional display board model for demonstrating the teaching information based on the demonstration manuscript image comprises the following steps:
step S102a, re-rendering at least one display area in a three-dimensional preset display board rendering model based on the presentation image, and generating the three-dimensional display board model.
The preset display board rendering model is a three-dimensional network model rendered through preset textures. For example, the support of the movable blackboard model has a texture with a preset wood grain color, and the blackboard surface has a preset black glass texture.
The rendering of the at least one display area in the three-dimensional preset display board rendering model based on the presentation document image can be understood as that when the preset display board rendering model has a plurality of display areas, the at least one display area in the preset display board rendering model is rendered again by using the presentation document image, so that the at least one display area in the preset display board rendering model can demonstrate teaching information in the presentation document image. For example, when the movable blackboard model has a front panel and a back panel, teaching information in the demonstration manuscript image is rendered on the front panel and the back panel of the movable blackboard model, so that the 3D holographic video segment played after interactive fusion can enable students in front of and behind the three-dimensional movable blackboard model to see the teaching information; by analogy, the movable blackboard model can be provided with a multidirectional board, so that students in more directions can see teaching information.
And S103, acquiring a holographic display board image comprising a display board image based on the three-dimensional display board model.
Because the three-dimensional panel model can rotate the multi-angle wantonly, and is watched, consequently, can acquire the diversified image of filming to the three-dimensional panel model that is unanimous with the preset parameter of filming of first 3D holographic video section, and then generate holographic panel image through diversified image.
The preset shooting parameters of the first 3D holographic video segment comprise position parameters of the camera and depth of field parameters of the camera.
In a specific embodiment, the acquiring a holographic board image including a board image based on the three-dimensional board model includes the following steps:
step S103-1, performing proportional correction on preset shooting parameters of the first 3D holographic video segment based on preset correction parameters, and acquiring shooting parameters aiming at the three-dimensional display board model.
For example, if the image proportion of the whole body image of the teacher in the first 3D holographic video segment is 1, and the image proportion is taken as a reference, and the preset proportion of the three-dimensional display board model is 0.5, the three-dimensional display board model is set according to the preset shooting parameters of the first 3D holographic video segment, and the display board image in the obtained holographic display board image and the whole body image in the 3D holographic video image are not harmonious after interactive fusion.
Therefore, the specific embodiment of the present disclosure performs the scale correction on the preset shooting parameters of the first 3D holographic video segment, and the preset correction parameters include the position correction parameters of the camera and the depth correction parameters of the camera. The position correction parameter is used for correcting the position parameter of the camera of the first 3D holographic video segment; the depth of field correction parameter is used for correcting the depth of field parameter of the camera of the first 3D holographic video segment.
And S103-2, acquiring a holographic display board image based on the shooting parameters of the three-dimensional display board model and the three-dimensional display board model.
The holographic exhibition board image is obtained through the shooting parameters of the corrected three-dimensional exhibition board model, so that the whole body image of a teaching teacher in the fused holographic video segment can be coordinated with the exhibition board image, and the 3D holographic video can demonstrate the teaching process more truly.
And step S104, fusing each frame of 3D holographic video image in the first 3D holographic video segment with the holographic display board image to generate a second 3D holographic video segment interacted between the whole body image and the display board image of the teaching teacher.
For example, if the movable blackboard model has front and back double-sided boards, the front of the movable blackboard model is in the same orientation with one display direction of the display device, and the back of the movable blackboard model is in the same orientation with the other display direction opposite to the display device, so that students sitting in two directions can see teaching information on the movable blackboard model; and the whole body image of the teaching teacher is placed beside the display board image, so that a virtual scene that the teaching teacher stands beside the movable blackboard model and explains teaching information in the movable blackboard model is created.
The embodiment of the disclosure carries out interactive fusion by utilizing the first 3D holographic video segment and the demonstration manuscript image for demonstrating teaching information to generate the second 3D holographic video segment. And a virtual scene of the teaching process of the teaching teacher is created through the second 3D holographic video segment, so that the virtual scene is closer to a real scene, the distance sense of the students to remote teaching is reduced, and the real feeling and the enthusiasm of participating in the teaching are improved.
Example 2
The present disclosure also provides an apparatus embodiment adapted to the above embodiment, for implementing the method steps described in the above embodiment, and the explanation based on the same name and meaning is the same as that of the above embodiment, and has the same technical effect as that of the above embodiment, and is not described again here.
As shown in fig. 3, the present disclosure provides a generation apparatus 300 for a 3D holographic video in an intelligent classroom, including:
the material acquisition unit 301 is configured to acquire a first 3D holographic video segment of a teaching teacher and a presentation image for demonstrating teaching information, where the first 3D holographic video segment is a 3D holographic video segment of a whole-body image of the teaching teacher that is synchronously captured by the presentation image during a presentation time period in a teaching session;
a model generating unit 302, configured to generate a three-dimensional display board model for demonstrating the teaching information based on the presentation document image;
an image obtaining unit 303, configured to obtain a holographic display board image including a display board image based on the three-dimensional display board model;
a video generating unit 304, configured to fuse each frame of 3D holographic video image in the first 3D holographic video segment with the holographic display board image, and generate a second 3D holographic video segment interacted between the whole body image of the lecturer and the display board image.
Optionally, the generating a three-dimensional display board model for demonstrating the teaching information based on the presentation document image includes:
and re-rendering at least one display area in a three-dimensional preset display board rendering model based on the demonstration manuscript image to generate the three-dimensional display board model.
Optionally, the image acquiring unit 303 includes:
the parameter acquiring subunit is configured to perform proportional correction on a preset shooting parameter of the first 3D holographic video segment based on a preset correction parameter, and acquire a shooting parameter for the three-dimensional display board model;
and the image acquisition subunit is used for acquiring a holographic display board image based on the shooting parameters of the three-dimensional display board model and the three-dimensional display board model.
Optionally, the material obtaining unit 301 includes:
the information acquisition subunit is used for acquiring the image identification information of the presentation image and the video segment identification information of the first 3D holographic video segment from the identification information queue;
and the vegetable acquisition subunit is used for acquiring the presentation image according to the image identification information and acquiring the first 3D holographic video segment according to the video segment identification information.
Optionally, the apparatus further includes a queue generating unit;
the queue generating unit includes:
the identification acquisition subunit is used for responding to the triggering of the starting demonstration information of the demonstration manuscript image during teaching, and acquiring the image identification information of the demonstration manuscript image and the video segment identification information of the first 3D holographic video segment;
and the queue adding subunit is used for adding the corresponding relation between the image identification information and the video segment identification information to the identification information queue.
The embodiment of the disclosure carries out interactive fusion by utilizing the first 3D holographic video segment and the demonstration manuscript image for demonstrating teaching information to generate the second 3D holographic video segment. And a virtual scene of the teaching process of the teaching teacher is created through the second 3D holographic video segment, so that the virtual scene is closer to a real scene, the distance sense of the students to remote teaching is reduced, and the real feeling and the enthusiasm of participating in the teaching are improved.
Example 3
As shown in fig. 4, the present embodiment provides an electronic device, including: at least one processor; and a memory communicatively coupled to the at least one processor; wherein the memory stores instructions executable by the one processor to cause the at least one processor to perform the method steps of the above embodiments.
Example 4
The disclosed embodiments provide a non-volatile computer storage medium having stored thereon computer-executable instructions that may perform the method steps as described in the embodiments above.
Example 5
Referring now to FIG. 4, shown is a schematic diagram of an electronic device suitable for use in implementing embodiments of the present disclosure. The terminal device in the embodiments of the present disclosure may include, but is not limited to, a mobile terminal such as a mobile phone, a notebook computer, a digital broadcast receiver, a PDA (personal digital assistant), a PAD (tablet computer), a PMP (portable multimedia player), a vehicle terminal (e.g., a car navigation terminal), and the like, and a stationary terminal such as a digital TV, a desktop computer, and the like. The electronic device shown in fig. 4 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiments of the present disclosure.
As shown in fig. 4, the electronic device may include a processing means (e.g., a central processing unit, a graphics processor, etc.) 401 that may perform various appropriate actions and processes according to a program stored in a Read Only Memory (ROM)402 or a program loaded from a storage means 408 into a Random Access Memory (RAM) 403. In the RAM403, various programs and data necessary for the operation of the electronic apparatus are also stored. The processing device 401, the ROM 402, and the RAM403 are connected to each other via a bus 404. An input/output (I/O) interface 405 is also connected to bus 404.
Generally, the following devices may be connected to the I/O interface 405: input devices 406 including, for example, a touch screen, touch pad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; output devices 405 including, for example, a Liquid Crystal Display (LCD), speakers, vibrators, or the like; storage 408 including, for example, tape, hard disk, etc.; and a communication device 409. The communication means 409 may allow the electronic device to communicate with other devices wirelessly or by wire to exchange data. While fig. 4 illustrates an electronic device having various means, it is to be understood that not all illustrated means are required to be implemented or provided. More or fewer devices may alternatively be implemented or provided.
In particular, according to an embodiment of the present disclosure, the processes described above with reference to the flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program embodied on a computer readable medium, the computer program comprising program code for performing the method illustrated in the flow chart. In such an embodiment, the computer program may be downloaded and installed from a network via the communication device 409, or from the storage device 408, or from the ROM 402. The computer program performs the above-described functions defined in the methods of the embodiments of the present disclosure when executed by the processing device 401.
It should be noted that the computer readable medium in the present disclosure can be a computer readable signal medium or a computer readable storage medium or any combination of the two. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples of the computer readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present disclosure, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In contrast, in the present disclosure, a computer readable signal medium may comprise a propagated data signal with computer readable program code embodied therein, either in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: electrical wires, optical cables, RF (radio frequency), etc., or any suitable combination of the foregoing.
The computer readable medium may be embodied in the electronic device; or may exist separately without being assembled into the electronic device.
Computer program code for carrying out operations for aspects of the present disclosure may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C + +, and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The units described in the embodiments of the present disclosure may be implemented by software or hardware. Where the name of an element does not in some cases constitute a limitation on the element itself.
Claims (10)
1. A generation method for 3D holographic video in an intelligent classroom is characterized by comprising the following steps:
acquiring a first 3D holographic video segment of a teaching teacher and a demonstration manuscript image for demonstrating teaching information, wherein the first 3D holographic video segment is a 3D holographic video segment of a whole body image of the teaching teacher synchronously photographed by the demonstration manuscript image in a demonstration time period during teaching;
generating a three-dimensional display board model for demonstrating the teaching information based on the demonstration manuscript image;
acquiring a holographic display board image comprising a display board image based on the three-dimensional display board model;
and fusing each frame of 3D holographic video image in the first 3D holographic video segment with the holographic display board image to generate a second 3D holographic video segment interacted between the whole body image and the display board image of the teaching teacher.
2. The method of claim 1, wherein generating a three-dimensional board model for presenting the lecture information based on the presentation image comprises:
and re-rendering at least one display area in a three-dimensional preset display board rendering model based on the demonstration manuscript image to generate the three-dimensional display board model.
3. The method of claim 1, wherein the obtaining a holographic board image comprising a board image based on the three-dimensional board model comprises:
carrying out proportional correction on preset shooting parameters of the first 3D holographic video segment based on preset correction parameters to obtain shooting parameters aiming at the three-dimensional display board model;
and acquiring a holographic display board image based on the shooting parameters of the three-dimensional display board model and the three-dimensional display board model.
4. The method according to claim 1, wherein the acquiring the first 3D holographic video segment of the lecturer and the presentation image for presenting the lecture information comprises:
acquiring image identification information of the presentation image and video segment identification information of the first 3D holographic video segment from an identification information queue;
and acquiring the demonstration manuscript image according to the image identification information, and acquiring the first 3D holographic video segment according to the video segment identification information.
5. The method of claim 4, further comprising:
in the course of teaching, responding to the trigger of the starting demonstration information of the demonstration manuscript image, and acquiring the image identification information of the demonstration manuscript image and the video segment identification information of the first 3D holographic video segment;
and adding the corresponding relation between the image identification information and the video segment identification information into the identification information queue.
6. A generate device that is arranged in intelligent classroom 3D holographic video, its characterized in that includes:
the material acquisition unit is used for acquiring a first 3D holographic video segment of a teaching teacher and a demonstration manuscript image for demonstrating teaching information, wherein the first 3D holographic video segment is a 3D holographic video segment of a whole body image of the teaching teacher synchronously photographed by the demonstration manuscript image in a demonstration time period in teaching;
the model generating unit is used for generating a three-dimensional display board model for demonstrating the teaching information based on the demonstration manuscript image;
the image acquisition unit is used for acquiring a holographic display board image comprising a display board image based on the three-dimensional display board model;
and the video generation unit is used for fusing each frame of 3D holographic video image in the first 3D holographic video segment with the holographic display board image to generate a second 3D holographic video segment interacted between the whole body image and the display board image of the teaching teacher.
7. The apparatus of claim 6, wherein the generating a three-dimensional board model for presenting the lecture information based on the presentation image comprises:
and re-rendering at least one display area in a three-dimensional preset display board rendering model based on the demonstration manuscript image to generate the three-dimensional display board model.
8. The apparatus of claim 6, wherein the image acquisition unit comprises:
the parameter acquiring subunit is configured to perform proportional correction on a preset shooting parameter of the first 3D holographic video segment based on a preset correction parameter, and acquire a shooting parameter for the three-dimensional display board model;
and the image acquisition subunit is used for acquiring a holographic display board image based on the shooting parameters of the three-dimensional display board model and the three-dimensional display board model.
9. The apparatus according to claim 6, wherein the material obtaining unit includes:
the information acquisition subunit is used for acquiring the image identification information of the presentation image and the video segment identification information of the first 3D holographic video segment from the identification information queue;
and the vegetable acquisition subunit is used for acquiring the presentation image according to the image identification information and acquiring the first 3D holographic video segment according to the video segment identification information.
10. The apparatus of claim 9, further comprising a queue generating unit;
the queue generating unit includes:
the identification acquisition subunit is used for responding to the triggering of the starting demonstration information of the demonstration manuscript image during teaching, and acquiring the image identification information of the demonstration manuscript image and the video segment identification information of the first 3D holographic video segment;
and the queue adding subunit is used for adding the corresponding relation between the image identification information and the video segment identification information to the identification information queue.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111298028.4A CN114007098B (en) | 2021-11-04 | 2021-11-04 | Method and device for generating 3D holographic video in intelligent classroom |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111298028.4A CN114007098B (en) | 2021-11-04 | 2021-11-04 | Method and device for generating 3D holographic video in intelligent classroom |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114007098A true CN114007098A (en) | 2022-02-01 |
| CN114007098B CN114007098B (en) | 2024-01-30 |
Family
ID=79927058
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111298028.4A Active CN114007098B (en) | 2021-11-04 | 2021-11-04 | Method and device for generating 3D holographic video in intelligent classroom |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114007098B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113129436A (en) * | 2021-05-17 | 2021-07-16 | 洛阳众智软件科技股份有限公司 | Method for generating three-dimensional demonstration manuscript |
| CN115331493A (en) * | 2022-08-08 | 2022-11-11 | 深圳市中科网威科技有限公司 | Three-dimensional comprehensive teaching system and method based on 3D holographic technology |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106842881A (en) * | 2017-01-20 | 2017-06-13 | 武汉创梦想教育管理有限公司 | A kind of holographic projection methods and system that curricula image is carried out indoor reproduction |
| CN110333837A (en) * | 2019-07-09 | 2019-10-15 | 京东方科技集团股份有限公司 | Conference system, communication means and device |
| CN110427107A (en) * | 2019-07-23 | 2019-11-08 | 德普信(天津)软件技术有限责任公司 | Virtually with real interactive teaching method and system, server, storage medium |
| US20200296327A1 (en) * | 2019-03-12 | 2020-09-17 | Light Field Lab, Inc. | Video communication including holographic content |
| CN112104794A (en) * | 2020-03-31 | 2020-12-18 | 北京文香信息技术有限公司 | Virtual micro-classroom studio system and device |
| KR102217783B1 (en) * | 2019-11-05 | 2021-02-19 | 한양대학교 산학협력단 | Hy-live education model based on 5g telepresence technology |
| CN112562433A (en) * | 2020-12-30 | 2021-03-26 | 华中师范大学 | 5G strong interaction remote delivery teaching system based on holographic terminal and working method thereof |
| CN112804516A (en) * | 2021-04-08 | 2021-05-14 | 北京世纪好未来教育科技有限公司 | Video playing method and device, readable storage medium and electronic equipment |
-
2021
- 2021-11-04 CN CN202111298028.4A patent/CN114007098B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106842881A (en) * | 2017-01-20 | 2017-06-13 | 武汉创梦想教育管理有限公司 | A kind of holographic projection methods and system that curricula image is carried out indoor reproduction |
| US20200296327A1 (en) * | 2019-03-12 | 2020-09-17 | Light Field Lab, Inc. | Video communication including holographic content |
| CN110333837A (en) * | 2019-07-09 | 2019-10-15 | 京东方科技集团股份有限公司 | Conference system, communication means and device |
| CN110427107A (en) * | 2019-07-23 | 2019-11-08 | 德普信(天津)软件技术有限责任公司 | Virtually with real interactive teaching method and system, server, storage medium |
| KR102217783B1 (en) * | 2019-11-05 | 2021-02-19 | 한양대학교 산학협력단 | Hy-live education model based on 5g telepresence technology |
| CN112104794A (en) * | 2020-03-31 | 2020-12-18 | 北京文香信息技术有限公司 | Virtual micro-classroom studio system and device |
| CN112562433A (en) * | 2020-12-30 | 2021-03-26 | 华中师范大学 | 5G strong interaction remote delivery teaching system based on holographic terminal and working method thereof |
| CN112804516A (en) * | 2021-04-08 | 2021-05-14 | 北京世纪好未来教育科技有限公司 | Video playing method and device, readable storage medium and electronic equipment |
Non-Patent Citations (1)
| Title |
|---|
| 马梦朝;张彦;赵义术;商玲玲;黄金鑫;鲁国涛;姜亚伟;: "配电网设备全息投影交互培训系统研究", 国网技术学院学报, no. 01, pages 40 - 44 * |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113129436A (en) * | 2021-05-17 | 2021-07-16 | 洛阳众智软件科技股份有限公司 | Method for generating three-dimensional demonstration manuscript |
| CN113129436B (en) * | 2021-05-17 | 2023-12-15 | 洛阳众智软件科技股份有限公司 | Method for generating three-dimensional demonstration manuscript |
| CN115331493A (en) * | 2022-08-08 | 2022-11-11 | 深圳市中科网威科技有限公司 | Three-dimensional comprehensive teaching system and method based on 3D holographic technology |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114007098B (en) | 2024-01-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9049482B2 (en) | System and method for combining computer-based educational content recording and video-based educational content recording | |
| CN114007098B (en) | Method and device for generating 3D holographic video in intelligent classroom | |
| CN111131876B (en) | Control method, device and terminal for live video and computer readable storage medium | |
| WO2022007565A1 (en) | Image processing method and apparatus for augmented reality, electronic device and storage medium | |
| CN103996314A (en) | Teaching system based on augmented reality | |
| WO2022057348A1 (en) | Music poster generation method and apparatus, electronic device, and medium | |
| KR20150084586A (en) | Kiosk and system for authoring video lecture using virtual 3-dimensional avatar | |
| CN113055624A (en) | Course playback method, server, client and electronic equipment | |
| CN103823877A (en) | Real object showing method, real object showing system and corresponding picture obtaining device | |
| Pantelić et al. | The development of educational augmented reality application: a practical approach | |
| Zheng | Research on mobile learning based on augmented reality | |
| CN110969159A (en) | Image recognition method and device and electronic equipment | |
| CN114095747B (en) | Live broadcast interaction system and method | |
| KR20110024880A (en) | System and method for learning a sentence using augmented reality technology | |
| JP2021086146A (en) | Content control system, content control method, and content control program | |
| Egusa et al. | Development of an interactive puppet show system for the hearing-impaired people | |
| JP6733027B1 (en) | Content control system, content control method, and content control program | |
| CN114038255B (en) | Answering system and method | |
| CN111415635B (en) | Large-screen display method, device, medium and electronic equipment | |
| CN114120729B (en) | Live teaching system and method | |
| WO2022255262A1 (en) | Content provision system, content provision method, and content provision program | |
| CN110290360B (en) | Image stitching method and terminal equipment for panoramic video image | |
| Ardjo et al. | The virtual machinery workshop: An immersive 360 degree Web-based vocational education learning | |
| See et al. | MOOC for AR VR Training | |
| CN107609018B (en) | Search result presenting method and device and terminal equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |