KR101757420B1 - The system for remote video communication and lecture based on interaction using transparent display - Google Patents

The system for remote video communication and lecture based on interaction using transparent display Download PDF

Info

Publication number
KR101757420B1
KR101757420B1 KR1020150072832A KR20150072832A KR101757420B1 KR 101757420 B1 KR101757420 B1 KR 101757420B1 KR 1020150072832 A KR1020150072832 A KR 1020150072832A KR 20150072832 A KR20150072832 A KR 20150072832A KR 101757420 B1 KR101757420 B1 KR 101757420B1
Authority
KR
South Korea
Prior art keywords
image
transparent display
user
student
remote
Prior art date
Application number
KR1020150072832A
Other languages
Korean (ko)
Other versions
KR20160138681A (en
Inventor
조경은
엄기현
치옥용
Original Assignee
동국대학교 산학협력단
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 동국대학교 산학협력단 filed Critical 동국대학교 산학협력단
Priority to KR1020150072832A priority Critical patent/KR101757420B1/en
Priority to PCT/KR2015/011446 priority patent/WO2016190493A1/en
Publication of KR20160138681A publication Critical patent/KR20160138681A/en
Application granted granted Critical
Publication of KR101757420B1 publication Critical patent/KR101757420B1/en

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
    • H04N7/142—Constructional details of the terminal equipment, e.g. arrangements of the camera and the display
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
    • H04N7/142—Constructional details of the terminal equipment, e.g. arrangements of the camera and the display
    • H04N7/144—Constructional details of the terminal equipment, e.g. arrangements of the camera and the display camera and display on the same optical axis, e.g. optically multiplexing the camera and display for eye to eye contact
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
    • H04N7/147—Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals

Abstract

BACKGROUND OF THE INVENTION 1. Field of the Invention [0001] The present invention relates to an interactive image communication and lecture system based on an interactive display using a transparent display, wherein a remote image communication apparatus can display an image and has light transmittance, , A rear view camera that detects the movement of the rear user located at the rear of the transparent display, and a rear camera to transmit the motion image of the rear user to the remote user located in the remote place, And generating a feedback image based on the response and providing the feedback image to the transparent display.

Description

[0001] Interactive-based remote video communication and lecture systems using transparent displays [

BACKGROUND OF THE INVENTION 1. Field of the Invention [0002] The present invention relates to a technique for implementing a conference or lecture among users located at remote locations based on image communication, and more particularly, to an interactive-based remote image communication and lecture system using transparent display.

As the information technology industry develops and the education infrastructure improves, various communication methods, conference methods, and education methods using computers and communication technologies have been developed. A communication method and a conference method between the two parties using a conventional telephone network have been proposed, and such technology has begun to spread in combination with video communication. In addition, in the online education, educational programs utilizing multimedia contents or learning terminals are developed and used.

This conventional remote lecture and conference system is based on the acquisition of a normal image, especially a participant 's face image, and the obtained image is merely a simple display together with lecture contents through the display means of the other party. In the case of video conferencing, it is possible to interact with the mouse and keyboard as input means, but its range is limited. In the case of online lectures, there is little practical interaction and only one-way video is broadcast. In addition, when a large number of people located at a remote location participate, only the image is shared as the number of participants increases, and the viewer can not grasp the current situation of the audience.

Although the prior art documents presented below suggest a structure of an online lecture system capable of simple interaction, the on-line lecture system still has many limitations and problems in spite of its advantage in providing learning opportunities to remote participants Respectively.

Korean Patent Laid-Open No. 10-2013-0139449, ITUTSU Education Co., Ltd., Dec. 23, 2013 Korean Patent Publication No. 10-2010-0060289, Classon Co., Ltd., Jun. 30, 2010

SUMMARY OF THE INVENTION The present invention has been made in view of the above circumstances, and it is an object of the present invention to provide a remote image communication method or a lecture method in which image information at the center of a face image is exchanged or a simple text- In this paper, we propose a solution to solve the problem that many participants have limited practical interaction and overcome the limit of meeting users' needs in meetings or lectures that require demonstration or practice only by the images displayed on the display screen.

According to an aspect of the present invention, there is provided a remote image communication apparatus capable of displaying an image and having light transmittance, thereby allowing a front user located at the front to simultaneously observe the image and an object positioned at the rear Can transparent display; A rear camera for sensing movement of a rear user located on a rear surface of the transparent display; And a processor for controlling the rear camera to transmit the motion image of the rear user to a remote user located at a remote location and generating a feedback image based on a response received from the remote user and providing the feedback image to the transparent display, And the feedback image is a response of the remote user visually recognizing the motion image of the back user received from the processing unit.

In the remote image communication apparatus according to an embodiment, the processing unit generates a feedback image indicating a supplementary opinion on the movement of the rear user, and displays the feedback image on a predetermined area on the transparent display, It is possible to induce a user to recognize an overlapping feedback image corresponding to the rear surface object transmitted through the transparent display.

In the remote image communication apparatus according to an exemplary embodiment, the processing unit may continuously track movement of the rear user through the rear camera, The position of the feedback image can be adaptively adjusted.

In a remote visual communication apparatus according to an embodiment, the transparent display is simultaneously observable in both the front and rear directions, and allows the rear user, who visually recognizes the feedback image displayed on the transparent display, It is possible to induce the user to correct his / her movement based on the motion.

In a remote visual communication device according to an embodiment, the transparent display comprises: a light transmissive screen which allows visual recognition of objects located in opposite directions; And an image generator formed of at least one layer for generating an image in accordance with a control signal and displaying an image in both directions of the light transmissive screen. In addition, the image generating unit may be configured such that two layers for generating an image are deposited in opposite directions to each other, and a first image signal and a second image signal in which the first image and the first image are inverted are respectively applied to the layer, The front and rear users can provide the same image.

The remote visual communication apparatus according to an exemplary embodiment of the present invention may further include a front camera that detects movement of at least one front user located on the front of the transparent display, To the remote user in real time.

According to another aspect of the present invention, there is provided a remote lecture system, which can display an image including lecture contents and has light transmittance, A transparent display that can be observed simultaneously; A rear camera for sensing a movement of a trainee located at a rear side of the transparent display; And a processor for controlling the rear camera to transmit the motion image of the student in real time to a lecturer located in a remote location and generating a feedback image based on a response received from the lecturer and providing the feedback image to the transparent display, The feedback image is a response of the instructor visually recognizing the motion image of the training student received from the processor.

In a remote teaching system according to another embodiment, the processing unit generates a feedback image indicating a supplementary opinion on the movement of the student, and displays the feedback image on a predetermined area on the transparent display, Thereby allowing the user to recognize the overlapping instructor feedback image corresponding to the rear surface object transmitted through the transparent display.

In the remote teaching system according to another embodiment, the processing unit may continuously track the movement of the training student through the rear camera, so that the lecture contents displayed on the transparent display in response to the movement of the training student Or the position of the instructor's feedback image can be adaptively adjusted.

In a remote steel system according to another embodiment, the transparent display can be observed simultaneously in both the front and rear directions, and allows the trainee, who visually recognizes the feedback image of the instructor displayed on the transparent display, The user may be instructed to correct his /

In a remote teaching system according to another embodiment, the transparent display comprises: a light transmissive screen for visually recognizing objects located in opposite directions; And an image generator formed of at least one layer for generating an image in accordance with a control signal and displaying an image in both directions of the light transmissive screen. In addition, the image generating unit may be configured such that two layers for generating an image are deposited in opposite directions to each other, and a first image signal and a second image signal in which the first image and the first image are inverted are respectively applied to the layer, Students and students on the front and rear can provide the same image.

The remote control system according to another embodiment of the present invention may further include a front camera that detects movement of at least one student located on a front surface of the transparent display, And a warning message may be provided to the students when a pattern indicating that the concentration is decreased is found. In addition, when the facial region extracted from the acquired images of the students faces the front of the transparent display, the processing unit determines that the state of the corresponding student is 'concentrated', and the facial region extracted from the acquired images of the students is the bottom If the facial region extracted from the images of the acquired students is oriented toward the direction other than the front or the floor beyond the critical duration, the state of the corresponding student is judged to be "distracting" can do. Further, the warning message may display a warning image interacting with the image displayed on the transparent display, or a warning image interacting with the trainee student observed through the transparent display, thereby attracting attention of the students on the front side .

In the remote lecture system according to another embodiment, the processing unit may calculate the percentage of students whose concentration reduction state is found among the students recognized through the front camera, and provide the ratio to the lecturer so that the lecturer instructs the lecturer to calculate the lecture contents, Feedback image or the warning message.

Embodiments of the present invention are able to transmit lively meeting and lecture contents to participants located on the field by providing or introducing actual practice scenes and on-screen images by using a transparent display to participants, It is possible to increase the effectiveness of meetings and lectures by inducing more active interactions to the participants located in the remote place or grasping the concentration state of the participants in real time.

1 is a diagram showing an environment in which a remote visual communication or lecture system according to embodiments of the present invention is implemented, centering on a transparent display.
2 is a block diagram illustrating an interactive-based remote visual communication or lecture system using a transparent display in accordance with an embodiment of the present invention.
3 is a diagram illustrating a case where a practicing student performs a cooking exercise through a remote lecture system according to an embodiment of the present invention.
FIG. 4 is a diagram illustrating an operation performed by a lecturer instructing cooking exercises through the remote lecture system of FIG. 3 according to an embodiment of the present invention.
5A and 5B are views illustrating the structure of a transparent display adopted by embodiments of the present invention.
6 is a diagram illustrating a method of controlling an image displayed on a transparent display through motion tracking in a remote lecture system according to an embodiment of the present invention.
FIG. 7 is a diagram for explaining a method of inducing concentration of students in a remote lecture system according to an embodiment of the present invention.

Hereinafter, embodiments of the present invention for solving the above-mentioned technical problems will be described in detail with reference to the drawings. In the following description and the accompanying drawings, detailed description of well-known functions or constructions that may obscure the subject matter of the present invention will be omitted. It is to be noted that the same components are denoted by the same names and reference numerals as possible throughout the drawings.

FIG. 1 illustrates an environment in which a remote visual communication or lecture system according to embodiments of the present invention is implemented, centered on a transparent display, in which all embodiments of the present invention can display an image on a screen, And a transparent display 10 having the property of visually confirming objects located beyond the screen.

1, a content image (which may be a graph or the like used in conferences or lecture contents) is displayed on the transparent display 10, and at least one front user The student 20 is located and the rear user or the student 30 is also located on the rear side of the transparent display 10. In this case, the front user or the student 20 and the rear user or the student 30 can see the other side of the screen through the transparent display 10 having light transmission.

Meanwhile, in FIG. 1, there are remote users or instructors 40 located away from the conference or lecture center around the transparent display 10. Here, the remote means that the participant is not a facing participant through the transparent display 10, and does not necessarily mean that the remote user or the instructor 40 should be located at a physically remote location. The remote user or instructor 40 accesses and controls the transparent display 10 through his / her terminal device or the like through network communication. Then, the remote user or instructor 40 can generate a necessary image during the conference or lecture and display it on the transparent display 10 through various interfaces or input means.

Now, specific embodiments of the present invention will be introduced based on this hardware structure.

FIG. 2 is a block diagram illustrating an interactive-based remote video communication or lecture system using a transparent display according to an embodiment of the present invention. The hardware configuration and the participants described above with reference to FIG. 1 are the same.

The transparent display 10 is capable of displaying images (which may include conference or lecture content) and has transparency so that the front-side user 20 located on the front side can display the image and the rear- It is a means to observe both objects simultaneously. A front user or a student 20 is positioned on the front of the transparent display 10, and a rear user or a student 30 is located on the rear of the transparent display 10. Of course, a remote user or instructor 40 is also located at a distance therefrom.

These participants can acquire and share their own images and motion images using the front camera 61, the rear camera 62, or the remote camera 63, respectively. In this case, the cameras 61, 62 and 63 may be partially omitted according to the necessity of implementation. However, in the essence of the present invention, a rear camera (not shown) used to acquire motion images of the rear- 62) is preferably adopted. In addition, these cameras 61, 62, and 63 can be used not only as a camera that acquires pixel information but also as a three-dimensional sensor or depth image acquisition means such as a Kinect, For example, it can be gesture recognition or the participant's intensive state recognition, etc.).

The processing unit 50 controls the rearview camera 62 to control the movement of the rear user or the student 30 And transmits the generated feedback image to a remote user or instructor 40 located in a remote location in real time and generates a feedback image based on the response received from the remote user or instructor 40 and provides the feedback image to the transparent display. The feedback image is a response of the remote user or the instructor 40 visually recognizing the motion image of the rear user or the training student 30 received from the processor 50.

If the remote video communication or lecture system includes a front camera 61 that senses the movement of at least one or more front users or students 20 located on the front of the transparent display 10, And transmits the image of the front user or the student 20 sensed through the front camera 61 to the remote user or the instructor 40 in real time so that the participants can receive the feedback attitude or response of the listening attitude. That is, the remote user or lecturer 40 can perform a query response based on the direct video communication with the participants, and can interact with the contents of the meeting or the lecture through the gesture recognition of the front camera 61.

On the other hand, the remote user or lecturer 40 can access the remote video communication or lecture system via the network via the remote processor 70, and provide his / her own image to the participants through the remote camera 63 . The configuration and implementation method of the remote processor 70 and the remote camera 63 may obscure the essence of the present invention, and a detailed description thereof will be omitted here. As a simple example, the remote user or instructor 40 may be able to connect to a remote video communication or lecture system via a notebook PC with a Kinect connected thereto. In addition, it is needless to say that a content database 75 for storing contents that can be used for conferences or lectures may be separately provided.

3 is a diagram illustrating a case where a practicing student performs a cooking exercise through a remote lecture system according to an embodiment of the present invention.

In the present embodiment, the processing unit of the remote lecture system can generate a feedback image indicating a supplementary opinion on the motion of the rear user (training student) and display the feedback image on a specific area on the transparent display. Referring to FIG. 3, a practicing student is performing cooking exercises near a laboratory located opposite to the rest of the students, centering on a transparent display. At this time, the content of the lecture can be displayed on the transparent display, and the image thus displayed can be viewed by both the trainee student and the rest of the student depending on the nature of the transparent display having bidirectional light transmittance.

Such a transparent display can be observed simultaneously in both the front and rear directions, and it is possible to allow the rear user (practicing student) visually recognizing the feedback image displayed on the transparent display to calibrate his / her movement based on the feedback image .

In addition, frontal users (the rest of the students) located on the front of the transparent display may have overlapping feedback images corresponding to the rearal objects (which may be practicing students, practice tools, and materials) Can be recognized. The image of the student's action is transmitted to the instructor in real time. The lecturer can magnify the action part of the student practicing in real time with the gesture and display the wrong action. The student can check the feedback image of the instructor and calibrate his / her wrong motion in real time. In other words, students located on the front of the transparent display can see both the cooking scene of students, the contents of the lecture displayed on the transparent display, and the feedback image of the instructor at the same time, thereby obtaining improved experience and learning effects. Based on these configurations and characteristics, it can be utilized in conferences, lectures, practical exercises, etc. that require demonstration or practice.

FIG. 4 is a diagram illustrating an operation performed by a lecturer instructing cooking exercises through the remote lecture system of FIG. 3 according to an embodiment of the present invention.

Referring to FIG. 4, the instructor can visually check the images of the participants (the students and the students who observe the students) through the display means, and can perform lectures using a remote camera using Kinect, . Especially, when the proposed configuration is utilized, it is possible for the lecturer to demonstrate himself / herself by pointing out the wrong part in the practice which the student is practicing in real time, and it is possible to acquire the feedback image with the remote camera and transmit it to the students again. At this time, the transmitted feedback image is displayed on the transparent display provided in the lecture room of the remote lecture system, thereby improving the understanding of the students.

Figs. 5A and 5B are views illustrating the structure of a transparent display adopted by embodiments of the present invention. Basically, a transparent display is used to visually recognize an object (person or object) And an image generation unit 12, 13, 14 for generating an image in accordance with a control signal applied from the processing unit 50 and displaying the image in both directions of the light transmissive screen. The structure of the transparent display exemplified in Figs. 5A and 5B is merely shown in terms of the functional aspects, and the order of arrangement, arrangement and spacing of the respective structures and the like are not limited to the environment and conditions in which the embodiments of the present invention are implemented As shown in FIG.

The light transmissive screen 11 functions as a light transmissive film layer of a liquid crystal display device and forms and supports a display screen. The image generating units 12, 13, and 14 may be formed as at least one layer. Hereinafter, two embodiments are presented, and the configuration thereof will be described sequentially.

Referring to FIG. 5A, it can be seen that the light transmissive screen 11 is deposited on both sides of the image generating unit 12 composed of one layer. However, A protective film or the like for protecting the image generating unit 12 may be used.

However, due to physical constraints on implementation, it has been pointed out that the light-transmissive screen 11 may display images on one side relatively darker than images on the other side. Therefore, it is shown that the second embodiment can solve this problem.

5B, it can be seen that the light transmissive screen 11 is deposited on both sides of the image generating units 13 and 14 composed of two layers, but a screen is formed not in both sides But it is also possible to finish with a protective film or the like which protects the image generating unit 13 or 14 on the other side.

Here, the image generating units 13 and 14 are arranged such that two directional layers are deposited in opposite directions with respect to image display, and the first image signal and the first image are reversed left and right (meaning a mirror effect It is preferable that the second video signals are respectively applied. With this configuration, users located on the front and rear sides of the transparent display can provide images of the same quality.

6 is a diagram illustrating a method of controlling an image displayed on a transparent display through motion tracking in a remote lecture system according to an embodiment of the present invention.

In the remote lecture system of the present embodiment, the movement of the rear user (the trainee student) is continuously tracked through the rear camera, so that the position of the feedback image displayed on the transparent display in accordance with the motion of the rear user is adaptively Can be adjusted.

If the position of the image 15 of the lecture displayed on the transparent display 10 is fixed regardless of whether the rear user (student) moves left or right, the movement of the rear user (student) and the contents of the lecture may overlap exist. 6 to facilitate the observation of front users (students) beyond the transparent display, the movement of the rear user (the trainee student) is controlled by a rear camera 62, such as a Kinect, And the position of the lecture image 15 displayed on the transparent display 10 is changed corresponding to the detected motion, thereby providing a more smooth lecture environment.

FIG. 7 is a diagram for explaining a method of inducing concentration of students in a remote lecture system according to an embodiment of the present invention. In a situation where a lecturer located at a remote location is hard to observe the appearance of a lecture listener, To solve the problem presented.

To this end, the remote teaching system according to the present embodiment further includes a front camera that detects the movement of at least one student located on the front of the transparent display, so that, based on the images of the students obtained through the front camera The state of reduced concentration can be checked, and a warning message can be provided to students when a pattern indicating that the concentration has deteriorated is found.

Such a warning message may warn students of the front side by displaying a warning image interacting with the image displayed on the transparent display or a warning image interacting with the trainee student observed through the transparent display. Referring to FIG. 7, it is possible to display a scene 17 in which an interesting effect is added on a transparent display, thereby confirming a scene inducing attention of the students. In addition, the alert image can be implemented to recognize and interact with the location of the trainee's student beyond the transparent display or the image of the instructor displayed on the transparent display. For example, it is possible to display a picture in which a virtual character appears and a lecturer or a joke plays a game with contents.

In general, the types of students who take lectures are those who concentrate on lectures, listen to lectures, listen to lectures, look in other directions, and write notes while watching lectures. It can be classified into three types, which can be judged according to the head direction of a person. Accordingly, the processing unit of the remote lecture system according to the present embodiment determines that the state of the corresponding student is 'concentrated' when the facial region extracted from the obtained student image is directed to the front of the transparent display, The face region extracted from the acquired images of the students is directed to a direction other than the front face or the bottom face longer than the critical duration time If so, the student's status can be judged to be 'distracting'.

The direction and duration of the face region can be obtained more easily by using a three-dimensional sensor such as a Kinect or a depth image camera. Since it is possible to recognize a plurality of users individually and to process the movements simultaneously, it is preferable to provide an appropriate number of sensors in consideration of the number of participating students.

Further, the processing unit of the remote lecture system may calculate the ratio of the students who have been detected in the concentration lowering state among the students recognized through the front face camera and provide the learner with the ratio, so that the lecturer instructs the lecture contents, Message to the user. For example, if the 'memo' state lasts more than two minutes, it can be judged to be 'distracting', which does not concentrate automatically. If the 'memo' state and the 'concentrated' state appear alternately, it can be recognized as a 'concentrated' state. If the state of the head motion is changed for more than two minutes, the state can be determined as 'distracted'. However, at the time of the student's question, it may be possible to temporarily stop the concentration of all the students, or separately define the duration for judging the 'memo' state according to the instructor's lecture data. Using this criterion, students can generate statistics on the concentration of students from the beginning of the lecture, calculate the average concentration index at the end of the lecture, and reflect the lecture evaluation.

The embodiments of the present invention described above can utilize a transparent display to provide real-time practice scenes and actual lecture contents on the screen, such as augmented reality, to students or introduce them during a meeting, Students, and other observers), and to enhance the effectiveness of meetings and lectures by inducing more active interaction with participants and instructors located in remote locations, or by understanding the concentration status of participants in real time .

In the meantime, embodiments of the present invention may be embodied in computer readable code on a computer readable recording medium in order to control the presented hardware. A computer-readable recording medium includes all kinds of recording apparatuses in which data that can be read by a computer system is stored.

Examples of the computer-readable recording medium include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, and the like. In addition, the computer-readable recording medium may be distributed over network-connected computer systems so that computer readable codes can be stored and executed in a distributed manner. In addition, functional programs, codes, and code segments for implementing the present invention can be easily deduced by programmers skilled in the art to which the present invention belongs.

The present invention has been described above with reference to various embodiments. It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims. Therefore, the disclosed embodiments should be considered in an illustrative rather than a restrictive sense. The scope of the present invention is defined by the appended claims rather than by the foregoing description, and all differences within the scope of equivalents thereof should be construed as being included in the present invention.

10: Transparent display
20: Front Users, Students
30: Backward user, student
40: Remote User, Instructor
50:
61: Front camera 62: rear camera
63: Remote camera
70: remote processor 75: content DB
11: light transmissive screen
12, 13 and 14:
15: Content video
17: warning image

Claims (17)

A transparent display capable of displaying an image and having light transmittance so that a front user located at the front can simultaneously observe the image and an object positioned at the rear;
A rear camera for sensing movement of a rear user located on a rear surface of the transparent display; And
And a processor for controlling the rear camera to transmit the motion image of the rear user to a remote user located at a remote location in real time and to generate a feedback image based on a response received from the remote user and provide the feedback image to the transparent display,
Wherein the feedback image is a response including information provided by the remote user visually recognizing the motion image of the back user received from the processing unit to correct movement of the back user, Is displayed,
Wherein the backward user's initial movement induced according to an image initially displayed on the transparent display and the backward user's calibrated movement induced according to the feedback image displayed on the transparent display are sequentially transmitted to the front user through the transparent display, To the remote video communication device. The method according to claim 1,
Wherein,
A feedback image representing a supplementary opinion on the movement of the rear user is generated and displayed on a predetermined area on the transparent display so that a front user located at the front of the transparent display can display an overlap image corresponding to the rear object transmitted through the transparent display, the overlapping feedback images are recognized together. The method according to claim 1,
Wherein,
Wherein the control unit continuously tracks the movement of the rear user through the rear camera to adaptively adjust the position of the feedback image displayed on the transparent display in response to the movement of the rear user. A video communication device. The method according to claim 1,
The transparent display comprises:
It can be observed simultaneously in both front and rear directions,
Wherein the backward user visually recognizing the feedback image displayed on the transparent display is instructed to correct his / her movement based on the feedback image. The method according to claim 1,
The transparent display comprises:
A light transmissive screen for visually recognizing objects located in mutually opposite directions; And
And an image generation unit configured to generate an image according to a control signal and to form at least one layer for displaying an image in both directions of the light transmissive screen. 6. The method of claim 5,
The image generation unit may include:
Two layers for producing an image are deposited in opposite directions to each other,
Wherein the first image signal and the second image signal obtained by inverting the first image are respectively applied to the layer to provide the same image to the users located on the front and rear sides of the transparent display, . The method according to claim 1,
And a front camera for sensing movement of at least one front user located on the front of the transparent display,
Wherein,
And transmits the image of the front user sensed by the front camera to the remote user in real time. A transparent display capable of displaying an image including content of a lecture and having a light transmittance so that a student located at the front can simultaneously observe the image and an object located at the rear;
A rear camera for sensing a movement of a trainee located at a rear side of the transparent display; And
And a processor for generating a feedback image based on a response received from the lecturer and providing the motion image to the transparent display by controlling the rear camera to transmit the motion image of the learner to a lecturer located at a remote location in real time,
Wherein the feedback image is a response including information provided by the instructor visually recognizing the motion image of the training student received from the processing unit to correct movement of the training student, Simultaneously,
Wherein the first movement of the training student induced according to the image initially displayed on the transparent display and the corrected movement of the training student induced according to the feedback image displayed on the transparent display are sequentially displayed on the transparent display To a student located at the front of the remote lecture system. 9. The method of claim 8,
Wherein,
Generating a feedback image indicating a supplementary opinion on the movement of the training student and displaying the feedback image in a predetermined area on the transparent display so as to allow a student located in front of the transparent display to display an overlap image overlapping lecturer's feedback image to be recognized together. 9. The method of claim 8,
Wherein,
The position of the lecture contents or the instructor feedback image displayed on the transparent display is adaptively adjusted in accordance with the movement of the training student by continuously tracking the movement of the training student through the rear camera A remote steel system characterized by. 9. The method of claim 8,
The transparent display comprises:
It can be observed simultaneously in both front and rear directions,
And instructs the student who visually recognizes the feedback image of the instructor displayed on the transparent display to correct the exercise of the student based on the feedback image. 9. The method of claim 8,
The transparent display comprises:
A light transmissive screen for visually recognizing objects located in mutually opposite directions; And
And an image generation unit configured to generate an image in accordance with a control signal and to form an image on both sides of the light transmissive screen in at least one layer. 13. The method of claim 12,
The image generation unit may include:
Two layers for producing an image are deposited in opposite directions to each other,
Wherein the first image signal and the second image signal obtained by inverting the first image are respectively applied to the layer to provide the same image to the students and the students located on the front and rear sides of the transparent display, system. 9. The method of claim 8,
And a front camera for sensing movement of at least one student located on the front of the transparent display,
Wherein,
And a warning message is provided to the students when a pattern indicating that the concentration is decreased is provided to the students. 15. The method of claim 14,
Wherein,
If the facial region extracted from the acquired images of the students is directed to the front of the transparent display, the state of the corresponding student is determined as 'concentrated'
If the face area extracted from the obtained images of the students is directed to the bottom, the state of the corresponding student is determined as 'memo'
Wherein the state of the corresponding student is determined to be 'distracting' when the face region extracted from the acquired student's image is directed to a direction other than the front or the floor beyond the critical duration. 15. The method of claim 14,
The warning message may include:
Wherein a warning image interacting with an image displayed on the transparent display or a warning image interacting with a trainee student observed through the transparent display is displayed so that the attention of the students on the front side is reminded. 15. The method of claim 14,
Wherein,
Calculating a ratio of students who have been detected in the concentration-reduced state among the students recognized through the front camera, and providing the ratio to the lecturer to guide the lecturer to adjust the lecture contents, the feedback image, or the warning message Remote teaching system.
KR1020150072832A 2015-05-26 2015-05-26 The system for remote video communication and lecture based on interaction using transparent display KR101757420B1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
KR1020150072832A KR101757420B1 (en) 2015-05-26 2015-05-26 The system for remote video communication and lecture based on interaction using transparent display
PCT/KR2015/011446 WO2016190493A1 (en) 2015-05-26 2015-10-28 Interaction-based remote video communication and lecturing system using transparent display

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020150072832A KR101757420B1 (en) 2015-05-26 2015-05-26 The system for remote video communication and lecture based on interaction using transparent display

Publications (2)

Publication Number Publication Date
KR20160138681A KR20160138681A (en) 2016-12-06
KR101757420B1 true KR101757420B1 (en) 2017-07-12

Family

ID=57392819

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020150072832A KR101757420B1 (en) 2015-05-26 2015-05-26 The system for remote video communication and lecture based on interaction using transparent display

Country Status (2)

Country Link
KR (1) KR101757420B1 (en)
WO (1) WO2016190493A1 (en)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101876115B1 (en) * 2017-01-12 2018-07-06 김동훈 A System Providing E-book Service Reading Text With Target User’s Voice
CN113132767A (en) * 2019-12-30 2021-07-16 星络智能科技有限公司 Storage medium, video pushing method and system
WO2022025353A1 (en) * 2020-07-30 2022-02-03 효성티앤에스 주식회사 Digital desk and image control method using same
KR102633657B1 (en) * 2020-07-30 2024-02-05 효성티앤에스 주식회사 Digiital desk and control method of image for the same
EP3968259A1 (en) 2020-09-15 2022-03-16 Hyosung Tns Inc. Digital desk and image control method using same

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120256823A1 (en) * 2011-03-13 2012-10-11 Lg Electronics Inc. Transparent display apparatus and method for operating the same
US20140205984A1 (en) * 2013-01-22 2014-07-24 Desire2Learn Incorporated Systems and methods for monitoring learner engagement during a learning event

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100060289A1 (en) 2008-09-05 2010-03-11 Skf Usa, Inc. System for Electrical Apparatus Testing
TW201323690A (en) 2011-12-02 2013-06-16 Tai-Yi He Expandable background set-up device
KR20140044730A (en) * 2012-10-05 2014-04-15 삼성전자주식회사 Method and system for augmented reality based smart classroom environment
KR101565472B1 (en) * 2013-05-24 2015-11-03 주식회사 골프존 Golf practice system for providing information on golf swing and method for processing of information on golf swing using the system
KR101518833B1 (en) * 2013-05-27 2015-05-13 테크빌닷컴 주식회사 Mobile termianl, computer-readable recording medium and method for image recognation and implementing augmented reality

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120256823A1 (en) * 2011-03-13 2012-10-11 Lg Electronics Inc. Transparent display apparatus and method for operating the same
US20140205984A1 (en) * 2013-01-22 2014-07-24 Desire2Learn Incorporated Systems and methods for monitoring learner engagement during a learning event

Also Published As

Publication number Publication date
WO2016190493A1 (en) 2016-12-01
KR20160138681A (en) 2016-12-06

Similar Documents

Publication Publication Date Title
KR101757420B1 (en) The system for remote video communication and lecture based on interaction using transparent display
Monroy Reyes et al. A mobile augmented reality system to support machinery operations in scholar environments
Larsson et al. The actor-observer effect in virtual reality presentations
Bowman et al. Evaluating effectiveness in virtual environments with MR simulation
JP6683864B1 (en) Content control system, content control method, and content control program
WO2021106803A1 (en) Class system, viewing terminal, information processing method, and program
US20220404907A1 (en) Method And Apparatus For Real-time Data Communication in Full-Presence Immersive Platforms
KR102283301B1 (en) Apparatus and Method for Providing real time comunication platform based on XR
Livatino et al. Stereo viewing and virtual reality technologies in mobile robot teleguide
Regenbrecht et al. Mutual gaze support in videoconferencing reviewed
US20190005831A1 (en) Virtual Reality Education Platform
Laviole et al. Nectar: Multi-user spatial augmented reality for everyone: three live demonstrations of educative applications
Melchor-Couto et al. Immersive virtual reality: exploring possibilities for virtual exchange
Chen Collaboration in Multi-user Immersive Virtual Environment
JP6892478B2 (en) Content control systems, content control methods, and content control programs
Gopalakrishnan et al. Parametric evaluation of progressively immersive multimedia representations for teaching environment in eLearning
Bednarz et al. Applications of networked virtual reality for tele-operation and tele-assistance systems in the mining industry
JP2021086146A (en) Content control system, content control method, and content control program
Torrejon et al. Panoramic audio and video: towards an immersive learning experience
JP2021009351A (en) Content control system, content control method, and content control program
Lyk et al. Creating a more immersive and" VR-like" 360-Degree video experience-development of an immersive and interactive alcohol resistance training tool
Jin A Constructivism-based 3D Scene Display Teaching System for Wushu Teaching.
Nawahdah et al. Motion adaptive orientation adjustment of a virtual teacher to support physical task learning
JP6733027B1 (en) Content control system, content control method, and content control program
Maidenbaum Sensory substitution training for users who are blind with dynamic stimuli, games and virtual environments

Legal Events

Date Code Title Description
A201 Request for examination
E902 Notification of reason for refusal
E701 Decision to grant or registration of patent right
GRNT Written decision to grant