TWI682354B - Cognitive learning system and method for learning system thinking using the same - Google Patents

Abstract

The present invention provides a cognitive learning system for assisting system thinking, in which the empathy thinking and meta-thinking in thinking education field can be developed through the assistance of the system for achieving objective of improving systematic thinking. In one embodiment, an image acquiring system with capability of detecting bio-signals of the participants is utilized to generate a streaming media associated with a topic discussion held by a guider and the participants. The system also provides an operation interface for the guider to setup at least one pause points within the streaming media, and a plurality of questions respectively corresponding to the at least one pause points. The participants can use a terminal device for replaying the streaming media and replying questions corresponding to the respective pause points. Through repeating the foregoingly described procedures, the participants can develop meta-thinking and empathy thinking for achieving the systematic thinking part within the core competencies.

Description

Cognitive learning system and its systematic thinking learning method

The present invention is a cognitive learning system, and in particular, it refers to a systemic thinking learning method of a cognitive learning system that allows participants to perform transpositional thinking and post-thinking training through image playback to improve the thinking education effect.

In the past education and training, the way of training thinking is often to guide students to think through the ability of face-to-face interviews, or to let students answer the designed questions on paper or computer screens and answer them with questions. The results are used as the basis for logical thinking teaching and training. For example, No. M562480 of the New Announcement of the Republic of China teaches a detection system for logical thinking ability, including an interactive device suitable for the subject to operate for testing, and a suitable for measuring and recording the subject’s eyeball position Eye tracker and eye movement information, and an analysis module that can receive the eye position and eye movement information recorded by the eye tracker, the analysis module can be based on the eye position and eye movement information from a behavior database Find the corresponding analysis result, and then display the analysis result on the interactive device. In addition, for another example, the patent of the Republic of China Invention Patent No. I623847, which teaches a computer program product for evaluating logical thinking ability, controls the test program presented in the test interface by setting at least one test control parameter Quiz rules. Then set at least one physiological stimulation parameter. Then, the subject is subjected to a test procedure. The test procedure is configured to require the testee to make judgments based on a plurality of cognitive objects having an arrangement relationship, and at the same time, the computer controls the peripheral device to give the testee physiological stimulation according to the physiological stimulation parameters. After the test is completed, enter the scoring mode, and calculate the score obtained by the testee when receiving the test procedure. Finally, enter the analysis mode, generate an analysis report based on the score, test control parameters, and physiological stimulation parameters, and store the analysis report in the storage device.

Since the aforementioned logical thinking training education belongs to the subject's subjective thinking training, since it does not dialyze the type of human thinking, it does not cover the depth and breadth of thinking education. Therefore, the education personnel in recent years has promoted a core quality cultivation education. Core literacy emphasizes the value and function of education. The three aspects of core literacy and the connotation of the nine projects can also cover knowledge, ability, attitude, etc. The concept emphasizes the promotion of individual whole person development and the cultivation of lifelong learning through literacy in the learning process. .

Core literacy emphasizes attitude. Most major countries in the world, including the United States and the mainland, are carrying out core literacy. Its main goal is lifelong learning, and the cultivation of autonomous action, communication and interaction and social participation are the three major aspects. The nine projects are launched again from three aspects: autonomous action, communication and interaction and social participation. The main actions include physical and mental qualities and self-improvement, systematic thinking and problem solving, planning execution and innovation response; communication and interaction include the use of signs Communication and expression, scientific and technological information and media literacy, artistic cultivation and aesthetic literacy, and social participation include ethical practice and civic consciousness, interpersonal relationships and teamwork, multiculturalism and international understanding, a total of three aspects and nine items.

Among the three aspects of core literacy, self-directed action is the most important aspect, because only you can take the initiative to have subsequent multiple possible developments. Among the three independent actions, system thinking is the core, because under the current education system, children do not act autonomously and are educated and commanded from an early age, so they are not sound in development. Among the three subdirections of autonomous action, the most important are the two abilities of systematic thinking and problem solving.

The so-called system thinking is proposed by Peter Senge. He proposed a learning organization, including the so-called fifth practice (The Fifth Discipline), the most important of which is systematic thinking. Because most of the previous thinking is critical thinking or logical thinking, but only these are incomplete. Systematic thinking is mainly to generate a loop to achieve the goal of thinkers.

Core literacy is a theory and concept, but in fact how to practice, or to achieve the effect of core literacy through system-assisted methods, there is currently no very systematic solution, especially for the system thinking department in autonomous action It also needs a cognitive learning system and its systematic thinking and learning methods to solve the current deficiencies in flipping education.

The main core of the present invention is to propose a system and an operation method that can be actually executed for the systematic thinking in autonomous action and can effectively assist participants to develop systematic thinking. The system and operation method of the present invention mainly capture the process of discussion on a subject by an image system that tracks the physiological state of the participant, and record it as a stream of images. Then an operation interface is provided so that the guide can set a pause playback point for the streaming image, and display the corresponding problem when the corresponding pause pause point is displayed. Participants can play back the streaming video with the paused playback point and the corresponding question through another terminal device afterwards, and reply to the related question. By repeating the above procedure, participants can train empathy and meta-thinking to achieve the training effect of systematic thinking in core literacy.

The present invention proposes an implementation architecture for system thinking, which can be realized through three steps. The first step is logical thinking, the second step is empathy thinking, and the third step is meta-thinking. -thinking), through the audio-visual system to assist the participants in learning, and then go back to rethink the process of their participation from the perspective of transposition and later, to achieve the effect of training system thinking.

In a specific embodiment, the present invention provides a cognitive learning system, including an image capture system, a sensing device, an arithmetic processor, a storage device, a first terminal device, and a second terminal device. The image capturing system is used to record a teaching situation mirror. The sensing device is used to sense a physiological signal about a plurality of participants in the teaching situation. The arithmetic processor is used to receive the physiological signal about each participant and determine the status of the physiological signal. When a physiological signal meets a specific condition, the image acquisition system is controlled to capture the participant corresponding to the physiological signal image. The storage device is used to store a video stream signal recorded by the image capturing system. The first terminal device is used to provide a first operation interface to a leader, so that the leader can set the audio and video streaming signal to generate setting information, and the setting information includes the audio and video streaming signal. A pause playing point is set at a specific time point, and at least one problem is designed for each pause play point. The second terminal device is used to provide a second operation interface to the participants, to play back the audio and video stream signal through the second operation interface, and to play back the audio and video stream signal according to the setting information The pause play point displays the corresponding at least one question, allowing the participant to answer the at least first question, and the second operation interface stores the content answered by the participant.

In a specific embodiment, the present invention provides a system thinking learning method, which includes the following steps: First, perform step (a) to provide a cognitive learning system, including an image capture system, a sensing device, a An arithmetic processor, a first terminal device and a second terminal device. Then, in step (b), the facilitator allows a plurality of participants to discuss and interact with each other to construct a teaching situation. Then, proceed to step (c) to record the teaching situation mirror using the image capturing system. Next, proceed to step (d) using the sensing device to sense a physiological signal about a plurality of participants in the teaching situation. Then proceed to step (e) to enable the arithmetic processor to receive the physiological signal about each participant and determine the status of the physiological signal. When there is a physiological signal that meets certain conditions, the image acquisition system is controlled to capture the corresponding physiological signal Participants’ images, and store the images in a storage device to form an audio and video streaming signal. Then, in step (f), the leader sets the audio and video streaming signal through a first operation interface provided by the first terminal device to generate setting information, and the setting information includes the audio and video streaming signal. A pause playing point is set at a specific time point, and at least one problem is designed for each pause play point. Then proceed to step (g). The participant uses a second operation interface provided by the second terminal device to play back the video stream signal, and in the process of playing back the video stream signal, according to the setting information, at each The pause play point displays the corresponding at least one question to allow the participant to answer the at least first question, and the second operation interface stores the content answered by the participant. Finally, step (h) is performed. After the step (g), the facilitator gathers the plurality of participants again to discuss and interact with the target again, and then repeats the steps (c)-(g) at least once.

Hereinafter, with reference to the accompanying drawings, various exemplary embodiments may be described more fully, and some exemplary embodiments are shown in the accompanying drawings. However, the inventive concept may be embodied in many different forms and should not be interpreted as being limited to the exemplary embodiments set forth herein. Rather, providing these exemplary embodiments will make the invention detailed and complete, and will fully convey the scope of the inventive concept to those skilled in the art. Similar numbers always indicate similar components. The following describes the cognitive learning system and its systematic thinking learning method with various embodiments and diagrams. However, the following embodiments are not intended to limit the present invention.

Please refer to FIG. 1, which is a schematic diagram of an embodiment of the cognitive learning system of the present invention. In this embodiment, the cognitive learning system 2 includes an image capturing system 20, a sensing device 21, an arithmetic processor 22, a storage device 23, a first terminal device 24, and a second mid-end device 25 . The image capturing system 20 includes at least one image capturing device 200, such as a camera, disposed around a classroom, and its field of view can cover all areas of the entire classroom R. The image capturing device 200 can zoom the field of view according to the control signal generated by the arithmetic processor 22. In addition, the image capturing device 200 is further provided on a base capable of multi-dimensional movement, and the base can perform the control signal Rotation or displacement movement to control the image capturing device 200 to move to an appropriate angle of view to capture images.

In the space of this classroom R, there are a plurality of participants and facilitators. The facilitator is mainly in control of the discussion. Participants can divide several people into a group and discuss the subject of a discussion. The number of image capturing devices 200 can be plural. If there are many, each image capturing device 200 can be set to play a different role. For example, one or some image capturing devices 200 are responsible for recording images of the entire field of view of the classroom. One or some image capture devices 200 are responsible for recording close-up images of specific people. The space image of the entire classroom R represents the entire process of recording the discussion subject and all participants’ images, including full-range images from different perspectives. It is used for post-thinking training purposes; and close-up images of specific characters can also include close-up images of different angles, which can be used for empathic thinking training purposes. In some embodiments, some image capturing devices 200 may have the function of capturing the whole and close-up images simultaneously.

In one embodiment, the sensing device has a plurality of sensing modules 210 for wearing on each participant 90 to sense their physiological state and generate corresponding physiological signals. The sensed physiological signal is transmitted to the signal receiving unit 211 that receives the signal by wireless communication. It should be noted that the sensing module 210 may be a signal transmission module with Bluetooth, infrared, RFID, ZigBee, UWB, ultrasonic, etc., for transmitting the signal to the signal receiving unit 211. The signal receiving unit 211 then transmits the received physiological signal to the arithmetic processor 22 in a wired or wireless manner. The physiological state includes information such as heartbeat, pulse, blood pressure or sound. It should be noted that, in another embodiment, the sensing device may be composed of the image capturing device 200 and the arithmetic processor 22, and the image captured by the image capturing device 300 is transmitted to the arithmetic processor 22, and the arithmetic The processor 22 analyzes the physiological state of the participant through images, including expressions such as smile, anger, and sadness, and generates corresponding physiological signals. In another embodiment, it can also be a combination of the sensing module 210, the image capturing device 200, and the arithmetic processor 22, which can be changed according to design needs.

The physiological signal measured by the sensing module 210 is analyzed and judged by the arithmetic processor 22. When the arithmetic processor 22 determines that a physiological signal meets a specific condition, the image capturing device 200 is controlled to acquire the corresponding physiological signal The image of the participant of the signal. For example, when the physiological signal of the participant 90A, for example, the sound meets certain conditions, the arithmetic processor determines that the participant is currently speaking, so the image capturing device is controlled to close the participant 90A and capture the participant 90A. Close-up image. There may be a plurality of image capturing devices, which capture images participating in the 90A at different angles.

In addition, it should be noted that when recording a close-up image of the participant 90A, the image capturing device 200 that records the entire process also synchronizes the images of all the personnel. In another embodiment, while recording a close-up image of participant 90A, if the physiological signals of other participants also reach the recorded standard, the arithmetic processor 22 may synchronously control other image capturing devices 200 to capture another Close-up image of participants. For example, in one embodiment, if another participant's 90B heartbeat rises, or the blood pressure rises, or the face has a special expression, or whispers to the person next to it, if the detection meets the record, The standard of video will also record a close-up image of participant 90B. In another embodiment, when the physiological signal of the participant is not at or below a certain level, the arithmetic processor 22 controls the image capturing device 200 to stop close-up recording. Of course, in the process of stopping the close-up video, the image capturing device 200 that records the entire field of video continues to be recorded.

In one embodiment, the computing processor 22 has image processing capabilities, and can receive the streaming image signals generated by each image capturing device 200, and then aggregate them according to the time series to form an audio and video streaming signal. The arithmetic processor 22 may be a workstation computer, a desktop computer, a notebook computer, a cloud server, or the like. In another embodiment, the arithmetic processor 22 may aggregate the streaming media generated by each image capturing device to form an audio and video streaming signal corresponding to each participant. For example, in one embodiment, taking participants 90A~90D as an example, the video stream signal may have multiple, and each video stream signal corresponds to participants 90A, 90B, 90C, and 90D, respectively. The reason why this effect can be achieved is that when the close-up image capture device is recording a specific participant’s image, because the arithmetic processor already knows which image capture device is currently recording which participant’s image, so when recording After the completion, when the arithmetic processor 22 is storing, it may give a mark that the close-up stream image corresponds to a specific participant. Therefore, after the entire discussion process is completed, the arithmetic processor can separately store the streaming images of the corresponding participants. The streaming image includes a full set of post-images, that is, full-length recordings, and transposed images about the user (participant and/or leader), that is, the user (participant and/or leader) ) Close-up image.

The storage device 23 is used to store an audio and video stream signal recorded by the image capturing system. In one embodiment, the storage device can receive the video stream signal through the arithmetic processor. The storage device 23 may be a storage device provided in the arithmetic processor 22, such as a hard disk, or a storage device externally connected to the arithmetic processor 22, such as a hard disk storage array or a NAS storage array. In another embodiment, the storage device 23 may also be a remote cloud storage server, which is electrically connected to the arithmetic processor through a network. In another embodiment, the storage device 23 can be directly electrically connected to the image capture device 200 of the image capture system to receive and store the video and audio stream signals generated by each image capture device 200.

The first terminal device 24 has an execution program. After execution, a first operation interface can be generated, and the user can use the first operation interface to perform various settings or operations. The first terminal device 24 may be a desktop computer, a notebook computer, or a smart handheld device, such as a smart phone or a tablet computer, but it is not limited thereto. In one embodiment, the leader uses the first terminal device 24 to obtain the video stream signal from the storage device 23 using the first operating interface, and sets the video stream signal to generate a setting message. The setting information includes setting a pause playback point at a specific time point for the video streaming signal, and designing at least one problem corresponding to each pause play point. In an embodiment, the pause play point may be a certain time point when a particular participant has a close-up shot, or a time point that causes everyone's attention and commotion during the entire discussion process.

In one embodiment, the facilitator can design different pause and play points and question content for each participant. For example, the facilitator can set the pause point for the close-up image of participant 90A, and design related issues. Similarly, for participants 90B~90D, there are also different problems and the setting of pause play points. In another embodiment, each participant's pause play point and question may also have the same content.

The second terminal device 25 has an execution program. After execution, a second operation interface can be generated, and participants can use the second operation interface to perform various operations. The second terminal device 25 may be a desktop computer, a notebook computer, or a smart handheld device, such as a smart phone or a tablet computer, but it is not limited thereto. In this embodiment, after returning home, the participant can obtain the corresponding audio and video streaming signal from the storage device 23 through the second terminal device 25 and the second operation interface for playback. The second operation interface reads the relevant setting information of the previous leader during the playback of the video stream signal, pauses the playback at each pause playback point, and displays the corresponding at least one problem. At this time, the participant can answer the at least first question, and then store the content answered by the participant back to the storage device 23 through the second operation interface.

The process of the participant playing back the streaming video signal using the second operation interface of the second terminal device 25 can achieve the effects of post-consideration and transposition thinking. There are three levels to achieve systematic thinking, the first is logical thinking, the second is empathic thinking, and the third is meta-thinking. The logic is based on self-centeredness, the empathy is based on the other party, and the latter is based on everyone. Among them, the part of logical thinking is the process of thinking of participants in the process of discussing the subject, which is the training of logical thinking. Because logical thinking is self-centered, training is easy. However, transposition and meta-thinking are generally not easy to learn, because the average learner is looking at the results, usually learning from the results of failure, and performing reverse engineering to find the cause and effect, but this can only analyze the cause, there is no way improve. Therefore, the playback of streaming video signals through the second terminal device 25 of the present invention, pause playback at one or more specific time points, and related issues of settings can allow participants to escape from the framework of traditional logical thinking and perform transpositional thinking and Post-thinking training.

It should be noted that when answering, participants can respond to all the questions designed on the knowledge points through voice and text. In addition, because the system 2 has a sensing device, the image capturing device 200 can be controlled by sensing the physiological signal of the participant to record a close-up image of the participant whose physiological signal response exceeds a certain level, so when in the subsequent playback process, Participants can look at themselves from the second person's point of view by watching and playing back their close-up images, and then create a rethinking training of transposition thinking by answering the preset questions of the paused playback point. Similarly, because the image capturing device 200 of the present invention also records images of the entire classroom space, participants can see the close-up images of themselves as well as the entire video, looking at the whole process from the perspective of bystanders. Answer the question of the paused playback point, and establish a post-thinking training.

In one embodiment, the storage device 23 is set in a cloud server, and each participant has a corresponding account. Therefore, when the participant uses the second terminal device 25 to connect to the cloud server, the Account and password, get the corresponding audio and video streaming signal.

Please refer to FIG. 2, which is a schematic flowchart of an embodiment of the system thinking learning method of the present invention. The process 3 includes step 30 to provide a cognitive learning system. In one embodiment, it can be as shown in FIG. 1, including an image capture system 2 with multiple image capture devices 20, a sense The measuring device has a plurality of sensing modules 200, an arithmetic processor 22, a first terminal device 24 and a second terminal device 25. The cognitive learning system is built in a space, for example, in a classroom R, where there are mentors, such as teachers, and multiple participants, such as students. The features of the foregoing elements are as described above, and will not be repeated here. The following flow is explained with the system of FIG. 1.

After the system is set up, proceed to step 31. The facilitator allows multiple participants to discuss and interact with each other to construct a teaching situation. In this step, the facilitator can set a discussion topic for participants to discuss and express their opinions on the subject. In one embodiment, the facilitator divides the participants into multiple groups to facilitate the discussion. In an embodiment, each participant is equipped with a sensing module 200 for sensing physiological signals about the participant during the discussion. In another embodiment, the sensing device may also include an image capture device 200, which captures the participant's image and transmits it to the arithmetic processor 22 to detect facial expressions, and use the detection result as a physiological signal . In another embodiment, the wearable sensing module 210 and the image capturing device 200 may be combined for detection.

During the discussion, step 32 is used to record the teaching situation mirror using the image capture system. Since the image capturing system has a plurality of image capturing devices 200, part of the image capturing devices 200 can be set at different locations in the classroom to record images of the whole discussion process from different perspectives. Next, proceed to step 33, using the sensing device to sense a physiological signal about a plurality of participants in the teaching situation. In step 33, the main purpose is to detect whether each participant's emotional or physiological response to vocalization, anger, anxiety, joy, or tension during the discussion. It can be used as the judgment of the subsequent recorded images.

The detected physiological signal will be transmitted to the arithmetic processor 22 for arithmetic processing. Through step 34, the arithmetic processor 22 receives the physiological signal about each participant and judges the status of the physiological signal. When the physiological signal matches Under specific conditions, the specific image capturing device 200 is controlled to capture images of participants corresponding to physiological signals, and the images are stored in a storage device 23 to form an audio-visual streaming signal. In one embodiment, there may be more than one image capturing device 200, so some of the image capturing devices 200 are responsible for performing the recording of step 32, and some image capturing devices 200 are responsible for performing the close-up of step 34 Video. That is to say, when the arithmetic processor 22 determines that some physiological signals conform to the standard of being recorded in close-up, it controls the image capturing device 200 to capture close-up images of participants corresponding to the physiological signals.

Here are a few examples to illustrate:

Scenario 1: When a participant speaks, an audio signal is generated, so the sensor module 210 worn by the participant detects the audio signal, and when the arithmetic processor 22 determines that the audio signal exceeds a certain standard, it controls the image capture device 200 will track the audio signal and capture close-up images of the participants.

Scenario 2: The image obtained by the image capturing device 200 recording the whole scene will be transmitted to the arithmetic processor 22 for image recognition. When a participant is found standing, the image capturing device is controlled to capture a close-up image of the standing person.

Scenario 3: When there is a physiological change in the user’s physiology, the physiological signal will sense the information of blood pressure, pulse or heartbeat. Based on the information, the arithmetic processor 22 determines that the participant’s emotional response is also controlled. The image capturing device 200 captures a close-up image of the standing person.

The foregoing scenario of capturing close-up images is only an illustrative embodiment, and in fact is not limited to the above examples.

In addition, it is to be explained how the image capturing device 200 can accurately capture images of participants whose physiological signals meet the close-up recording standard. In one embodiment, since the image capturing device 200 is provided with a driving device capable of controlling the spatial position, such as a base for six-axis movement, the control signal of the arithmetic processor 22 can drive the image capturing device to perform three-axis Rotation and three-axis displacement movement. Next, there are several ways to locate the position of the participant to be captured. In one embodiment, since the image capturing device 200 is installed, a certain position in the classroom can be used as the origin to perform origin calibration. Therefore, each image capturing device can change the orientation of the captured image under the control of the arithmetic processor. Then, through the image positioning method, for example: as shown in FIG. 3A, when the current situation is two, as long as there are at least three image capturing devices 200 that simultaneously capture participants raising their hands to speak, they can be based on the three image capturing devices The current position of 200 is where the position of the participant is located. Once you have the position of the participant, you can record close-up shots. The method of positioning belongs to the technology used in the table and will not be repeated here.

In another positioning embodiment, each sensing module further has a wireless transmitting element, which can be Bluetooth, infrared, RFID, ZigBee, UWB, ultrasonic, etc. Then, the so-called indoor positioning technology can be used, for example: "Triangle The "positioning" algorithm locates the signals generated by the above wireless transmitting elements. The more commonly used signal processing and positioning methods include received signal strength indication (RSSI) positioning technology, which determines the distance between the signal point and the receiving point by the strength of the received signal, and then performs a positioning calculation based on the corresponding data. Technology, received signal angle 度 Locating method (angle of arrival, AOA) is the information measured by the directional antenna (Directional Antenna) to obtain the 來 source direction and arrival time locating method of the Active Tag signal (time of arrival, TOA), TOA depends on the time that each "transmitter" sends a signal to a "receiver". Through time, the distance between the receiver and the individual transmitter can be calculated, and then the triangle positioning formula can be used to calculate the coordinates of the receiver. The aforementioned positioning techniques are all well-known to those skilled in the positioning field, and will not be repeated here. As shown in FIG. 3B, each sensing module 210 has a wireless transmitting device element, and through at least three signal receiving units 211, the above-mentioned positioning technique can be used to locate the position where the signal is emitted, and then control image capture The device captures close-up images of the corresponding participants.

Through the aforementioned procedures of steps 32-34, after the discussion is over, you can get the entire discussion video and the close-up images of each participant, which are then integrated into a stream of video signals. It should be noted that, in an embodiment, each participant may correspond to a stream of video signals. The stream of video signals includes video images of the overall discussion process and close-up images of the specific participant. It is displayed in the form of a picture-in-picture (PIP), as shown in FIG. 4A, or in the form of split screen, as shown in FIG. 4B. Figure 4B is a three-split screen, where the left-most split screen is the image of all participants, and the right and two split screens are close-ups of two different perspectives when the physiological signal of the participant 90A meets the close-up video image. In another embodiment, the streaming video signal may also be a video image of the overall discussion process, and the close-up image may be presented by superimposing a hyperlink on the image, as shown in FIG. 5. In addition, the sequence of steps 32-34 is not limited to the foregoing embodiment, that is, the sequence of the repairs performed may be changed.

After completing the recording of the entire discussion to form one or more streaming video signals, step 35 is performed, and the leader sets the audio and video streaming signal to generate a setting by providing a first operating interface provided by the first terminal device Information, the setting information includes setting a pause playback point at a specific time point of the video stream signal, and designing at least one problem corresponding to each pause play point. In this step, the main purpose is to allow participants to discuss the activity, and then return to further consider the transposition and post-consideration thinking by playing back the streaming audio and video signals. Therefore, the leader can edit the video streaming signal through the first operation interface generated after the first terminal device executes an application program. The settings for editing include the setting of the pause playback point, and the problem of interacting with the participants watching the playback at the pause playback point.

In one embodiment of step 35, the system will generate a corresponding streaming audio signal for each participant after discussing the activity again, so the leader can set different pause points according to the corresponding streaming audio signal of each participant The question set by each pause play point will be different for each participant.

After step 35, proceed to step 36. The participant uses a second operation interface provided by the second terminal device to play back the audio and video streaming signal. During the playback of the audio and video streaming signal, the second operation interface can be based on The setting information displays the corresponding at least one question at each paused play point, so that the participant can answer the at least first question, and the second operation interface stores the content answered by the participant. In the playback process, it includes a panoramic video image of the overall discussion process, and a close-up image of the participant who started recording because the physiological signal was sensed at a specific point in time. The participant watched the panoramic video image afterwards and paused the playback point When answering related questions for reflection, you can train participants to think retrospectively. In addition, participants can watch participants’ close-up images afterwards and answer related questions to reflect when they pause the playback point. Thinking. Therefore, through step 36, participants can be allowed to have training opportunities for post-consideration and empathic thinking while watching and answering questions during playback. Therefore, through this system, each participant can make logical thinking training from discussion activities, as well as post-playback transposition and post-thinking training, to achieve the purpose of systematic thinking training in core literacy and autonomous action.

In order to further improve the effectiveness of the system thinking training, further after step 36, step 37 can be carried out, the leader gathers the plurality of participants again to re-discuss and interact with the subject, and then repeats steps (32)-(36) At least once. After repeating the second round, another streaming video signal will be obtained again, and the corresponding paused playback point and related question answering information. At this time, the leader or the participant can further improve the training effectiveness of the participant's systematic thinking through the comparison of the two results.

In summary, the cognitive learning system and the system thinking learning method of the present invention propose that system thinking in autonomous action can be actually executed, and can effectively assist participants to develop system thinking. Through a video system that tracks the physiological state of the participants, the process of the participants' discussion on a topic is captured and recorded as a stream of images. Then an operation interface is provided so that the guide can set a pause playback point for the streaming image, and display the corresponding problem when the corresponding pause pause point is displayed. Participants can play back the streaming video with the paused playback point and the corresponding question through another terminal device afterwards, and reply to the related question. By repeating the above procedure, participants can train empathy and meta-thinking to achieve the training effect of systematic thinking in core literacy.

The above descriptions only describe the preferred embodiments or examples of the technical means adopted by the present invention to solve the problem, and are not intended to limit the scope of the patent implementation of the present invention. That is, any changes and modifications that are consistent with the context of the patent application scope of the present invention, or made in accordance with the patent scope of the present invention, are covered by the patent scope of the present invention.

2‧‧‧Cognitive learning system 20‧‧‧Image capture system 200‧‧‧Image capture device 21‧‧‧sensing device 210‧‧‧sensor module 211‧‧‧Signal receiving unit 22‧‧‧ arithmetic processor 23‧‧‧Storage device 24‧‧‧ First terminal device 25‧‧‧Second mid-range device 90、90A~90D‧‧‧Participants R‧‧‧Classroom 3‧‧‧ Systematic thinking learning method 30~37‧‧‧ steps

FIG. 1 is a schematic diagram of an embodiment of the cognitive learning system of the present invention. FIG. 2 is a schematic flowchart of an embodiment of the system thinking learning method of the present invention. 3A and 3B are schematic diagrams of the positioning of participants by the cognitive learning system of the present invention. 4A and 4B are schematic diagrams of different types of streaming video signals of the cognitive learning system of the present invention. 5 is a schematic diagram of different types of streaming video signals of the cognitive learning system of the present invention.

2‧‧‧Cognitive learning system

20‧‧‧Image capture system

200‧‧‧Image capture device

21‧‧‧sensing device

210‧‧‧sensor module

211‧‧‧Signal receiving unit

22‧‧‧ arithmetic processor

23‧‧‧Storage device

24‧‧‧ First terminal device

25‧‧‧Second mid-range device

90、90A~90D‧‧‧Participants

R‧‧‧Classroom

Claims (10)

A cognitive learning system, including: An image capture system for recording a teaching situation mirror; A sensing device for sensing a physiological signal about a plurality of participants in the teaching situation; An arithmetic processor is used to receive physiological signals about each participant and determine the status of the physiological signals. When a physiological signal meets a specific condition, the image acquisition system is controlled to acquire the participant corresponding to the physiological signal image; A storage device for storing a video stream signal recorded by the image capturing system; A first terminal device is used to provide a first operation interface to a leader, so that the leader can set the audio and video streaming signal to generate setting information, and the setting information includes the audio and video streaming signal. Set a pause play point at a specific time point, and design at least one question corresponding to each pause play point; and A second terminal device is used to provide a second operation interface to the participants, to play back the audio and video stream signal through the second operation interface, and in the process of playing back the audio and video stream signal, according to the setting information, in each The pause play point displays the corresponding at least one question, allowing the participant to answer the at least first question, and the second operation interface stores the content answered by the participant. The cognitive learning system as described in item 1 of the patent application scope, wherein the sensing device includes a plurality of sensing modules, which are respectively disposed on each participant. The cognitive learning system as described in item 1 of the patent application scope, wherein the physiological signal includes one of pulse, heartbeat, sound, facial expression, or any combination of the foregoing. The cognitive learning system as described in item 1 of the patent application scope, wherein the storage device is set in a cloud storage system, and the first image streaming signal is transmitted to the storage device via a network for storage. A systematic thinking learning method, which includes the following steps: (a) Provide a cognitive learning system, including an image capture system, a sensing device, an arithmetic processor, a first terminal device, and a second terminal device; (b) The facilitator asks multiple participants to discuss and interact with each other to construct a teaching situation; (c) Use the image capture system to record the teaching situation mirror; (d) use the sensing device to sense a physiological signal about a plurality of participants in the teaching situation; (e) causing the arithmetic processor to receive physiological signals about each participant and determine the status of the physiological signals, and when there is a physiological signal that meets certain conditions, control the image acquisition system to capture the participant corresponding to the physiological signal And store the image in a storage device to form an audio and video streaming signal; (f) The leader configures the audio and video streaming signal through a first operation interface provided by the first terminal device to generate setting information, and the setting information includes a specific time point of the audio and video streaming signal Set a pause play point, and design at least one question for each pause play point; (g) The participant uses a second operating interface provided by the second terminal device to play back the audio and video streaming signal, and in the process of playing back the audio and video streaming signal, according to the setting information, play at each pause Click to display the corresponding at least one question, so that the participant can answer the at least first question, and the second operation interface stores the content answered by the participant; and (h) After this step (g), the facilitator gathers the plurality of participants again to re-discuss and interact with the subject, and then repeats steps (c)-(g) at least once again. The systematic thinking learning method as described in item 5 of the patent application scope further includes the audio and video streaming signals obtained twice after the step (h) is performed once, and the two audio and video strings targeted by the participants The step of comparing the contents answered by the pause point contained in the streaming signal. The systematic thinking learning method as described in item 5 of the patent application scope, wherein the step (h) further includes the step of playing back the previous video stream signal and the content answered by each participant in response to the question of the corresponding playback pause point. The system thinking learning method as described in item 5 of the patent application scope, wherein the sensing device includes a plurality of sensing modules, which are respectively arranged on each participant. The systematic thinking learning method as described in item 5 of the patent application scope, wherein the physiological signal includes one of pulse, heartbeat, sound, facial expression, or any combination of the foregoing. The system thinking learning method as described in item 5 of the patent application scope, wherein the storage device is set in a cloud storage system, and the first image streaming signal is transmitted to the storage device via a network for storage.

Images