KR101484190B1 - System and method for supporting appreciation of moving picture contents with human reaction and computer readable storage medium storing program executing the same - Google Patents

System and method for supporting appreciation of moving picture contents with human reaction and computer readable storage medium storing program executing the same Download PDF

Info

Publication number
KR101484190B1
KR101484190B1 KR20140038656A KR20140038656A KR101484190B1 KR 101484190 B1 KR101484190 B1 KR 101484190B1 KR 20140038656 A KR20140038656 A KR 20140038656A KR 20140038656 A KR20140038656 A KR 20140038656A KR 101484190 B1 KR101484190 B1 KR 101484190B1
Authority
KR
South Korea
Prior art keywords
video content
bookmark
control unit
computer program
glove
Prior art date
Application number
KR20140038656A
Other languages
Korean (ko)
Inventor
남택진
이문환
Original Assignee
한국과학기술원
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 한국과학기술원 filed Critical 한국과학기술원
Priority to KR20140038656A priority Critical patent/KR101484190B1/en
Application granted granted Critical
Publication of KR101484190B1 publication Critical patent/KR101484190B1/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/014—Hand-worn input/output arrangements, e.g. data gloves
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/015—Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Dermatology (AREA)
  • Neurosurgery (AREA)
  • Neurology (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Biomedical Technology (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

BACKGROUND OF THE INVENTION 1. Field of the Invention [0001] The present invention relates to a technology for supporting viewing of moving image contents, and more particularly, to a system and method for supporting viewing of moving image content by generating bookmarks in moving image content. According to the present invention, A video display unit receiving a control signal from the control unit and outputting an image of the video content; And a glove type input device including a glove type glove part and at least one body reaction detection sensor provided in the glove part, And a bookmark is generated in the video content viewing support system.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a system and method for supporting video content viewing by a body reaction, and a recording medium on which a computer program for implementing the method is recorded. 2. Description of the Related Art [0002]

BACKGROUND OF THE INVENTION 1. Field of the Invention [0001] The present invention relates to a technology for supporting viewing of moving image contents, and more particularly, to a system and method for supporting viewing of moving image content by generating bookmarks in moving image content.

Korean Patent Registration No. 10-0566215 describes a bookmark service method of video contents. In the above-described prior art, a specific playback interval is registered as a bookmark in the moving image playback mode, thereby enhancing the user's convenience. However, in the above-mentioned prior art, a method of registering bookmarks in video contents is performed by a user through an input device such as a keypad, and since bookmarks can not be generated in response to a user's unconscious body reaction, There is a limit to supporting the appreciation activities on the side.

SUMMARY OF THE INVENTION It is an object of the present invention to provide a system and method for supporting a video content appreciation supporting a sensation activity on the emotional side by generating a bookmark according to a conscious or unconscious body reaction of a viewer.

In order to achieve the above object, according to an aspect of the present invention,

A control unit; A video display unit receiving a control signal from the control unit and outputting an image of the video content; And a glove type input device including a glove type glove part and at least one body reaction detection sensor provided in the glove part, And a bookmark is generated in the video content viewing support system.

The body reaction sensor may be a pressure sensor.

The pressure sensor may be installed on the palm of the glove part.

The body reaction sensor may be a heart rate sensor.

The heartbeat sensor may be provided on the thumb of the glove part.

The body reaction sensor may be a GSR sensor.

The GSR sensor may be installed at the detection and stop portions of the glove portion, respectively.

The glove type input device may further include a wireless communication module that enables wireless communication with the control unit.

The wireless communication module may be a Bluetooth module.

In order to achieve the above object, according to another aspect of the present invention,

A control unit having a memory device in which a video content appreciation support computer program is stored, and a processor for executing the video content appreciation aid computer program; A video display unit receiving a control signal from the control unit and outputting an image of the video content; And a glove type input device including a glove type glove part and a globe type input device including a pressure sensor installed in the glove part. The video content appreciation support method comprises the steps of: A step of executing a computer program supporting a video content in which the program is executed; A pressure signal checking step of checking whether a pressure signal outputted from the pressure sensor exists in the control unit; And a real time bookmark generating step of generating a bookmark in the moving picture content being reproduced corresponding to a time point at which the pressure signal is received when the pressure signal is confirmed in the pressure signal checking step .

In the real-time bookmark creation step, a text input window may be created corresponding to the bookmark creation time.

The video content appreciation support method may further include a screen capture step of capturing an image of a moving picture corresponding to the bookmark generation time.

The video content appreciation support system may further include a camera for capturing a face of a viewer, and the method for supporting a video content appreciation further includes a face capture step of capturing a face of a viewer corresponding to the bookmark creation time using the camera can do.

The moving image appreciation support method may further include a moving image appreciation information generation step of generating impression information including the bookmark information.

In order to achieve the above object, according to another aspect of the present invention,

There is provided a computer-readable recording medium recording a program for executing the video content listening support method.

In order to achieve the above object, according to another aspect of the present invention,

A control unit having a memory device in which a video content appreciation support computer program is stored, and a processor for executing the video content appreciation aid computer program; A video display unit receiving a control signal from the control unit and outputting an image of the video content; And a glove type input device provided with glove type glove part and glove type input device provided on the glove part. The method of supporting video content appreciation using video contents content appreciation support system according to claim 1, A step of executing a computer program for supporting a video content listening support computer program; A bio-signal storage step of storing the bio-signal output from the bio-signal detection sensor in the memory device; A bio-signal change analysis step of analyzing the accumulated bio-signals stored in the memory device after the video ends and extracting a measured part higher than a reference; And generating a bookmark corresponding to the extracted point in the bio-signal change analysis step, and generating a bookmark after watching.

In order to achieve the above object, according to another aspect of the present invention,

A control unit; A video display unit receiving a control signal from the control unit and outputting an image of the video content; And a camera for capturing an image of a face of a viewer, wherein the controller generates a bookmark in the video content using a facial expression change confirmed from a face image of a viewer input from the camera, / RTI >

The video content appreciation support system may further include a printer that prints an output including a QR code including the bookmark information.

In order to achieve the above object, according to another aspect of the present invention,

A control unit having a memory device in which a video content appreciation support computer program is stored, and a processor for executing the video content appreciation aid computer program; A video display unit receiving a control signal from the control unit and outputting an image of the video content; And a camera for capturing a face of a viewer, the method comprising: executing a video content appreciation support computer program in which the video content appreciation support computer program is executed together with the reproduction of the video content; A facial expression change checking step of checking whether a facial expression of a viewer is changed from an image output from the camera; And a real-time bookmark creation step of creating a bookmark in the video content being played back at a time point when a change in a facial expression of the viewer is confirmed in the facial expression change confirmation step. / RTI >

The video content appreciation support system may further include a printer, and the video content appreciation support method may further include a printing step of outputting an output including a QR code including the bookmark information through the printer.

The output may further include a facial expression of the viewer corresponding to the bookmark creation time and a captured image of the moving image.

According to the present invention, all of the objects of the present invention described above can be achieved. Specifically, there are a conscious body reaction sensed by a pressure sensor installed in a glove-type input device during video watching, a GSR sensor installed in a glove-type input device, an unconscious body reaction sensed through a heart sensor, Since bookmarks are created by using the bookmark, it is possible to effectively support the impression activity on the emotional side.

1 is a block diagram showing a configuration of a moving image content appreciation support system according to an embodiment of the present invention.
FIG. 2 is a perspective view schematically showing an embodiment of the video content appreciation support system shown in FIG. 1. FIG.
3 and 4 are a plan view and a bottom view of the gloved input device shown in Fig.
FIG. 5 is a flowchart illustrating a video content listening support method according to an embodiment of the present invention.
FIG. 6 is a view showing a state where a bookmark is generated by a conscious body reaction using the gloved input device shown in FIG. 1. FIG.
7 is a view showing a state where a bookmark is generated by the unconscious body reaction using the gloved input device shown in FIG.
Fig. 8 is a view showing an output output by the printer shown in Fig. 1. Fig.
FIG. 9 shows a screen upon execution of the moving image appreciation information file generated by the moving image content appreciation support system shown in FIG.

Hereinafter, the configuration and operation of a preferred embodiment of the present invention will be described in detail with reference to the drawings.

First, a video content appreciation support system according to an embodiment of the present invention will be described in detail with reference to the drawings. FIG. 1 is a block diagram of a moving image content appreciation support system according to an embodiment of the present invention. FIG. 2 is a perspective view illustrating an exemplary implementation of the moving image content appreciation support system 100 shown in FIG. 1, a video content appreciation support system 100 according to an embodiment of the present invention includes a control unit 100a, a video display unit 110a, an audio output unit 118, a basic input device 119 A glove-type input device 120, a camera 140, and a printer 150. The glove- The video content appreciation support system 100 generates a bookmark using the body reaction sensed by the gloved input device 120 and the camera 140 when viewing a moving image and allows text input corresponding to the portion where the bookmark is generated And supports the appreciation activities of video contents in an emotional aspect.

The control unit 100a includes a processor 101, a memory device 102, and a network device 103. [

The processor 101 is generally called a central processing unit (CPU), and is a program for supporting a moving image content appreciation supporting a moving image content appreciation support system according to the present invention while exchanging signals with other constituent elements, Run the video playback computer program.

The memory device 102 includes a ROM for transferring data and instructions in a unidirectional manner to the processor 101, a RAM for bidirectionally bi-directionally exchanging data and instructions with the processor 101, And an auxiliary storage device such as a hard disk. The memory device 102 stores a moving picture content appreciation support computer program for driving the moving picture content appreciation support system according to the present invention and a moving picture content to be reproduced. The memory device 102 may store conventional conventional moving picture reproducing computer programs.

The network device 103 enables communication with the outside in various ways including wired or wireless.

The video content stored in the memory device 102 built in the controller 100a is reproduced in the present embodiment. Alternatively, video content stored in a separate external memory device such as USB connected to the controller 100a may be reproduced , The VOD through the network device 103 may be reproduced. In the present embodiment, it is assumed that the controller 100a forms one module (corresponding to the main body in a typical PC structure) as shown in Fig.

The image display unit 110a receives a control signal from the processor 101 and outputs an image. The image display unit 110a may be a conventional monitor used in a computer.

The audio output unit 118 receives a control signal from the processor 101 and outputs a sound. In this embodiment, the audio output unit 118 forms one output module 110 together with the image display unit 110a as shown in FIG. However, the image display unit 110a and the audio output unit 118 may be separated from each other. Although the control unit 100a and the output module 110 are separately configured in the present embodiment, the control unit 100a and the output module 110 may be integrated into one module There will be.

The basic input device 119 includes a keyboard device 119a and a mouse device 119b used in a typical PC. The keyboard device 119a can be mainly used for text input, and the mouse device 119b can be mainly used for controlling a video content listening support computer program.

In the present embodiment, the controller 100a, the output module 110, and the basic input device 119 are described as being separate from each other. Alternatively, the controller 100a may be integrated into one unit as in the case of a tablet computer.

The gloved input device 120 transmits a conscious and / or unconscious body reaction signal sensed from the hand of the viewer U to the control section 100a. 2 to 4, the glove-type input device 120 includes glove-shaped glove 121, a heartbeat sensor 122 installed at the tip of the glove portion 121, A pressure sensor 124 provided at a palm portion of the glove portion 121, and a glove portion 121 (see FIG. 1) And a control unit 125 fixed to the upper surface wrist portion of the control unit 125. The heart rate sensor 122, the GSR sensors 123a and 113b, and the pressure sensor 124 constitute a body reaction detection sensor in this embodiment.

The glove part 121 is in the form of a finger glove. In this embodiment, it is assumed that the glove part 121 has no part corresponding to the finger and the base.

The glove part 121 of the heart rate sensor 122 is provided at the tip of the thumb part. The heart rate sensor 122 measures the heartbeat of the viewer U in real time.

The GSR sensors 123a and 123b are installed at the ends of the detection and stop parts of the glove part 121, respectively. The GSR sensors 123a and 123b measure the GSR signal. The GSR signal has the fastest response speed as a bio signal that immediately displays changes in the autonomic nervous system. The psychological change of the viewer U from the GSR signal can be estimated.

The pressure sensor 124 recognizes when the viewer U grasps a fist and generates an electrical signal.

The control unit 125 is fixed to the upper wrist portion of the glove portion 121. [ The control unit 125 includes a microcontroller 125a and a wireless communication module 125b.

The microcontroller 125a is electrically connected to the heartbeat sensor 122, the GSR sensors 123a and 123b, the pressure sensor 124 and the wireless communication module 125b to control the operation of the heart rate sensor 122 and the GSR And transmits the body reaction signals measured from the sensors 123a and 123b and the pressure sensor 124 to the processor 101 of the controller 100a through the wireless communication module 125b.

The operation of the wireless communication module 125b is controlled by the microcontroller 125a so that the body reaction signals measured from the heartbeat sensor 122, the GSR sensors 123a and 123b, and the pressure sensor 124 are transmitted to the controller 100a. To the processor 101 of FIG. In the present embodiment, it is assumed that the Bluetooth module is used as the wireless communication module 125b. For this, the controller 100a is configured to support Bluetooth. In the present embodiment, the glove type input device 120 is described as being connected to the controller 100a wirelessly, but it may be connected by wire.

The camera 140 transmits the sensed image information to the processor 101 of the control unit 100a. The image or QR code including the face of the viewer U is transmitted to the processor 101 via the camera 140. [

The printer 150, as a thermal transfer print, outputs a face of the user U, which is controlled by the processor 101 and captured, a captured moving image screen, and a QR code.

FIG. 5 is a flowchart illustrating a method of supporting a moving image content appreciation according to an embodiment of the present invention. The method of supporting a moving image content appreciation shown in FIG. 5 uses the moving image content appreciation support system shown in FIG. 1 and FIG. 2. Hereinafter, a method of supporting a moving image content appreciation shown in FIG. 5 will be described in detail. Therefore, the description of the video content appreciation support method shown in FIG. 5 includes the description of the operation of the video content content appreciation support system shown in FIG. 1 and FIG.

Referring to FIG. 5, a method of supporting a moving image content appreciation according to an embodiment of the present invention includes executing a computer program for supporting a moving image content appreciation (S10), a pressure signal checking step (S21), a living body signal storing step (S22) (Step S23), a real-time bookmark generating step S30, a screen and a facial expression capturing step S31, a motion picture reproduction confirmation step S32, a body reaction ending step S33, A text input step S36, a moving picture audition information generating step S37, a printing step S38, an e-mail sending step S39, .

In the video content listening support computer program execution step (S10), the video content listening support computer program stored in the memory device (102) is executed by the processor (101). When the video content appreciation support computer program is executed, the video content desired by the viewer U is reproduced and simultaneously the video appreciation information generation function is performed. That is, the computer program supporting the video content appreciation performs a function of reproducing the video content and a function of generating the video appreciation information. The video content is output in the form of an image together with the audio through the output module 110. In addition, the glove-type input device 120 and the camera 140 are operated by the moving image appreciation information generating function to start the body reaction detection of the viewer U. The body reaction detection includes a body reaction detection through the gloved input device 120 and a body reaction detection through the camera 140. [ The heartbeat sensor 122 and the GSR sensors 123a and 123b of the gloved input device 120 are sensed by the pressure sensor 124 of the gloved input device 120 and the conscious body reaction of the viewer U is sensed. , The unconscious body reaction of the viewer (U) is detected. The conscious or unconscious body reaction sensed through the gloved input device 120 is transmitted to the controller 100a through the wireless communication module 125b, which is a Bluetooth module. The reproduction of the video content may be reproduced by a normal video reproduction computer program other than the video content appreciation support computer program. In this case, the video content appreciation support computer program is automatically executed in cooperation with the video reproduction, Only the video viewing information generating function can be performed.

In the pressure signal checking step S21, the existence of the pressure signal measured by the pressure sensor 124 of the gloved input device 120 is confirmed by the video content appreciation support computer program. The pressure signal means that the viewer (U) has had a conscious body reaction to hold a fist. If the pressure signal is confirmed, the real-time bookmark generation step S30 is performed, and if the pressure signal is not confirmed, the motion picture playback confirmation step S32 is performed.

In the bio-signal storage step S22, the bio-signals measured by the heart-beat sensor 122 of the glove-type input device 120 and the bio-signals measured by the GSR sensors 123a and 123b are read by the video- (102). After the biological signal storage step (S22), the motion picture reproduction confirmation step (S32) is performed.

In the facial expression change confirmation step S23, the facial expression change of the viewer U acquired from the camera 140 is detected by the video content appreciation support computer program. If it is confirmed that there is a change in the facial expression, a real-time bookmark creation step S30 is performed, and if it is confirmed that there is no change in the facial expression, the video reproduction confirmation step S32 is performed.

In the real-time bookmark creation step (S30), a bookmark for a specific reproduction position of a moving picture being reproduced in real time is generated by the moving picture content appreciation support computer program. The position where the bookmark is generated in the real-time bookmark creation step S30 is the position where the pressure signal is confirmed in the pressure signal confirmation step S21 and the position where the expression change is confirmed in the expression change confirmation step S23. A text input window is created together with the creation of the bookmark. After the real-time bookmark creation step S30, a screen and facial expression capture step S31 is performed.

In the screen and facial expression capturing step S31, a screen at a position corresponding to the bookmark generated in the real-time bookmark generating step S30 by the computer program for capturing the moving image content and a facial expression of the viewer U are captured and stored. After the screen and facial expression capturing step S31, the moving picture reproduction confirming step S32 is performed.

In the video reproduction confirmation step (S32), it is confirmed whether the moving image is being reproduced by the video content appreciation support computer program. When it is confirmed that the moving image is being reproduced, the pressure signal checking step S21, the biological signal storing step S22 and the facial expression change confirming step S23 are performed again, The ending step S33 is performed. That is, during the reproduction of the moving picture, a real-time bookmark generating step S30 and a screen and a facial expression capturing step S31 are repeatedly performed. FIG. 6 shows a screen in which a bookmark is generated by a pressure signal in this process. 6, the screen 111 includes a moving picture playback area 112, a plurality of bookmarks 114a, and a text input window 115a corresponding to a plurality of bookmarks 114a. Area 113, as shown in FIG. In the present embodiment, it is described that the bookmark 114a by the pressure signal is circular. Although not shown, bookmarks and text input windows due to changes in facial expressions can also be displayed on the screen in the same manner as pressure signals. At this time, the bookmark by the change of the facial expression may be another form (for example, star shape) or another color of the circle so as to be distinguished from the bookmark by the pressure signal.

In the body reaction detection termination step S33, the body reaction detection function by the gloved input device 120 and the camera 140 is terminated by the video content appreciation support computer program. After the body reaction detection termination step S33, the biological signal change analysis step S34 is performed.

In the biological signal change analysis step S34, the computer program for supporting the video content appreciation analyzes the accumulated bio-signals received from the heartbeat sensor 122 and the GSR sensors 123a and 123b to extract highly measured parts. After the biological signal change analysis step S34, the bookmark creation step S35 is performed.

In the bookmark creation step S35 after viewing, a bookmark and a text input window are created in correspondence with the points extracted in the bio signal change analysis step S34 by the video content appreciation support computer program. FIG. 7 shows a screen displaying a bookmark and a text input window generated by the bookmark creation step S35 after viewing. 7, the screen 111 includes a moving picture playback area 112, a plurality of bookmarks 114b and 114c, text input windows 115b and 115c located corresponding to a plurality of bookmarks 114b and 144c, A GSR curve 116 and an auditory information display area 113 in which a heartbeat curve 117 is displayed. In the present embodiment, the bookmark 114b by the GSR signal is a triangle, and the bookmark 114c by the heartbeat signal is a square. Alternatively, the bookmark 114b by the GSR signal and the bookmark 114c by the heartbeat signal may be different colors of the circle to be distinguished from other bookmarks. After the bookmark creation step S35 after viewing, the text input step S36 is performed.

In the text input step S36, text such as an impression of a scene corresponding to the text input windows 115a, 115b, and 115c generated by the video content appreciation support computer program is input by the viewer U. The text input step S36 may be performed by the viewer U using an input device such as a keyboard 119a and a mouse 119b.

In the moving image viewing information generating step (S37), moving image viewing information is generated by the moving image listening computer program. The video viewing information includes corresponding video content information, viewer U information, accumulated heartbeat signal and GSR signal information stored in the bio-signal storing step S22, bookmark information generated in the real-time bookmark generating step S30, The captured image information, the bookmark information generated in the bookmark creation step S35, and the text information generated in the text input S36.

In the print step S38, the output product P is printed by the printer 150 by the video content appreciation support computer program. FIG. 8 shows an example of the output P. 8, the output P is displayed along with the user facial image P1 and the screen capture scene P2 acquired in the screen and facial expression capturing step S31 together with the moving image generated in the moving image viewing information generating step S37 And a QR code in which information identifying the audition information is recorded.

In the e-mail sending step S39, data corresponding to the printed output P in the print step S38 is automatically sent by e-mail of the viewer U by the video content audit support computer program.

After all the steps shown in FIG. 5 are performed, the viewer U can select the corresponding video content and re-view the main part. This will be described in detail as follows. The viewer executes the moving image viewing information through the video content supporting computer program. The moving image viewing information may be directly selected and executed by the moving picture content supporting computer program or the QR code P3 of the output P output from the printing step S38 via the camera 140, Is executed. 9 shows a moving image sensibility information execution screen. 9, the screen 111 includes a playback area 112 in which a screen of a moving image content is output, a facial expression display area 112a in which a captured facial expression of a viewer is output, a plurality of bookmarks 114a, 114b, 114c and a feeling information display area 113 in which a plurality of text windows 115a, 115b, 115c are displayed. Only the portions where the bookmarks 114a, 114b, and 114c are formed may be sequentially output in a slide manner, or may be moved to the corresponding portion by the operation of the user's mouse or the like and reproduced, Can be confirmed.

The above-described video content appreciation support computer program according to the embodiment of the present invention described above may be recorded on a recording medium readable by a computer and executed by a computer so that the above-described functions can be executed. In addition, the computer program supporting the video content appreciation may include a code that is coded in a computer language such as C, C ++, JAVA, or machine language in which the processor (CPU) of the computer can be read. The code may include a function code related to a function or the like that defines the functions described above and may include an execution procedure related control code necessary for the processor of the computer to execute the functions described above according to a predetermined procedure. In addition, such code may further include memory reference related code as to what additional information or media needed to cause the processor of the computer to execute the aforementioned functions should be referenced at any location (address) of the internal or external memory of the computer . Examples of the computer-readable recording medium on which the above-described program is recorded include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical media storage, and the like.

Although the present invention has been described with reference to the above embodiments, the present invention is not limited thereto. It will be understood by those skilled in the art that various changes and modifications may be made without departing from the spirit and scope of the invention as defined by the appended claims.

100: Video contents listening support system
100a: Control section 101: Processor
102: memory device 103: network device
110: output module 110a: image display unit
118: audio output unit 119: basic input device
119a: keyboard device 119b: mouse device
120: glove type input device 121: glove part
122: heart rate sensor 123a, 123b: GSR sensor
125: control unit 125a: microcontroller
125b: wireless communication module 140: camera
150: Printer

Claims (23)

A control unit;
A video display unit receiving a control signal from the control unit and outputting an image of the video content; And
A glove type glove portion and at least one body reaction sensor provided in the glove portion,
Wherein the control unit generates a bookmark in the video content using a body response signal input from the body reaction detection sensor. The method according to claim 1,
Wherein the body reaction detection sensor is a pressure sensor. The method of claim 2,
Wherein the pressure sensor is installed on the palm of the glove part. The method according to claim 1,
Wherein the body reaction detection sensor is a heart rate sensor. The method of claim 4,
Wherein the heartbeat sensor is mounted on the thumb of the glove part. The method according to claim 1,
Wherein the body reaction detection sensor is a GSR sensor. The method of claim 6,
Wherein the GSR sensor is installed at the detection and stopping parts of the glove part, respectively. The method according to claim 1,
Wherein the glove-type input device further comprises a wireless communication module that enables wireless communication with the control unit. Claim 9 has been abandoned due to the setting registration fee. The method of claim 8,
Wherein the wireless communication module is a Bluetooth module. A control unit having a memory device in which a video content appreciation support computer program is stored, and a processor for executing the video content appreciation aid computer program; A video display unit receiving a control signal from the control unit and outputting an image of the video content; And a glove type input device having a glove type glove part and a pressure sensor installed in the glove part. The method of supporting video image content appreciation using a video content appreciation support system,
Executing a video content appreciation support computer program in which the video content appreciation support computer program is executed together with the reproduction of the video content;
A pressure signal checking step of checking whether a pressure signal outputted from the pressure sensor exists in the control unit; And
And generating a bookmark in the video content being played back corresponding to a time point at which the pressure signal is received when the pressure signal is confirmed in the pressure signal checking step. The method of claim 10,
And generating a text input window corresponding to the bookmark creation time in the real-time bookmark creation step. The method of claim 10,
Further comprising a screen capturing step of capturing an image of a moving picture corresponding to the bookmark creating time point. The method of claim 10,
Wherein the video content appreciation support system further includes a camera for picking up a face of a viewer,
Further comprising a facial expression capturing step of capturing a facial expression of a viewer corresponding to the bookmark creation time using the camera. The method of claim 10,
Further comprising a moving image viewing information generating step of generating viewing information including the bookmark information. A computer-readable recording medium having recorded thereon a program for executing the video content appreciation support method described in any one of claims 10 to 14. A control unit having a memory device in which a video content appreciation support computer program is stored, and a processor for executing the video content appreciation aid computer program; A video display unit receiving a control signal from the control unit and outputting an image of the video content; And a glove type input device including a glove type glove part and a bio signal detection sensor installed in the glove part, the method comprising:
Executing a video content appreciation support computer program in which the video content appreciation support computer program is executed together with the reproduction of the video content;
A bio-signal storage step of storing the bio-signal output from the bio-signal detection sensor in the memory device;
A bio-signal change analysis step of analyzing the accumulated bio-signals stored in the memory device after the video ends and extracting a measured part higher than a reference; And
And generating a bookmark after the viewing to generate a bookmark corresponding to the point extracted in the biological signal change analysis step. A computer-readable recording medium having recorded thereon a program for executing the video content appreciation support method according to claim 16. A control unit;
A video display unit receiving a control signal from the control unit and outputting an image of the video content; And
And a camera for picking up a face of a viewer,
Wherein the control unit generates a bookmark in the video content using a change in facial expression confirmed from a face image of a viewer inputted from the camera. 19. The method of claim 18,
Further comprising a printer for printing an output including a QR code including the bookmark information. A control unit having a memory device in which a video content appreciation support computer program is stored, and a processor for executing the video content appreciation aid computer program; A video display unit receiving a control signal from the control unit and outputting an image of the video content; And a camera for capturing a face of a viewer, the method comprising:
Executing a video content appreciation support computer program in which the video content appreciation support computer program is executed together with the reproduction of the video content;
A facial expression change checking step of checking whether a facial expression of a viewer is changed from an image output from the camera; And
And a real-time bookmark creation step of creating a bookmark in the video content being played back corresponding to a time point when the change in the expression of the viewer is confirmed in the expression change confirmation step. The method of claim 20,
Wherein the video content appreciation support system further comprises a printer,
Further comprising a printing step of outputting an output including a QR code including the bookmark information through the printer. 23. The method of claim 21,
Wherein the output further includes a facial expression of a viewer corresponding to the bookmark creation time and a captured image of the moving image. A computer-readable recording medium having recorded thereon a program for executing the video content appreciation support method recited in any one of claims 20 to 22.
KR20140038656A 2014-04-01 2014-04-01 System and method for supporting appreciation of moving picture contents with human reaction and computer readable storage medium storing program executing the same KR101484190B1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR20140038656A KR101484190B1 (en) 2014-04-01 2014-04-01 System and method for supporting appreciation of moving picture contents with human reaction and computer readable storage medium storing program executing the same

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR20140038656A KR101484190B1 (en) 2014-04-01 2014-04-01 System and method for supporting appreciation of moving picture contents with human reaction and computer readable storage medium storing program executing the same

Publications (1)

Publication Number Publication Date
KR101484190B1 true KR101484190B1 (en) 2015-01-20

Family

ID=52590913

Family Applications (1)

Application Number Title Priority Date Filing Date
KR20140038656A KR101484190B1 (en) 2014-04-01 2014-04-01 System and method for supporting appreciation of moving picture contents with human reaction and computer readable storage medium storing program executing the same

Country Status (1)

Country Link
KR (1) KR101484190B1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2019160386A1 (en) * 2018-02-19 2019-08-22 박재홍 Method for providing content collection and sharing service on basis of user's emotions

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20080037947A (en) * 2006-10-27 2008-05-02 삼성전자주식회사 Method and apparatus of generating meta data of content
KR20100000336A (en) * 2008-06-24 2010-01-06 삼성전자주식회사 Apparatus and method for processing multimedia contents
KR20120095193A (en) * 2011-02-18 2012-08-28 에스케이플래닛 주식회사 Face recognition service system, method and apparatus for face recognition service thereof of
KR20130099418A (en) * 2012-02-29 2013-09-06 한국과학기술원 Method and apparatus for controlling playback of content based on user reaction

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20080037947A (en) * 2006-10-27 2008-05-02 삼성전자주식회사 Method and apparatus of generating meta data of content
KR20100000336A (en) * 2008-06-24 2010-01-06 삼성전자주식회사 Apparatus and method for processing multimedia contents
KR20120095193A (en) * 2011-02-18 2012-08-28 에스케이플래닛 주식회사 Face recognition service system, method and apparatus for face recognition service thereof of
KR20130099418A (en) * 2012-02-29 2013-09-06 한국과학기술원 Method and apparatus for controlling playback of content based on user reaction

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2019160386A1 (en) * 2018-02-19 2019-08-22 박재홍 Method for providing content collection and sharing service on basis of user's emotions

Similar Documents

Publication Publication Date Title
JP6525496B2 (en) Display device, remote control device for controlling display device, control method for display device, control method for server, and control method for remote control device
KR101730759B1 (en) Manipulation of virtual object in augmented reality via intent
US20170221379A1 (en) Information terminal, motion evaluating system, motion evaluating method, and recording medium
US8654038B2 (en) Head mounted display and imaging data usage system including the same
US20130278552A1 (en) Detachable sensory-interface device for a wireless personal communication device and method
JPWO2016038953A1 (en) DETECTING DEVICE, DETECTING METHOD, CONTROL DEVICE, AND CONTROL METHOD
TW201119368A (en) Image processing device, image processing method, and computer program
JP2015166890A (en) Information processing apparatus, information processing system, information processing method, and program
JP2011188061A (en) Image processor, image processing method, and program
JP2020039029A (en) Video distribution system, video distribution method, and video distribution program
JP6255935B2 (en) Handwriting reproducing apparatus and program
US20120256831A1 (en) Cursor display device and cursor display method
CN103502910B (en) Method for operating laser diode
JP2016511674A (en) Method and apparatus for controlling a computer program with an intraoral scanner
JP7198244B2 (en) Video distribution system, video distribution method, and video distribution program
KR101484190B1 (en) System and method for supporting appreciation of moving picture contents with human reaction and computer readable storage medium storing program executing the same
US20090059019A1 (en) Audio/video apparatus and control method of the same
EP3906459B1 (en) Sensing device suitable for haptic perception applications
JP5811674B2 (en) Questionnaire system
JP5917999B2 (en) Information providing system, information providing method, and electronic device
US20150262013A1 (en) Image processing apparatus, image processing method and program
US20140007118A1 (en) Comparison device, comparison method, non-transitory recording medium, and system
JP2006277448A (en) Data processor and personal identification device
JP6836877B2 (en) Wind instrument practice support device and practice support method
JP6010062B2 (en) Cue point control device and cue point control program

Legal Events

Date Code Title Description
E701 Decision to grant or registration of patent right
GRNT Written decision to grant
FPAY Annual fee payment

Payment date: 20180102

Year of fee payment: 4

LAPS Lapse due to unpaid annual fee