KR101415447B1 - System and method for information sharing based on social network service through watching video - Google Patents

Abstract

A method and a system for sharing information based on a conceptual tag cloud are provided. The method and the system for sharing information can create words which appear together in one sentence or an adjacent sentence using words extracted from a script document of a video, can build an interface based on an ODP structure which represents domain in a hierarchical structure and a document which consists of the words appearing together, and can share information between lecturers or learners using this interface.

Description

TECHNICAL FIELD [0001] The present invention relates to a system and method for sharing information based on social network services through video viewing,

The following discussion is about systems and methods for effective communication or communication between lecturers and learners in environments such as e-learning.

Information exchange in general online education is as follows.

For example, cyber lectures used by universities or online education for middle and high school students is a form in which lecturers provide learner with one-way information. At this time, the lecturer distributes the learning materials (video contents, lecture materials (PPT, script, etc.)) to the learner so that the learner can smoothly take lectures.

This online education is distinguished from offline education, and its context is not consistent between lecturer and learner. In offline education, lecturers and lecturers are lecturing in the same place at the same time. Therefore, even if a lecturer asks a question or a lecturer asks questions in the context of the current context, everyone who lectures can easily understand the current situation There are features.

However, in online education, lecturers and learners watch lectures at different places at different times or lectures. When you want to share some information in this situation, the lecturer and the learner have to explain their current context in detail. Otherwise, accurate communication can not be achieved.

For example, if a lecturer is asked "What is JAVA?", There is no easy answer without context information. This is because the word JAVA refers to JAVA, one of the programming languages, JAVA, which is one of the coffee names, and JAVA, which is one of the island names.

Under this general online teaching method, there is a method of explaining their context by using a text or voice record file or the like. In such a case, it is not easy to communicate the point of a question accurately because there are cases in which the subject is out of the subject while explaining the context. In this situation, it is difficult to communicate between lecturers, learners, learner and learners. Therefore, there are various problems such as consuming a lot of time in sharing, querying and responding information.

In order to be able to use the online education system, which can receive lectures anytime and anywhere at any time without having to be concerned with the time and place of the learner, in order to become a higher level lecture, Information sharing should be active. In offline education, information sharing between lecturer and learner or learner and learner is easy and natural.

On the other hand, in online education, information sharing between lecturers and learners or between learner and learner is very limited and passive. Also, in online education, there may be cases where the learner does not understand the question of the learner correctly, or the learner does not know how to ask the question when the learner asks the learner.

Accordingly, in order to solve such a problem, the present invention provides a method of easily and accurately describing a learner context to a lecturer, learner or learner, and an acquaintance in a social network using a conceptual tag cloud. In addition, the present invention provides an intuitive form of information sharing method in which the lecturer or acquaintances receiving the contents transmitted by the learner can directly access and confirm the corresponding contents.

The server terminal for the cloud-based information sharing service includes a key word extracting unit for extracting key words or important words from a script document; A video and key word mapping unit for mapping information on a start time or a scene section of a key word or important word extracted from the script document or important words and videos extracted from the script document; And a conceptual tag cloud display unit for displaying an interface and a conceptual tag cloud to the user based on the extracted keyword or important word.

The information on the key word or the scene section in which the important word appears in the video includes information on a start word and an end frame in which the keyword or an important word appears in the video, or information on a start time and an end time.

The information on the start time of the key word or the important word in the video includes information on the first frame number or time in which the key word or important word appears in the video.

Wherein the server terminal further comprises a social network message management unit for providing a function of sharing information with an acquaintance existing in a user's social network in a specific part of the video, It provides the ability to see what the user has asked about the contents of the lecturer and the contents of the user's answers.

The server terminal may further include an event processing unit for processing an event corresponding to the selection when the user selects the conceptual tag cloud displayed through the conceptual tag cloud display unit. The event processing unit may map the conceptual tag cloud selected by the user The information about the start time of the video or the information about the scene section is reproduced at the corresponding position and information about the start time of the video mapped to the conceptual tag cloud selected by the user or the information about the scene section And displaying the scripts for the plurality of pieces of information on a screen when the plurality of pieces of information are included.

Wherein the server terminal further includes an event processing unit for processing an event corresponding to the selection when the user selects the conceptual tag cloud displayed through the conceptual tag cloud display unit, If the acquaintance of the social network receiving the transmitted message selects the conceptual tag cloud in the received message, the event processing unit receives the event, and information on the start time of the video mapped to the conceptual tag cloud selected by the acquaintance And displaying the corresponding scripts on the screen.

The social network message management unit selects a conceptual tag cloud displayed through a conceptual tag cloud display unit so that the user can ask the acquaintances of the social network about specific contents, To the acquaintances.

The social network message management unit receives the contents of the user's inquiry through the messages received by the acquaintances in the user's social network through the video or through the smart device, The user can recognize the user's question by selecting the cloud, and the user's social network further includes a function of allowing the user to select the tag cloud of another video, not the current video, to answer the user.

According to an embodiment of the present invention, there is provided a conceptual tag cloud-based information sharing method comprising: extracting important words from a script document of a video; Constructing an Open Directory Project (ODP) structure to represent domains in a hierarchical structure; Generating words co-occurring in a sentence or a neighboring sentence using important words extracted from the script document; Classifying a document made up of the words together into terminal nodes of the ODP structure; Constructing an interface based on the ODP structure and a document consisting of the words appearing together; And sharing information between the lecturer or the learner using the conceptual tag cloud and the interface in the social network service.

The words appearing together may include at least one important word.

The step of classifying the document consisting of the words appearing together into the terminal nodes of the ODP structure may classify the document consisting of the coexistence words into the terminal notes of the ODP structure using the cosine similarity.

The step of extracting important words from the script document of the video may extract an important word from the script document of the video using either the TF-IDF or the LSA.

The conceptual tag cloud-based information sharing system according to an exemplary embodiment of the present invention includes an extracting and generating unit for extracting important words in a script document of a video and generating words appearing together in one sentence or neighboring sentences using the extracted important words; A construction unit for constructing an ODP structure to represent domains in a hierarchical structure; A classifying unit for classifying a document consisting of the words appearing together into terminal nodes of the ODP structure; And a sharing unit for sharing information between the lecturer or the learner using an interface constructed based on the ODP structure and a document composed of the words appearing together.

According to one embodiment, a learner can share information with other learners or lecturers using a conceptual tag cloud service. The learner can express his / her context in conceptual form by selecting his / her friend or lecturer in his / her social network, and can make an effective and accurate inquiry using short words .

According to one embodiment, a learner or a lecturer who receives a question from his / her friend or learner can easily understand the contents of the question, and can answer a question by setting a specific section of the text or video.

According to an exemplary embodiment, information can be shared while maintaining accurate context between a lecturer, a learner, a learner, and a learner using a conceptual tag cloud.

1 is a block diagram showing an example of a conceptual tag cloud-based information sharing system.
2 is a diagram showing an example of an upper category of the ODP structure.
3 is a diagram showing an example of an upper category, a lower category and words of the ODP structure.
4 is a diagram showing an example of a user interface of the conceptual tag cloud-based information sharing system.
5 is a diagram showing another example of the user interface of the conceptual tag cloud-based information sharing system.
6 is a diagram showing another example of a user interface of the conceptual tag cloud-based information sharing system.
7 is a diagram showing an example of a message structure for conceptual tag cloud-based information sharing.
8 is a flowchart illustrating an example of a conceptual tag cloud-based information sharing method.
9 is a diagram illustrating a conceptual tag cloud-based information sharing server terminal according to an embodiment of the present invention.
10 is a flowchart illustrating a method of interworking with video, conceptual tag cloud, and SNS according to an embodiment of the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

In the present invention, when providing information, an accurate context can be expressed in an easy and structured form using a structured tool, and a method of accurately describing the intention of the user based on the accurate context can be provided.

The conceptual tag cloud has a conceptual hierarchical structure such as an ontology, and each tag cloud exists in each leaf node. Generally, a tag cloud refers to a tag (word) obtained from metadata and visually arranged in consideration of importance and popularity, and displayed on a web site. Normally tags are arranged in the form of a two-dimensional table, in which order is arranged alphabetically / alphabetically. To emphasize visual significance, each tag changes its shape, such as color or thickness, depending on its importance (or popularity). The user can find a favorite keyword among the displayed tags and select it to move to the web page originally linked to the metadata. Here, a user who uses a conceptual tag cloud-based information sharing system may include a learner and a lecturer.

The purpose of using this tag cloud is to know the association of the tags easily, and intuitively know what keywords are most important on the current page. When the user selects tag cloud, the conceptual hierarchical structure of the tag is grasped by the system, and the hierarchical structure of the information can be expressed on behalf of the user. In this way, the user can present his / her context easily and accurately.

1 is a block diagram showing an example of a conceptual tag cloud-based information sharing system.

The conceptual tag cloud-based information sharing system 100 may include an extraction generating unit 110, a storage unit 120, a building unit 130, a classification unit 140, and a sharing unit. According to an aspect of the present invention, the conceptual tag cloud-based information sharing system 100 can share information with a learner or a lecturer present in a social network using a conceptual tag cloud.

The extracting and generating unit 110 may extract an important word from the script document of the video. For example, the extraction and generation unit 110 may use a term frequency-inverted document frequency (TF-IDF) and a latent semantic analysis (LSA) algorithm to extract important words in a script document. To this end, the extraction and generation unit 110 may assume that each sentence in the script document of the video is a single document. The extracting and generating unit 110 can calculate the importance of the word using the frequency of the word appearing in the current document and the word appearing in the entire document through the assumption, and the following formula can be used.

The term frequency (tf) for a document given in Equation 1 is simply the number of times the word appears in the document. However, in this case, if the length of the document is longer, the term frequency may become larger regardless of the actual importance of the word, and therefore, in general, the importance of the word t _i in a specific document d _j is normalized as follows.

Where, n _{i, j} is the number of times the word appears in the document d t _{i j,} and the denominator is the number of all the words in the document d _j it appears. The IDF (Inverse Document Frequency) is a numerical value indicating the general importance of the word, and logs the total number of documents divided by the number of documents containing the word.

은 단어 t_i가 등장하는 문서들의 숫자이고, TF-IDF 가중치는 term frequency와 inverse document frequency의 곱으로 계산된다.
Here, | D | is the total number of documents in the language

Is the number of documents in which the word t _i appears, and the TF-IDF weight is calculated as the product of the term frequency and the inverse document frequency.

In addition, the extraction and generation unit 110 may generate words appearing together in one sentence or neighboring sentences using the extracted important words. Here, a word extracted from a script document may have a perfect meaning in comparison with one or more combinations. For example, since words such as "Semantic Web" and "World Wide Web" can be expressed accurately in terms of one or more combinations, the extraction and generation unit 110 may generate a single document or a neighboring document The co-occurrence term can be generated by calculating words appearing together.

For example, a keyword extracted from a script document may have perfect meaning as compared to one or more combinations. Here, perfect meaning can be more accurate. For example, the terms "Semantic Web" and "World Wide Web" refer to the words "Semantic", "World", "Wide" In the case of one or more combinations, the actual meaning can be accurately expressed. Therefore, the extraction and generation unit 110 may calculate words appearing together in one document or a neighboring document to extract words appearing together.

For example, a key word or an important word may be a word having a specific meaning, which can maintain accurate context between a lecturer and a learner, a learner, and a learner. Through these keywords or Keywords, the learner or learner can easily understand the context.

The storage unit 120 may store a script document of video and video. Here, the script document of the video may be a document written in text form by a person, or a document written in text form in a video using a speech recognition technique. The storage unit 120 may store the script document of the video together with the corresponding sentence and the frame information of the video. Here, the frame information may include information on a start time and an end time.

The construction unit 130 may construct an ODP (Open Directory Project) structure to represent each domain in a hierarchical structure. Here, the ODP structure has a hierarchical structure corresponding to various domains (Arts, Business, Computers, News, etc.) and can be expressed in a hierarchical structure such as an ontology. In addition, the constructor 130 may include a constructed conceptual hierarchical ontology. Specific examples of the ODP structure will be described later with reference to FIG. 2 and FIG.

The classifying unit 140 may classify a document composed of words together into a leaf node of the ODP structure. The classifying unit 140 classifies words having a semantic form consisting of one or more words generated using currently separate script documents, hierarchical structure information constructed by ODP, and information of words into an ODP structure It can be classified into a specific leaf node of the established hierarchical structure. For this classification, the classifier 140 must calculate the similarity between documents. For this calculation, a formula such as cosine similarity may be used. For example, the classifier 140 may map information extracted from the script document to hierarchical structure information of the ODP structure. In addition, the classifier 140 may include a tag cloud classified and mapped in the manner described above.

The sharing unit can share the information between the lecturer and the learner by using the interface expressed in the conceptual form to provide information to the user using the generated ODP structure and the information mapped to the ODP structure. Here, concrete examples of the interface will be described later with reference to Figs. 4 to 7.

2 is a diagram showing an example of an upper category of the ODP structure.

For example, Computers 210 may be one of the top categories. Computers 210 may also include sub-categories such as Internet 211, Software 212, and Hardware 213. [ As such, the ODP structure may include one or more higher categories, such as Arts, Business, Computers 210, and each higher category may include one or more sub-categories.

3 is a diagram showing an example of an upper category, a lower category and words of the ODP structure.

For example, the top category Computers 310 may include subcategories 320 that are Computer science, Hardware, Internet, Security, Software, Systems. Here, the subcategory 320 may include corresponding information and words. For example, it can be assumed that the words representing the computer 310 in the ODP structure are composed of 32 words 330 such as Algorithms and Artificial Intelligence.

4 is a diagram showing an example of a user interface of the conceptual tag cloud-based information sharing system.

The user interface may include video content 410 and a graph 420 of an ODP-based conceptual structure. In one example, the video content 410 may be selected by the learner. In addition, the graph 420 can be used to represent each word mapped to a terminal node of the ODP structure in an intuitive form to the user.

5 is a diagram showing another example of the user interface of the conceptual tag cloud-based information sharing system.

The user interface may include a tag cloud 510 and a script document list 520.

The tag cloud 510 may be a result screen in which important words are extracted from a document included in the hierarchical structure selected by the learner and provided in a tag cloud form. Also, the tag cloud 510 can express the word of the script document of the terminal node of the ODP structure selected by the learner.

In addition, the script document list 520 may be a list representing a script document in which a word related to the tag currently selected by the learner exists. For example, if the currently selected word appears in a particular part of the video, then only the scenes related to it can be collected and provided to the learner or lecturer.

6 is a diagram showing another example of a user interface of the conceptual tag cloud-based information sharing system.

The user interface may include an information sharing popup 610 and an information sharing display list 620.

The information sharing pop-up 610 may be an interface through which a learner can learn information about a video content and then share information or ask questions. Information input to the information sharing pop-up 610 will be described later with reference to FIG.

The information sharing display list 620 may include an indication of the learner's question and the lecturer's answer to the learner's question. Here, each piece of information can be set to be public or private by the learner or lecturer. For example, a learner or lecturer can answer an open question. In addition, the learner or lecturer who answers can choose a specific part of the associated video along with the text to take the place of the answer.

7 is a diagram showing an example of a message structure for conceptual tag cloud-based information sharing.

The message structure may include a Username element 710, an Ontology Hierarchy element 720, an At time element 730, and a Comment element 740.

The Username element 710 may include information identifying the user as the name or identity of the user who is to share the information.

The ontology hierarchy element 720 may include ontology layer information of a question selected by the learner. The ontology hierarchy element 720 can be used to easily understand the context of the current user.

For example, if you ask what the word JAVA is, the learner can not easily answer without conceptual hierarchy information. This is because the word JAVA represents JAVA, one of the programming languages, JAVA, one of the coffee names, and JAVA, which is one of the island names, so it may not be clear which context the learner asked the question. Based on these contents, if the Ontology Hierarchy element (720) is represented as Computer / Programming, the lecturer can more clearly understand that JAVA is a computer programming language.

The At time element 730 is information about a video specific scene or a shot that a learner views, and when a lecturer or another learner receives a message having the following structure, And may include information enabling movement to the position of one video.

The comment element 740 may include information indicating what information the learner wants to share in the current context or to which part the question is to be asked.

For example, the structure of answering a learner's question can also be the same as a message structure.

8 is a flowchart illustrating an example of a conceptual tag cloud-based information sharing method.

The information sharing system can extract important words from the script document of the video (810). For example, the information sharing system can extract important words from a script document of a video using either TF-IDF or LSA. Here, the script document can be manually generated, such as when a specific person hears and writes, or can be automatically generated using voice recognition technology.

The information sharing system can construct an ODP structure to represent domains in a hierarchical structure (820). For example, an information sharing system can construct an ODP structure to represent a domain as an ontology hierarchical structure.

The information sharing system can generate words that appear together in a sentence or a neighboring sentence using an important word extracted from a script document (830). Here, the words appearing together may include at least one important word.

The information sharing system may classify documents consisting of words appearing together into terminal nodes of the ODP structure (840). For example, the information sharing system can classify a document consisting of words appearing together into a terminal node of the ODP structure using the cosine similarity.

The information sharing system can construct an interface provided to the user based on the ODP structure and a document including the words appearing together (850).

The information sharing system can share information among lecturers or learners using a conceptual tag cloud in a social network service (860).

According to an exemplary embodiment, the conceptual tag cloud-based information sharing method can be roughly divided into three parts. For example, the conceptual tag cloud-based information sharing method includes a preprocessing step 810-840, a conceptual tag cloud-based user interface building step 850, and a step 860 of sharing information with the learner or the lecturer using the structured information ).

Thus, according to the embodiment, an intuitive form of conceptual tag cloud-based information sharing service is possible. Therefore, the information sharing system can provide information in an effective and intuitive way to share information between learner and lecturer or learner and learner in the environment of online education.

For example, the conceptual tag cloud service enables learners to share information with other learners or lecturers. Learner can present context in conceptual form by choosing his / her friend or lecturer in his / her social network, choosing the information or word he / she is currently curious about, and making effective and accurate inquiry using short words .

For example, a learner or lecturer who receives a question from his or her friend or learner can easily understand the content of the question and can answer the question by setting a specific section of text or video.

The apparatus described above may be implemented as a hardware component, a software component, and / or a combination of hardware components and software components. For example, the apparatus and components described in the embodiments may be implemented within a computer system, such as, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable array (FPA) A programmable logic unit (PLU), a microprocessor, or any other device capable of executing and responding to instructions. The processing device may execute an operating system (OS) and one or more software applications running on the operating system. The processing device may also access, store, manipulate, process, and generate data in response to execution of the software. For ease of understanding, the processing apparatus may be described as being used singly, but those skilled in the art will recognize that the processing apparatus may have a plurality of processing elements and / As shown in FIG. For example, the processing unit may comprise a plurality of processors or one processor and one controller. Other processing configurations are also possible, such as a parallel processor.

The software may include a computer program, code, instructions, or a combination of one or more of the foregoing, and may be configured to configure the processing device to operate as desired or to process it collectively or collectively Device can be commanded. The software and / or data may be in the form of any type of machine, component, physical device, virtual equipment, computer storage media, or device , Or may be permanently or temporarily embodied in a transmitted signal wave. The software may be distributed over a networked computer system and stored or executed in a distributed manner. The software and data may be stored on one or more computer readable recording media.

The method according to an embodiment may be implemented in the form of a program command that can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, and the like, alone or in combination. The program instructions to be recorded on the medium may be those specially designed and configured for the embodiments or may be available to those skilled in the art of computer software. Examples of computer-readable media include magnetic media such as hard disks, floppy disks and magnetic tape; optical media such as CD-ROMs and DVDs; magnetic media such as floppy disks; Magneto-optical media, and hardware devices specifically configured to store and execute program instructions such as ROM, RAM, flash memory, and the like. Examples of program instructions include machine language code such as those produced by a compiler, as well as high-level language code that can be executed by a computer using an interpreter or the like. The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the embodiments, and vice versa.

9 is a diagram illustrating a conceptual tag cloud-based information sharing server terminal according to an embodiment of the present invention.

Referring to FIG. 9, the conceptual tag cloud-based information sharing server terminal according to an embodiment of the present invention may include a key word extracting unit, a video and keyword mapping unit, a conceptual tag cloud display unit, a social network message management unit, have.

At this time, the key word extraction unit extracts key words or important words from the script provided with the video.

The video and key word mapping unit performs a function of mapping the extracted key word and information on the start start or start frame of a specific scene of the video.

The conceptual tag cloud display unit can designate the size, position or color of the text according to the importance of the extracted tag and display it on the screen.

The social network message management part plays a role of supporting the user to perform a question using a conceptual tag or to answer a question written by a friend to an acquaintance in a social network.

The event processing unit plays a video or another video with a scene or frame of the video mapped to the tag cloud selected by the user.

10 is a flowchart illustrating a method of interworking with video, conceptual tag cloud, and SNS according to an embodiment of the present invention.

Referring to FIG. 10, when a user is viewing a specific portion of a video and wants to share information or ask questions with friends who are present in the social network, the conceptual tag cloud provided with the current video is selected, The user can select an acquaintance or a group in the message list and transmit the message.

Messages received from an acquaintance in a social network include the concept of a conceptual tag cloud and a message written by an acquaintance.

In this case, when the content of the context transmitted by the acquaintance is directly confirmed, a method of moving to the context of the corresponding video by clicking the conceptual tag cloud is provided.

9 to 10, the description of the unexplained matters may be applied as it is through FIGS. 1 to 8, so that a detailed description thereof will be omitted.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments. For example, it is to be understood that the techniques described may be performed in a different order than the described methods, and / or that components of the described systems, structures, devices, circuits, Lt; / RTI > or equivalents, even if it is replaced or replaced. Therefore, other implementations, other embodiments, and equivalents to the claims are also within the scope of the following claims.

100: Conceptual Tag Cloud-based Information Sharing System
110:
120:
130:
140:

Claims (8)

A server terminal for a tag cloud-based information sharing service,
A key word extracting unit for extracting a word from a script document;
A video and key word mapping unit for mapping information extracted from the script document and information on a start time of a word or a scene segment in a video;
A tag cloud display unit for displaying an interface and a tag cloud to a user based on the extracted word;
Lt; / RTI >
A social network message management unit providing a function of sharing information with an acquaintance existing in a user's social network in a specific part of the video
Further comprising:
Wherein the social network message management unit comprises:
A server terminal that provides a function that allows the user to ask questions about the content of a lecture in a particular part of the video and to view the contents of the user's answers. The method according to claim 1,
Information on a scene segment in which a word appears in the video
And information on a start time and an end time of the start frame and the end frame in which the word appears in the video. The method according to claim 1,
The information on the start time of the word in the video
And information on a first frame number or time at which a word appears in the video. delete The method according to claim 1,
An event processor for processing an event corresponding to the selection when the user selects the tag cloud displayed through the tag cloud display unit,
Further comprising:
The event processing unit
The information about the start time of the video mapped to the tag cloud selected by the user, or the information about the scene section, and displays the information on the start time of the video mapped to the tag cloud selected by the user or the scene interval And displaying scripts for the plurality of pieces of information on a screen when a plurality of pieces of information about the plurality of pieces of information are displayed. The method according to claim 1,
An event processor for processing an event corresponding to the selection when the user selects the tag cloud displayed through the tag cloud display unit,
Further comprising:
The event processing unit
When an acquirer of a social network that receives a message transmitted from a user via a social network message management unit selects a tag cloud from the received message, the corresponding event is received by the event processing unit, and the video data of the video mapped to the tag cloud selected by the acquaintance And displaying a script corresponding to information on the start time on the screen. The method according to claim 1,
Wherein the social network message management unit comprises:
The user can express the current user's context to the acquaintances by selecting the displayed tag cloud through the tag cloud display unit so that the user can ask the acquaintances of the social network about specific contents, Further including a server terminal. The method according to claim 1,
Wherein the social network message management unit comprises:
The acquaintances in the user's social network receive the user's question during the video viewing or through the message received through the smart device and select the tag cloud received from the user to understand the user's question, Wherein the server terminal further includes a function of allowing the acquaintance in the user's social network to select the tag cloud of another video other than the current video to answer the user.

Images