KR100835437B1 - System for providing user adapted multi-media using multi-media accumulation point - Google Patents

Abstract

The present invention relates to a user-adaptive multimedia providing system comprising a plurality of user terminals and a mounting type terminal, wherein the plurality of user terminals have a communication means and an output means, and the mounting type terminal includes a communication means for communicating with a plurality of user terminals, a user. And a processor for clustering the multimedia files transmitted from the terminal and selecting multimedia representing the characteristics of the current user group, a database storing the clustered multimedia data in the processor, and output means for outputting the multimedia file selected by the processor. As a result, the administrator can provide a multimedia service that dynamically reflects the common characteristics of users gathered at a specific place without direct intervention on the installed terminal.

Description

System and method for providing user adapted multimedia using multimedia accumulation point

1 is a view for explaining a user adaptive multimedia providing system using a multimedia storage point according to an embodiment of the present invention;

2 is a flowchart illustrating a user adaptive multimedia providing method using a multimedia accumulation point according to an embodiment of the present invention;

3 is a view for explaining a data flow of the multimedia providing system according to an embodiment of the present invention;

4 is a view for explaining a method of expressing characteristics of a multimedia file;

5 is a flowchart illustrating a method of dividing multimedia files transmitted from various user terminals into several clusters.

Explanation of symbols on the main parts of the drawings

100a, 100b, 100c: user terminal

100d, 100e: User terminal out of communication range

101a, 101b, 101c, 101d, 101e: communication means of the user terminal

102a, 102b, 102c, 102d: output means of the user terminal

103: installable terminal 104: processor

105: communication means of the mounting terminal 106,107: output means of the mounting terminal

108: database

The present invention relates to a system for providing a multimedia service using short-range wireless communication, and more particularly, when multimedia files stored in a user terminal equipped with a short-range wireless communication function are delivered to an installed terminal installed at a fixed location, the installed terminal. The present invention relates to a system and method for providing a user-adaptive multimedia using a multimedia accumulation point that classifies multimedia files and uses representative files at a location where an installed terminal is installed.

Currently, application systems are developed to provide various services based on location information, and various services based on wireless communication functions have been studied. These location-based services are formed in the form of using the base station or GPS information that the user terminal is connected to determine the location, and provides a service according to the location to the user. In addition, short-range wireless communication-based system has been utilized for the formation of a human network between users, collaboration through the sharing of work content, and search for information. Accordingly, a short range wireless communication based system has been applied in a form of providing a terminal at a specific location, providing predetermined advertisements and information to surrounding users, or using a user's information to provide a suitable service.

However, this service utilizes static information at a specific location, and cannot use information such as location and preference of users, which are dynamically changed with time, and characteristics, atmosphere, and personality of the area. There are disadvantages.

In addition, in order to use such a service, the contents of the service must be specifically set in advance in the system, and the user has to restrict personal information to his or her own information terminal in advance in order to receive a service suitable for the user. .

Therefore, there has been a demand for a system capable of providing a user-oriented multimedia service reflecting the characteristics of a user group gathered at a specific place through user multimedia accumulation and clustering.

The present invention has been made in view of the above, and provides a user-adapted multimedia using a multimedia accumulation point that can provide a dynamic multimedia content service that represents the characteristics of a specific place through clustering of multimedia files collected from user terminals It is an object to provide a system and method.

The user adaptive multimedia providing system according to the present invention for achieving the above object is composed of a plurality of user terminals and the installation terminal, the plurality of user terminals having a communication means and an output means, the installation terminal, a plurality of user terminals A communication means for communicating with the server, a processor for clustering multimedia files transmitted from the user terminal, selecting a multimedia indicating characteristics of a current user group, a database storing the clustered multimedia data, and outputting the multimedia file selected by the processor. And an output means.

In this case, the communication means of the plurality of user terminals and the communication means of the installed terminal may communicate using any one of Bluetooth, WLAN, or Zigbee short-range wireless communication method. In addition, the output means of the mounting terminal is preferably a sound reproduction device and / or display.

The processor includes a personal arrangement module for comparing and analyzing multimedia characteristic information classified as a representative cluster and multimedia data transmitted by a user terminal, and selecting and transmitting a multimedia file similar to a specific user's preference to a specific user terminal. It is preferable.

In the multimedia data stored in the database, each characteristic is represented by a binary number string, and similarity between the multimedia data is calculated using a binary vector space model.

A method for providing user adaptive multimedia according to the present invention for achieving the above object is performed in a user adaptive multimedia providing system consisting of a plurality of user terminals and an installable terminal, and the user terminal and the installable terminal are connected to a wireless network. A step in which a file is transmitted from a user terminal to an installable terminal, a multimedia file accumulated in the installable terminal is clustered and stored in a database, and a multimedia file most similar to the multimedia file is generated by referring to the multimedia file information transmitted by a specific user terminal. And selecting the representative file in the representative cluster and transmitting the selected file to the corresponding user terminal.

In accordance with an aspect of the present invention, there is provided a method for providing user-adapted multimedia according to the present invention, comprising: (a) collecting N multimedia files from a user terminal by an installed terminal, and (b) selecting N multimedia files collected by the installed terminal in advance. (C) collecting the new multimedia file from the user terminal by the installed terminal, and (d) collecting the collected multimedia file as the closest cluster center among the K initial cluster centers. Classifying the cluster as being corresponding to the nearest cluster center; (e) updating the cluster center to reflect the added M files when M multimedia files are collected; and (c) if M multimedia files are not collected. Moving (f) reclassifying the entire multimedia file using the updated cluster center; And (g) determining if the cluster center has converged, and if not converged, moving to step (e) and, if converged, moving to step (c), wherein N, K, and M are arbitrary constants. It is characterized by.

In this case, in step (b), the K initial cluster centers may be selected using a sample representing a specific genre, or randomly selected under a constraint of estimating a PDF based on N samples and maintaining an appropriate distance based thereon. .

를 생성하는 단계,

와 같이

를 정규화하여 L-차원 공간의 단위 구(球)상으로 매핑하는 단계 및,

를 이용하여 각

를 K 개의 군집으로 분류하는 단계를 포함하고, i는 샘플의 인덱스, L은 비트-벡터의 길이, 코사인 유사도는

인 것이 바람직하고, (e) 단계에서, 군집의 중심을 갱신하는 것은

를 이용하는 것이 바람직하다. And step (b) is a binary vector for multimedia data.

Generating the,

together with

Normalizing and mapping onto a unit sphere in L-dimensional space,

Using each

Is classified into K clusters, i is the index of the sample, L is the length of the bit-vector, and the cosine similarity is

Preferably, in step (e), updating the center of the cluster is

It is preferable to use.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. However, the following embodiments are provided to those skilled in the art to fully understand the present invention, and may be modified in various forms, and the scope of the present invention is limited to the embodiments described below. It is not.

(Example)

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a view for explaining a user-adaptive multimedia providing system using a multimedia storage point in accordance with a preferred embodiment of the present invention.

Referring to FIG. 1, a system for providing user adaptive multimedia using a multimedia accumulation point according to an exemplary embodiment of the present invention includes a plurality of user terminals 100a, 100b, 100c, 100d, and 100e and a fixed installation terminal 103. . Various multimedia files stored in a plurality of user terminals are transmitted to the installation terminal 103 installed at a fixed location, and the installation terminal 103 accumulates and clusters these multimedia files to form a collection of characteristic media to the user terminal. to provide.

To this end, the user terminals 100a, 100b, 100c, 100d, and 100e are provided with communication means 101a, 101b, 101c, 101d, and 101e to communicate with the installed terminal 103. The communication means 101a, 101b, 101c, 101d, and 101e of the user terminal for communicating with the installed terminal 103 preferably perform a short range wireless communication function such as Bluetooth, WLAN, Zigbee, and the like. . The user terminals denoted by reference numerals 100d and 100e refer to terminals outside the short range communication with the installed terminal. In addition, the user terminal is provided with output means 102a, 102b, 102c, 102d for outputting multimedia data. Such user terminals may be mobile phones, PDAs, smartphones, PMPs, digital cameras with communication capabilities, and other digital convergence terminals.

The installed terminal 103 is installed at a fixed position and includes a processor 104, communication means 105, output means 106, 107, and a database 108. The communication means 105 communicates with the user terminals 101a, 101b, and 101c, and communicates with the user terminal using a short range wireless communication method such as Bluetooth, WLAN, Zigbee, and the like. . The output means may be in various forms such as the sound reproducing apparatus 106 or the display 107. The database 108 serves to store multimedia data.

The processor 104 of the installed terminal serves to cluster multimedia files. In addition, the processor 104 generates a list of multimedia files to be played through an algorithm for selecting media representing common and representative characteristics of the current user group based on the information stored in the database 108, and transmits them to the user terminal or installs them. Through the terminal output means it is provided to the entire user group in common.

The processor 104 of the installed terminal may include an individual match module. The personal match module compares and analyzes multimedia characteristic information classified into a representative cluster and information transmitted by a user's terminal to analyze the personal match module. It selects files similar to each user's preferences shown in multimedia files from representative cluster and transmits them to personal terminal. This module enables users to receive not only common multimedia services that match the overall characteristics of the current user group, but also multimedia services that meet their personal preferences.

As shown in FIG. 1, the installed terminal 103 installed in a fixed position communicates with the user terminals 101a, 101b, and 101c that have entered the communication range using a communication means, but the terminals 101d and 101e are out of the communication range. Also, when approaching the installation type terminal 103 and entering a distance within which communication is possible, of course, it is possible to communicate using short-range wireless communication. The installation terminal 103 may be installed in various places such as a cultural street, a cafe, a restaurant, a main point of a tourist spot, a club, a park bench, a large store, etc. according to the purpose of utilizing the system.

2 is a flowchart illustrating a user adaptive multimedia providing method using a multimedia accumulation point according to an exemplary embodiment of the present invention.

2 illustrates a flow from the moment a user enters a specific place to the transmission of multimedia to the user terminal. First, when a user enters into an area in which communication with the installation type terminal is possible, the user terminal and the installation type terminal are connected to the wireless network (step 200). Then, the multimedia file owned by the user is transmitted to the installed terminal (step 201).

Through this process, multimedia files accumulated in the installed terminal are clustered by the processor of the installed terminal and stored in the database (step 202). At this time, the personal media files of a plurality of users are continuously delivered to the installation type terminal, and the cluster classification form is dynamically changed at regular intervals.

Next, referring to the media file information transmitted by the specific user terminal, the media file most similar to the file of the user is selected (step 203), and the selected file is transmitted to the user terminal (step 204).

3 is a view for explaining the data flow of the multimedia providing system according to an embodiment of the present invention.

When the user terminals 101a, 101b, 101c, 101d, and 101e enter the communication area of the installed terminal 103, multimedia stored in the user terminal, for example, a music file, is transmitted to the database 108 of the installed terminal. (300). The music files received from the various users are classified into several clusters by the clustering algorithm by the processor 104 of the installed terminal, and the music corresponding to the most representative cluster is selected. If the installation terminal is installed in the cafe, the music corresponding to the representative cluster among the classified clusters can be reproduced as the background music of the cafe through the output means 106 such as a speaker, the output means such as a joint display 107 It may also be output through (301). Then, each user is provided with his or her preferences 100a, 100b, and 100c similar to his or her favorite music files belonging to the representative cluster (302).

Through this process, the background music of the cafe is filled with the common taste of the group of people who use it frequently. This atmosphere can be a factor that makes people come back to this cafe.

Hereinafter, a method of expressing characteristics of a multimedia file will be described with reference to FIG. 4.

Each multimedia file is accompanied by metadata of a common format that expresses its characteristics, and the metadata expresses its own characteristics according to the type of multimedia file. Each feature data of the multimedia file may be represented by a binary number string (multidimensional binary vector). When the user stores the multimedia file in his terminal, the user may directly input each feature data or utilize the data inferred by the user's personal agent.

In order to represent the characteristics of the multimedia file as a binary number string, a binary vector space model is utilized as shown in FIG. That is, in the binary vector space, the characteristics of all multimedia data are represented by an array of bits, and unique characteristics appear depending on which position value of the elements of the array is one. For example, when the multimedia file is a movie, the elements of the binary number strings are defined in a dictionary form, and the characteristics of each movie are expressed in binary. Since a movie can be characterized by the lead actor, director, genre, and production year, if the lead actor is Lee Byung Hun, only Lee Byung Hun will be 1 and the number of leading actors will be '001000…'. Can be expressed as' In addition, the director, genre, and production year are expressed in a binary number string in a similar manner, and combining these characteristics produces a binary number string for a given movie. Therefore, media data containing 1 in common at various positions of array elements have similar characteristics.

5 is a flowchart illustrating a method of dividing multimedia files transmitted from various user terminals into several clusters.

As described with reference to FIG. 4, the characteristic data of the multimedia file expressed in the form of a binary number string is represented by an n-dimensional vector. If such data are to be classified into K clusters, each K cluster centroid set may be determined, and each multimedia characteristic data may belong to a specific cluster. In this way, it is possible to extract the representative characteristics of those included in the largest cluster among the multimedia files owned by the current users.

The cluster classification method according to a preferred embodiment of the present invention is composed of three stages: initialization, classification, and centroid update of the cluster. At this time, the classification and update are repeatedly performed to find the optimal cluster.

Referring to FIG. 5, first, N multimedia files are collected (operation 500). The sample multimedia file is waiting to be collected until N files are collected from the user. That is, since there are no files in the installed terminal at all, before the N files are collected, the characteristics of the location where the installed terminal is located or the characteristics of people gathered there cannot be extracted. It is.

Where N is any constant and refers to an appropriate number of characteristics of the collected multimedia file to some extent. In general, the N value can be determined from the experimental experience.

은 임의로 결정한다. 예를 들어, 미리 준비된 장르를 대표하는 샘플을 이용하거나, N개의 샘플을 바탕으로 PDF를 추정하고 이를 기초로 적절한 거리를 유지하는 제한 하에서 랜덤하게 선택하는 방법을 이용할 수 있다. Next, K initial cluster centers are selected (step 501). Here, the K value may be determined empirically according to the variety of users. Center of K clusters

Is determined arbitrarily. For example, a sample representing a pre-prepared genre may be used, or a method of randomly selecting under a constraint of estimating a PDF based on N samples and maintaining an appropriate distance based thereon may be used.

Next, the collected initial N pieces of data are classified as corresponding to the nearest cluster center (step 502).

를 생성한다.The step of finding the nearest cluster center is described in more detail. First, by using keyword matching for the initial N data stored in the database, a binary vector is obtained as follows.

Create

Where i is the index of the sample and L is the length of the bit-vector or the dimension of binary vector space.

를 정규화(normalize)하여 L-차원 공간의 단위 구(球)상으로 매핑한다.And as shown in Equation 1 below

Normalize to map onto a unit sphere in L-dimensional space.

로 매핑한 것이다.As a result, the multimedia file s _i is a point on the unit sphere of R ^L.

Is mapped to.

를 이용하여 각

를 K 개의 군집으로 분류한다. 따라서, 각 멀티미디어 파일 샘플은 다음의 수학식 2에 따라 분류된다.And

Using each

Are classified into K clusters. Therefore, each multimedia file sample is classified according to the following equation (2).

로 주어진다.Where cosine similarity is

Is given by

The present invention should consider that the user's multimedia data is continuously added to the system, so that the user's data is continuously operated as the data is collected by a predetermined amount, thereby dynamically reflecting the characteristics of the user group changing in real time.

Therefore, after step 502, a new data sample is collected from the user (step 503).

Next, the collected files are temporarily classified into clusters corresponding to cluster centers closest to the file data (step 504). The classification may use the method described in operation 502.

Next, it is judged whether a predetermined number of files (M) have been collected (step 505). If not, the flow proceeds to step 503. In other words, each time user data is added, rather than calculating and modifying the cluster, it waits until the appropriate number of files (M) is collected.

If M pieces are collected, the center of each cluster is updated to reflect the newly added M pieces of file data (step 506). Updating the center of the cluster can use the following equation (3).

The center of each updated cluster is also in the unit sphere of the L-dimensional space.

Next, all multimedia file samples are classified again using the updated centers of clusters (step 507).

This classification and central update process is repeated until the classification of the sample is stabilized. In other words, it is determined whether the center of the cluster has converged (operation 508). If not, the process proceeds to step 506 to update the center of the cluster again. If converged, the process proceeds to operation 503 to collect new data samples from the user.

As described above, according to the present invention, a user-oriented multimedia content exhibiting common characteristics of people gathered at a specific place through a process of accumulating and clustering user multimedia of an installed terminal is provided. As a result, the administrator can provide a media service that dynamically reflects the common characteristics of users gathered at a specific place without direct intervention on the installed terminal.

When such a user-adapted multimedia providing system is installed in a place where many people gather, such as a tourist destination, a downtown area, a store, etc., it can not only provide multimedia information reflecting the characteristics of the user group, but also naturally provide the place through the characteristic multimedia. It can also be expected to promote, so it can attract other users to form a new culture.

As mentioned above, although preferred embodiment of this invention was described in detail, this invention is not limited to the said embodiment, A various deformation | transformation by a person of ordinary skill in the art within the scope of the technical idea of this invention is carried out. This is possible.

Claims (11)

In the user adaptive multimedia providing system consisting of a plurality of user terminals and installation type terminal, The plurality of user terminals have a communication means and an output means, Mounting terminal, Communication means for communicating with a plurality of user terminals; A processor for clustering multimedia files transmitted from the user terminal and selecting multimedia representing common and representative characteristics of current users of the plurality of user terminals communicating with the installed terminal; A database for storing clustered multimedia data in the processor; And an output means for outputting the multimedia file selected by the processor. The method of claim 1, The communication means of the plurality of user terminals and the communication means of the installed terminal is a user adaptive multimedia providing system characterized in that the communication using any one of the short-range wireless communication method of Bluetooth, WLAN, or Zigbee. The method of claim 1, Output means of the installation terminal is a user adaptive multimedia providing system, characterized in that the sound playback device and the display. The method of claim 1, The processor compares and analyzes the multimedia characteristic information classified as a representative cluster with the multimedia data transmitted by the user terminal, and selects and transmits a multimedia file with high similarity according to the characteristic of the specific user to transmit to the specific user terminal. User adaptive multimedia providing system comprising a module. The method of claim 1, In the multimedia data stored in the database, each characteristic is represented by a binary number string, and the similarity between the multimedia data is calculated using a binary vector space model. In the multimedia providing method performed in a user adaptive multimedia providing system consisting of a plurality of user terminals and installation type terminal, Connecting the user terminal and the installed terminal to a wireless network; Transmitting the multimedia file from the user terminal to the installed terminal; Clustering multimedia files accumulated in the installed terminal and storing them in a database; Selecting a multimedia file having the highest similarity with the multimedia file by referring to the multimedia file information transmitted by the specific user terminal; And transmitting the selected file to the corresponding user terminal. The method of claim 6, In the multimedia data stored in the database, each characteristic is represented by a binary number string, and the similarity between the multimedia data is calculated using a binary vector space model. In the multimedia providing method performed in a user adaptive multimedia providing system consisting of a plurality of user terminals and installation type terminal, (a) collecting, by the installed terminal, the N multimedia files from the user terminal; (b) classifying, by the installed terminal, the N multimedia files collected into ones corresponding to the nearest cluster center among the K initial cluster centers selected in advance; (c) collecting, by the installed terminal, a new multimedia file from the user terminal; (d) classifying the collected multimedia file as corresponding to the closest cluster center among the K cluster centers; (e) updating the cluster center by reflecting the added M files when M multimedia files are collected, and moving to step (c) when M multimedia files are not collected; (f) reclassifying the entire multimedia file using the updated cluster center; (g) determining if the cluster center has converged, and if not converged, moving to step (e) and, if converged, moving to step (c), And N, K, and M are arbitrary constants. The method of claim 8, wherein in step (b), The K initial cluster centers are selected using a sample representing a specific genre. According to claim 8, wherein step (b), Binary Vectors for Multimedia Data

Generating a;

together with

Is normalized so that the point on the unit sphere in L-dimensional space

Mapping to;

Using each

Labeling K into clusters, i is the index of the sample, L is the length of the bit-vector,

Is the center of the cluster, the cosine similarity is

,

Is

Means a value of k to make a minimum value. The method of claim 10, wherein in step (e), Updating the center of the cluster

But use

Is

Multimedia providing method characterized in that the size of.

Images