JP2001285836A - Data managing system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To efficiently deal with moving image data concerning a network type data managing system for managing multi media data including at least the moving image data. SOLUTION: When receiving the request of registering multimedia data from a client, 'when multi media data whose registration is requested is moving image data and the size or the time of the moving image data exceeds a threshold', a data managing server registers the multimedia data to a stream distribution server as stream data and registers an address in the stream distribution server of the multimedia data in a database. When receiving the request of retrieving the multimedia data from the client, the address of the multimedia data matching with a retrieving condition is transmitted to the client.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a network type data management system for managing multimedia data including at least moving image data.

[0002]

2. Description of the Related Art In recent years, WWW on the Internet
With the rapid spread of the (World Wide Web), it has become common to search for information via a network using a WWW browser. Such information search by a WWW browser can be performed also on an intranet in which the technology of the Internet is applied to an information communication system in a company, etc., and the same operation as the information search on the WWW is performed by using the WWW browser. A system that can extract still image data registered in a database via a network has been put to practical use.

[0003] In addition, with the recent improvement in moving image data compression technology and the increase in the capacity of recording media, moving image data has been converted into a database, and the moving image data registered in such a database has been stored in a WWW browser. A system that can take out, play, and regenerate has come into practical use.

[0004]

By the way, in a system for reproducing moving image data with a WWW browser, all of the moving image data read from a database is temporarily stored in a WWW browser.
There is a technology that employs a distribution technology (hereinafter, referred to as “download-type distribution”) that downloads to a WW browser and starts reproduction when the download is completed.

However, in a system employing such “download type distribution”, when distribution of moving image data having a large data amount is requested, a long time is required for downloading and a waiting time is required until reproduction starts. There is a problem. Therefore, an object of the present invention is to provide a data management system that can efficiently handle moving image data.

[0006]

According to a first aspect of the present invention, there is provided a data management system comprising: a client for transmitting a request for registration or search of multimedia data including at least moving image data via a network; A data management server for receiving via
A stream distribution server that stores the multimedia data in accordance with an instruction of the data management server and streams the moving image data of the stored multimedia data; and a multimedia in accordance with an instruction of the data management server. And a database for storing data based on a predetermined logical structure.When the data management server receives a request for registration of multimedia data, the data management server reads, `` the multimedia data requested to be registered is moving image data, and If the size or time of the moving image data exceeds a threshold value, the multimedia data is registered as stream data in the stream distribution server, and the address of the multimedia data in the stream distribution server is stored in the database. Register, and click `` Multimedia Iadeta is moving picture data,
And, when the size or time of the moving image data is equal to or less than a threshold or when the multimedia data requested to be registered is multimedia data other than moving image data, the multimedia data is Registering in the database based on a logical structure, while receiving a request for searching for multimedia data, searching the database and transmitting to the client an address of multimedia data matching the search condition; Is characterized in that, upon receiving an address of multimedia data that matches a search condition, the multimedia data corresponding to the address is referred to.

That is, in the data management system according to the first aspect, the registration destination of the moving image data is switched in accordance with the size or time of the moving image data. Therefore, when the client refers to the multimedia data, the data amount is large. Stream data is distributed from the stream distribution server for moving image data and moving image data that takes time to reproduce and distribute.

In the present invention, the time of the moving image data indicates the time required for the distribution of the moving image data and the time required for the reproduction, and varies depending on the compression method and the data transfer speed of the network. The data management system according to claim 2, wherein the data management server is a cache that stores multimedia data that meets a search condition or an address of the multimedia data. It has a buffer.

Therefore, according to the data management system of the present invention, the information (multimedia data or the address of the multimedia data) stored in the cache buffer can be reused in another process.
According to a third aspect of the present invention, in the data management system according to the first or second aspect, the client receives an external operation for extracting an arbitrary scene of the moving image data, and extracts the scene by the external operation. It is characterized in that an arbitrary scene of the plurality of moving image data thus reproduced is continuously reproduced.

[0010]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. In the following, as a data management system corresponding to an embodiment of the present invention, registration of moving image data and still image data is described. And a data management system for performing a search. FIG. 1 is a functional block diagram of the data management system.

In FIG. 1, a data management system 10
Is formed on a predetermined network, and the client 1
1, a WWW server 12, a data management server 13 (a server that manages the database 14 and the stream distribution server 15), a database 14, and a stream distribution server 15. Client 11 is a WWW
A personal computer with a browser,
In addition to basic input / output devices such as keyboards, mice, and displays, video cameras, digital still cameras,
An image capturing device 16 such as a scanner is connected.

An application program for realizing the following functions by a WWW browser is downloaded to the client 11 via the WWW server 12 in advance. << Image Acquisition Function >>: A function for acquiring moving image data and still image data from the image capturing device 16 and the internal hard disk.

<< Request transmission function >>: A function of transmitting to the data management server 13 a request selected by the operator in the registration and retrieval of moving image data and still image data. However, at the time of data registration, moving image data or still image data selected by the operator and attribute data (eg, classification, title, shooting date, photographer, etc.) set by the operator are added together with the registration request. When a search is requested, a search condition (corresponding to the content of the attribute data) set by the operator is transmitted together with the search request.

<< Scene extraction function >>: A function of supporting an operation of extracting an arbitrary scene from moving image data and transmitting a request for registration of an arbitrary scene extracted by an operator to the data management server 13. However, a scene in the present embodiment corresponds to a plurality of continuous frame images, and when registering an arbitrary scene, a frame number of a start point and an end point of the scene extracted by the operator in accordance with the registration request And playback elapsed time.

<< Search Result Document Analysis Display Function >>: Analyzes a search result document (details will be described later) generated by the data management server 13, and lists thumbnail images for moving image data and still image data that match the search conditions. A function to display information on the display. << Moving image playback function >>: Supports the operation of selecting a thumbnail image for desired moving image data from a list of thumbnail images displayed on the display by the << search result document analysis display function >>, and the selected thumbnail image (A function for implementing a moving image reproduction process described below).

When the operator selects a thumbnail image for a plurality of moving image data, only the scenes previously extracted by the << scene extraction function >> are continuously reproduced from the plurality of moving image data. When moving image data is distributed as stream data from the stream distribution server 15, the stream data is reproduced as moving image data.

On the other hand, the data management server 13 has a cache buffer and has a “registering process” to be described later.
It has a registration processing function and a search processing function for realizing <search processing>. In FIG. 1, only the client 11 is described as a client of the data management system 10 for the sake of simplicity. However, the data management system 10 includes a plurality of clients.
It is assumed that the data management server 13 processes requests transmitted from a plurality of clients in parallel by using a multi-thread or the like.

2 to 4 are operation flowcharts of the data management system 10. FIG. 2 shows << registration processing >> by the data management server 13, FIG. 3 shows << search processing >> by the data management server 13, and FIG. 4 shows << moving image reproduction processing >> by the client 11. Hereinafter, FIG.
The operation of the present embodiment will be described with reference to FIGS.

First, the "registration process" will be described. When the data management server 13 receives a registration request for moving image data or still image data, the data management server 13 determines whether the data requested to be registered is moving image data (S1 in FIG. 2). If the data requested to be registered is moving image data, it is determined whether the size or time of the moving image data exceeds a threshold (S2 in FIG. 2).

When the size or time of the moving image data requested to be registered exceeds the threshold, the data management server 13 transmits the moving image data to the stream distribution server 1.
5 and the attribute data of the moving image data and the address in the stream distribution server 15 are registered in the database 14 (S3 in FIG. 2). However, in the present embodiment, the address of the moving image data in the stream distribution server 15 is represented by a URL (Uniform Resource Locator), and the URL character string is registered in the database 14.

On the other hand, when the data requested to be registered is still image data, or when the size or time of the moving image data requested to be registered is equal to or smaller than a threshold, the data management server 13 requests the registration. The registered data and the attribute data of the data are registered in the database 14 (S4 in FIG. 2). When the data management server 13 receives an arbitrary scene registration request for moving image data, the data management server 13 extracts the frame numbers of the start point and end point of the scene extracted by the operator using the “scene extraction function” of the client 11 described above. Elapsed playback time (hereinafter referred to as "scene identification information")
Is registered in the database 14, and a thumbnail image corresponding to the frame image at the start point of the scene is registered in the database 14. If the data requested to be registered is still image data, the data management server 13
The thumbnail image corresponding to the still image data is registered in the database 14.

In the << registration processing >> of the present embodiment, the registration of moving image data and still image data is performed based on a request from the client 11, but the registration request of moving image data and still image data is XML. (Extensib
le Markup Language) and a registration request document described in a language standardized by a third-party organization.
As shown by a dotted line, a registration interface (for example, CORBA: Common Object Request Broker Arch) for inputting the registration request document to the data management server 13.
interface standardized by a third-party organization such as itecture) and a registered document analysis function that analyzes the registration request document, registers moving image data and still image data based on requests from other systems. can do.

That is, the data management server 13 converts the registration request document transmitted from another system as a request for registration of moving image data and still image data, and moving image data and still image data via the registration interface. Receive. Then, the data embedded in the registration request document is extracted, the data is registered in the database 14, and the moving image data and the still image data are stored in the database 14.
And the stream distribution server 15.

As described above, in the <registration process> of the present embodiment, the function expansion of the data management system 10 can be easily realized by providing the data management server 13 with the registration interface and the registered document analysis function. At the same time, connection and cooperation with other systems can be easily realized.

Next, << search processing >> will be described. However,
Hereinafter, for simplicity, moving image data and still image data are referred to as image data, and data other than image data (attribute data, thumbnail image data, “scene specifying information”, The URL character string for the image data is referred to as related data. Upon receiving the image data search request and the search condition, the data management server 13 searches the database 14 for related data and determines whether image data that matches the search condition is registered in the stream distribution server 15. Yes (Fig. 3S
1).

As a result of the determination, if image data matching the search condition is registered in the stream distribution server 14, the data management server 13 determines whether the relevant data (moving image data in the stream distribution server 15) matches the search condition. (Including a URL character string for the image data) in the database 14
(S2 in FIG. 3), and generates a search result document reflecting the search result using the obtained related data (S3 in FIG. 3).
3). In addition, the data management server 13 is the WWW server 1
Then, the generated search result document is transmitted to the server 2 and temporarily stored (S4 in FIG. 3).

However, the search result document is the client 1
1 shows a screen configuration for displaying a list of thumbnail images for image data matching the search condition, etc., and is described in a language standardized by a third party such as XML. When there are a plurality of image data that match the search condition, the data management server 13 repeatedly performs steps S1 and S2 (in some cases, FIGS. 3S5 and S6 described later) to generate a search result document.

On the other hand, as a result of the determination in FIG. 3S1, if the image data matching the search condition is registered in the database 14, the data management server 13 stores the image data matching the search condition and the related data from the database 14. Obtain (S5 in FIG. 3). And the data management server 13
Generates a URL character string corresponding to an address when saving image data matching the search condition in the WWW server 12;
The image data matching the search condition acquired from the database 14 or the generated URL character string is stored in the cache buffer (S6 in FIG. 3).

Further, the data management server 13 generates a search result document using the related data matching the search condition acquired from the database 14 and the URL character string for the image data in the WWW server 12 (S7 in FIG. 3). . Then, the data management server 13 transmits the search result document and the image data matching the search condition to the WWW server 12, and temporarily stores the document (S8 in FIG. 3). For image data that matches the search conditions, the WWW server 1
2 is held in association with the URL character string described above.

The data management server 13 corresponds to S4 and S8 in FIG.
When the search result document is stored in the WWW server 12, the UR for the search result document in the WWW server 12
The L character string is transmitted to the client 11 (S9 in FIG. 3).
When the URL character string is transmitted in this manner, the client 11 accesses the search result document in the WWW server 12 using the URL character string, and performs the search by the << search result document analysis display function >> described above. A list of thumbnail images for moving image data and still image data that match the conditions is displayed on the display as a search result.

That is, according to the << search processing >> of the present embodiment, if the image data matching the search condition is moving image data, the frame of the start point of the scene extracted by the operator in advance by the << scene extraction function >> When a thumbnail image corresponding to the image is displayed on the display, and the image data matching the search condition is still image data, a thumbnail image corresponding to the still image data is displayed on the display.

By the way, in the << search processing >> of the present embodiment, since the search result document is described in a language standardized by a third party, any system which can analyze a document described in such a language is required. For example, the image data registered in the data management system 10 can be searched without any special function change. That is, interoperation between the data management system 10 and another system can be easily realized.

In particular, when the search result document is described in XML, the degree of freedom in designing the user interface can be increased. Further, in the << search processing >> of the present embodiment, since the image data that matches the search conditions acquired from the database 14 and the URL character strings for the image data in the WWW server 12 are stored in the cache buffer, these information are stored in the cache buffer. It can be reused in subsequent search processing, and it is possible to reduce the overhead associated with image data search.

In the << search processing >> of the present embodiment, the database 14 of the image data matching the search conditions is used.
Is stored in the WWW server 12, but the image data registered in the stream distribution server 15 may also be stored in the WWW server 12. Also, as described above, the stream distribution server 15
When the image data registered in the WWW server 12 is stored in the WWW server 12, the image data and the URL character string for the image data in the WWW server 12 may be stored in the cache buffer.

Next, the << moving image reproducing process >> will be described. When the operator selects a thumbnail image for moving image data in a state where a list of thumbnail images for moving image data and still image data that match the search conditions is displayed on the display as described above, It is determined whether a plurality of thumbnail images have been selected (S1 in FIG. 4).

When a plurality of thumbnail images are selected as a result of such determination, the client 11
The order in which the thumbnail images are selected is recorded, and the URL character string of the moving image data and “scene specifying information” for each thumbnail image are extracted from the search result document (S1 in FIG. 4). In addition, the client 11 checks each UR
Of the moving image data corresponding to the L character string, only scenes corresponding to “scene specifying information” are sequentially and continuously reproduced (FIG. 4).
S2).

That is, if the URL character string is the WWW server 1
2 corresponds to the moving image data, the moving image data of the WWW server 12 is accessed using the URL character string, and the “scene specifying information” is indicated in the moving image data distributed from the WWW server 12. When the moving image data corresponding to the scene is extracted and reproduced, and the URL character string corresponds to the moving image data in the stream distribution server 15, the stream distribution server 15 uses the URL character string and the "scene specifying information". And reproduces the moving image data corresponding to the scene indicated by the “scene specifying information” distributed from the stream distribution server 15.

On the other hand, when a single thumbnail image is selected as a result of the determination in FIG. 4S1, the client 11 extracts the URL character string of the moving image data for the thumbnail image from the search result document (S4 in FIG. 4). The moving image data in the WWW server 12 or the stream distribution server 15 is accessed using the URL character string, and the distributed moving image data is reproduced (S5 in FIG. 4).

By the way, since the moving image data distributed from the stream distribution server 15 is stream data, the waiting time until the start of reproduction can be minimized. On the other hand, the moving image data distributed from the WWW server 12 is the moving image data registered in the database 14 with a relatively small data amount.
3 can be performed quickly and the reproduction in FIG. 4S5 can be performed quickly.

Therefore, in the << moving image reproduction process >> of the present embodiment, the reproduction of moving image data can be started more quickly than in a system employing "download type distribution", and different moving image data can be reproduced. Any scene can be smoothly and continuously reproduced.

By the way, all information (URL character string of moving image data, "scene specifying information",
The order in which thumbnail images were selected)
4, the same continuous reproduction can be reproduced. Also, as described above, the database 14
Can be regarded as independent moving image data different from the original moving image data.

That is, the << moving image reproducing process >> of the present embodiment is a process corresponding to moving image editing in which moving image data corresponding to an arbitrary scene is actually connected to generate new moving image data. It can be easily realized by the continuous reproduction. By the way, in the present embodiment,
Since the application program in the client 11 is downloaded via the WWW server 12, the time and labor required for the installation work and the like by the operator can be reduced, and the application program can be easily distributed.

In this embodiment, the client 11
And the data management server 13 are separately arranged to distribute processing. Since the data management server 13 processes requests transmitted from a plurality of clients in parallel, the processing efficiency of the entire data management system 10 is improved. Can be improved. In the present embodiment, the processing of registering and retrieving moving image data and still image data and reproducing the moving image data has been described. However, in the data management system 10, moving image data and still image data are processed similarly to the existing database system. The image data may be updated or deleted.

[0044]

As described above, according to the first aspect of the present invention, moving image data having a large data amount or moving image data requiring a long time for reproduction or distribution can be reproduced promptly by stream distribution. it can. According to the first aspect of the present invention, since the stream distribution server is provided separately from the data management server, the load on the data management server when distributing a large amount of moving image data can be reduced. . Further, according to the first aspect of the present invention, moving image data having a small data amount is not registered in the stream distribution server, so that all the moving image data is registered in the stream distribution server regardless of the data amount. The load on the distribution server can be reduced.

According to the second aspect of the present invention, since the information (multimedia data or the address of the multimedia data) stored in the cache buffer can be reused in another process, the same multimedia data can be used. It is possible to reduce the overhead at the time of distribution again. According to the third aspect of the present invention, it is possible to easily realize, by continuous playback, processing corresponding to moving image editing, in which moving image data corresponding to an arbitrary scene is actually connected to generate new moving image data. it can.

Therefore, according to the first to third aspects of the present invention, moving image data can be handled efficiently.

[Brief description of the drawings]

FIG. 1 is a functional block diagram of a data management system.

FIG. 2 is an operation flowchart (1) of the data management system.

FIG. 3 is an operation flowchart (2) of the data management system.

FIG. 4 is an operation flowchart (3) of the data management system.

[Explanation of symbols]

 Reference Signs List 10 Data management system 11 Client 12 WWW server 13 Data management server 14 Database 15 Stream distribution server 16 Image capture device

──────────────────────────────────────────────────続 き Continued on the front page (51) Int.Cl. ⁷ Identification symbol FI Theme coat ゛ (Reference) H04L 12/28 H04L 11/00 310Z F-term (Reference) 5B075 KK03 KK07 ND12 ND23 ND34 ND40 NK06 NK13 NK25 NR03 NR20 PP02 PP03 PP13 PP22 PP28 PQ02 PQ41 PQ42 PQ46 PQ48 UU34 UU35 5B082 FA12 5C064 BA07 BB10 BC18 BC23 BC27 BD02 BD08 5K033 AA01 AA03 BA13 BA15 DA01 DA13 DB10

Claims (3)

[Claims] 1. A client for transmitting, via a network, a request for registration or search of multimedia data including at least moving image data; a data management server for receiving a client's request via a network; A stream distribution server that stores the multimedia data in accordance with an instruction, and distributes the moving image data of the stored multimedia data in a stream; and, according to the instruction of the data management server, converts the multimedia data into a predetermined logic. And a database for storing based on the structure. When the data management server receives the request for registration of the multimedia data, the data management server reads, "The multimedia data requested to be registered is moving image data, and the moving image data If the size or time exceeds the threshold " The multimedia data is registered as stream data in the stream distribution server, and the address of the multimedia data in the stream distribution server is registered in the database. “The multimedia data requested to be registered is moving image data. And when the size or time of the moving image data is equal to or less than a threshold value or when the multimedia data requested to be registered is multimedia data other than moving image data, Registering in the database based on the logical structure of, on the other hand, upon receiving a request for multimedia data search, searches the database, transmits to the client an address of multimedia data that matches the search condition, Client matches search criteria A data management system comprising: when receiving an address of multimedia data, referring to the multimedia data corresponding to the address. 2. The data management system according to claim 1, wherein the data management server includes: multimedia data that matches a search condition;
A data management system comprising a cache buffer for storing an address of the multimedia data. 3. The data management system according to claim 1, wherein the client receives an external operation for extracting an arbitrary scene of the moving image data, and a plurality of moving images extracted by the external operation. A data management system for continuously reproducing an arbitrary scene of data.