Classifications

• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06F—ELECTRIC DIGITAL DATA PROCESSING
  • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
  • G06F16/40—Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
  • G06F16/43—Querying
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06F—ELECTRIC DIGITAL DATA PROCESSING
  • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
  • G06F16/80—Information retrieval; Database structures therefor; File system structures therefor of semi-structured data, e.g. markup language structured data such as SGML, XML or HTML
  • G06F16/83—Querying
  • G06F16/832—Query formulation

Definitions

• the present invention is related to a query expressing apparatus and method for searching multimedia data; and, more particularly, to a query expressing apparatus and method that can re-use a designated region and express diverse queries in a Moving Picture Experts Group (MPEG) 7 query format for searching multimedia data by using field types to express the queries.
• MPEG Moving Picture Experts Group
• Searching content-based multimedia data in diverse multimedia environments requires a method of efficiently expressing multimedia contents, and to express diverse data included in a multimedia content, a systematic expression scheme is required.
• MPEG 7 defines specifications for descriptors expressing the contents of audio and visual
• DDL Dynamic Language
• the MPEG-7 is related to a structure of metadata for expressing multimedia data such as image, audio, and moving picture.
• MPEG-7 query format is a form of a query expressed in MPEG-7 for multimedia data search.
• MPEG-7 query format defines syntax for searching MPEG-7 documents.
• MPEG-7 multimedia data are searched using the MPEG-7 query format .
• MPEG-7 query format should be able to exactly express diverse queries from users and diverse query types. For example, there are diverse query types, such as a sentence-type query, e.g., "music video starring Rain", example-based query using a multimedia file itself as a query, and an MPEG-7 textual description-based query.
• the above diverse query types should be able to be exactly expressed in MPEG-7 query format. Therefore, it is required to develop a query expression method that can exactly express diverse queries and query types in MPEG-7 query formats for MPEG-7 multimedia data search.
• a specific position is designated at first and the length and area attributes are designated for the specific location.
• a secondary search is executed within the result of a primary search.
• Fields used in the present invention expresses a user query as a query for searching multimedia data.
• Field types specify the attributes of the fields.
• the OutputDescriptionType is a type of an OutputDescription field indicating an output query result. According to the conventional technology, the OutputDescriptionType cannot express an operation result related to a plurality fields as output.
• FieldType included in the OutputDescriptionType refers to a specific element or attribute. However, since the FieldType is based on XPath, there are some restrictions in expressing a relationship between element and attribute.
• extensible Markup Language (XML) Path Language (XPath) is a standard of World Wide Web Consortium (W3C) and it is a language describing a method of arraying and processing elements by using a syntax designated on a path based on a structure of an XML document. XPath uses pass expression to define nodes of an XML document. Besides, it uses mathematics, functions and other extensible expressions.
• an embodiment of the present invention is directed to providing a query expression apparatus and method that can express diverse query types in Moving Picture Experts Group (MPEG) 7 query format and re-use a pre-designated region for multimedia search by using field types.
• MPEG Moving Picture Experts Group
• an apparatus for expressing a query inputted from a user for multimedia data search, which includes: an input means for receiving a query for multimedia data search from a user; and a query expression means for expressing the input query in a field type, wherein the field type includes at least one among identifier information indicating identification (ID) information of a field presenting a search condition included in the input query; type information indicating data type information of the field; and reference information indicating identifier information of another field for reference.
• ID identification
• a method for expressing a query inputted from a user for multimedia data search which includes: receiving a query for multimedia data search from a user; and expressing the input query in a field type, wherein the field type includes at least one among identifier information indicating identification (ID) information of a field presenting a search condition included in the inputted query; type information indicating data type information of the field; and reference information indicating identifier information of another field for reference.
• ID identification
• a search apparatus for searching multimedia data based on a query inputted from a user, which includes: an expression means for expressing the input query in a field type; and a search means for searching multimedia data based on the query expressed in the field type, wherein the field type includes at least one among identifier information indicating identification (ID) information of a field presenting a search condition included in the inputted query; type information indicating data type information of the field; and reference information indicating identifier information of another field for reference.
• ID identification
• a recording medium for recording a data structure where a query inputted from a user is expressed in a field type for searching multimedia data based on the query, which includes: at least one among identifier information indicating identification (ID) information of a field presenting a search condition included in the inputted query; type information indicating data type information of the field; and reference information indicating identifier information of another field for reference.
• ID identification
• type information indicating data type information of the field
• reference information indicating identifier information of another field for reference.
• the query expression apparatus and method of the present invention for multimedia data search can search Moving Picture Experts Group (MPEG) 7 documents with diverse queries and make a secondary search onto a portion whose range is defined by the primary search.
• MPEG Moving Picture Experts Group
• Fig. 1 is a block view showing a query expressing apparatus using field types for searching multimedia data in accordance with an embodiment of the present invention.
• Fig. 2 is a flowchart describing a query expressing method using field types shown in Fig. 1 to search multimedia data in accordance with an embodiment of the present invention.
• Fig. 3 illustrates field types used in an embodiment of the present invention.
• Fig. 1 is a block view showing a query expressing apparatus using field types for searching multimedia data in accordance with an embodiment of the present invention.
• the query expressing apparatus of the present invention includes a query expression unit 101, a query analysis unit 103, and a search engine 105.
• the query expression unit 101 expresses a query inputted from a user for searching multimedia data by using field types.
• the query analysis unit 103 analyzes the meaning of the query expressed by the query expression unit 101, and the search engine 105 searches for multimedia data related to the query analyzed in the query analysis unit
• the query expression unit 101 uses field types to accurately express the meaning of the inputted user query.
• the field types used in the query expression unit 101 will be described in detail by referring to Fig. 3.
• Fig. 2 is a flowchart describing a query expressing method using field types shown in Fig. 1 to search multimedia data in accordance with an embodiment of the present invention.
• a user inputs a user query into the query expression unit 101.
• the query expression unit 101 expresses the user query as a query for searching multimedia data by using field types.
• the query analysis unit 103 analyzes the meaning of the query expressed by the query expression unit 101.
• step S207 the search engine 105 searches for multimedia data related to the query whose meaning is analyzed by the query analysis unit 103.
• the method of the present invention includes a query expression step of expressing a user query by using field types, a query analysis step of analyzing the expressed query, and a search step of searching for multimedia data related to the analyzed query.
• Fig. 3 illustrates field types used in an embodiment of the present invention.
• the field types used to express a user query as a query for searching multimedia data include a field type identifier (ID) (typelD) 301, a field type name (typeName) 303, and a reference (ref) 305.
• ID field type identifier
• typeName field type name
• ref reference
• the field type includes at least one among ID information of a field indicating a search condition included in the inputted query, type information indicating data type information of the field, and reference information indicating ID information of another field for reference.
• the ID information corresponds to the typelD 301; the type information, to the typeName 303; and the reference information, to the ref 305, respectively.
• the typeID 301 is an identifier assigned to each field used for expressing a user query as a query for searching multimedia data.
• the typeID 301 is an ID information unique to the field indicating a search condition included in the user query.
• the typeID 301 makes fields possible to refer to each other.
• the typeID 301 is a field type ID (FieldTypelD) .
• the typeName 303 is type information indicating data type information of the field.
• the typeName 303 specifies the name of a complex data type defined according to Moving Picture Experts Group 7 (MPEG-7) Standard and limits a field used to express the user query as a query for multimedia data search to a specific data type.
• MPEG-7 Moving Picture Experts Group 7
• the ref 305 is reference information indicating ID information of anther field.
• the ref 305 makes it possible to refer to a field identifier including the typeID 301.
• Mpeg7//VisualCoding/Frame which is a Frame part of VisualCoding included in Mpeg-7, can be defined as a field value.
• a field used to express a user query as a query for searching multimedia data can be expressed in a complicated XPath and it may be referred during query input or query output.
• an ID attribute (e.g., typeID 301) is added to FieldType.
• Table 3 shows FieldType of Fig. 3 described in a schema format in accordance with an embodiment of the present invention.
• a field value is described in an xPath format (Mpeg7 : xPathRefType) in the xml schema.
• FieldType is extended from Mpeg7 : xPathRefType .
• the typeID 301, typeName 303 and ref 305 of Fig. 3 are defined by such attributes as ID, typeName and ref, respectively.
• An element including a low-level element of FieldType includes an IDREF element referring to a specific field.
• the item is a basic unit of data used in MPEG-7 multimedia contents.
• the outputNameSpace specifies Uniform Resource Identifier (URI) of namespace related to the metadata expressed in a Description element.
• outputNameSpace may be namespace related to MPEG-7 or another metadata format.
• the namespace is a document on a specific website, it checks out names of specific data elements or attributes used within an exclusive Markup Language (XML) file, when a data set for something is formed and shared by people on the web by using XML.
• XML exclusive Markup Language
• An author of an XML file checks namespace by designating a web address at around starting position of the XML file according to Uniform Resource Locator (URL) .
• URL Uniform Resource Locator
• An XML parser provided as part of a web browser comes to figure out rules for expression and where it can find different information about the elements of the XML file.
• the XML parser may refer to a definition XSL at an address "http://www.anyco.com/xml/schema” to figure out how to process data of the XML file beginning with a letter "xsl.”
• the XML file entitled “A Modest Proposal” can be analyzed based on XSL definition at "http : //www . anyco . com/xml/schema” .
• ID, typeName and Ref can be selectively used, information corresponding to a query can be searched upon receipt of a query format using one of the three informations.
• Table 5 shows an example of a field type of the xml schema format shown in the Table 3.
• Table 5 shows a field type when a user query "search images whose image size (horizontal * vertical) is greater than 1024*768.”
• FieldType has such elements as [Field], [SourceFeature] , and [FeatureName] .
• Elements of FieldType are used to express a query conforming to an Mpeg-7 Query Format, and a specific field may be referred to based on the ref 305. As a specific field is referred to, an additional data path can be described to express a region indicated by the field referred to.
• An element includes attributes of a field, such as field type ID, field type name, and reference.
• fields type ID such as field type ID, field type name, and reference.
• M7DocID >//VisualCoding/Frame ⁇ /mp7qf : Field> .
• the fields of the elements are Mpeq7 and VisualCodinq/Frame, respectively.
• the typeID 301 of Mpeg7 is M7DocID
• the typeID 301 of VisualCoding/Frame is VisualCodingFramelD.
• VisualCoding/Frame having the VisualCodingFramelD as the typeID 301 refers to Mpeg7 having M7DocID as a typeID based on the ref 305.
• QFDeclcaration includes two elements, which are DeclaredField and Resource.
• DeclaredField includes ID used for a field to be re-used.
• QFDeclaration defines QueryCondition defined in Mpeg-7 Standard or resources referred to in order to describe a query condition or result data in OutputDescription.
• Table 6 illustrates an element of QFDeclaration defined as QFDeclarationType in accordance with an embodiment of the present invention
• Table 7 defines a field type of the present invention in the QFDeclarationType shown in Table 6.
• QFDeclarationType is a field type of QFDeclaration and it includes DeclaredField as an element
• DeclaredFieldType is a field type of DeclaredField.
• token type is a unit distinguished in a series of text sequence and its range is broader than XPath.
• the query expression unit 101 expresses a user query by using the field types described above.
• the query expression unit 101 can express the user query in an XML format.
• the query analysis unit 103 shown in Fig. 1 parses a query expressed by the query expression unit 101 and analyzes the meaning of the query expressed by the query expression unit 101.
• the query analysis unit 103 analyzes the meaning of the query expressed by the query expression unit 101 and analyzes what fieldType ID 301, typeName 303, ref 305, and field values included in the expressed query stand for.
• the ref 305 referring to the same ID 301 is analyzed to refer to the internal value of the same region. For instance, since [ ⁇ height] and [ ⁇ width] of [FeatureName] element commonly refer to a
• the method of the present invention described above can be realized as a program and stored in a computer-readable recording medium, such as CD-ROM, RAM, ROM, floppy disks, hard disks, magneto-optical disks and the like. Since the process can be easily implemented by those skilled in the art to which the present invention pertains, further description will not be provided herein. While the present invention has been described with respect to the specific embodiments, it will be apparent to those skilled in the art that various changes and modifications may be made without departing from the spirit and scope of the invention as defined in the following claims.
• the technology of the present invention can search MPEG-7 documents by using diverse queries, and make a secondary search over a region designated through a primary search.

Landscapes

• Engineering & Computer Science (AREA)
• Theoretical Computer Science (AREA)
• Physics & Mathematics (AREA)
• Data Mining & Analysis (AREA)
• Databases & Information Systems (AREA)
• General Engineering & Computer Science (AREA)
• General Physics & Mathematics (AREA)
• Multimedia (AREA)
• Mathematical Physics (AREA)
• Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Priority Applications (4)

Applications Claiming Priority (2)

Publications (1)

Family

ID=40341469

Family Applications (1)

Country Status (6)

Families Citing this family (3)

Citations (4)

Family Cites Families (13)

• 2007
  • 2007-12-27 WO PCT/KR2007/006909 patent/WO2009020260A1/en not_active Ceased
  • 2007-12-27 KR KR1020070138848A patent/KR100941971B1/ko not_active Expired - Fee Related
  • 2007-12-27 CN CN200780100908A patent/CN101815997A/zh active Pending
  • 2007-12-27 JP JP2010519846A patent/JP5264905B2/ja not_active Expired - Fee Related
  • 2007-12-27 EP EP07860704A patent/EP2186021A4/en not_active Withdrawn
  • 2007-12-27 US US12/671,909 patent/US8805868B2/en active Active

Patent Citations (4)

Non-Patent Citations (1)

Also Published As

Similar Documents

Legal Events