KR20150087440A - Content providing system and method by using object recognition - Google Patents

Content providing system and method by using object recognition Download PDF

Info

Publication number
KR20150087440A
KR20150087440A KR1020140006514A KR20140006514A KR20150087440A KR 20150087440 A KR20150087440 A KR 20150087440A KR 1020140006514 A KR1020140006514 A KR 1020140006514A KR 20140006514 A KR20140006514 A KR 20140006514A KR 20150087440 A KR20150087440 A KR 20150087440A
Authority
KR
South Korea
Prior art keywords
content
server
mobile terminal
descriptor
load information
Prior art date
Application number
KR1020140006514A
Other languages
Korean (ko)
Other versions
KR101892286B1 (en
Inventor
양승호
한상준
Original Assignee
주식회사 웰시스템 (영업소)
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 주식회사 웰시스템 (영업소) filed Critical 주식회사 웰시스템 (영업소)
Priority to KR1020140006514A priority Critical patent/KR101892286B1/en
Priority to PCT/KR2014/004018 priority patent/WO2015108243A1/en
Publication of KR20150087440A publication Critical patent/KR20150087440A/en
Application granted granted Critical
Publication of KR101892286B1 publication Critical patent/KR101892286B1/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00—Systems or methods specially adapted for specific business sectors, e.g. utilities or tourism
    • G06Q50/10—Services

Landscapes

  • Business, Economics & Management (AREA)
  • Information Transfer Between Computers (AREA)
  • Tourism & Hospitality (AREA)
  • Human Resources & Organizations (AREA)
  • Economics (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Marketing (AREA)
  • Primary Health Care (AREA)
  • Strategic Management (AREA)
  • Physics & Mathematics (AREA)
  • General Business, Economics & Management (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)

Abstract

The present invention relates to a content providing system using object recognition and a method thereof, which can securely recognize an object by dynamically adjusting the size of data transmission and reception in consideration of load of a server and a network. The content providing method comprises: a step where a mobile terminal obtains images and generates multiple descriptors by the size of the images; a step where the mobile terminal requests content provision from a server through the descriptor corresponding to the size of the original image; a step where the server retrieves contents corresponding to the descriptor and then provides the retrieved content to the mobile terminal upon the success of content retrieving, but provides server load information to the mobile terminal upon the failure of content retrieving; and a step where the mobile terminal receiving the content performs content providing operation, but the mobile terminal receiving the server load information transforms the type of descriptor based on the server load information and then requests the content provision again.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention [0001] The present invention relates to a content providing system using object recognition,

The present invention relates to an object recognition technology, and more particularly, to a content providing system using object recognition that monitors a network environment and actively adjusts a load required for data transmission and reception when an object recognition operation is performed on a web- ≪ / RTI >

Object recognition technology is a technology that processes and analyzes images to find out what objects are in the images. In the conventional object recognition technology, an image of an object and characteristics of the object are constructed in a database, and the object is recognized in the currently input image by using the information of the constructed database. However, in this case, .

Recently, a technique has been proposed and widely used to expand a kind of recognizable object by constructing a database related to object recognition on a web that can register and provide infinite information.

However, since the mobile terminal needs to search and acquire necessary information after accessing the server that constructs and operates the database, there is a disadvantage that the speed and performance of the object recognition are greatly influenced by the load of the server and the network. That is, if there are a large number of mobile terminals connected to the server, a large content of the content requested to be provided, or an excessive load on the network, then a smooth content providing operation can not be performed.

Accordingly, the present invention provides a content providing system and method using object recognition, which can stably perform an object recognition operation by actively adjusting a size of data transmission / reception in consideration of load on a server and a network.

The objects of the present invention are not limited to the above-mentioned objects, and other objects not mentioned can be clearly understood by those skilled in the art from the following description.

According to a first aspect of the present invention, there is provided, as a means for solving the above problems, a method for generating a plurality of descriptors for each image size, and requesting content provision based on one of the plurality of descriptors, A mobile terminal that varies the type; And generating and storing a descriptor corresponding to each of the content source and the resized content after resizing the content size in a plurality of steps, and when a descriptor is transmitted from the mobile terminal, the content corresponding to the transmitted descriptor And provides a content providing system using object recognition including a server for acquiring and providing information.

The server retrieves a content corresponding to the transmitted descriptor, and provides content and server load information to the mobile terminal when a content search is successful, and provides only the server load information to the mobile terminal when a content search fails .

When the mobile terminal receives the content and the server load information together from the server, the mobile terminal confirms the server load information and confirms the response time of the server, and then determines whether the response time is shorter than a predetermined threshold And a function of varying the type of the descriptor to be used in the content providing request only when the size of the descriptor is larger than the size of the descriptor.

When the mobile terminal receives the content and the server load information together from the server, the mobile terminal confirms the server load information and confirms the response time of the server. After the server load is small, And a function of varying the content streaming method only when the threshold value is larger than the set threshold value.

In addition, when the mobile terminal receives only the server load information from the server, the mobile terminal further includes a function of re-requesting content provision after varying the type of the descriptor to be used in the content provision request based on the server load information .

As a means for solving the above problems, according to a second aspect of the present invention, there is provided a mobile terminal comprising: a plurality of descriptors for each image size after a mobile terminal acquires an image; Requesting the server to provide the content through the descriptor corresponding to the original size of the image; Providing server load information to the mobile terminal when the server fails to retrieve the content, searching the corresponding content for the descriptor, providing the retrieved content to the mobile terminal when the retrieval of the content is successful; And the mobile terminal, which has received the content, performs a content providing operation, and the mobile terminal, which has received the server load information, changes the descriptor type based on the server load information, And a method of providing contents using object recognition including the object recognition.

Wherein the providing of the server load information to the mobile terminal is performed by mapping the server load information to the content that is successfully retrieved when the content search is successful.

The method may further include varying a descriptor type to be used in a content provision request based on the response time if the response time is greater than a preset value although the server provides the content and the server load is smaller than a predetermined value And further comprising:

If the response time is greater than a predetermined value, the content streaming method to be used when requesting a content based on the response time is variable, even if the server provides the content and the server load is smaller than a predetermined value. The method comprising the steps of:

According to a third aspect of the present invention, there is provided, as a means for solving the above-mentioned problems, a mobile terminal comprising: a plurality of descriptors for each image size; Requesting a server for content provision through a descriptor corresponding to the original size of the image; And changing the type of the descriptor to be used in the content providing request based on the load of the server when the server can not provide the content, and then requesting the content provisioning again.

The method may further include varying a descriptor type or a content streaming method to be used when requesting a content based on the response time if the server provides the content but the response time is greater than a predetermined value .

According to a fourth aspect of the present invention, as a means for solving the above-mentioned problems, there is provided a method for generating and storing a content source and a descriptor corresponding to each resized content after resizing a content size into a plurality of steps ; If the mobile terminal requests content provision through a descriptor, searching for a content corresponding to the descriptor; And providing the server load information to the mobile terminal when the content search is successful, and providing the server load information only to the mobile terminal if content search fails, .

As described above, in the present invention, the object recognition operation can be performed while considering the load of the server and the network, thereby providing the maximum performance system.

1 is a diagram illustrating a contents providing system using object recognition according to an embodiment of the present invention.
2 is a diagram for explaining an image and content resizing method according to an embodiment of the present invention.
3 is a view for explaining a database building method of a contents providing system using object recognition according to an embodiment of the present invention.
4 is a view for explaining an object recognition method of a content providing system using object recognition according to an embodiment of the present invention.
FIG. 5 is a view for explaining an object recognition method of a content providing system using object recognition according to another embodiment of the present invention.

BRIEF DESCRIPTION OF THE DRAWINGS The above and other objects, features and advantages of the present invention will be more apparent from the following detailed description taken in conjunction with the accompanying drawings, in which: FIG. In the following description of the present invention, a detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear.

The following terms are defined in consideration of the functions of the present invention, and these may be changed according to the intention of the user, the operator, or the like.

The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. These embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art to which the present invention pertains. Only. Therefore, the definition should be based on the contents throughout this specification.

1 is a diagram illustrating a contents providing system using object recognition according to an embodiment of the present invention.

1, the content providing system 100 of the present invention may include a content providing server 110, at least one mobile terminal 120, a database 130, and the like.

The object recognition system 100 enables various operations such as image search, moving image playback, product purchase site access, navigation, and the like to be linked based on images recognized by the mobile terminal 120. In addition, the terminal-recognized image may consist of a trademark, a logo, a movie poster, an album jacket, a photograph, and the like, and may allow the user to immediately inform and associate the operation or information.

However, in order to perform the associating operation, the mobile terminal 120 provides the image recognized by the mobile terminal 120 to the server 110, and the server 110 receives the corresponding content, In the case of directly providing an image having a relatively large amount of data to the server 110, since a large load is applied to the server, the descriptor having a relatively small amount of data is exchanged.

The descriptor expresses a feature point unique to the image, which is characterized by enabling efficient description and management of the image. That is, if a descriptor is extracted from an image and converted into a database, various contents can be managed and controlled by a database composed of descriptors.

Accordingly, in the present invention, the server 110 can search for and provide a content corresponding to an image currently recognized by the mobile terminal 120 using a descriptor.

In addition, the present invention allows the mobile terminal 120 to receive various contents corresponding to the image recognized by the server 110 via the descriptor, Or capacity) can be actively varied so that the effects of the server 110 and the network 130 can be minimized.

For this, the mobile terminal 120 of the present invention resizes the size (or capacity) of the image acquired by the mobile terminal 120 in various stages as shown in FIG. 2, and then generates and stores a descriptor corresponding to each content size . Then, the mobile terminal 120 receives the necessary content from the server 110 on the basis of the descriptor corresponding to the image original size, and grasps the loads of the server 110 and the network 130 based on the content provision state .

Then, the server 110 reduces the image size to be used for the content query in proportion to the load of the server 110 and the network 130, and then provides the corresponding descriptor so that the server 110 can also provide the reduced-size content .

Hereinafter, the function of each component will be described in more detail.

The mobile terminal 120 may be implemented by various communication devices that can be carried by a user such as a smart phone or a tablet PC and can perform various operations such as a video / audio communication operation, an image acquisition operation, and an Internet connection operation. The mobile terminal 120 acquires an image necessary for object recognition using a camera built in the mobile terminal 120, and resizes the image in various stages. Then, a descriptor generation algorithm such as Scale Invariant Feature Transform (SIFT), Maximally Stable Extremal Regions (MSER), and Speed Up Robust Feature (SURF) is used to generate a descriptor corresponding to each of the image source and the resized image do.

The server 110 requests and provides the necessary content to the server 110 based on one of the plurality of descriptors. The load of the server 110 and the network 130 is determined based on the content provision state, By varying the type of descriptor to be used, the server 110 also provides reduced-size content.

At this time, the contents provided by the server 110 may include operation information including information on the object recognition operation and additional information necessary for performing the operation. Examples of the operation information may include information for image display, movie reproduction, purchase of goods, and navigation. The additional information may include a URL of a node storing an image corresponding to the above operation information, a URL of a merchandise selling site for purchasing a product, and latitude and longitude information of a map for navigation execution. Of course, at this time, it is a matter of course that each operation information and additional information can be variously expanded by an enterprise customer, a content manager, or a system development operator.

The server 110 stores and manages various contents for supporting the object recognition operation. However, in the present invention, in order to actively vary the content size to be provided to the mobile terminal 120 according to the network environment, the content size is rescaled at various stages at the time of content registration, and then the content source and the re- And generates and stores a descriptor corresponding to each of the contents.

The server 110 of the present invention performs a content search and provision operation on the basis of a descriptor transmitted from the mobile terminal 120 and further provides its load information when providing the content so that the mobile terminal 120 transmits its load So that the user can grasp the current level.

The database 130 stores, in addition to the content source, a plurality of content copies in which content sources are resized in various sizes. At this time, a descriptor having different information is mapped to each of the content source and the plurality of content copies.

3 is a view for explaining a database building method of a contents providing system using object recognition according to an embodiment of the present invention.

First, when the content requested to be registered is generated, the server 110 resizes the size of the content in various stages (S10). In step S10, the resizing step can be adjusted according to the type and size of the content. For example, if the content size is large, the resizing step may be set to three levels, and if not, the resizing step may be set to two levels.

Then, a descriptor corresponding to each of the content source and the resynchronized content is generated, and then the descriptor is mapped to each of the content source and the resynchronized content (S11).

At this time, the descriptor can be automatically generated based on an image or a moving image included in the content, but can be manually input by a content provider or a system administrator when automatic generation of a descriptor is impossible.

In addition, only when the content includes moving images (S12), the streaming method to be used for each network environment can be defined and stored in advance (S13). That is, the codecs used for video streaming include Audio Video Interleaved (AVI), Advanced Streaming Format (ASF), Moving Picture Expert Group (MPEG), MOV, RM, Quality codec capable of supporting a high quality and a small capacity when the load on the server 110 and the network 130 is large.

4 is a view for explaining an object recognition method of a content providing system using object recognition according to an embodiment of the present invention.

First, when the mobile terminal 120 acquires a terminal image using a camera built in itself (S20), the mobile terminal resizes the size of the terminal image to various stages, A plurality of descriptors are generated (S21).

In the present invention, the descriptor corresponding to the original size of the terminal image is a generic descriptor, and the descriptor corresponding to each of the resized images is referred to as an adaptive descriptor.

Then, the mobile terminal 120 transmits a generic descriptor corresponding to the original size of the terminal image to the server 110 to request the server 110 to provide a content corresponding to the terminal image (S22).

Then, the server 110 searches the database 130 based on the general descriptor provided by the mobile terminal 120 to acquire a content corresponding to the general descriptor (S23).

If the content search is successful (S24), the server 110 grasps the current load of the server 110 (i.e., determines how much data is present in the data reception queue), generates load information, (S25).

On the other hand, if the content search is not successful (S24), the server 110 provides only its load information to the mobile terminal 120 (S26).

Then, the mobile terminal 120 receives the content and the server load information together, or fails to receive the content, and receives only the server load information (S27, S30).

The mobile terminal 120 that has successfully received the content confirms the server load information and at the same time checks the response time until the content is provided after the content provision request. If the response time is shorter than the predetermined threshold If it is large, it is determined that a large load is currently applied to the network 130 (S28).

And changes the type of the descriptor to be used in the content providing request so that the content providing request operation can be performed with a minimum load. That is, the mobile terminal 120 selects an adaptive descriptor corresponding to the image downsized from the image source, thereby enabling the next content providing request operation to be performed. At this time, it is preferable that the downscaling ratio of the image original is increased in proportion to the response time (S29).

On the other hand, the mobile terminal 120 that failed in receiving the content checks the current load of the server 110 based on the server load information, determines the downsampling ratio of the image source so as to be proportional to the current load of the server 110, And selects the corresponding adaptive descriptor. Then, the selected adaptive descriptor is retransmitted to the server 110 to request the content providing again (S30, S31).

Then, the server 110 performs the content search operation again based on the adaptive descriptor, transmits the content and the server load information when the content search is successful, and transmits only the server load information when the content search fails (S23 to S26).

That is, according to the present invention, when the content search fails, the content providing request operation can be repeatedly performed while sequentially adjusting the image size. However, the number of repeatable times of the content providing request operation is set so that the content providing request operation is prevented from being infinitely repeated.

Also, in the above embodiment, the type of the descriptor is varied according to the network load, but the streaming method may be adjusted as shown in FIG. 5 in some cases.

The computer-readable recording medium on which the program commands are recorded may be a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, Media storage devices.

The computer-readable recording medium on which the above-described program is recorded may be distributed to a computer apparatus connected via a network so that computer-readable codes can be stored and executed in a distributed manner. In this case, one or more of the plurality of distributed computers may execute some of the functions presented above and send the results of the execution to one or more of the other distributed computers, The computer may also perform some of the functions described above and provide the results to other distributed computers as well.

A computer capable of reading a recording medium on which an application that is a program for driving a content providing system using object recognition according to each embodiment of the present invention is recorded can be used not only in a general PC such as a general desktop or a notebook computer, , A tablet PC, a PDA (Personal Digital Assistants), and a mobile terminal, and it should be interpreted as all devices capable of computing.

While the present invention has been described in connection with what is presently considered to be the most practical and preferred embodiments, it is to be understood that the invention is not limited to the disclosed embodiments. That is, within the scope of the present invention, all of the components may be selectively coupled to one or more of them. In addition, although all of the components may be implemented as one independent hardware, some or all of the components may be selectively combined to perform a part or all of the functions in one or a plurality of hardware. As shown in FIG. The codes and code segments constituting the computer program may be easily deduced by those skilled in the art. Such a computer program can be stored in a computer-readable storage medium, readable and executed by a computer, thereby realizing an embodiment of the present invention. As a storage medium of the computer program, a magnetic recording medium, an optical recording medium, or the like can be included.

It is also to be understood that the terms such as " comprises, "" comprising," or "having ", as used herein, mean that a component can be implanted unless specifically stated to the contrary. But should be construed as including other elements. All terms, including technical and scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs, unless otherwise defined. Commonly used terms, such as predefined terms, should be interpreted to be consistent with the contextual meanings of the related art, and are not to be construed as ideal or overly formal, unless expressly defined to the contrary.

The foregoing description is merely illustrative of the technical idea of the present invention and various changes and modifications may be made by those skilled in the art without departing from the essential characteristics of the present invention. Therefore, the embodiments disclosed in the present invention are intended to illustrate rather than limit the scope of the present invention, and the scope of the technical idea of the present invention is not limited by these embodiments. The scope of protection of the present invention should be construed according to the following claims, and all technical ideas within the scope of equivalents should be construed as falling within the scope of the present invention.

Claims (12)

A mobile terminal for generating a plurality of descriptors for each image size, requesting a content provision based on one of the plurality of descriptors, and varying a descriptor type based on a content provision result; And
A step of generating and storing a descriptor corresponding to each of the content source and the resynchronized content after the content size is rescaled in a plurality of steps and acquiring a content corresponding to the transmitted descriptor when the descriptor is transmitted from the mobile terminal And a server for providing the content. 2. The method of claim 1, wherein the server
Wherein the search server searches the content corresponding to the transmitted descriptor and provides the content and the server load information to the mobile terminal when the content search is successful and provides only the server load information to the mobile terminal when the content search fails. A content providing system using object recognition. 3. The method of claim 2, wherein the mobile terminal
When receiving the content and the server load information together from the server, checking the server load information and checking the response time of the server, if the response time is larger than the predetermined threshold despite the server load being small And a function of varying the type of the descriptor to be used in the content providing request. 3. The method of claim 2, wherein the mobile terminal
When receiving the content and the server load information together from the server, checking the server load information and checking the response time of the server, if the response time is larger than the predetermined threshold despite the server load being small And a function of changing a content streaming method only for a predetermined period of time. 3. The method of claim 2, wherein the mobile terminal
Further comprising a function of re-requesting content provision after varying a type of a descriptor to be used in a content provision request based on the server load information when only server load information is received from the server Content providing system. Generating a plurality of descriptors for each image size after the mobile terminal acquires the images;
Requesting the server to provide the content through the descriptor corresponding to the original size of the image;
Providing server load information to the mobile terminal when the server fails to retrieve the content, searching the corresponding content for the descriptor, providing the retrieved content to the mobile terminal when the retrieval of the content is successful; And
The mobile terminal that has received the content may perform a content providing operation and the mobile terminal having received the server load information may change the type of the descriptor based on the server load information and then request the content provision again A method for providing contents using object recognition. 7. The method of claim 6, wherein providing to the mobile terminal
Wherein when the content search is successful, the server load information is mapped to the content that is searched for and provided. 8. The method of claim 7,
If the response time is greater than a preset value although the server provides the content and the server load is smaller than the predetermined value, changing the descriptor type to be used in the content provision request based on the response time Wherein the object recognition method comprises the steps of: 8. The method of claim 7,
Further comprising the step of varying a content streaming method to be used at the time of the content providing request based on the response time if the response time is greater than a predetermined value although the server provides the content and the server load is smaller than the preset value The object recognition method comprising the steps of: Generating a plurality of descriptors for each image size after the mobile terminal acquires the images;
Requesting a server for content provision through a descriptor corresponding to the original size of the image; And
And changing the type of the descriptor to be used in the content providing request based on the load of the server when the server can not provide the content, and then requesting the content providing again. 11. The method of claim 10,
Further comprising changing a descriptor type or a content streaming method to be used upon requesting a content based on the response time if the server provides the content but the response time is greater than a preset value To provide content. Generating and storing a content source and a descriptor corresponding to each resized content after resizing the content size in a plurality of steps;
If the mobile terminal requests content provision through a descriptor, searching for a content corresponding to the descriptor; And
If the content search is successful, mapping the server load information to the retrieved content and providing the server load information to the mobile terminal; and if the retrieval of the content fails, providing only the server load information to the mobile terminal.
KR1020140006514A 2014-01-20 2014-01-20 Content providing system and method by using object recognition KR101892286B1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
KR1020140006514A KR101892286B1 (en) 2014-01-20 2014-01-20 Content providing system and method by using object recognition
PCT/KR2014/004018 WO2015108243A1 (en) 2014-01-20 2014-05-07 System and method for providing contents using object recognition, and application thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020140006514A KR101892286B1 (en) 2014-01-20 2014-01-20 Content providing system and method by using object recognition

Publications (2)

Publication Number Publication Date
KR20150087440A true KR20150087440A (en) 2015-07-30
KR101892286B1 KR101892286B1 (en) 2018-08-27

Family

ID=53876644

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020140006514A KR101892286B1 (en) 2014-01-20 2014-01-20 Content providing system and method by using object recognition

Country Status (1)

Country Link
KR (1) KR101892286B1 (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20070045982A (en) * 2005-10-28 2007-05-02 캐논 가부시끼가이샤 Image distribution system and client terminal and control method thereof
JP2007279858A (en) * 2006-04-03 2007-10-25 Canon Inc Information terminal, information distribution device, and information distribution system
KR20090091854A (en) * 2008-02-26 2009-08-31 중앙대학교 산학협력단 System and method of content adaptation for mobile web conditions
KR20120044732A (en) * 2010-10-28 2012-05-08 지미디어(주) Method and system for transmitting vector graphics image file

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20070045982A (en) * 2005-10-28 2007-05-02 캐논 가부시끼가이샤 Image distribution system and client terminal and control method thereof
JP2007279858A (en) * 2006-04-03 2007-10-25 Canon Inc Information terminal, information distribution device, and information distribution system
KR20090091854A (en) * 2008-02-26 2009-08-31 중앙대학교 산학협력단 System and method of content adaptation for mobile web conditions
KR20120044732A (en) * 2010-10-28 2012-05-08 지미디어(주) Method and system for transmitting vector graphics image file

Also Published As

Publication number Publication date
KR101892286B1 (en) 2018-08-27

Similar Documents

Publication Publication Date Title
US11017018B2 (en) Systems and methods of building and using an image catalog
JP6249419B2 (en) Image identification and organization according to layout without user intervention
CN1538351B (en) Method and computer for generating visually representative video thumbnails
CN105786969B (en) Information display method and device
KR101952666B1 (en) System and method for presenting a video stream
US20170235828A1 (en) Text Digest Generation For Searching Multiple Video Streams
US10078509B2 (en) Method and system for processing lifelong learning of terminal and apparatus
US20090094197A1 (en) Method and Apparatus for Integrated Cross Platform Multimedia Broadband Search and Selection User Interface Communication
US20150324477A1 (en) Two-Dimensional Code Processing Method and Terminal
US20160078059A1 (en) Mobile device, image reproducing device and server for providing relevant information about image captured by image reproducing device, and method thereof
US20150100582A1 (en) Association of topic labels with digital content
US20170195384A1 (en) Video Playing Method and Electronic Device
US20070143277A1 (en) Content based partial download
US8861865B2 (en) Method and apparatus for searching for image
US20170171334A1 (en) Single-account multiple-preference recommendation method for video website and electronic device
US20170094133A1 (en) System and method for accessing images with a captured query image
WO2023016349A1 (en) Text input method and apparatus, and electronic device and storage medium
US10057606B2 (en) Systems and methods for automated application of business rules using temporal metadata and content fingerprinting
WO2019057191A1 (en) Content retrieval method, terminal and server, electronic device and storage medium
US20100228751A1 (en) Method and system for retrieving ucc image based on region of interest
US20160164984A1 (en) Determining Browsing Activities
US20170060862A1 (en) Method and system for content retrieval based on rate-coverage optimization
US20120182981A1 (en) Terminal and method for synchronization
US9959322B1 (en) Ranking channels in search
US8768999B2 (en) System and method of acquiring contents

Legal Events

Date Code Title Description
A201 Request for examination
E902 Notification of reason for refusal
AMND Amendment
E902 Notification of reason for refusal
AMND Amendment
E601 Decision to refuse application
AMND Amendment
J201 Request for trial against refusal decision
J301 Trial decision

Free format text: TRIAL NUMBER: 2016101003341; TRIAL DECISION FOR APPEAL AGAINST DECISION TO DECLINE REFUSAL REQUESTED 20160603

Effective date: 20180706

S901 Examination by remand of revocation
N231 Notification of change of applicant
GRNO Decision to grant (after opposition)
GRNT Written decision to grant