KR100854755B1 - Method and System for Searching The Requested Image Service by Comparing The Objects And Partial Images - Google Patents

Abstract

The present invention relates to a method and system for providing an image retrieval service by comparing an object and a partial image.

A mobile communication terminal, a PDSN that receives and transmits a signal transmitted from a mobile communication terminal when the mobile communication terminal is in motion, and an SMSC which notifies the mobile communication terminal of a result of searching on the Internet through a mobile switching center (MSC). In the system, the mobile communication terminal receives the request through the PDSN and retrieves an image from the Internet network and transmits a search result to the mobile communication terminal through the SMSC, the object comparison search and partial image by the search of the image It provides a system for providing an image search service by comparing the object and the partial image, characterized in that it comprises an object image search server for performing a comparison search.

According to the present invention, by searching for all the object information in the image included in the image format to find the image including the object desired by the user, even if the file name or the image on the Internet that does not properly describe the desired image to search It can be found, and the effect of searching more images more efficiently can be obtained.

 Object Image Search Server, Object Comparison, Partial Image Comparison

Description

Method and System for Searching The Requested Image Service by Comparing The Objects And Partial Images}

1 is a diagram showing a system for providing an image retrieval service by comparing an object and a partial image according to a preferred embodiment of the present invention;

2 is a view showing simply the internal structure of the object image search server according to an embodiment of the present invention,

3 is a flowchart illustrating a method of providing an image search service by comparing an object and a partial image according to an exemplary embodiment of the present invention;

4 is a flowchart specifically illustrating a step image object comparison search process;

5 is a flowchart specifically illustrating a step partial image comparison search process.

<Description of Symbols for Main Parts of Drawings>

100: mobile communication terminal 110: BTS

120: BSC 130: PDSN

140: object image search server 150: SMSC

160: MSC 170: gateway

180: personal computer 210: control unit

220: memory unit 230: display unit

240: key input unit 250: network interface card

260: database server

The present invention relates to a method and system for providing an image retrieval service by comparing an object and a partial image. More specifically, a method for easily searching for an image on the Internet by searching the desired image by comparing object information included in the image format first and secondly comparing partial images, thereby finding an image easily. And to the system.

In general, a mobile communication system has been developed through a first generation analog AMPS (Advanced Mobile Phone System) method and a second generation cellular (Cellular) / Personal Communication Service (PCS) method. With the development, IMT-2000 (International Mobile Telecommunication 2000), a third generation mobile communication system that has been standardized by ITU-R, has been commercialized. IMT-2000 is CDMA 2000 1X, 3X, EV-DO, Wideband CDMA (WCDMA), etc., and is used in IS-95A and IS-95B networks by using the IS-95C network that has evolved from the existing IS-95A and IS-95B networks. It is a service that can provide wireless Internet at a transmission speed of up to 144 Kbps, much faster than the supportable data transfer rate of 14.4 Kbps or 56 Kbps. In particular, by using IMT-2000 service, it is possible to provide various multimedia services (AOD, VOD, etc.) at a faster speed as well as improving existing voice and wireless broadcasting service (WBS) service quality.

In addition, as computers, electronics, and communication technologies have advanced dramatically, various wireless communication services using wireless networks have been provided. The most basic wireless communication service is a wireless voice call service that provides a voice call to a mobile terminal user wirelessly, which can provide a service regardless of time and place. In addition, while supplementing the voice call service by providing a text message service, recently, a wireless Internet service that provides an Internet communication service to a user of a mobile communication terminal through a wireless communication network has emerged.

Therefore, the subscribers of the mobile communication service can freely move and talk with the other party anytime and anywhere by using the wireless communication service, and through the wireless Internet service, various information necessary for life, for example, news, weather, sports, securities, Exchange rates or traffic information may be provided in various forms such as text, voice, or images.

With the expansion of mobile communication services, image providing services such as video and photographs are rapidly developing, and various devices providing the service are being developed and released.

However, the existing image retrieval function on wireless and wired networks could search for the desired image file only by the file name of the image file, a description of the file, and data classified into a separate database. In other words, only images with filenames or descriptions, or limited image files with a separate database service were searched.

In the conventional method, since the image file can be searched only by the formatted and classified data, there is a problem that all the image files on the Internet can be searched to find the desired image.

In order to solve this problem, the present invention primarily compares the object information included in the image format, and secondly compares partial images to search for images desired by the requester, thereby efficiently searching for images on the Internet. Its purpose is to provide a method and system for easy identification.

In order to achieve the above object, according to the first object of the present invention, a mobile communication terminal, a PDSN for receiving and transmitting a signal transmitted from a mobile communication terminal when the mobile communication terminal is in motion, and the MSC search result of the Internet. In a system including an SMSC for notifying the mobile communication terminal through a Mobile Swiching Center, the mobile communication terminal receives a request through the PDSN and retrieves an image from the Internet network to retrieve a search result through the SMSC. The present invention provides a system for providing an image search service by comparing an object and a partial image, wherein the object image search server transmits to the terminal and performs an object comparison search and a partial image comparison search by searching for the image.

According to a second object of the present invention, an object comparison search and a partial image comparison search are performed by receiving an image request from a mobile communication terminal through a PDSN, searching for an image on the Internet network, and transmitting a search result to the mobile communication terminal via SMSC. In the object image search server to perform,

A controller configured to control the components of the object image search server to transmit the wallpaper content downloaded from the wallpaper content provider to the mobile communication terminal;

A memory unit which temporarily stores data processed by the controller or stores a program for performing a function of the object image search server, and stores data necessary for the operation of the object image search server;

A display unit which outputs related information to a panel or a monitor so that an administrator managing the object image search server can check an operation process or an error of the object image search server and a processing status according to key input from a key input unit;

A key input unit used by a manager to manually input data or commands to operate the object image search server;

Implemented as a network server, an object image search server comprising a database server for performing operations such as storing, searching, deleting, editing, and adding a mobile identification number (MIN) and a search image of a mobile communication terminal. To provide.

According to a third object of the present invention, there is provided a method for providing an image retrieval service by comparing an object and a partial image, the method comprising: (a) connecting an object image retrieval server to a mobile communication terminal using wireless data communication; ; (b) searching for an object comparison in the image on an image of the Internet; And (c) performing a partial image comparison search on an image of the Internet.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. First of all, in adding reference numerals to the components of each drawing, it should be noted that the same reference numerals are used as much as possible even if displayed on different drawings. In addition, in describing the present invention, when it is determined that the detailed description of the related well-known configuration or function may obscure the gist of the present invention, the detailed description thereof will be omitted.

In addition, hereinafter, the present invention will be described under the assumption that a code division multiple access (CDMA) 2000 system is used as the mobile communication system. However, the CDMA 2000 system is a system designated for convenience of description and the mobile communication system used in the present invention is not limited thereto.

1 is a diagram illustrating a system for providing an image retrieval service by comparing an object and a partial image according to a preferred embodiment of the present invention.

A system for providing an image retrieval service by comparing an object and a partial image according to a preferred embodiment of the present invention includes a mobile communication terminal 100, a base transceiver station (BTS) 110, and a base station controller 120 BSC. , Packet Data Serving Node (PDSN) 130, Object Image Search Server 140, Short Message Service Center (SMSC) 150, Mobile Swiching Center (MSC) 160, Gateway 170, Personal Computer 180 ).

The mobile communication terminal 100 according to the preferred embodiment of the present invention is not only providing a voice call function for wirelessly connecting to the mobile communication network and performing a normal voice call by wireless communication with another mobile communication terminal or a landline telephone. Mobile communication terminal that can send and receive short messages, multimedia messages, etc. using a message service center.

Here, the mobile communication terminal 100 may be a personal digital assistant (PDA), a cellular phone, a personal communication service (PCS) phone, a hand-held PC, a global system for mobile (GSM) phone, a W-CDMA ( Wideband CDMA (CDMA) phone, CDMA-2000 phone, Mobile Broad and System (MBS) phone and the like, the type can be determined according to the type of mobile communication system constituting the mobile communication network. Here, MBS phone refers to a mobile phone to be used in the fourth generation system currently being discussed.

The mobile communication terminal 100 receives the object image data transmitted by the short message service center and displays the image on the screen of the mobile communication terminal 100.

To this end, the mobile communication terminal 100 creates and edits a short message or a multimedia message as well as a basic configuration as a mobile communication terminal for using a voice communication service and a wireless data service or a wireless Internet service provided by the mobile communication network 110. And a message application capable of performing operations such as modifying, storing and deleting, transmitting and receiving a short message or a multimedia message using a short message service center, and outputting the received message on the screen.

The mobile communication terminal 100 is based on HTML using a wireless application protocol (WAP), which is a wireless Internet access protocol, and an HTTP protocol to access the object image retrieval server 140 using a mobile communication network. It has a browser for Internet connection such as Microsoft Internet Explorer (MIE), Handheld Device Transport Protocol (HDPT), i-Mode of NTT DoKoMo or 'NATE' of SK Telecom.

Each BTS 110 is arranged in units of cells, receives a call request signal from the destination terminal 180 through a traffic channel among signal channels, and receives the received call request signal from the BSC 120. The location registration is performed to determine the location of the mobile communication terminal 100 which is transmitted to or existing in the cell area under its control. In addition, the BTS 110 is a network endpoint device that is directly connected to the mobile communication terminal 100 by performing baseband signal processing, wired / wireless conversion, and wireless signal transmission and reception.

For example, when the mobile communication terminal 100 is a receiving side, the BTS 110 detects the position of the mobile communication terminal 100 existing in its cell area, and then, via the BSC 120 from the MSC 160. The transmitted call request signal is transmitted to the mobile communication terminal 100 existing in the cell area under its control.

The BSC 120 controls the BTS 110, and allocates and releases radio channels for the mobile communication terminal 100, controls the transmission output of the mobile communication terminal 100 and the BTS 110, inter-cell soft handoff and hard hand. It performs off-determination, transcoding and vocoding, GPS clock distribution, and operation and maintenance of the base station. In addition, the BSC 120 transmits subscriber information of the location-registered mobile communication terminal 100 to the MSC 160. The BSC 120 transfers the call request signal transmitted from the mobile communication terminal 100 through the BTS 110 to the MSC 160, and conversely, the BSC 120 transmits the call request signal transferred from the MSC 160 to the BTS. It serves to deliver to the mobile communication terminal 100 through 110.

The PDSN 130 interworks with a DCN (Data Core Network) and an external Internet network and routes packets destined for a mobile node (MN) to a foreign agent (FA) and manages location information data of the mobile node (MN).

Also, when the mobile communication terminal 100 is in motion, the mobile communication terminal 100 receives a signal transmitted from the mobile communication terminal 100 and connects the object image retrieval server 140.

The object image search server 140 receives a request from the mobile communication terminal 100, searches for an image on the Internet, and transmits a search result to the mobile communication terminal 100. That is, the object comparison search is performed first and the partial image comparison search is performed second. Here, the object comparison search is to compare the object information included in the image format instead of the 'string' (e.g. file name, picture description) which is the key of the existing search, and the partial image comparison search is a partial image (eg By searching for the requested image through the mobile communication terminal 100 by comparing the shape of a person, an animal, a mountain, the sea, the sea, etc., the user searches for an image on the Internet and finds the desired image.

The SMSC 150 is a service for transmitting a short message without any additional equipment, and is a call processing device for transmitting weather information, securities information, exchange rate information, etc. to a subscriber or calling and messages between mobile phones. In addition, the terminal has a function of sending or receiving mail through the Internet, PC communication, and the like. The main service functions include 'message transmission service' function that can leave its own number and message, voice message notification service, text information notification service, internet mail and PC communication transmission function, bank and securities account notification service function. Have.

In addition, a short message service (SMS) that performs a function of delivering a short message so that a number, a letter, and the like can be bidirectionally transmitted and received between the mobile communication terminal 100 and various character delivery systems (not shown) using a mobile communication network. It provides a message service (MMS), and provides a multimedia messaging service (MMS) that delivers multimedia messages such as pictures, images, and videos other than simple text or voice messages.

In the present invention, the SMSC 150 notifies the mobile communication terminal 100 of the search result of the object image search server 140 through the MSC 160.

MSC 160 is a wired / wireless hybrid digital switch that provides wired communication (PSTN / ISDN) and mobile communication functions, and includes access switching subsystem (ASS), interconnection network subsystem (INS), and central control subsystem (CCS). It is divided into four sub-systems of LRS (Location Registration Subsystem), and functions to handle basic and additional services, subscriber's incoming, outgoing call processing, location registration procedure and handoff procedure, and interworking with other networks.

The gateway 170 connects the object image search server 140 and the personal computer 180 to interwork with each other.

The personal computer 180 can directly search for the image data retrieved from the object image search server 140 through the gateway, rather than through the Internet. Therefore, the user may be provided with the service that can be provided from the mobile communication terminal 100 through the personal computer 180.

2 is a diagram schematically illustrating an internal structure of an object image search server according to an exemplary embodiment of the present invention.

The object image search server 140 according to an exemplary embodiment of the present invention includes a control unit 210, a memory unit 220, a display unit 230, a key input unit 240, a network interface card 250, and a database server 260. It includes.

The controller 210 controls all components of the object image search server 140 to transmit the image data retrieved from the Internet network to the mobile communication terminal 100. To this end, the control unit 210 includes a computing module such as a microprocessor.

The memory unit 220 temporarily stores data processed by the controller 210 or stores a program for performing a function of the object image search server 140, and stores data necessary for the operation of the object image search server 140. Save it. To this end, the memory unit 220 is a nonvolatile memory for storing a predetermined program and data, and the contents are in EEPROM (Electrically Erasable and Programmable Read Only Memory) or block units that can modify the contents in byte units. It includes a flash memory that can modify the flash memory (SDRAM) to temporarily store the generated data (SDRAM).

The display unit 230 is related to the administrator who manages the object image retrieval server 140 so as to check the operation process or error of the object image retrieval server 140 and the processing status according to key input from the key input unit 240. Information is output to a panel or monitor using a light emitting diode (LED).

The key input unit 240 is used by the administrator to manually input data or commands to manipulate the object image search server 140. The network interface card 250 is a communication module that provides a communication interface for the object image retrieval server 140 to communicate with the mobile communication network and the SMSC 150.

The database server 260 is implemented as a network server, and stores, retrieves, deletes, edits, and adds a mobile identification number (MIN) and a search image of the mobile communication terminal 100.

3 is a flowchart illustrating a method of providing an image search service by comparing an object and a partial image according to an exemplary embodiment of the present invention.

First, the mobile communication terminal 100 accesses the object image search server 140 through wireless data communication (S300).

Herein, wireless data communication refers to communication in which data is moved in a mobile communication network, and a signal generated in the mobile communication terminal 100 is transmitted to the object image retrieval server 140 via the BSN 120 via the BTS 110 and through the PDSN. The image data transmitted by the object image retrieval server 140 searches for the desired image on the Internet and transmits the found image data to the BSC 120 and the BTS via the SMSC 150 and the MSC 160. It is transmitted to the mobile communication terminal 100 through the (110).

The object image search server 140 is connected to the mobile communication terminal 100 to recognize an image requested by the user and perform an object comparison search in the image on the Internet network (S310). The object comparison search in the image refers to the object information (background names such as mountains and seas, names of creatures such as adult men, women, dogs and cats, or names of things such as rockets, buses, and airplanes) in the existing image format. It is called as an object image format.

After the object comparison search in the image is finished, a partial image comparison search is performed in the next step (S320).

Here, the partial image comparison search is a method of searching for a file having the highest match rate through a pattern comparison and color sense on the Internet by setting a partial image as a reference or finding files having a specific match rate or more.

4 is a flowchart specifically illustrating a step image object comparison search process.

In the object comparison search in an image, first, a new image file is formatted and defined (S400). That is, the object image format is generated by including the existing file format and object information. As mentioned above, this refers to object information (background names such as mountains, seas, names of creatures such as adults, men, women, dogs, cats, or things like rockets, buses, and airplanes) in the existing file format, and these names are unique. It is used as a code.).

In the next step, the object image search server 140 converts the object name requested by the user into a unique code and finds an image desired by the user by referring to and comparing the unique code in the internal object information with respect to the image files on the Internet. (S410).

5 is a flowchart specifically illustrating a step partial image comparison search process.

In the partial image comparison search, first, a desired partial image is selected from a list of partial images of the object image search server 140, or an image stored in the user's mobile terminal 100 or an image stored in a personal computer is uploaded to the server. To select a partial image (S500).

Here, the partial image refers to the above-mentioned object information (background names such as mountains and seas, names of creatures such as adult men, women, dogs and cats, or names of things such as rockets, buses, and airplanes, and these names are used as unique codes. Can be

In the next step, the object image search server 140 finds an image that matches the specified partial image by a certain probability by comparing the image of the object comparison search result in the image with the image itself, and then transmits the image to the mobile terminal 100 of the user. Notify by SMS or display on a personal computer (S510).

In this case, notifying by SMS retrieves a large number of images on the Internet through comparison of the images themselves, so it takes a lot of search time, so if the user disconnects from the mobile phone, the result is notified via SMS. You can see the resulting image.

The above description is merely illustrative of the technical idea of the present invention, and those skilled in the art to which the present invention pertains may make various modifications and changes without departing from the essential characteristics of the present invention. Therefore, the embodiments disclosed in the present invention are not intended to limit the technical idea of the present invention but to describe the present invention, and the scope of the technical idea of the present invention is not limited by these embodiments. The scope of protection of the present invention should be interpreted by the following claims, and all technical ideas within the scope equivalent thereto should be construed as being included in the scope of the present invention.

As described above, according to the present invention, by searching all the object information in the image included in the image format to find the image including the object desired by the user, all images on the Internet that do not have a file name or description are also searched As a result, it is possible to find a wider desired image, and to obtain an effect of searching more images more efficiently.

Claims (15)

delete delete delete delete delete delete An object image retrieval server for performing an object comparison search and a partial image comparison search by receiving a request from a mobile communication terminal through a PDSN and retrieving an image from the Internet network and transmitting a search result to a mobile communication terminal via SMSC. A controller configured to control the components of the object image search server to transmit the wallpaper content downloaded from the wallpaper content provider to the mobile communication terminal; A memory unit which temporarily stores data processed by the controller or stores a program for performing a function of the object image search server, and stores data necessary for the operation of the object image search server; A display unit which outputs related information to a panel or a monitor so that an administrator managing the object image search server can check an operation process or an error of the object image search server and a processing status according to key input from a key input unit; A key input unit used by a manager to manually input data or commands to operate the object image search server; Implemented as a network server, a database server that stores, retrieves, deletes, edits, and adds mobile identification numbers (MINs) and search images of mobile communication terminals. Includes, the object image search server An object image retrieval server characterized by finding an image desired by a user by converting an object name requested by a user into a unique code and referring to and comparing a unique code in the internal object information with respect to image files on the Internet. delete In the method for providing an image search service by comparing the object and the partial image, (a) the object image retrieval server is connected to the mobile communication terminal using wireless data communication; (b) searching for an object comparison in the image on an image of the Internet; And (c) searching for partial image comparison on an image of the Internet Including; Step (b) is (b1) defining a new image file format; And (b2) converting the object name requested by the user into a unique code and finding a desired image by referring to and comparing the unique code in the internal object information with respect to image files on the Internet; Method for providing an image search service by comparing the object and the partial image comprising a. delete 10. The method of claim 9, wherein step (c) (c1) selecting a desired partial image from a list of partial images of the object image search server or uploading an image stored in a mobile communication terminal or an image stored in a personal computer to a server to select the partial image; And (c2) The object image search server finds an image that matches the specified partial image by a specific probability by comparing the image of the object comparison search result in the image with the image itself, and notifies the user's mobile terminal to SMS. Displaying on a personal computer Method for providing an image search service by comparing the object and the partial image comprising a. The method of claim 7, wherein the object image search server It is possible to directly retrieve the image data retrieved from the object image search server through a personal computer connected to the gateway, the user can be provided with a service that can be provided from the mobile communication terminal through a personal computer Object Image Search Server. delete The method of claim 7, wherein the unique code is The object image search server, characterized in that the number uniquely assigned to the object information, including the background name, creature name, thing name. The method of claim 7, wherein the object image search server, The object image search server compares the partial image designated by the user with the images of the first search result, finds an image that matches a predetermined probability or more, and notifies the user's mobile terminal by SMS or compares the partial image shown by the personal computer. An object image search server for performing a search.

Images