KR101242142B1 - Method and system for pre-verification of data - Google Patents

Abstract

PURPOSE: A data pre-verification method and a system thereof are provided to approve the input of a product name data according to the validity verification result of the product name data included in a manifest, thereby accurately writing the manifest. CONSTITUTION: An input unit(10) receives import/export container product name data. A data processing unit(20) divides the import/export container product name data at the word level. An attribute extraction unit(30) extracts attribute information corresponding to a word from a reference database(40). A data verification unit determines whether or not the import/export container product name data is distinguished corresponding to a combination and meaning of the words. An approval determination unit determines the input approval and an input limit of the import/export container product name data corresponding to the determination result. [Reference numerals] (10) Input unit; (20) Data processing unit; (30) Attribute extraction unit; (40) Reference database; (50) Reference database updating unit; (60) Data verification unit

Description

Method and system for pre-verification of data

The present invention relates to a method and system for limiting the input of ambiguous data by confirming whether or not the meaning of the data is identified upon data input and pre-validating the data.

Conventional import and export cargo handling procedures include a mixed bill of lading (House B / L) submitted and entered by the carrier (master or airline) and submitted by the forwarder (transport broker). It is automatically collected by the manifest manifest collection system (MFCS) and sent to customs.

In this case, the master bill of lading (Master B / L) and mixed cargo bill of lading (House B / L) refer to the declaration unit of the manifest, and the manifest is a comprehensive list of cargo loaded on all vessels or aircraft entering and leaving the country. it means.

Afterwards, customs shall classify the item into one item number through an international unified goods classification system (WCO) designated by the World Customs Organization (WCO) based on the contents of the manifest sent from the manifest collection system, and proceed with customs clearance by applying the tariff rate. do.

Therefore, if the contents of the manifest are unclear, there is a problem in that a lot of time and manpower is wasted in customs inspection by reconfirming and classifying the manifest and the actual import and export goods.

Conventionally, as a way to alleviate the problem of the inspection burden, if the shipper (owner, owner of import and export cargo), the carrier and the forwarder find an error in the manifest, the manifest is collected before it is sent to customs. Is correcting the manifest.

As another option, if a manifest error on the manifest is confirmed after the manifest is sent to the customs office through the manifest collection system, an application for correction of the manifest and a letter of reason shall be submitted to the customs office for approval and payment of a predetermined penalty fee. By doing so, the manifest is corrected.

This prevents problems in customs inspections due to errors in the manifest, and minimizes waste of manpower and time.

However, if the shipper, carrier and forwarder intentionally enter an incorrect item name on the manifest in order to reduce the tax rate and conceal the contingency cargo, it is difficult to expect such voluntary manifest correction. The burden is not greatly reduced.

On the other hand, in relation to the management technology of the manifest manifest number, Korean Patent Publication No. 953273 proposes an aerial manifest list collection system for detecting the error of the manifest.

1 shows a process of transmitting a conventional import and export cargo list.

According to the Republic of Korea Patent Publication No. 953273, a shipper, a shipping company that detects a description error of the manifest and creates a manifest containing the description error in the process of examining the manifest sent to customs through the manifest collection system; The forwarder will notify you of any errors in the manifest and correct them.

However, according to the Republic of Korea Patent Publication No. 953273, unnecessary personnel and time in the process of detecting errors in the manifest list takes customs inspection, shipper, shipping company and the notification of the error in the manifest list The disadvantage is that the forwarder has to bear a certain cost incurred to correct the manifest.

Therefore, the carrier or forwarder may not be able to find the master bill of lading (Master B / L) and the mixed bill of lading (House B / L) at the stage of preparation or manifest loading system (MFCS). In the step of creating a manifest that collects the mixed bill of lading (House B / L), the item name data of the import and export cargo included in the master bill of lading and the mixed bill of lading (House B / L) is verified. According to the verification result, a technique for selectively transmitting the manifest to customs is required.

The problem to be solved by the embodiments of the present invention is to propose a method for verifying the validity of the item name data included in the manifest in the step before being transmitted to the customs and to determine whether to approve the item name data according to the result.

In order to solve the above problems, the present invention provides an input unit for importing and exporting cargo name data, a data processing unit for dividing the article data into word units, and a morpheme of the item name data extracted from the import and export declaration and manifest declaration report reported for many years. And a reference database which stores part-of-speech information extracted by analyzing a word, semantic information for each part-of-speech, and related information. An attribute extracting unit for extracting attribute information corresponding to the word from the reference database, and a data verification unit for determining whether the item name data can be identified based on the combination and meaning of the words for each part of speech based on the extracted attribute information And an approval determination unit for determining an input approval and an input restriction of the item name data according to the determination result.

The attribute information may be part-of-speech information, semantic information of the word, and related information about a synonym, a standard word, an abbreviation, a standard, and an HS code.

The attribute extractor may further include a reference database updater configured to update the reference database by extracting attribute information of the word from an external database including a web-based open source dictionary when the attribute information of the word cannot be extracted from the reference database. It may include.

The data verification unit may determine that the input item name data is identifiable when the set of words is composed of only one noun for meaning identification.

 The data verification unit may determine that the input item name data is identifiable when the set of words includes at least two nouns capable of meaning identification.

The data verification unit may determine that the input item name data can be identified when the set of words includes one or more nouns and adjectives each capable of identifying a meaning.

The data verification unit may determine that the input item name data is not discernible when the set of words includes nouns and adjectives in which meanings cannot be identified.

In order to solve the above problems, the present invention, the input unit receives the import and export cargo item name data, the data processing step of dividing the input item name data by word unit, the attribute extraction unit attribute information corresponding to the word According to an embodiment, a data pre-verification method including extracting a reference data from a reference database and determining whether to identify an import / export cargo name data consisting of a set of words having the attribute information in the data identification unit is provided.

The attribute information may be part-of-speech information, semantic information of the word, and related information about a synonym, a standard word, an abbreviation, a standard, and an HS code.

The reference database may store part-of-speech information extracted by analyzing the morphemes and words of the item-name data extracted from export and import declarations and manifest declarations reported for many years, and the extracted parts-of-speech information and related information.

In the determining whether the item name data is identified, if the set of words includes only one noun capable of identifying the meaning, the input item name data may be determined as identifiable and the input may be approved.

In the determining whether the item name data is identified, if the set of words includes at least two nouns capable of meaning identification, the input item name data may be determined as identifiable and the input may be approved.

In the determining whether the item name data is identified, if the set of words includes one or more nouns and adjectives each capable of meaning identification, the input item name data may be determined as identifiable and the input may be approved.

In the determining whether the item name data is identified, if the set of words includes nouns and adjectives whose meanings cannot be identified, the input item name data may be determined to be indistinguishable and the input may be restricted.

According to the embodiment of the present invention, the entry list can be accurately generated by approving the entry of the article name data in accordance with the result of the validation of the article name data included in the manifest at the stage before it is transmitted to the customs office, This delay can be prevented. In addition, it is possible to increase the accuracy of tariff rate determination and selection of contingency cargo.

1 shows a process of transmitting a conventional import and export cargo list.
2 is a block diagram of a product name data pre-verification system according to an exemplary embodiment of the present invention.
3 illustrates a configuration of a reference database according to an embodiment of the present invention.
4 illustrates a configuration of a reference database updater according to an embodiment of the present invention.
5 illustrates a configuration of a data identification unit according to an embodiment of the present invention.
6 is a flowchart illustrating a process of pre-verification of item name data according to an embodiment of the present invention.
7 to 8 illustrate various embodiments of the item name data pre-verification screen.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the drawings, parts irrelevant to the description are omitted to clearly describe the present invention, and the same reference numerals are used for the same parts throughout the specification.

Whenever a component is referred to as "including" an element throughout the specification, it is to be understood that the element may include other elements, not the exclusion of any other element, unless the context clearly dictates otherwise. In addition, the terms “… unit”, “module”, etc. described in the specification mean a unit that processes at least one function or operation, which may be implemented by hardware, software, or a combination of software.

Throughout the specification, "article data" means the name of the cargo imported or exported by ship or aircraft, and collectively the name of the cargo written on the manifest and the import and export declaration prepared by the shipper, carrier and forwarder to Customs. do.

2 is a block diagram of a system for preliminary verification of product name data according to an embodiment of the present invention.

2, the product name data pre-verification system includes an input unit 10, a data processing unit 20 for processing the inputted product name data in a minimum unit, and an attribute extraction unit 30 for extracting attributes of the product name data processed in the minimum unit. , The reference database 40 providing attribute information of the item name data, the reference database updater 50 for updating the reference database 40, and a data identification unit 60 for determining whether the inputted data is approved. .

The input unit 10 is a means for receiving product name data in a word and / or sentence form from a shipper, a transport company, and a forwarder, and the product name data is input in English due to the nature of the language used for import and export of cargoes worldwide.

The data processing unit 20 divides the item name data input through the input unit 10 into word units, which are minimum units of sentences.

Afterwards, the remaining words except for words that cannot be meaningfully identified, such as a word composed of numbers only or words including special characters, are transmitted to the attribute extracting unit 30.

At this time, among the words including the special characters, a word including '-' (an asterisk) expressing the connection and separation of each word and a '.' (Period) expressing the end of a sentence is classified as a word capable of identifying meaning. Transfer to attribute extraction unit 30.

The attribute extractor 30 extracts an attribute of a word transmitted from the data processor 20, that is, a part of speech, meaning, and related information of the word, from the reference database 40.

The part-of-speech of the word means a noun, an adjective, an adverb, a verb, and a preposition, and the meaning means a unique meaning of the word, and the related information means a synonym, a standard word, an abbreviation, a standard, and an HS code corresponding to the word. do.

The reference database 40 stores the result of extracting the parts of speech by analyzing the morphemes and words of the item name data extracted from the export and import declaration and the manifest declaration which have been reported for many years, and the meaning and the related information which can be identified by the extracted parts of speech.

It also includes a product name that is commonly used in the trade industry and can be classified into a single item number through the International Uniform Product Classification System (HS), and the thesaurus of the product name related to the trade industry, and by the user of the data pre-verification system. Can be updated.

3 illustrates a configuration of a reference database according to an embodiment of the present invention.

The reference database 40 of FIG. 3 includes a semantic database 41 including semantic-specific meaning information of words related to product name data commonly used in the trade business, and related word information such as synonyms, abbreviations, dialects, and standard words of the product name data. An associated term database 42, an HS code database 43 including corresponding HS code information for each item name data, and other databases including item name data information, brand information, specification of material name data, material information, etc. 44).

For example, if the item name data 'live animal' is input from the input unit 10, the words live and animal are transmitted from the data processing unit 20, and the attribute extractor 30 'live' the parts of speech for each word. -Such as adjectives, verbs, and 'animal-noun'.

From the extracted parts of speech, we extract the words live and animal which have nouns and adjective parts of speech that can be used to identify the meaning of the item name data, and the meanings corresponding to the live and animal are 'live-live, active', 'animal -Extract like animal.

It also extracts related information about animals, called animal.

As described above, the result of extracting the part-of-speech, meaning, and related information of the word is transmitted to the data identification unit 60.

In this case, when there is a large number of semantic information corresponding to live as described above, semantic information having high importance is extracted based on the importance of semantic information stored in the semantic database 41.

The importance is set based on the actual frequency of use, range of use, and accuracy in the trade business with respect to the words transmitted from the data processing unit 20, and even when parts of speech and related information are extracted, the importance is high based on the importance. Extract parts of speech information and related information.

Returning to the description of FIG. 2 again, if the attribute of the word transferred from the data processing unit 20 from the reference database 40 is not extracted, the word is transferred to the reference database update unit 50.

4 illustrates a configuration of a reference database updater according to an embodiment of the present invention.

As shown in FIG. 4, the reference database updater 50 defines an attribute of the word based on an external database 51 and a data searcher 52 that searches for the word from the external database 51 and the search result. It includes a data defining unit 53.

The external database 51 refers to a web-based open source dictionary and API (Application Program Interface), which are freely provided by portal sites and public institutions such as Naver and Google.

The data retrieval unit 52 retrieves the attribute of the word through the external database 51 for the words for which the attribute is not extracted by the attribute extractor 30.

The data definition unit 53 classifies the attribute of the word searched through the data retrieval unit 52 into parts of speech, meaning, and related information of the word and stores it in the reference database 40.

Returning to the description of FIG. 2 again, the attribute extraction result of the attribute extraction unit 30 is transmitted to the data identification unit 60.

5 illustrates a configuration of a data identification unit according to an embodiment of the present invention.

The data identification unit 60 of FIG. 5 stores a data verification unit 61 that verifies the article name data according to a predetermined criterion, an approval determination unit 62 that determines whether the article name data is approved, and a result of storing the approval result. Database 63.

The data verification unit 61 determines whether the inputted item name data can be identified based on the part-of-speech combination and meaning of the word based on the result of attribute extraction of the word transmitted from the attribute extractor 30.

In this case, the criteria are shown in Table 1 below.

Category Verification result Error message Extract two or more nouns normal - Extract one or more nouns and adjectives normal - Extract 1 noun only check Make sure it's broad. Typo (Meaning Identifiable) Extraction error A typo exists. Dialect extraction (meaningly discernible) error Please enter a standard language. Extract only brand error Brand name. Words longer than 31 bytes
Extract (meaningly unidentifiable) error A space is required. Extract only noise (no meaningful discernible) words error
The item name is unclear.
Extract only one adjective error Typo (no meaningful discernment) extraction error

As shown in Table 1, it is determined whether the item name data can be identified according to the part-of-speech combination of the word.

Assuming that two or more words transmitted from the data processing unit 20 include at least two nouns that can identify a meaning, or include at least one adjective and nouns, Judging by.

If a combination of all other parts of speech or the word is determined to be a word that cannot be identified, and a correctable error is found in the described item name data, an error message as shown in Table 1 is output to the user.

The approval determination unit 62 determines whether or not the input article name data is approved according to the verification result of the data verification unit 61 and stores the approval result in the result database 63.

In this case, the item name data having the verification result of 'normal' accepts the input, and the item name data of the 'check' and 'error' is referred to the error message output from the data verification unit 61 so that the user inputs the item name data again. Wait

6 is a flowchart illustrating a process of pre-validating item name data according to an embodiment of the present invention.

First, when product name data composed of English words and / or sentences is input through the input unit 10 (S11), the product name data is divided into word units through the data processing unit 20 (S12).

For example, when product name data such as 'Riding MotorBike 250cc' is input, the product name data is divided into Riding, MotorBike, and 250cc.

Thereafter, the attribute extractor 30 extracts the attribute of the divided word through the reference database 40 (S13), and the attribute extraction results of the Riding, MotorBike, and 250cc are shown in Table 2 below.

word property
Riding
Parts of speech Nouns meaning Horse Riding, Riding, Riding Related information -
Motorbike
Parts of speech noun meaning motorcycle Related information Synonyms: motorcycle
250 cc
Parts of speech noun meaning - Related information Unit (cc): displacement

The attribute extraction result of Table 2 is transmitted to the data verification unit 61, and the 'highest' of significance is extracted from the meaning information of the Riding word having a plurality of extraction results and transferred to the data verification unit 61.

In this case, if the attribute of the word cannot be extracted through the reference database 40, the external database 51 is searched (S14), and the attribute information of the word retrieved from the external database 51 is transmitted to the data verification unit 61. On the other hand, it is stored in the reference database 40 (S15).

At this time, the external database 51 includes a web-based open source dictionary and API (Application program interface) provided by portal sites such as Naver and Google and public institutions free of charge. Perform a search by sending a query and analyzing the returned results.

Next, based on the attribute extraction result, the data verification unit 61 determines whether the item name data can be identified based on the parts of speech combination, meaning, and related information of the words.

It is determined whether the word transmitted through the attribute extraction unit 30 is composed of one noun that can identify meanings (S16), and when the word is composed of one noun that can identify meanings, the item name data input from the input unit 10 is determined. Is determined to be normal (S19).

For example, when the item name data input through the input unit 10 is one word 'Animal', 'Animal' is a broad term that refers to everything except animals and plants and humans with four feet, and an error message is output.

However, if the item name data input through the input unit 10 is composed of one word capable of meaning identification that can be classified as an HS code such as 'Avalon', the item name data is determined to be normal.

If the set of words transmitted through the attribute extraction unit 30 does not consist of one noun that can identify meanings, it is determined whether the following two conditions are satisfied (S17), and if the at least one condition is satisfied, the entered item name data Is determined to be normal (S19).

Condition 1. Does the name contain at least two identifiable nouns?

Condition 2. Does it include one identifiable noun and one or more adjectives?

If the set of words transmitted through the attribute extractor 30 does not satisfy at least one of the above conditions 1 and 2, an error message is generated according to the parts of speech combination, meaning, and related information according to Table 1 above. Output (S18) and store the result in the result database.

For example, in the case of the item name data 'Riding MotorBike 250cc' divided as shown in Table 2, the item name data is input because it includes at least one noun (MotorBike-motorcycle) and an adjective (Riding-use) that can identify meanings. Is determined to be normal.

If the input item name data is 'Riding Vehicle', the item name data includes one adjective (Riding-useable) that can identify meaning, but the noun vehicle at the rear is a general term for a rideable vehicle. The relevant information is extracted and an error message is output.

7 to 8 illustrate various embodiments of the item name data pre-verification screen.

The article name data pre-verification screen of FIGS. 7 to 8 will be described with reference to Table 1. FIG.

As shown in FIG. 7, when item name data such as 'DW' is inputted, as a result of extracting an attribute for 'DW', relevant information such as 'abbreviation of a mobilization, brand' corresponding to 'DW' is extracted and the item name data cannot be identified. An error message that is determined and notifies the result of the determination is output.

Thereafter, the user waits for the user to re-enter the product name data, or lists the relevant information related to the brand name 'DW (mobilization)' stored in the reference database as shown in FIG. It can be induced to choose.

The data pre-validation may be performed by the carrier and the forwarder to create a master bill of lading (Master B / L) and a mixed bill of lading (House B / L) or the group bill of lading (Master B / L) in the manifest collection system. And a mixed bill of lading (House B / L) may be performed to generate a manifest and transmitting the manifest to customs.

In addition, although the embodiments of the present invention have been described in detail above, the scope of the present invention is not limited thereto, and various modifications and improvements of those skilled in the art using the basic concepts of the present invention defined in the following claims are also provided. The implementation of the method proposed in the present invention by software in particular belongs to the scope of the present invention.

10: input unit 20: data processing unit 30: data analysis unit
40: Reference Database 41: Meaning Database
42: relational database 43: HS code database
44: other database 50: reference database update unit
51: external database 52: data search unit
53: data definition unit 60: data identification unit
61: data verification unit 62: approval determination unit
63: results database

Claims (14)

An input unit for inputting import and export cargo name data;
A data processing unit for dividing the article name data into word units;
A reference database for storing the parts-of-speech information extracted by analyzing the morphemes and words of the item-name data extracted from the export and import declaration and the manifest report which have been reported for many years, and the extracted parts-of-speech information and related information;
An attribute extraction unit for extracting attribute information corresponding to the word from the reference database;
A data verification unit determining whether the item name data can be identified based on the combination and meaning of the words for each part of speech based on the extracted attribute information; And
Approval determination unit for determining the approval of the input of the article name data and the input restriction in accordance with the determination result
Data pre-validation system comprising a. The method of claim 1, wherein the attribute information,
And at least one or more of parts-of-speech information, meaning information, and information on synonyms, standard words, abbreviations, standards, and HS codes corresponding to the words. The method of claim 1, wherein the attribute extraction unit,
The apparatus may further include a reference database updater configured to update the reference database by extracting the attribute information of the word from an external database including a web-based open source dictionary when the attribute information of the word cannot be extracted from the reference database. Data pre-validation system. The method of claim 1, wherein the data verification unit,
And if the set of words comprises only one noun capable of identifying the meaning, the input article name data is determined to be identifiable. The method of claim 1, wherein the data verification unit,
And if the set of words includes at least two nouns that can identify meanings, determine the input item name data as identifiable. The method of claim 1, wherein the data verification unit,
And if the set of words includes at least one noun and an adjective each capable of identifying a meaning, the input item name data is determined to be identifiable. The method of claim 1, wherein the data verification unit,
And if the set of words includes nouns and adjectives whose meaning cannot be identified, determining the input item name data as unidentifiable. Receiving an input / export cargo item name data by an input unit;
Dividing the inputted article name data into word units by a data processing unit;
Extracting, by an attribute extractor, attribute information corresponding to the word from a reference database; And
Determining whether the data identification unit identifies the import / export cargo name data consisting of the set of words having the attribute information;
Data pre-validation method comprising a. The method of claim 8, wherein the attribute information,
And at least one or more of parts-of-speech information, meaning information, and information on synonyms, standard words, abbreviations, standards, and HS codes corresponding to the words. The method of claim 8, wherein the reference database,
And a part-of-speech information extracted by analyzing the morphemes and words of the item-name data extracted from the export and import declaration and the manifest declaration report reported for many years, and storing the extracted parts-of-speech information and related information. The method of claim 8, wherein the determining whether the item name data identification,
And if the set of words comprises only one noun capable of identifying the meaning, the input article name data is determined to be identifiable and the input is approved. The method of claim 8, wherein the determining whether the item name data identification,
And if the set of words includes at least two nouns capable of meaning identification, determine the input item name data as identifiable and approve the input. The method of claim 8, wherein the determining whether the item name data identification,
And if the set of words includes one or more nouns and adjectives each capable of identifying a meaning, the input item name data is determined to be identifiable and the input is approved. The method of claim 8, wherein the determining whether the item name data identification,
And if the set of words includes nouns and adjectives whose meanings cannot be identified, determining the input item name data as unidentifiable to limit the input.

Images