KR101597017B1 - Multi-language support services using optical character recognition code - Google Patents

Abstract

An embodiment of the present invention relates to a multilingual support method using an optical recognition code, comprising: extracting the optical recognition code from image data of an object including the optical recognition code; Analyzing the optical recognition code to obtain an address of a connection server; Receiving the augmented reality data corresponding to the object by connecting to the connection server; And matching the augmented reality on the photographed image data using the augmented reality data.

Description

[0001] MULTI-LANGUAGE SUPPORT SERVICES [0002] USING OPTICAL CHARACTER RECOGNITION CODE [

The following description relates to a service technique using an optical recognition code, and relates to a service method capable of supporting multiple languages by using an optical recognition code.

The menus of restaurants are in traditional print form, and due to their spatial limitations, there is a limit to the information that can be displayed. In order to solve such a problem, when a two-dimensional barcode is added to a menu plate so that an application of a device capable of recognizing a two-dimensional barcode can be used, a method of obtaining additional information can be used.

Korean Patent Publication No. 2010-0085887 relates to a forest guide system and a guidance method using a squirrel cord. By recognizing a two-dimensional bar code, an image displayed through a camera of a smart phone is displayed on the screen, have. However, the conventional technology does not provide a method of applying a multilingual language in a globalized era, and complicated procedures are required because multilingual applications require not only costly troubles but also translation services through experts.

The multilingual support apparatus according to an embodiment provides a translation service to a foreigner by applying an augmented reality to an imprint by recognizing and attaching an optical recognition code to a printed matter.

The multi-language support method using an optical recognition code according to an exemplary embodiment includes: extracting the optical recognition code from image data of an object including the optical recognition code; Analyzing the optical recognition code to obtain an address of a connection server; Receiving the augmented reality data corresponding to the object by connecting to the connection server; And matching the augmented reality on the photographed image data using the augmented reality data.

The step of receiving the augmented reality data corresponding to the object by connecting to the connection server includes: transmitting information on the target language to the connection server; And receiving augmented reality data corresponding to the object from the connection server and configured in the target language.

According to one aspect of the present invention, the multi-language support method using the optical recognition code may further include the step of outputting the selected data to audio using the TTS when the data configured in the target language is selected from the augmented reality data .

According to another aspect, the optical recognition code includes: the connection server address information; Physical size information of the optical recognition code; And an overall layout size information of an object to which the optical recognition code is attached, and the connection server address information includes a network address of the connection server; A customer code corresponding to a customer associated with the object; And additional information.

According to another aspect of the present invention, a multi-language support method using the optical recognition code may include analyzing the optical recognition code to obtain physical size information of the optical recognition code and total layout size information of the object including the optical recognition code The method comprising the steps of:

According to another aspect, the physical size information of the optical recognition code includes a transverse length of the optical recognition code and a longitudinal length of the optical recognition code, and the total layout size information of the object corresponds to The coordinates of the vertexes of the quadrangle corresponding to the object are set as the reference points and the coordinates of the other vertexes are determined based on the reference point .

According to another aspect of the present invention, the step of matching the augmented reality on the photographed image data using the augmented reality data includes a step of acquiring the physical size information of the optical recognition code, And matching the augmented reality data on the photographed image data using the whole layout size information.

According to another aspect, the augmented reality data includes: the physical size information of the optical recognition code; The total layout size information of the object including the optical recognition code; And at least one main information data, wherein each of the main information data includes reference point data related to a position of the main information data; Layout data related to the layout of the main information data; And additional information data.

According to another aspect of the present invention, the step of matching the augmented reality on the photographed image data using the augmented reality data includes a step of, by using the reference point data of the main information data and the layout data of the main information data, And matching the information data on the photographed image data.

According to another aspect, the object includes a menu plate, wherein the additional information data includes a description in a target language for at least one of a recipe, an intake method, and a material of the food corresponding to the main information data .

According to another aspect of the present invention, the step of matching the augmented reality on the photographed image data using the augmented reality data may include the step of, when the photographed image data includes price information, And converting and displaying the price information based on a currency unit of the country of the target language.

The multi-language support method using an optical recognition code according to an exemplary embodiment includes: maintaining augmented reality data in a DB server; Receiving a customer code and additional information associated with an optical identification code from a personal information device; Retrieving augmented reality data from the DB server using the customer code and the additional code; And transmitting the searched augmented reality data to the personal information device, wherein the augmented reality data may include layout information for matching the augmented reality data to an object including the optical recognition code.

According to one aspect, the augmented reality data includes: physical size information of the optical recognition code; Total layout size information of an object including the optical recognition code; And at least one main information data, wherein each of the main information data includes reference point data related to a position of the main information data; Layout data related to the layout of the main information data; And additional information data.

The multi-language support method using an optical recognition code according to an exemplary embodiment of the present invention includes: extracting the optical recognition code from image data including the optical recognition code; Analyzing the optical recognition code to obtain an address of a connection server; Receiving the augmented reality data corresponding to the object by connecting to the connection server; And a step of overlaying and displaying the translated caption on the caption portion on the image data using the layout information included in the augmented reality data.

The multi-language support apparatus according to an embodiment can provide a translation service through an optical recognition code at no additional cost, and can provide intuitive recognition to users by applying augmented reality technology.

1 is a block diagram of a multi-language support apparatus according to an exemplary embodiment of the present invention.
2 is a diagram illustrating an address configuration of a connection server of a multi-language support apparatus according to an exemplary embodiment.
3 is a view for explaining physical size information of an optical recognition code according to an embodiment.
4 is a diagram for explaining total layout size information of an object to which an optical recognition code is attached according to an embodiment.
5 is a diagram illustrating a configuration of augmented reality data of a connection server according to an exemplary embodiment.
FIG. 6 illustrates an example of applying augmented reality data of a connection server according to an embodiment.
7 is a diagram illustrating an operation of the multi-language support apparatus according to an exemplary embodiment of the present invention.
8 is a flowchart illustrating a multi-language support method of the multi-language support apparatus according to one embodiment.
9 is an example in which an overlay program of the multi-language support apparatus according to an embodiment is applied.

Hereinafter, embodiments will be described in detail with reference to the accompanying drawings.

The optical recognition code is a code for transmitting information in the form of an image, and may include, for example, a one-dimensional bar code, a two-dimensional bar code, a three-dimensional bar code and the like. Hereinafter, the case where the two-dimensional bar code is used in connection with the optical recognition code will be described as an example, but the optical recognition code is not limited thereto.

1 is a block diagram of a multi-language support apparatus according to an exemplary embodiment of the present invention.

The multilingual support device may include a personal information device 110, a connection server 120, and a database server 130.

The personal information device 110 may extract the optical recognition code from the captured image data of the object including the optical recognition code and interpret the extracted optical recognition code to obtain the address of the connection server 120. [ For example, the optical recognition code may be a two-dimensional barcode. In addition, the optical recognition code can be interpreted to obtain the physical size information of the optical recognition code and the whole layout size information of the object including the optical recognition code.

The personal information device 110 may connect to the connection server 120 and receive the augmented reality data corresponding to the object. For example, the personal information device 110 can transmit information on the target language to the connection server 120 and receive the augmented reality data corresponding to the object and configured in the target language from the connection server 120. [ At this time, if data of the augmented reality language is selected from the augmented reality data, the selected data can be output as audio using the TTS.

The personal information device 110 may match the augmented reality on the photographed image data using the augmented reality data received from the connection server 120. [ For example, it is possible to match the augmented reality data on the photographed data by using the physical size information of the optical recognition code and the whole layout size information of the object including the optical recognition code. The main information data can be matched on the photographed image data by using the reference point data of the main information data and the layout data related to the layout of the main information data. If the photographed image data includes price information, the augmented reality data can be converted and displayed based on the currency unit of the country of the target language by applying the exchange rate of the country of the target language.

The database server 130 can maintain the augmented reality data.

The connection server 120 can receive the additional code and the additional information associated with the optical recognition code from the personal information device 110 and can retrieve the augmented reality data from the database server 130 using the customer code and the additional code have. The connection server 120 may transmit the augmented reality data to the personal information device 110. [

2 is a diagram illustrating an address configuration of a connection server of a multi-language support apparatus according to an exemplary embodiment.

The optical recognition code information may include connection server address, optical recognition code physical size information, and total layout size information. The address 200 of the connection server may include a server address 210, a separator 1 220, a customer code 230, a separator 2 240 and additional information 250. At this time, the configuration of the address (200) information of the connection server can use the same structure as the currently used http.

The server address 210 is the network address of the server, for example, it may be an IP address in the form of IPv4, IPv6, or a domain name address. The address (200) of the connection server can use the customer code (230) and the additional information (240) to distinguish the contents to be transmitted. The customer can use the customer code 230 and the additional information 240 to provide a plurality of customers with contextual data (xml) connection service.

Referring to FIG. 2, 203.211.215.32 represents the network address 210 of the server, and the delimiter 220 represents /,? The customer code 230 and the additional information 250 can be distinguished by entering a symbol as shown in FIG.

The customer code 230 is a code number assigned to each customer, and can be represented as 201301004050508888. For example, the customer code 230 may be given a certain criterion, such as a restaurant, a client, or the like.

At page = 04 in the additional information 250, the page of the menu sheet may mean four pages of the whole page or a few pages of the menu board. At lang = en, the language can be set to English. At this time, the additional information 250 may be included in an optical recognition code (for example, a two-dimensional bar code) or may be additionally set through an app. For example, in setting the language, if it is set to English, the language can be set to English in the two-dimensional barcode, and a language (for example, English) to be output by the user through the app can be set.

3 is a view for explaining physical size information of an optical recognition code according to an embodiment.

The optical recognition code information may include a connection server address, optical identification code physical size information, and overall layout size information. A description of connection server address information can be referred to FIG. 2, 4 will be referred to.

The basic unit of the optical recognition code is mm, and it can be composed of the width (W) and the height (H). The physical size information of the optical recognition code can be used as reference information for arranging the data into the augmented reality in the photographed image.

4 is a diagram for explaining total layout size information of an object to which an optical recognition code is attached according to an embodiment.

4A is a diagram illustrating total layout size information included in the optical recognition code according to an exemplary embodiment.

The optical recognition code information may include connection server address, optical recognition code physical size information, and overall layout size information. The entire layout size information can be recognized as a reference point closest to the optical recognition code. At this time, the physical coordinates may be (0, 0).

Referring to FIG. 4A, since the closest point in the optical recognition code may be the reference point 410, the reference point 410 may be designated as (0, 0). At this time, the data storage order can be stored clockwise starting from the reference point 410, and the entire layout size information can be stored in the form of data including integers (Point information) and (x, y) coordinates including reference points . At this time, the basic unit may be mm. Accordingly, the Point information (1) 420, the Point information (2) 430, and the Point information (3) 440 can be stored in the clockwise direction of the reference point 410.

The multi-lingual support apparatus according to an embodiment can correct the photographed image by using the optical recognition code physical size information, the distortion rate (for example, slope) and the stored total layout size information, can do.

4B is a diagram illustrating an example of total layout size information included in the optical recognition code according to an embodiment.

Referring to FIG. 4B, the entire layout size information in FIG. 4A is represented by xml. 4A, the overall layout size information may include a reference point 410, Point information 1 420, Point information 2 430, and Point information 3 440, (x, y), the total layout size information can be represented by four points with the number <4> and the reference point (0, 0) can be represented by <point data> <x> 0 </ x> Point data 1 can be represented by <point data> <x> 200 </ x> <y> 0 </ y>. In this way, Point information 2 and Point information 3 can also be expressed.

5 is a diagram illustrating a configuration of augmented reality data of a connection server according to an exemplary embodiment.

The augmented reality data of the connection server may include optical recognition code physical size information 510, total layout size information 520 and main information data 530. [ The optical recognition code physical size information and the whole layout size information can be used as positional information of data when augmented reality is applied.

As described in FIG. 3, the optical recognition code physical size information 510 may be composed of a width W and a height H as a basic unit of the optical recognition code.

The overall layout size information 520 may be composed of a reference point (0,0), Point information (1), Point information (2), and Point information (3) as described in FIG. A detailed description thereof will be given with reference to FIG.

The main information data 530 may include reference point data, layout data associated with the information data layout, and additional information data. The main information data 530 includes main information data 1, main information data 2, ..., and main information data 3 according to an object (e.g., a signboard, a signboard, , And main information data n. The reference point data may be close to the optical recognition code, and the layout data related to the information data layout may be stored in the clockwise direction of the reference point. The layout data related to the reference point data and the information data layout can be used as the position information of the data when the augmented reality is applied.

Further, the main information data can display additional information using xml. For example, additional information such as a hyperlink, an image, a video link, and the like can be displayed using the xml format. This will be described in detail with reference to FIG.

FIG. 6 illustrates an example of applying augmented reality data of a connection server according to an embodiment.

The main information data may include reference point data 610 related to the position of the main information data, layout data related to the layout of the main information data, and additional information data. For example, the additional information data may include links, price information with applied currency rates, TTS audio output, and the like.

The reference point data 610 may be a point close to the optical recognition code and may be represented by xml such as <Point> <X> 30 </ X> <Y> 30 </ Y> </ Point> .

The outline area 620 is layout data related to the layout of the main information data. Four points can be represented by xml as <NUMBER> 4 </ NUMBER>, and <POINT_DATA> <X> 30 </ X> 30 </ Y> </ POINT_DATA>, <POINT_DATA> <X> 300 </ X> <Y> 80 </ Y> </ / Y> </ POINT_DATA>, <POINT_DATA> <X> 30 </ X> <Y> 80 </ Y> </ POINT_DATA>.

When the data configured in the target language is selected from the augmented reality data, the selected data can be outputted as audio using the TTS 640. [ The link 630 function can be performed by clicking the data configured in the target language. If the photographed image data includes price information, the augmented reality data can be converted and displayed based on the currency unit of the country of the target language by applying the exchange rate of the country of the target language.

Referring to FIG. 6, for example, assuming that the target language is English, it is possible to output Assorted Bossam, which is translated into English, and output an image or connect a moving image by clicking Assorted Bossam. For example, it is possible to describe in at least one of the recipes, recipes and materials of the food corresponding to the main information data in a target language, and with the pictures of all the ingredients, such as boiled pork, cabbage, spicy radish The name of the material can be output. All bosses can be output as audio by using the TTS 640. [ In order to output all bossam as audio, for example, all bossam texts can be output as bossam audio using TTS conversion program. In addition, if the menu includes price information for the food, it is possible to display the Korean price of 20000 won for all bossams and the price of 18.85 dollars converted to US dollars. At this time, the price converted into US dollars can be converted into dollars in accordance with the exchange rate when the Korean won is inputted.

 TEXT> Description </ TEXT> A description of the menu (text information) can be output and can be stored as xml using the layout data related to the layout of the reference point data and main information data. Lt; / RTI >

7 is a diagram illustrating an operation of the multi-language support apparatus according to an exemplary embodiment of the present invention.

7 is a diagram showing an example of setting a target language through an app of a personal information device and recognizing an optical recognition code.

The application can be executed from the personal information device. After running the app, you can set the target language and get the service in the language you set. Also, if the selected language does not exist, it can be provided in the default language. For example, if you set the target language to English, you can get translated services in English. If no language is selected, the current local language can be selected as the service language using GPS. For example, local translation and network translation services can be linked through an ad hoc service by user setting.

After setting the language, the camera shooting mode can be executed. The entire object (e.g., a menu plate) can be photographed by the user, wherein the entire menu plate can include an optical identification code. The app can separate the optical recognition code and the outline information from the photographed image, and can extract the information data by analyzing the optical recognition code. For example, the connection server address, optical recognition code physical size information, and overall layout size information can be extracted.

The personal information device can connect to the connection server using the connection server address from the data extracted from the optical recognition code, and the connection server retrieves the augmented reality data from the database server based on the customer code and the additional information transmitted from the personal information device And the retrieved augmented reality data can be transmitted to the personal information device. By applying the Augmented Reality, a menu translated into English can be provided to the user. For example, a user can intuitively select a menu through a UI of a provided app to provide an order.

8 is a flowchart illustrating a multi-language support method of the multi-language support apparatus according to one embodiment.

The multilingual support device may be configured as a personal information device, a connection server, and a database server. Accordingly, a method of supporting multi-language through a personal information device, a connection server, and a database server will be described.

The personal information device is, for example, a device including a communication function, and can be a smart device capable of recognizing an optical recognition code and photographing. After selecting the app from the personal information device, it can be executed (801). At this time, the target language can be set through the executed application (803), and the service can be received in the selected language through the selected language. Also, in setting the language, it may be set by the user and translated through the default language (804). For example, if you do not set a language, you can use the GPS to select the current local language as the service language.

After running the app, the camera shooting mode can be executed (805). The entire object can be photographed by the user, and the entire object can include an optical recognition code. At this time, it is necessary to reset the language or return to the initial screen without taking a picture for another reason (802). The app can separate the optical recognition code and the outline information from the captured image (806). The app can interpret the optical recognition code to extract the connection server address, the optical recognition code physical size information, and the entire layout size information.

The application can connect to the connection server using the address of the connection server (807). The connection server can search and request the augmented reality data to the database server using the customer code and the additional information included in the connection server address (809). The database server may retrieve the requested augmented reality data (810). At this time, the database server may include optical recognition code physical size information, total layout size information, and main information data. If the augmented reality data requested is present (811), the database server selects the xml data, and if there is no matching actual reality data, the base xml data can be selected.

The xml data selected from the database server may be transmitted to the personal information device (812). For example, the xml data selected from the database server may be transmitted to the connection server (813) and then delivered to the corresponding application of the personal information appliance. The app can use the xml data to correct the captured image. The app can match the xml data to the augmented reality over the corrected image so that the user can use the service in the target language (e. G., Translated menu language into the target language) (814). When the xml data is matched with the photographed image, the optical recognition code physical size information can be used as the reference information. For example, the image can be corrected even if the photographed image is distorted or distorted.

The multi-language support apparatus according to an embodiment can provide a translation service through an optical recognition code at no additional cost, and can provide intuitive recognition to users by applying augmented reality technology.

9 is an example in which an overlay program of the multi-language support apparatus according to an embodiment is applied.

9 shows a multi-language support apparatus in which xml information is overlaid by using an optical recognition code and a layout information of a part requiring translation.

In operating an application (e.g., game) 910, it is possible to support multiple languages by running an overlay application 920 in the app. Extract the optical recognition code 930 from the image data including the optical recognition code 930, and interpret the optical recognition code 930 to obtain the address of the connection server. It is possible to connect to the connection server and receive the augmented reality data corresponding to the object. The translated subtitle can be overlaid on the subtitle portion on the video data using the layout information included in the augmented reality data.

Referring to FIG. 9, for example, if a foreign user wants to play a game in Korean in Russian for playing a game, the game can be played in Russian by applying an overlay program of a multi-language support device.

For example, it can be applied to signboards and signboards. After attaching only the optical recognition code to the existing signboards and signboards, it is possible to provide information to the user as augmented reality by executing the app. Accordingly, the user can intuitively recognize the information, and is commonly managed by the server, so that standardization and accurate expression are possible. In addition, it can be applied to the subway route map, so it can support multilingual without space limitations.

The multi-language support apparatus according to an embodiment can support multi-language by only operating an overlay program without any additional modification to the program, and is easy to modify.

The apparatus described above may be implemented as a hardware component, a software component, and / or a combination of hardware components and software components. For example, the apparatus and components described in the embodiments may be implemented within a computer system, such as, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable array (FPA) A programmable logic unit (PLU), a microprocessor, or any other device capable of executing and responding to instructions. The processing device may execute an operating system (OS) and one or more software applications running on the operating system. The processing device may also access, store, manipulate, process, and generate data in response to execution of the software. For ease of understanding, the processing apparatus may be described as being used singly, but those skilled in the art will recognize that the processing apparatus may have a plurality of processing elements and / As shown in FIG. For example, the processing unit may comprise a plurality of processors or one processor and one controller. Other processing configurations are also possible, such as a parallel processor.

The software may include a computer program, code, instructions, or a combination of one or more of the foregoing, and may be configured to configure the processing device to operate as desired or to process it collectively or collectively Device can be commanded. The software and / or data may be in the form of any type of machine, component, physical device, virtual equipment, computer storage media, or device , Or may be permanently or temporarily embodied in a transmitted signal wave. The software may be distributed over a networked computer system and stored or executed in a distributed manner. The software and data may be stored on one or more computer readable recording media.

The method according to an embodiment may be implemented in the form of a program command that can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, and the like, alone or in combination. The program instructions to be recorded on the medium may be those specially designed and configured for the embodiments or may be available to those skilled in the art of computer software. Examples of computer-readable media include magnetic media such as hard disks, floppy disks and magnetic tape; optical media such as CD-ROMs and DVDs; magnetic media such as floppy disks; Magneto-optical media, and hardware devices specifically configured to store and execute program instructions such as ROM, RAM, flash memory, and the like. Examples of program instructions include machine language code such as those produced by a compiler, as well as high-level language code that can be executed by a computer using an interpreter or the like. The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the embodiments, and vice versa.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments. For example, it is to be understood that the techniques described may be performed in a different order than the described methods, and / or that components of the described systems, structures, devices, circuits, Lt; / RTI &gt; or equivalents, even if it is replaced or replaced.

Therefore, other implementations, other embodiments, and equivalents to the claims are also within the scope of the following claims.

110: Personal information device
120: connection server
130: Database server

Claims (14)

In a multi-language support method using an optical recognition code,
Extracting the optical recognition code from the captured image data of an object including the optical recognition code;
Analyzing the optical recognition code to obtain physical size information of the optical recognition code and total layout size information of the object including the optical recognition code;
Analyzing the optical recognition code to obtain an address of a connection server;
Receiving the augmented reality data corresponding to the object by connecting to the connection server; And
And a step of matching the augmented reality on the photographed image data using the augmented reality data
Lt; / RTI &gt;
Wherein the physical size information of the optical recognition code includes a transverse length of the optical recognition code and a longitudinal length of the optical recognition code,
Wherein the total layout size information of the object includes coordinates of each vertex of the rectangle corresponding to the object,
Wherein the step of matching the augmented reality on the photographed image data using the augmented reality data comprises:
The augmented reality data is corrected by correcting the photographed image data using the physical size information and the distortion rate of the optical recognition code and the entire layout size information of the object including the optical recognition code, To augmented reality
The method comprising the steps of: The method according to claim 1,
Wherein the step of receiving the augmented reality data corresponding to the object connected to the connection server comprises:
Forwarding information about a target language to the connection server; And
Receiving augmented reality data corresponding to the object from the connection server and configured in the target language
The method comprising the steps of: 3. The method of claim 2,
Outputting the selected data as audio using the TTS when data configured in the target language is selected from the augmented reality data;
The method comprising the steps of: The method according to claim 1,
The optical recognition code comprises:
The connection server address information;
Physical size information of the optical recognition code; And
The total layout size information of the object to which the optical recognition code is attached
Lt; / RTI &gt;
The connection server address information may include,
A network address of the connection server;
A customer code corresponding to a customer associated with the object; And
Additional Information
The method comprising the steps of: delete The method according to claim 1,
A coordinate of a point closest to the optical recognition code among the vertexes of the quadrangle corresponding to the object is set as a reference point and the other vertices are set as coordinates with reference to the reference point
Multilingual support method using optical recognition code. delete The method according to claim 1,
Wherein the augmented reality data comprises:
The physical size information of the optical recognition code;
The total layout size information of the object including the optical recognition code; And
At least one main information data
Lt; / RTI &gt;
Wherein each of the main information data includes:
Reference point data related to a position of the main information data;
Layout data related to the layout of the main information data; And
Additional information data
The method comprising the steps of: 9. The method of claim 8,
Wherein the step of matching the augmented reality on the photographed image data using the augmented reality data comprises:
Matching the main information data on the photographed image data using the reference point data of the main information data and the layout data of the main information data
The method comprising the steps of: 9. The method of claim 8,
Wherein the object includes a menu plate,
Wherein the additional information data comprises:
A description in the target language regarding at least one of the food recipe, the intake method and the material corresponding to the main information data
The method comprising the steps of: The method of claim 3,
Wherein the step of matching the augmented reality on the photographed image data using the augmented reality data comprises:
If the photographed image data includes price information, the augmented reality data converts the price information based on the currency unit of the country of the target language by applying the exchange rate of the country of the target language, and displays
The method comprising the steps of: In a multi-language support method using an optical recognition code,
Maintaining augmented reality data on a DB server;
Receiving a customer code and additional information associated with an optical identification code from a personal information device;
Retrieving augmented reality data from the DB server using the customer code and the additional information; And
Transmitting the retrieved augmented reality data to the personal information device
Lt; / RTI &gt;
Wherein the augmented reality data comprises:
Physical size information of the optical recognition code;
Total layout size information of an object including the optical recognition code; And layout information for matching the augmented reality data to an object including the optical recognition code
Lt; / RTI &gt;
Wherein the physical size information of the optical recognition code includes a transverse length of the optical recognition code and a longitudinal length of the optical recognition code,
Wherein the overall layout size information of the object includes the coordinates of each vertex of the rectangle corresponding to the object. 13. The method of claim 12,
Wherein the augmented reality data comprises:
At least one main information data
Lt; / RTI &gt;
Wherein each of the main information data includes:
Reference point data related to a position of the main information data;
Layout data related to the layout of the main information data; And
Additional information data
The method comprising the steps of: In a multi-language support method using an optical recognition code,
Extracting the optical recognition code from the image data including the optical recognition code;
Analyzing the optical recognition code to obtain an address of a connection server;
Receiving augmented reality data corresponding to an object by connecting to the connection server; And
A step of overlaying the translated caption on the caption portion on the image data using the layout information included in the augmented reality data
Lt; / RTI &gt;
Wherein the augmented reality data comprises:
Physical size information of the optical recognition code;
Total layout size information of an object including the optical recognition code; And layout information for matching the augmented reality data to an object including the optical recognition code
Lt; / RTI &gt;
Wherein the physical size information of the optical recognition code includes a transverse length of the optical recognition code and a longitudinal length of the optical recognition code,
Wherein the overall layout size information of the object includes the coordinates of each vertex of the rectangle corresponding to the object.

Images