KR102369324B1 - Smart route creation method and device - Google Patents

Abstract

As a preferred embodiment of the present invention, the method for generating a smart route includes the steps of receiving input of a departure point and a destination; receiving a user request as a search term; and the route display unit displays a smart route that meets the user's request among a plurality of candidate routes from the source to the destination on a map, and displays at least one content that meets the user's request in real time according to the user's location and displaying it in real time by selecting it.

Description

Smart route creation method and device

The present invention relates to a method of providing content reflecting a user's request along a user's search path.

With the rapid spread of Internet, IPTV, SNS, Mobile LTE, etc. and the expansion of video OTT services such as YouTube and Netflix, the distribution and consumption of multimedia video is rapidly increasing. In general, the user watches the video from the beginning to the end in order to check the contents of the video.

However, in recent years, there is a growing demand for users to view only scenes in which desired information is provided within a video. The reality is that it is difficult to find.

A preferred embodiment of the present invention proposes a method in which the user can receive necessary contents on the moving path by providing contents or advertisements meeting the user's request on the user's search path.

As a preferred embodiment of the present invention, the method for generating a smart route includes the steps of receiving input of a departure point and a destination; receiving a user request as a search term; and the route display unit displays a smart route that meets the user's request among a plurality of candidate routes from the source to the destination on a map, and displays at least one content that meets the user's request in real time according to the user's location and displaying it in real time, wherein the search word is in the form of a sentence.

As a preferred embodiment of the present invention, each of the at least one content has time information and location information on a Geographic Information System (GIS), and the time information includes a starting time and an ending time of the content. It is characterized in that it includes. In addition, the content is characterized in that the information value of the content decreases as the extinction time approaches.

As a preferred embodiment of the present invention, the content display unit displays the corresponding content when the conditions for the creation time and the extinction time of the at least one content are not arranged at the input time when the search word is input and are not arranged with the content of the search word. characterized by selection.

In a preferred embodiment of the present invention, the content display unit selects the corresponding content only when the location information of the at least one content is on the smart path.

As a preferred embodiment of the present invention, when the at least one content is a video, the content having the closest location information based on the user's current location is sequentially reproduced in order of the user's current location, and the user's request information is provided in the vicinity of the user's moving path. It is characterized in that it provides the related content in real time. In this case, it is characterized in that only a partial section related to the search word is reproduced in the video.

As a preferred embodiment of the present invention, when the at least one content is a moving picture, metadata is provided in the form of a sentence for each at least one scene constituting the moving picture, and the metadata is based on the metadata. It is characterized in that only the starting point and the ending point of the searched scene are reproduced by searching for a scene having the highest degree of matching with the search term.

As a preferred embodiment of the present invention, the matching degree is determined based on the similarity between the search word and the metadata, and becomes 0 when two sentences are the same, and the value increases as the similarity between the two sentences decreases. It is characterized in that the determination is made using a Levenshtein distance technique.

As a preferred embodiment of the present invention, the at least one content includes at least one of a moving picture, a photo, text, and audio.

As a preferred embodiment of the present invention, it is characterized in that at least one content satisfying the user's request is displayed overlaid on the smart route displayed on the map.

As another preferred embodiment of the present invention, the smart route generating device includes a first input unit for receiving a starting point and a destination; A second input unit for receiving a user's request as a search word; and a route display unit for displaying a smart route that meets the user's request among a plurality of routes from the origin to the destination on a map; and the route display unit and a content display unit that selects at least one content that meets the user's request in real time according to the user's location and displays it on the smart route in real time, wherein the search word is in the form of a sentence. do.

As another preferred embodiment of the present invention, the at least one content includes advertisement information for a product or service related to the smart route.

As a preferred embodiment of the present invention, the method and apparatus for generating a smart route display on the user's movement route the contents of only a specific section in which the user wants to search within the user video within the specific route that the user finds. There is an effect of being able to acquire necessary information along the movement route.

In addition, it enables a curation service that recommends videos or advertisements that users may like based on the user's usual video viewing history and taste.

1 shows an example in which components constituting a moving picture are divided into a scene and a shot as a preferred embodiment of the present invention.
FIG. 2 is a flowchart of a method for retrieving information inside a moving picture as a preferred embodiment of the present invention.
3 is a diagram showing an internal configuration of an apparatus for searching video internal information as a preferred embodiment of the present invention.
4 shows an example of dividing a shot in a moving picture as a preferred embodiment of the present invention.
5 shows an example of assigning a tag set to a shot as a preferred embodiment of the present invention.
6 illustrates an example of grouping a shot into a scene as a preferred embodiment of the present invention.
7 is a flowchart of a method for retrieving information in a moving picture as another preferred embodiment of the present invention.
8 shows an embodiment of searching for information inside a moving picture as a preferred embodiment of the present invention.
9 is another preferred embodiment of the present invention, showing the internal configuration of the smart route generating device.
FIG. 10 shows an implementation example of the content selection unit of FIG. 9 as a preferred embodiment of the present invention.
11 shows an example of generating a smart route as a preferred embodiment of the present invention.
12 is a flowchart for creating a smart route as a preferred embodiment of the present invention.

Best mode for carrying out the invention

As a preferred embodiment of the present invention, the method for generating a smart route includes the steps of receiving input of a departure point and a destination; receiving a user request as a search term; and the route display unit displays a smart route that meets the user's request among a plurality of candidate routes from the source to the destination on a map, and displays at least one content that meets the user's request in real time according to the user's location and displaying it in real time, wherein the search word is in the form of a sentence.

Modes for carrying out the invention

Hereinafter, with reference to the drawings will be described in detail so that those of ordinary skill in the art to which the present invention pertains can easily understand and reproduce.

1 shows an example in which components constituting a moving picture are divided into a scene and a shot as a preferred embodiment of the present invention.

As a preferred embodiment of the present invention, the moving picture 100 is segmented into n shots (n is a natural number) 111, 113, 121, 123, 125, 131, 133. For a method of classifying shots in a video, refer to FIG. 4 .

At least one shot is grouped into units having similar meanings or subjects to compose a scene. Referring to the example of FIG. 1 , the first shot 111 and the second shot 113 are grouped into the first scene 110 , and the third shot 121 , the fourth shot 123 , and the fifth shot are grouped together. 125 may be grouped into the second scene 120 , and the sixth shot 131 and the seventh shot 133 may be grouped into the third scene 130 . In the present invention, a subject may include at least one meaning.

2 is a flowchart of a method for searching video internal information as a preferred embodiment of the present invention.

When there is content to be searched for in a specific video, the user selects a video and inputs a search word through a search word input interface provided when video selection is activated. It is premised on the assumption that a video is indexed in units of scenes by providing metadata in the form of sentences for each scene. As a preferred embodiment of the present invention, when receiving a sentence as a search word from a user, the video internal information search apparatus searches for a specific section that matches the search word or has high relevance in the video, and reproduces only the searched specific section.

As another preferred embodiment of the present invention, when a user inputs a search term related to content to be searched in a specific video, the video internal information search apparatus searches for a scene with the highest degree of matching with the search word in the video (S210). and (S220), only the start point to the end point of the searched scene is played back (S230).

3 shows an internal configuration diagram of an apparatus 300 for searching video internal information as a preferred embodiment of the present invention. 4 to 6 show detailed functions of the video section search unit 320 constituting the apparatus 300 for searching video internal information. 7 is a flowchart showing a search for video inside information. Hereinafter, a method for searching video internal information in a device for searching video internal information will be described with reference to FIGS. 3 to 7 .

As a preferred embodiment of the present invention, the apparatus 300 for searching video internal information may be implemented in a terminal, a computer, a notebook computer, a handheld device, or a wearable device. In addition, the apparatus 300 for searching video internal information may be implemented in the form of a terminal having an input unit for receiving a user's search word, a display for displaying a video, and a processor. In addition, the method of retrieving the video internal information may be implemented by being installed in the form of an application in the terminal.

As a preferred embodiment of the present invention, the apparatus 300 for searching video internal information includes a search word input unit 310 , a video section search unit 320 , and a video section playback unit 330 . The moving picture section search unit 320 includes a shot segmentation unit 340 , a scene generating unit 350 , a metadata generating unit 360 , and a moving picture indexing unit 370 .

The search word input unit 310 receives a search word from the user in the form of a sentence. Users can use all forms of voice search, text search, and image search. An example of an image search is a case where the contents scanned from a book are converted into text and used as a search term. The search word input unit 310 may be implemented as a keyboard, a stylus pen, a microphone, or the like.

The video section search unit 320 searches for a specific section in the video that matches the search word input from the search word input unit 310 or has content related to the search word. As an embodiment, the video section search unit 320 searches for a scene in which a sentence having the highest degree of matching with the input search word sentence is assigned as metadata.

The video section search unit 320 indexes and manages videos so that information can be searched within a single video.

7, the shot segmentation unit 340 segments the video in shot units (S710), assigns a tag set to each segmented shot (S720), and adds a tag set to each shot. A keyword is derived for each shot by applying a topic analysis algorithm (S730). The keyword is derived in the form of identifying and discriminating the content of each of at least one shot constituting the moving picture.

The scene generator 350 determines the similarity between adjacent before and after shots on the timeline of the moving picture. The similarity determination may be performed based on a keyword derived from each shot, an object detected in each shot, a voice feature detected in each shot, and the like. As a preferred embodiment of the present invention, the scene generator 350 may create a scene by grouping shots having a high similarity between adjacent shots based on a keyword ( S740 ). An algorithm for performing grouping may include a hierarchical clustering technique (S750). In this case, a plurality of shots included in one scene may be interpreted as delivering content having similar meaning or subject matter. For an example of grouping shots through hierarchical clustering in the scene generator 350 , refer to FIG. 8 .

The scene generator 350 assigns a scene tag to each created scene (351, 353, 355). The scene tag may be generated based on an image tag assigned to each of at least one shot included in each scene. In the present invention, a scene tag may be generated by a combination of tag sets assigned to each of at least one shot constituting a scene. Also, the scene keyword may be generated as a combination of keywords derived from each of at least one shot constituting the scene. In a preferred embodiment of the present invention, the scene tag may serve as a weight when generating metadata for each scene.

The metadata generator 360 supports a search for content inside a moving picture by analyzing the scenes generated by the scene generator 350, and providing metadata for each scene (S760). Metadata assigned to each scene acts as an index. Metadata is in the form of a summary sentence indicating the contents of each scene.

The metadata may be generated by further referring to a scene tag assigned to each of at least one shot constituting one scene. Scene tags can serve as weights when performing deep learning to generate metadata. For example, weight may be assigned to image tag information and voice tag information extracted from at least one tag set included in the scene tag.

Metadata is generated based on STT (Speech to Text) data of voice data extracted from at least one shot constituting each scene, and a scene tag extracted from each of at least one shot constituting each scene. For example, a summary sentence is generated by performing deep learning machine learning on at least one STT data and at least one scene tag obtained from at least one shot constituting one scene. Metadata is given to each scene by using a summary sentence generated through machine learning for each scene.

The video indexing unit 370 uses metadata assigned to each scene of the video S300 as an index. For example, if the video S300 is classified into three scenes, the video indexing unit 370 uses the first sentence 371 given as metadata to the first scene 351 (0:00 to t1). Used as an index, the second sentence 373 given as metadata to the second scene 353 (t1 to t2) is used as an index, and given as metadata to the third scene 355 (t2 to t3) The third sentence 375 is used as an index.

In the video indexing unit 370, the user's search sentence is a first search sentence (S311), and the first search sentence (S311) is a first of a plurality of metadata (371, 373, 375) allocated to each of a plurality of scenes in one video. When it is determined that the sentence 371 has the highest degree of matching, it is determined that the video section having the highest degree of matching with the search sentence input in the search word input unit 310 is the first scene 351 . In this case, the video section reproducing unit 330 reproduces only the section 0:00 to t1 of the first scene 351 in the video S300.

As a preferred embodiment of the present invention, the video indexing unit 370 uses a Levenshtein distance technique in which the value becomes 0 when two sentences are identical and the value increases as the similarity between the two sentences decreases. can be determined, but is not limited thereto, and various algorithms for determining the similarity between two sentences can be used.

In the video indexing unit 370, the user's search text is the second search text (S313), and the second search text (S313) is the first of a plurality of metadata (371, 373, 375) allocated to each of a plurality of scenes in one video. When it is determined that two sentences are the highest, it is determined that the video section having the highest degree of matching with the search sentence input in the search word input unit 310 is the second scene 353 . In this case, the video section reproducing unit 330 reproduces only the section t1 to t2 of the second scene 353 in the video S300.

Similarly, when the video indexing unit 370 determines that the user's search sentence is the third search sentence (S315) and the third search sentence (S315) has the highest degree of matching with the third sentence, it is input to the search word input unit 310 It is determined that the video section with the highest degree of matching with the search sentence is the third scene 355 . In this case, the video section reproducing unit 330 reproduces only the section t2 to t3 of the third scene 355 in the video S300.

4 shows an example of dividing a shot in a moving picture as a preferred embodiment of the present invention. 4 , the x-axis represents time (sec), and the y-axis represents a representative HSV value.

As a preferred embodiment of the present invention, the shot segmentation unit 340 of the video internal information search device extracts frames from the video S300 at regular intervals as images, and then converts each image into an HSV color space. Then, three time series data composed of representative values (median) of H (hue) (S401), S (saturation) (S403) and v (brightness) (S405) of each image are generated. And, when the inflection points of each of the three time series data of H (hue) (S401), S (saturation) (S403), and v (brightness) (S405) all coincide or are within a certain time period, the corresponding point of the shot Set as a starting point or an ending point. In FIG. 4 , the t=10sec point at which the inflection points of the three time series data coincide are set as the end point of the first shot 410 and the start point of the second shot 420 . In addition, the t=21sec point at which the inflection points of each of the three time series data coincide were set as the end point of the second shot 420 and the start point of the third shot 430 .

5 shows an example of assigning a tag set to a shot as a preferred embodiment of the present invention.

In a preferred embodiment of the present invention, after segmenting a moving picture in units of shots, a tag set is assigned to each shot. FIG. 5 illustrates an example in which the first tag set 550 is applied to the first shot 510 .

In a preferred embodiment of the present invention, the shot 510 is classified into image data 510a and audio data 510b. In the image data 510a, after extracting images per second (520a), an object is detected in each image (530a). Then, an image tag is generated based on the detected object (540a). Image tags apply object annovation or labeling to objects detected in images to construct learning data, then perform object recognition through deep learning related to image recognition, and extract objects for each image. can be created based on

In the voice data 510b, STT conversion 520b is performed, morphemes are extracted (530b), and a voice tag is generated (540b). When both the image tag 540a and the audio tag 540b are generated, a tag set 550 is generated. The tag set refers to a combination of the image tag 540a and the voice tag 540b detected during the time when the first shot 510 is, for example, between 00:00 and 10:00 seconds.

6 illustrates an example of grouping a shot into a scene as a preferred embodiment of the present invention.

After assigning an integrated tag to each shot ( 610 ), a topic analysis algorithm is applied to tag sets assigned to each shot ( 620 ) to derive a keyword for each shot ( 630 ). After that, the scene creation unit determines the similarity between adjacent front and rear shots and groups them into a scene. FIG. 6 illustrates an example of creating a scene through hierarchical clustering 640 after determining the degree of similarity based on the keyword 630 .

8 shows an embodiment of searching for information inside a moving picture as a preferred embodiment of the present invention.

It is assumed that an example of a case in which a user selects a 50-second video 800 for which a content is to be searched.

The embodiment of FIG. 8 shows an example in which the video 800 selected by the user in the shot segmentation unit is segmented into seven shots 801 to 807. The device for searching video internal information generates a tag set by extracting a video tag and an audio tag from each of the seven shots (801 to 807), and then performs topic analysis such as LDA on the tag set for each shot (801 to 807) 807), a keyword is derived.

Referring to the embodiment of FIG. 8 , the first shot 801 is in the section from 0:00 to 0:17, and the first keyword derived from the first shot 801 is (Japan, Corona 19, severe) 801a ) am. The second shot 802 is a section from 0:18 to 0:29, and the second keyword derived from the second shot 802 is (Japan, Corona 19, Spread) 802a. The third shot 803 is a section from 0:30 to 0:34, and the third keyword derived from the third shot 803 is (New York, Corona 19, Europe, Inflow) 803a. The fourth shot 804 is a section from 0:34 to 0:38, and the fourth keyword derived from the fourth shot 804 is (US, Corona 19, death) 804a. The fifth shot 805 is a section from 0:39 to 0:41, and the fifth keyword derived from the fifth shot 805 is (US, Corona 19, confirmed, dead). The sixth shot 806 is a section from 0:42 to 0:45, and the sixth keyword derived from the sixth shot 806 is (US, Corona 19, death) 806a. The seventh shot 807 is a section from 0:46 to 0:50, and the seventh keyword derived from the seventh shot 807 is (US, Corona 19, death) 807a.

The scene generator groups at least one shot based on the similarity. The degree of similarity can be determined based on keywords extracted from each shot, and video tags and voice tags can be further referred to.

8 , the first shot 801 and the second shot 802 are grouped into the first scene 810 , the third shot 803 is grouped with the second scene 820 , and The fourth to seventh shots 804 to 807 are grouped as the third scene 830 .

The first scene 810 is a section from 0:00 to 0:29, and the first keyword derived from the first shot 801 is derived from (Japan, Corona 19, severe) 801a and the second shot 802 . The second keyword used is (Japan, Corona 19, Spread) (802a) to "Japan Corona 19 continues to spread" (810b) referring to the voice data of the first shot (801) and the second shot (802). metadata is provided.

The second scene 820 is a section from 0:30 to 0:34, and the third keywords derived from the third shot 803 are (New York, Corona 19, Europe, Inflow) 803a and the third shot 803. With reference to the voice data of “New York’s Corona 19 is said to be coming from Europe” (820b), metadata is given.

The third scene 830 is a section from 0:35 to 0:50, and is derived from the fourth keyword (mi, corona 19, death) 804a derived from the fourth shot 804 and the fifth shot 805. The fifth keyword (US, Corona 19, confirmed, dead), the sixth keyword (US, Corona 19, dead) 806a derived from the sixth shot 806, and the fourth shot 804 to the sixth shot 806 ) with reference to the voice data of "This is the news of the death of COVID-19 in the United States." (830b) is given.

In a preferred embodiment of the present invention, when the user selects the video 800 and the search word input interface is activated, the user inputs the content to be searched in the form of a sentence. For example, a search term sentence "What is the current state of Corona in the United States?" (840) may be input.

The video indexing unit searches for metadata with the highest degree of matching with the search word sentence 840 by using the metadata given to each scene as an index. The degree of matching is determined based on the similarity between the search word 840 and the metadata 810b, 820b, and 830b, and becomes 0 when two sentences are the same, and the Levinstein distance ( Levenshtein distance) technique can be used.

The video indexer searches for the metadata most similar to the user search query (840) "How is the current state of Corona in the United States?" The finished third scene 830 is played back to the user. When the user inputs the search word 840, only the section of the third scene 830 corresponding to the section 0:35 to 0:50 related to the search word 840 in the video 800 can be searched and viewed.

As another preferred embodiment of the present invention, the video indexing unit may provide the user with metadata assigned to each scene 810 to 830 constituting the video as an index. Users can preview the contents of the video in advance through the video index.

9 is another preferred embodiment of the present invention, showing the internal configuration of the smart route generating device. 11 shows an example in which a smart route is presented by the smart route generating device. It will be described with reference to FIGS. 9 and 11 .

The smart route generating device 900 includes an input unit 910 and a route display unit 920 , and can communicate with an external server 950 via wire or wireless. Examples of the external server 950 include a server 951 equipped with a map database, a server 953 equipped with a content database, a server 955 in which user-specific lifestyles, preferences, etc. are recorded and managed, and an advertisement database. and a server 957, a communication company server, and the like.

An example of the smart route generating device 900 includes terminals such as a mobile phone, a smart phone, a smart watch, a tablet, a notebook computer, and the like. In addition, the smart route generating apparatus 900 may include all types of terminals having a processor that controls implementation so as to display the route input by the user.

The input unit 910 includes a first input unit 912 and a second input unit 914 . The first input unit 912 is an interface for receiving a departure point and a destination from a user, and includes a text input, an audio input, a touch input, and the like. The second input unit 914 is an interface for receiving a user request from a user as a search word, and includes a text input and an audio input. Referring to FIG. 11 , the first input unit 912 may receive a departure point 1120a , a destination 1120b , a first waypoint 1120c , a second waypoint 1120d , and the like.

The second input unit 914 may be implemented to be activated after receiving the source and destination through the first input unit 912 . However, it should be noted that this corresponds to an embodiment of the present invention and can be modified. Referring to FIG. 11 , the second input unit 914 is an interface in the form of a search window 1110 and may receive an audio input 1111 to a text input 1113 . As a preferred embodiment of the present invention, the second input unit 914 receives the user's request in the form of a sentence.

The route display unit 920 includes a smart route display unit 930 and a content display unit 940 .

In a preferred embodiment of the present invention, the smart route refers to routes that meet the user's request received through the second input unit 914 among a plurality of candidate routes from the source to the destination input by the user.

Referring to FIG. 11 , the smart route display unit 930 searches for a user's request "find a place to eat breakfast" 1113 among a plurality of candidate routes from a departure point 1120a to a destination 1120b. Displays the paths with results. Referring to FIG. 11 , the smart route display unit 930 may display a first smart route ( S1100 ), a second smart route ( S1110 ), a third smart route ( S1120 ), and the like.

The content display unit 940 displays at least one content on the smart route in real time according to the user's location. To this end, the content display unit 940 may further include a content selection unit (not shown).

As a preferred embodiment of the present invention, each content shown on the smart route has time information and location information on a Geographic Information System (GIS), and the time information includes a starting time and ending time of the content. time) is included. The content selection unit selects content that meets the user's request on the smart route using time information and location information of each content pre-stored in a preset database. For a description of this, refer to FIG. 10 .

When the user inputs a search term through the second input unit 914 , the content display unit 940 may display all contents matching the user search term on the smart route. In this case, the content includes text, audio, and video, and may include advertisements, SNS, blog posts, and the like.

Thereafter, the content display unit 940 may sequentially reproduce some of the contents displayed on the smart route according to the user's real-time location. In more detail, when at least one content related to at least one smart path is a video, the content display unit 940 sequentially plays the video in order of the content having the closest location information based on the user's current location. The user may be provided with content related to the user's request in real time around the user's moving path.

For example, if the user is located at the departure point S1120a at time t1 and there is a sandwich shop 1101 in the nearest location, the sandwich shop 1101 is played. However, if the user is detected on the first smart route S1100 instead of on the second smart route S1110 where the sandwich shop 1101 is located at time t2, the user's location 1121a detected at time t2 and The contents of the nearest samgyetang restaurant 1102 are played. Thereafter, the contents of the noodle collection 1103 closest to the user's location 1121b detected at time t3 are reproduced.

In a preferred embodiment of the present invention, the video provided by the user may be provided only for a specific section of the video related to the user's search term, not the entire video uploaded to SNS, blog posting, video provided by an advertising company, etc. For a method of extracting and providing only a specific section related to a user's search term from a video, refer to the description related to FIGS. 1 to 8 .

10 shows an implementation example of a content selection unit as a preferred embodiment of the present invention.

The content selection unit extracts all the contents associated with a plurality of candidate paths from the origin to the destination, input from the user through the first input unit ( FIGS. 9 and 910 ) from the server or external server in which the contents are stored in advance, and extracts the contents list (S1010). ).

Thereafter, the first content group is extracted by comparing the creation time and extinction time information of each content in the content list with the user's search word input time ( S1020 ).

For example, the creation time of the content provided by the first store is 11:00 and the extinction time is 3:00, the creation time of the content provided by the second store is 11:30, and the extinction time is 3: 00:00, the creation time of the content provided by the third store is 10:00, the extinction time is 2:30, and the user's search term "Find a place to have breakfast" (FIGS. 11, 1113) input time At 11:05 minutes, only the content provided by the first store and the content provided by the third store are extracted as the first content group.

Next, a second content group matching the meaning of the user's search term is extracted from the first content group (S1030). For example, when the content provided by the first store relates to a haircut and the content provided by the third store relates to food, only the content provided by the third store is extracted into the second content group. Then, the contents in the second content group are reproduced in an order adjacent to the user's location (S1040).

12 is a flowchart for creating a smart route as a preferred embodiment of the present invention.

As a preferred embodiment of the present invention, a method of generating a smart route that proposes a destination to which the user can perform a desired task to the user is as follows. The origin and destination are input from the user (S1210), and thereafter, the user's request is input as a search word (S1220). In this case, the search term has the form of a sentence.

The smart route display unit displays a smart route that meets the user's request among a plurality of candidate routes from the source to the destination on the map (S1230). In addition, at least one content is further displayed on the smart route in real time according to the location of the user through the content display unit at the same time or separately according to the user's selection (S1240).

Methods according to an embodiment of the present invention may be implemented in the form of program instructions that can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, etc. alone or in combination. The program instructions recorded on the medium may be specially designed and configured for the present invention, or may be known and available to those skilled in the art of computer software.

As described above, although the present invention has been described with reference to limited embodiments and drawings, the present invention is not limited to the above embodiments, and various modifications and variations from these descriptions can be made by those skilled in the art to which the present invention pertains. This is possible.

Claims (15)

receiving input of a departure point and a destination;
receiving a user request as a search term; and
Displaying a smart route that meets the user's request among a plurality of candidate routes from the origin to the destination on a map, and further displaying at least one content on the smart route in real time according to the user's location step; including,
The search word is in the form of a sentence, the at least one content includes content related to the search word, and each of the at least one content is
It has time information and location information on a Geographic Information System (GIS), wherein the time information includes a content creation time (starting time) and an ending time (ending time). delete The method of claim 1, wherein the content is
The method of generating a smart route, characterized in that the information value of the content decreases as the extinction time approaches. The method of claim 1, wherein the content display unit
The method for generating a smart route, characterized in that when the generation time and extinction time conditions of the at least one content are not arranged at an input time at which the search word is input and are not arranged with the contents of the search word, the corresponding content is selected. The method of claim 1, wherein the content display unit
The method for generating a smart route, characterized in that the selected content is selected only when the location information of the at least one content is on the smart route. The method of claim 1, wherein when the at least one content is a video
A method for generating a smart route, characterized in that the content related to the user's request is provided in real time around the user's moving route by sequentially playing the content having the closest location information based on the user's current location. 7. The method of claim 6,
A method for creating a smart route, characterized in that only a partial section related to the search term is reproduced in the video. The method of claim 1, wherein when the at least one content is a video
The video is provided with metadata in the form of a sentence for each at least one scene constituting the video,
A method for generating a smart route, characterized in that a scene having the highest degree of matching with the search term is searched for based on the metadata, and only the starting point and the ending point of the searched scene are reproduced. The method of claim 8, wherein the degree of matching is
It is determined based on the similarity between the search word and the metadata, and when two sentences are the same, the value is 0, and the value increases as the similarity between the two sentences decreases using a Levenshtein distance technique. How to create a smart route with The method of claim 1, wherein the at least one content is
A method for creating a smart route comprising at least one of video, photo, text, and audio. The method of claim 1, wherein it is superimposed on the smart route displayed on the map.
The method for generating a smart route, characterized in that displaying at least one content that meets the user's request. a first input unit for receiving a departure point and a destination;
a second input unit for receiving user requests as search terms; and
a route display unit for displaying a smart route that meets the user's request among a plurality of routes from the origin to the destination on a map;
The route display unit includes a content display unit that selects at least one content that meets the user's request in real time according to the user's location and displays it on the smart route in real time, wherein the search word is in the form of a sentence ego,
Each of the at least one content has time information and location information on a Geographic Information System (GIS), and the time information includes a starting time and an ending time of the content. generating device. The method of claim 12, wherein the at least one content is
A smart route generating device, characterized in that it includes advertisement information on goods or services related to the smart route. delete 12. A computer-readable recording medium in which a program for performing the method according to any one of claims 1 to 11 is recorded.

Images