WO2019164025A1

WO2019164025A1 - Location-based image providing method and device therefor

Info

Publication number: WO2019164025A1
Application number: PCT/KR2018/002126
Authority: WO
Inventors: 박은주; 여두성
Original assignee: 주식회사 알티캐스트
Priority date: 2018-02-21
Filing date: 2018-02-21
Publication date: 2019-08-29
Also published as: KR20190100629A; KR102097199B1

Abstract

A location-based image providing method and a device therefor are disclosed. A location-based image providing method of a server comprises the steps of: receiving an information request from a user terminal, wherein the information request includes location information; extracting at least one previously captured image related to the location information according to the information request; and transmitting the extracted at least one previously captured image to the user terminal.

Description

Location based image providing method and device

The present invention relates to a method and an apparatus for providing a location based image. The present invention is the result of a research project for the development of information and communication broadcasting technology development of the Ministry of Science and ICT, which is a national research and development project.

Recently, due to the rapid development of information and communication, mobile terminals, especially mobile phones such as smart phones, have been transformed into devices that perform multimedia functions beyond simple functions of simply making a phone call. In addition, there is a situation in which an application is developed to perform various functions in a mobile terminal.

In addition, with the development of communication technology, individuals play a role of solving the conventional place and time constraints simultaneously by forming a network on the Internet using Internet technology through a PC. In addition, a service that allows individuals to establish a relationship with others in their own virtual space on the Internet, that is, to provide communication and share various information, has emerged, which is called Social Networking Service (SNS): SNS). The most typical forms of social network services were Cyworld, Naver, Daum, Mini Homepage, Blog, Cafe, etc. Recently, the forms such as Twitter, Me2day, and Facebook are newly evolving.

Due to the activation of social network services, users have a need to share videos with friends or share videos in the same place. There was no.

The present invention is to provide a method and apparatus for providing a location-based image.

In addition, the present invention is to provide a location-based image providing method and apparatus that can provide a combination of images previously photographed by friends in relation to the current location of the user or the location of the image stored in the user terminal.

According to an aspect of the present invention, a location-based image providing method is provided.

According to an embodiment of the present invention, there is provided a location-based image providing method in a server, the method comprising: receiving an information request from a user terminal, the information request including location information; Extracting at least one previously photographed image related to the location information according to the information request; And transmitting the extracted at least one previously photographed image to the user terminal.

The previously photographed image may be an image previously photographed by acquaintances at the same or similar location as the location information.

The location information is a current location of the user terminal or a location of an image photographed by the user terminal.

The server may be a social network service (SNS) server or a device linked with the social network service (SNS) server, and the acquaintance is a friend or follower who has formed a relationship in the social network service (SNS).

Extracting previously photographed positions of the previously photographed image; And generating navigation information using the location information and the previously photographed location and transmitting the navigation information to a user terminal.

According to another embodiment of the present invention, a method for providing a location-based image in a user terminal, the method comprising: transmitting an information request to a server, wherein the information request includes location information; Receiving previously photographed images of acquaintances related to the location information in response to the request for information from the server; And outputting a combination of the previously photographed images.

Acquiring a current location of the user terminal; And outputting photographing direction guide information by using the current location and location information of the previously photographed image.

Combining and outputting the previously photographed image,

The previously photographed image may be combined and output in consideration of at least one of the location information and proximity, time, season, and similarity of the image.

Receiving navigation information up to a location of the previously photographed image; And outputting the navigation information.

According to another aspect of the present invention, an apparatus for providing a location-based image is provided.

According to an embodiment of the present invention, in a server, a communication unit for receiving an information request from a user terminal, the information request including location information; And an information extracting unit extracting at least one previously photographed image related to the location information according to the information request, wherein the extracted at least one previously photographed image is transmitted to the user terminal through the communication unit. A server may be provided.

The apparatus may further include a navigation providing unit configured to extract a previously photographed location of the previously photographed image, generate navigation information using the location information and the previously photographed location, and transmit the navigation information to a user terminal.

By providing a location-based image providing method and apparatus according to an embodiment of the present invention, it is possible to provide a combination of images previously photographed by friends in relation to the current location of the user or the location of the image stored in the user terminal. .

1 is a view schematically showing the configuration of a system for providing a location-based image providing service according to an embodiment of the present invention.

2 is a diagram illustrating a previously taken image according to an embodiment of the present invention.

3 is a diagram illustrating an image captured (or previewed) by a user terminal according to an embodiment of the present invention.

4 is an exemplary view outputting a combined image according to an embodiment of the present invention.

5 is an exemplary view outputting a combined image according to another embodiment of the present invention.

6 is a flowchart illustrating a location-based image providing method according to an embodiment of the present invention.

7 is a flowchart illustrating a location-based image providing method according to another embodiment of the present invention.

8 is an exemplary view of outputting photographing direction guide information according to an embodiment of the present invention.

9 is a block diagram schematically illustrating an internal configuration of a user terminal according to an embodiment of the present invention.

10 is a block diagram schematically showing an internal configuration of a server according to an embodiment of the present invention.

As used herein, the singular forms "a", "an" and "the" include plural forms unless the context clearly indicates otherwise. In this specification, terms such as “consisting of” or “comprising” should not be construed as necessarily including all of the various components or steps described in the specification, and some of the components or some steps It should be construed that it may not be included or may further include additional components or steps. In addition, the terms "... unit", "module", etc. described in the specification mean a unit for processing at least one function or operation, which may be implemented in hardware or software or a combination of hardware and software. .

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a view schematically showing the configuration of a system for providing a location-based image providing service according to an embodiment of the present invention, Figure 2 is a diagram illustrating a previously photographed image according to an embodiment of the present invention; 3 is a diagram illustrating an image photographed (or previewed) by a user terminal according to an embodiment of the present invention, and FIG. 4 is an exemplary view outputting a combination of images according to an embodiment of the present invention. 5 is an exemplary view outputting a combination of images according to another embodiment of the present invention.

Referring to FIG. 1, a system according to an embodiment of the present invention includes a user terminal 110 and a server 120.

The user terminal 110 is a device for interlocking with the server 120 and receiving the image previously photographed by the location-based acquaintances from the server 120 and combining the same.

For example, the user terminal 110 may receive an image previously photographed by an acquaintance from the server 120 at the same or similar position as the current position of the user terminal 110, and output the combined image. Also, the user terminal 110 captures an image at a specific location, stores the location information together with the location information, and then moves to a place to view the stored image. The image captured by the server 120 may be received from the server 120 and output in combination.

For example, it is assumed that a user having the user terminal 110 is located near the “Seoraksan Daeseung Falls”. The user terminal 110 may obtain the current location of the user terminal 110 and transmit it to the server 120. Accordingly, the server 120 captures images previously captured by acquaintances who have formed a relationship on a social network service (SNS, hereinafter referred to as SNS) at the same or similar location as the current location of the user terminal 110 (previously photographed). Image) and then transmit it to the user terminal 110. For example, it is assumed that there is an image photographed in the spring by the first acquaintance who has formed a relationship with the user on the SNS, and an image photographed by the second acquaintance in the summer and autumn exists. The server 120 may extract the images photographed in the spring, summer, and autumn, which are previously photographed images on the SNSs of the first acquaintance and the second acquaintance, and then transmit them to the user terminal 110.

Accordingly, the user terminal 110 may output the previously photographed image by combining the previously photographed image in consideration of at least one of time, season, location proximity, and similarity of the image received from the server 120.

As another example, it is assumed that a user having the user terminal 110 moves to a resort after capturing an image near the “Seoraksan Daeseung Falls”. When the user checks the image near the "Seoraksan Daeseung Falls" stored in the user terminal 110, the user terminal 110 transmits a request for information to the server 120 to be identical to the location information of the image to be viewed. Or, similarly, the acquaintances can receive the previously photographed images and combine them and output them.

The method of outputting a combination of previously photographed images received from the server 120 may vary.

For example, the user terminal 110 may combine and output a previously photographed image over time. In this case, when the image photographed by the user exists, the user terminal 110 places the image photographed by the user in the center and then arranges the previously photographed image around the image photographed by the user over time or in a season. It can also be arranged according to the output.

For another example, the user terminal 110 may output in consideration of the similarity between the image photographed by the user and the previously photographed image. For example, a combination of an image photographed by a user (or a previewed image) and a previously photographed image having high similarity may be output. As another example, the current location of the user terminal 110 or the location of the image photographed by the user terminal 110 and the previously photographed images adjacent in distance may be combined and output.

As such, the method itself for combining and outputting images previously photographed by the user terminal 110 may vary widely.

In addition, the user terminal 110 is a portable electronic device having a communication function and a GPS function, and may be a mobile communication terminal or a tablet PC. Of course, in addition to the electronic device equipped with a communication function and a GPS function can be applied equally. The user terminal 110 may be an electronic device having only a communication function. The same applies to the case where the location information can be obtained from a separate server through the communication function.

The server 120 is a means for extracting images previously photographed by acquaintances and providing them to the user terminal 110 according to an information request of the user terminal 110. Here, the information request may include location information. The location information may be the current location of the user terminal 110 or the location of the image photographed by the user terminal 110 (that is, the location where the image is photographed).

That is, the server 120 extracts a previously photographed image (ie, an image previously photographed by acquaintances) related to the location information included in the information request according to the information request of the user terminal 110 and the user terminal 110. ) Can be sent.

In addition, the server 120 may generate navigation information by using the previously photographed location of the extracted previously photographed image and the location information included in the information request, and then transmit the navigation information to the user terminal 110.

In addition, the server 120 may be a social network service server (SNS) or a server linked with the corresponding social network service server.

A method of combining and outputting the previously photographed image by the user terminal 110 will be briefly described.

2 (a) to 2 (c) are diagrams illustrating an image previously photographed. 3 is a diagram illustrating an image captured by the user terminal 110 or an image previewed by the user terminal 110.

As illustrated in FIG. 4, the user terminal 110 may output a panorama format by combining a previously photographed image and an image photographed by the user terminal 110 over time.

For another example, as shown in FIG. 5, the image may be output in consideration of at least one of season, distance proximity, and image similarity based on the image photographed by the user terminal 110 or the previewed image.

In addition, although not shown in FIGS. 4 and 5, the previously photographed image may be output in a slide manner in consideration of at least one of season, distance proximity, and image similarity.

6 is a flowchart illustrating a location-based image providing method in a user terminal according to an embodiment of the present invention.

In operation 610, the user terminal 110 obtains current location information of the user terminal 110 in real time.

In FIG. 6, the user terminal 110 acquires the current location information only once in the description of the page, but the user terminal 110 may acquire and update the current location information periodically or aperiodically.

For example, the user terminal 110 may obtain current location information on the user terminal 110 in real time through the GPS module provided. Since the method itself of obtaining the current position information of the user terminal 110 through the GPS module is obvious to those skilled in the art, a separate description thereof will be omitted.

In addition, the user terminal 110 may acquire the location after identifying the location through the communication module in addition to the GPS module. In addition, since it is obvious to those skilled in the art, a separate description thereof will be omitted.

In operation 615, the user terminal 110 transmits an information request to the server 120. Here, the information request may include the current location.

In operation 620, the server 120 extracts a previously photographed image from a location that is the same as or similar to the current location of the user terminal 110 according to the information request of the user terminal 110.

For example, the server 120 extracts an image previously photographed by acquaintances at a location that is the same as or similar to the current location of the user terminal 110 at the request of the user terminal 110. Here, acquaintances refer to other users who have formed a relationship with the user on the SNS. In the present specification, "acquaintance" should be interpreted broadly to refer to all other users who form a buddy relationship with a user on SNS or have applied for following.

In operation 625, the server 120 transmits the extracted at least one previously photographed image to the user terminal 110.

In operation 630, the user terminal 110 outputs a combination of previously photographed images received from the server 120.

The user terminal 110 may output the previously photographed image received from the server 120 in consideration of at least one of time lapse, season change, location proximity, and image similarity.

In FIG. 6, a description will be given based on a method of receiving, by the user terminal 110, images previously photographed by acquaintances from the server 120 at the same or similar location as the current location of the user terminal 110, and outputting the combined images. It was.

However, as another example, the user terminal 110 may store the image by mapping the first position to the image after capturing the image at the first position. Subsequently, in a state where the position of the user terminal 110 is changed to the second position, when the user manipulates the user terminal 110 to view an image photographed at the first position, the user terminal 110 is An image previously photographed by acquaintances at the same or similar position as the first position of the captured image may be received from the server 120 and then combined and output.

In operation 710, the user terminal 110 obtains current location information of the user terminal 110 in real time.

In operation 715, the user terminal 110 transmits a navigation information request including the current location to the server 120.

In operation 7820, the server 120 extracts a location previously photographed by the user or acquaintances within a predetermined distance based on the current location according to the navigation information request.

For example, in response to a request for navigation information received from the user terminal 110, the server 120 may determine a location of an image previously photographed by a user or acquaintances within a predetermined distance (radius) based on a current location (a previously photographed location). Is extracted on SNS. For example, it is assumed that the current position of the user terminal 110 is near "Seoraksan Jangsudae Ticket Office." Of course, the current location of the user terminal 110 may be coordinate information including latitude / longitude. For convenience of understanding and explanation, the coordinate information according to latitude / longitude of the current location of the user is described as processed information. However, the current location of the user should be extended and interpreted as coordinate information including latitude / longitude.

The server 120 extracts a location (previously taken location) taken by acquaintances who have formed a relationship with the user on the SNS within a predetermined distance based on the current location. For example, it is assumed that the locations previously photographed by acquaintances are the same as "Longsudae Rest Area", "Thin Waterfall", "Daeseung Falls", and "Big Gambongbong".

The server 120 may generate navigation information using the positions of the previously photographed positions "longevity rest area", "quad waterfall", "daeseung waterfall", and "large gamutbong" as the respective nodes.

The navigation information generated by the server 120 includes a location previously visited and photographed by acquaintances, and may be formed to include a specific place (store).

In operation 725, the server 120 generates navigation information using the extracted previously photographed location.

In operation 730, the server 120 transmits the generated navigation information to the user terminal 110.

In operation 735, the user terminal 110 sequentially moves to the location where the acquaintances were previously photographed according to the navigation information received from the server 120, and captures an image (picture).

In operation 740, the user terminal 110 requests the server 120 for an image previously photographed by an acquaintance at a location (current location) at which the picture is taken.

In operation 745, the server 120 extracts an image previously photographed by friends from the same or similar location as the current location and transmits the image to the user terminal 110. For example, when the user terminal 110 reaches each node (that is, the previously photographed location) as the navigation information moves, the user terminal 110 requests and receives a previously photographed image according to each node location from the server 120. Can be. Accordingly, the server 120 may extract previously photographed images of acquaintances according to each node (ie, current location) and transmit the extracted images to the user terminal 110.

In operation 750, the user terminal 110 generates a panoramic image by displaying the currently photographed image and the previously photographed image received by the server 120 over time to generate a panoramic image.

In FIG. 7, the navigation information is generated based on the assumption of generating navigation information based on the positions of a plurality of previously photographed images. Detailed navigation information may be provided using a previously photographed location of the captured image.

In addition, the user terminal 110 may generate and output the photographing direction guide information using the coordinate information of the position (previously photographed position) of the image previously photographed by the current position and acquaintance of the user terminal 110. 8 illustrates an example in which photographing direction guide information is output. As illustrated in FIG. 8, the photographing direction guide information may be output by overlapping one region of the previewed screen.

Referring to FIG. 9, the user terminal 110 according to an exemplary embodiment of the present invention may include a communication unit 910, a location acquisition unit 915, a camera 920, an image processing unit 925, a navigation unit 930, and a display. It includes a unit 935, a memory 940, and a processor 945.

The communication unit 910 is a means for transmitting and receiving data with other devices through a communication network.

For example, the communication unit 910 transmits an information request to the server 120 under the control of the processor 945, and receives a previously photographed image related to the location information from the server 120 in response to the information request. Can be. Here, the information request may be a current location of the user terminal 110 or a location of an image photographed by the user terminal 110.

The location obtaining unit 915 is a means for obtaining the location of the user terminal 110.

For example, the location acquisition unit 915 may be a GPS module. Of course, the location acquisition unit 915 may obtain a schematic location of the user terminal 110 through the communication unit 910.

The camera 920 is a means for photographing an image. In addition, when storing the captured image, the camera 920 may map and store the position where the image is captured.

The image processor 925 is a means for combining and outputting previously photographed images received from the server 120.

The navigation unit 930 is a means for outputting navigation information based on the current position. In this case, the navigation information may include a path of each previously photographed position within a predetermined distance as a unit node based on the current position. This may be provided by the server 120, as described in FIG. 7.

The display unit 935 is a means for outputting data input or stored through the user terminal 110 in the form of visual information. For example, the display unit 935 may be a liquid crystal display (LCD).

The memory 940 stores instructions, algorithms, various data derived from this process, etc. necessary to perform the method of generating a location-based image according to an embodiment of the present invention.

The processor 945 may include internal components of the user terminal 110 (for example, the communication unit 910, the location acquisition unit 915, the camera 920, and the image processing unit 925). , The navigation unit 930, the display unit 935, the memory 940, and the like.

10 is a block diagram schematically illustrating an internal configuration of a server according to an embodiment of the present invention.

Referring to FIG. 10, the server 120 according to an embodiment of the present invention includes a communication unit 1010, an information extracting unit 1015, a navigation providing unit 1020, a memory 1025, and a processor 1030. It is composed.

The communication unit 1010 is a means for transmitting and receiving data with other devices (for example, the user terminal 110) through a communication network.

For example, the communication unit 1010 may receive an information request including location information from the user terminal 110. In addition, the communication unit 1010 may transmit navigation information including a previously photographed image or a previously photographed location to the user terminal 110 under the control of the processor 1030.

The information extractor 1015 is a means for extracting an image (previously photographed image) previously photographed by an acquaintance at the same or similar location information as the information request of the user terminal 110.

The information extractor 1015 may extract images of acquaintances who have formed a relationship on the SNS with the user at the same or similar location as that of the user terminal 110. To this end, location information may be separately mapped to a tag in each image.

For another example, the information extractor 1015 may extract locations previously photographed by acquaintances within a predetermined distance based on the location information of the user terminal 110.

The navigation provider 1020 is a means for generating navigation information including a path connected by using the previously photographed location extracted by the information extraction unit 1015 as each node. As such, the generated navigation information may be transmitted to the user terminal 110 through the communication unit 1010.

The memory 1025 is a means for storing various instructions, algorithms, various data derived from the process, etc. necessary for operating the server according to an embodiment of the present invention.

The processor 1030 may include internal components of the server 120 (eg, the communication unit 1010, the information extractor 1015, the navigation provider 1020, and the memory 1025). And the like).

The above-described location-based image providing method according to the present invention may be embodied as computer readable codes on a computer readable recording medium. Computer-readable recording media include all kinds of recording media having data stored thereon that can be decrypted by a computer system. For example, there may be a read only memory (ROM), a random access memory (RAM), a magnetic tape, a magnetic disk, a flash memory, an optical data storage device, and the like. The computer readable recording medium can also be distributed over computer systems connected over a computer network, stored and executed as readable code in a distributed fashion.

Claims

In the location-based image providing method in the server,

Receiving an information request from a user terminal, the information request including location information;

Extracting at least one previously photographed image related to the location information according to the information request; And

And transmitting the extracted at least one previously photographed image to the user terminal.
According to claim 1,

And the previously photographed image is an image previously photographed by acquaintances at the same or similar position as the position information.
According to claim 1,

The location information is a current location of the user terminal or location-based image providing method characterized in that the location of the image taken by the user terminal.
The method of claim 2,

The server may be a social network service (SNS) server or a device interworking with the social network service (SNS) server,

And the acquaintance is a friend or a follower who has formed a relationship in the social network service (SNS).
According to claim 1,

Extracting previously photographed positions of the previously photographed image; And

And generating navigation information using the location information and the previously photographed location and transmitting the navigation information to a user terminal.
In the server for performing the location-based image providing method,

A communication unit for receiving an information request from a user terminal, wherein the information request includes location information; And

An information extractor configured to extract at least one previously photographed image related to the location information according to the information request;

The extracted at least one previously photographed image is transmitted to the user terminal through the communication unit.
The method of claim 6,

And the previously photographed image is an image previously photographed by acquaintances at the same or similar location as the location information.
The method of claim 6,

The location information is a server, characterized in that the current location of the user terminal or the location of the image taken by the user terminal.
The method of claim 6,

And a navigation providing unit for extracting each previously photographed position of the previously photographed image, generating navigation information using the position information and the previously photographed position, and transmitting the navigation information to a user terminal.
A location-based image providing method in a user terminal,

Sending an information request to a server, the information request including location information;

Receiving previously photographed images of acquaintances related to the location information in response to the request for information from the server; And

And combining and outputting the previously photographed image.
The method of claim 10,

The location information is a current location of the user terminal or location-based image providing method characterized in that the location of the image previously photographed by the user terminal.
The method of claim 10,

Acquiring a current location of the user terminal; And

And outputting photographing direction guide information by using the current location and location information of the previously photographed image.
The method of claim 10,

Combining and outputting the previously photographed image,

And outputting a combination of the previously photographed images in consideration of at least one of the location information and the proximity, the time, the season, the photographing direction, and the similarity of the images.
The method of claim 10,

Receiving navigation information up to a location of the previously photographed image; And

And outputting the navigation information.
A computer-readable recording medium product having recorded thereon a program code for performing the method according to claim 1.