WO2015147437A1 - Mobile service system, and method and device for generating location-based album in same system - Google Patents

Abstract

The present invention relates to a mobile service system, and a method and a device for generating a location-based album in the system. The present invention can form groups by classifying pictures or videos according to predetermined album generation criteria, determine a location for each of the formed groups and then select one or more representative pictures or videos at the determined location, and automatically generate an album using the selected representative pictures or videos, thereby automatically generating a location-based album without a separate operation of a user. Therefore, the present invention enables a user to simply and conveniently identify pictures of locations identified according to time through the generated album, and can provide an album which a user can more conveniently use.

Description

Mobile service system, method and device for creating location based album in the system

The present invention relates to a mobile service, and in particular, a mobile service system for automatically generating and providing an album based on a location to a user by dividing pictures or videos taken by a user by time or location, and location-based in the system. An album generating method and apparatus are provided.

Recently, thanks to the remarkable development of information and communication technology and semiconductor technology, the spread and use of portable terminals is increasing rapidly. In particular, recent portable terminals have reached the stage of mobile convergence that encompasses the range of other terminals instead of staying in their own traditional areas.

Typically, a mobile terminal has a TV viewing function (e.g., a mobile broadcasting such as Digital Multimedia Broadcasting (DMB) or Digital Video Broadcasting (DVB)), a music playback function (e.g., an MP3) MPEG Audio Layer-3), picture taking function, and internet access function are being added.

In addition, recent mobile communication terminals have developed various types of user functions based on an open OS, and provide various conveniences and entertainments as users can install them arbitrarily. The application can be easily obtained, and the high performance can handle many functions processed by the PC.

In addition, the mobile communication terminal provides a variety of services by using the pictures or videos taken from simply taking a picture or video through a picture taking function or the like. One of them is a service that provides a photo or video taken by making an album.

However, the existing mobile album production is inconvenient that the user must select the desired photo by searching for the photo to be included in the album.

The present invention has been proposed in order to solve the conventional inconvenience, forming a group by dividing the photographed pictures or videos according to a predetermined album generation criteria, and selected from the determined position by determining the position for each formed group The present invention provides a mobile service system for automatically generating an album using the representative photo or video, a method and an apparatus for generating a location-based album in the system.

A service device according to an embodiment of the present invention for achieving the above object, the communication unit for performing a communication for generating a location-based album in conjunction with one or more terminal devices through a communication network; And functionally connected with the communication unit to receive and store a photographed picture or a video taken from the terminal device, form a group by dividing the photographed picture or video according to a preset album generation criterion, and position each formed group. May include a service providing unit for selecting one or more representative pictures or videos at the determined location and automatically generating an album using the selected representative pictures or videos.

In the service apparatus according to the preferred embodiment of the present invention, the control unit analyzes the background image of the photographed picture or video included in each group, and the previously stored picture or video including an image similar to the analyzed background image The location information may be estimated by comparing the searched one or more pictures or videos, and the final location may be determined for each group by using the estimated location information.

In the service device according to the preferred embodiment of the present invention, the control unit may provide the terminal device with the album automatically generated according to the request of the terminal device.

In the service device according to a preferred embodiment of the present invention, the service provider, in consideration of the time and location for creating the album in advance to set the album generation criteria, by setting a group according to the set album generation criteria The stored photo or video may be controlled to be stored in the set group.

In the service apparatus according to the preferred embodiment of the present invention, the service providing unit, the period and time zone for creating an album, and a predetermined time unit for forming a group, and the user can move in the set predetermined time unit The album generation criteria may be set in advance by setting a distance.

In the service device according to an embodiment of the present invention, the service providing unit, the group of the photographed pictures or videos are divided by a predetermined time unit of the album generation criteria, the group of divided pictures or videos set by the predetermined time unit Can be stored in

In the service device according to the preferred embodiment of the present invention, the service provider may classify and store the pictures or videos stored in each group of the time unit by the photographed location.

In the service apparatus according to the preferred embodiment of the present invention, the service providing unit, by analyzing the background image of the photo or video stored in each group of the time unit to extract the region information, and the photographed by using the extracted region information Location can be identified.

In the service apparatus according to the preferred embodiment of the present invention, the service providing unit may extract text, landmarks, and voice information indicating a region from the analyzed background image as region information.

In the service apparatus according to the preferred embodiment of the present invention, the service provider reads the stored pictures or videos according to a preset album generation criterion, groups the read pictures or videos into groups, and divides the read pictures or videos into groups. The location of the location can be determined using the meta information.

In the service device according to the preferred embodiment of the present invention, the service providing unit reads the pre-stored picture or video taken at a maximum distance set for each time unit of the preset album generation criterion and displays the read picture or video at the time. Can be grouped by unit.

In the service apparatus according to the preferred embodiment of the present invention, the service provider may collect the pictures or videos having similar location information and group them by location using location information included in the meta information of the read pictures or videos. have.

In the service device according to the preferred embodiment of the present invention, the service provider may set the first or last picture taken among the pictures or videos included in each group as the representative picture.

A terminal device according to an embodiment of the present invention for achieving the above object, the communication unit for performing a communication for generating a location-based album in conjunction with the service device via a communication network; Functionally connected with the communication unit, to execute the application for generating the album received from the service device, to form a group by dividing the pictures or videos taken by the user according to a preset album generation criteria, and to position each formed group A controller configured to select one or more representative pictures or videos at the determined location and automatically generate an album using the selected representative pictures or videos; And an output unit configured to output the generated album to an execution screen under the control of the controller.

In the terminal device according to the preferred embodiment of the present invention, the control unit forms the respective groups by time or location, and analyzes the background image of the pictures or videos stored in each of the formed groups to extract the extracted region information. It may be transmitted to a service device, receive map information corresponding to local information from the service device, map the received map information with a picture or video corresponding to the analyzed background image, and store the received map information in a corresponding group.

In the terminal device according to the preferred embodiment of the present invention, the control unit, by selecting a representative picture or video in sequence according to the shooting time of the pictures or videos included in each group at a predetermined period of the selected representative for each group The album may be automatically generated using a photo, and the selected representative photo or video may be changed at the predetermined period and output when the album is output.

In the terminal device according to the preferred embodiment of the present invention, the controller may select one or more representative pictures in consideration of one or more of contrast, resolution, brightness, focus, and size of the pictures or videos included in each group. have.

In the terminal device according to the preferred embodiment of the present invention, the control unit, by selecting a representative picture or video in sequence according to the shooting time of the pictures or videos included in each group at a predetermined period of the selected representative for each group The album may be automatically generated using a photo, and the selected representative photo may be changed and output at the preset period when the album is output.

In the terminal device according to the preferred embodiment of the present invention, the control unit receives map information corresponding to the determined location information of each group from the service device, and is generated as a representative picture or video selected from each group. When the album is output, the selected representative picture may be controlled to be mapped with the map information and output.

In the terminal device according to the preferred embodiment of the present invention, if the user selects any one representative picture or video from the album output on the execution screen, all the pictures included in the selected representative picture or video group or The video may be controlled to be output on the execution screen.

In the terminal device according to the preferred embodiment of the present invention, if the user selects any one representative picture or video from the album output on the execution screen, all the pictures included in the selected representative picture or video group or The video may be controlled to be output on the execution screen together with the map information.

Mobile service system according to a preferred embodiment of the present invention for achieving the object as described above, form a group by dividing the pictures or videos taken by the user according to a preset album generation criteria, and position each group formed A service device for selecting one or more representative pictures or videos at the determined location and automatically generating an album using the selected representative pictures or videos; And a terminal device for communicating with the service device through a communication network, receiving an album generation generated from the service device, and outputting the received album to an execution screen.

In the mobile service system according to the preferred embodiment of the present invention, the service device searches the map information corresponding to the information on the determined position, and outputs the searched map information together when outputting the generated album. Can be provided as

In the method for generating a location-based album in a service apparatus according to an exemplary embodiment of the present invention for achieving the above object, a group is formed by dividing a photo or video taken by a terminal device according to a preset album generation criterion. Doing; Determining one or more representative pictures or videos at the determined location by determining a location for each formed group; Automatically generating an album using the selected representative picture or video; And providing the generated album to the terminal device.

A location-based album generation method in a terminal device according to a preferred embodiment of the present invention for achieving the above object, comprising: receiving and installing and storing an application for creating an album from a service device through a communication network; Executing the application for creating an album to form one or more groups according to preset album creation criteria; When the user takes a picture or video, dividing the taken picture or video according to a preset album generation criterion and storing the picture or video in a corresponding group; When the photographing is completed, determining a location for each group; Selecting at least one representative picture or video at a location determined for each group; Automatically generating an album by using the selected representative picture or video, and outputting the representative picture or video included in the generated album on the execution screen for each time or location.

Location-based album generation method in a terminal device according to another embodiment of the present invention for achieving the object as described above, the step of receiving and installing an application for creating an album from the service device via a communication network; Photographing and storing pictures or videos by a user; Reading the stored pictures or videos according to a preset album generation standard by executing the application for creating an album; Grouping the read photographs or videos into groups; Determining a location using meta information of each group of pictures or videos; Selecting at least one representative picture or video at the determined location; Automatically generating an album using the selected representative picture or video; And outputting representative pictures or videos included in the generated album on an execution screen by time or location.

In the computer-readable recording medium of the present invention for achieving the above object, a program for executing a location-based album generation method is recorded.

The present invention forms a group of photographs or videos taken by time or by location to determine a location for each group, and thus, based on location without using a user's separate operation using one or more representative pictures or videos selected from the determined location. Since one album can be automatically generated, the created album can easily check the photos of the identified locations by time and can provide an album that the user can use more conveniently.

1 is a diagram illustrating a configuration of a mobile service system according to embodiments of the present invention.

2 is a diagram illustrating a configuration of a terminal device in a mobile service system according to embodiments of the present invention.

3 is a diagram illustrating a configuration of a service apparatus in a mobile service system according to embodiments of the present invention.

4 is a diagram illustrating a method for creating a location-based album in a service device according to a first embodiment of the present invention.

5 is a diagram illustrating a method for generating a location-based album in a terminal device according to a second embodiment of the present invention.

6 is a diagram illustrating a method for generating a location-based album in a terminal device according to a third embodiment of the present invention.

7 is a diagram illustrating an example of a time and a location set to determine the location of pictures of each group according to embodiments of the present invention.

8 is a diagram illustrating an example of dividing photographed pictures by time according to embodiments of the present invention.

9 is a diagram illustrating an example of dividing pictures taken by time and space according to embodiments of the present invention.

10 to 13 are diagrams showing screen examples for showing albums created according to embodiments of the present invention.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. However, in the following description and the accompanying drawings, detailed descriptions of well-known functions or configurations that may obscure the subject matter of the present invention will be omitted. In addition, it should be noted that like elements are denoted by the same reference numerals as much as possible throughout the drawings.

The terms or words used in the specification and claims described below should not be construed as being limited to ordinary or dictionary meanings, and the inventors are appropriate as concepts of terms for explaining their own invention in the best way. It should be interpreted as meanings and concepts in accordance with the technical spirit of the present invention based on the principle that it can be defined. Therefore, the embodiments described in the present specification and the configuration shown in the drawings are only the most preferred embodiments of the present invention, and do not represent all of the technical ideas of the present invention, and various alternatives may be substituted at the time of the present application. It should be understood that there may be equivalents and variations.

First, a mobile service system according to an embodiment of the present invention will be described in detail with reference to the accompanying drawings.

1 is a diagram illustrating a configuration of a mobile service system according to embodiments of the present invention.

Referring to FIG. 1, the mobile service system may include one or more terminal devices 100 and a service device 200 connected through a communication network 10.

The terminal device 100 refers to a terminal capable of transmitting and receiving various data via the communication network 10 according to a user's key manipulation, and may be a tablet PC, a laptop, or a personal computer. ), A smart phone, a personal digital assistant (PDA), a smart TV, and a mobile communication terminal (Mobile Communication Terminal).

In addition, the terminal device 100 is a terminal for performing voice or data communication using the communication network 10, and stores a browser, a program, and a protocol for communicating with the service device 200 via the communication network 10. It refers to a terminal having a microprocessor for operating and controlling various programs. That is, the terminal device 100 can perform server-client communication with the service device 200, and any terminal can be used as long as it can execute a messenger service, and all communication computing devices such as a notebook computer, a mobile communication terminal, and a PDA can be used. It is a broad concept to include. On the other hand, the terminal device 100 is preferably manufactured in the form having a touch screen, but is not necessarily limited thereto.

In particular, the terminal device 100 according to the first embodiment of the present invention performs communication for a mobile service by interworking with the service device 200 through the communication network 10, and is automatically generated from the service device 200. The album can be received and the received album can be output to the execution screen.

Meanwhile, the terminal device 100 according to the second and third embodiments of the present invention may receive and install and store an application for generating a mobile service, in particular, a location-based album, from the service device 200. In addition, the terminal device 100 may execute an application for creating an album, and form a group by dividing a photo or video taken by the user according to a preset album generation criterion. The terminal device 100 may determine a location for each formed group, select one or more representative pictures or videos at the determined location, and automatically generate an album using the selected pictures or videos. Can be displayed on the execution screen.

In particular, the service device 200 according to the first embodiment of the present invention receives and stores a picture or video taken from one or more terminal devices 100 through a communication network, and uses a location-based album by using the picture or video. Can be generated automatically. To this end, the service apparatus 200 forms a group by dividing the photographed photos or videos according to a preset album generation criterion, and selects one or more representative photos or videos at the determined position by determining a position for each formed group. The album may be automatically generated using the selected representative picture or video.

The service device 200 according to the second and third embodiments of the present invention may be a related program for generating a mobile service, in particular, a location-based album, by interworking with one or more terminal devices 100 through a communication network 10. You can provide an application. In addition, when the service device 200 receives the information on the determined location of each group from the terminal device 100, the service device 200 searches for map information corresponding to the received determined location information, and outputs the generated map information to the generated album. It may be provided to the terminal device 100 to output the time together. The terminal device 100 and the service device 200 are interworked through the communication network 10. The communication network 10 uses an internet protocol using various wired / wireless communication technologies such as an internet network, an intranet network, a mobile communication network, and a satellite communication network. A network that can send and receive data. In addition, the communication network 10 is combined with the service device 200 to store computing resources such as hardware and software. Such a communication network 10 is not only an open network such as a local area network (LAN), a wide area network (WAN), an open network such as the Internet, but also code division multiple access (CDMA) and wideband code division (WCDMA). It is a concept that collectively refers to networks such as Multiple Access (GSM), Global System for Mobile Communications (GSM), Long Term Evolution (LTE), and Evolved Packet Core (EPC), as well as next-generation networks and computing networks to be implemented.

The configuration of a terminal device according to embodiments of the present invention in a mobile service system configured as described above will be described in detail with reference to the accompanying drawings.

2 is a diagram illustrating a configuration of a terminal device in a mobile service system according to embodiments of the present invention.

Referring to FIG. 2, the terminal device 100 may include a control unit 110, an input unit 120, a communication unit 130, a storage unit 140, an output unit 150, and a photographing unit 160. have.

The controller 110 according to the embodiments of the present invention performs overall control of the terminal device 100, and in particular, may control related operations for generating and providing a mobile service and a location-based album. To this end, the controller 110 may include a service execution module 111 for providing a location-based album to a user or generating a location-based album.

The service execution module 111 according to the embodiments of the present invention is functionally connected with the communication unit 120, after installing an application for executing a location-based album received from the service device 200, the communication network 10. By interworking with the service device through a mobile service for creating and providing albums can be executed at the request of the user.

In addition, the service execution module 111 according to the first embodiment of the present invention transmits a picture or video taken by the service device 100 and automatically generates the picture or video by using the picture or video taken from the service device 200. The created album can be output by time and location on the execution screen.

In addition, the service execution module 111 according to the second and third embodiments of the present invention installs and stores an application for creating an album received from the service device 200 and an application for creating an album according to a user's request. You can run

In addition, the service execution module 111 forms a group by dividing the photos or videos taken by the user according to a preset album generation criterion, and determines a location for each formed group to display one or more representative pictures or videos at the determined location. The album can be automatically created using the selected photo or video.

Specifically, the service execution module 111 according to the second embodiment of the present invention sets the album generation criteria in advance in consideration of the time and location for generating the album, and sets the group according to the set album generation criteria. It can be controlled to store the captured photo or video in the set group. At this time, the service execution module 111 sets a period and time zone for creating an album, a predetermined time unit for forming a group, and sets a maximum distance that a user can move in a predetermined predetermined time unit to preview the album creation criteria. Can be set. For example, when the user sets the photo or video taken from 11:30 to 12:00 on a specific day as an album through the setting window, as shown in FIG. 7, the service execution module 111 is attached. Set a predetermined time unit (for example, 10 minutes) t1, t2, t3, and may set the maximum distance (1km, 2km 3km) the user can move in a certain time unit in consideration of the walking or moving means. At this time, the radius up to the maximum distance that can be moved in a predetermined time unit may be set to R1, R2, and R3.

Accordingly, the service execution module 111 according to the second embodiment of the present invention may classify the photographed pictures or videos by a predetermined time unit of the album creation standard and store the divided pictures or videos in a group set by the predetermined time unit. have. For example, as shown in FIG. 8, the service execution module 111 includes three pictures or videos taken at the starting point s (11:30) and t1 (11:31 to 11:40) time. To the t1 group, save 4 photos or videos taken at t2 (11:41-11:50) time to the t2 group, and 3 photos taken at t3 (11:51-12:00) Or you can save the video to t3 group.

In addition, the service execution module 111 may classify and store the pictures or videos stored in each group in a predetermined time unit by the photographed location. For example, as shown in FIG. 9, the service execution module 111 may find similar regions for each of R1, R2, and R3 according to the maximum distance in the t1, t2, and t3 groups, and classify the photographed pictures or videos again. have.

In addition, the service execution module 111 extracts region information by analyzing a background image of a photo or a video in each group to collect photos of similar regions in each group of a predetermined time unit, and photographs using the extracted region information. Location can be identified. To this end, the service execution module 111 extracts text, landmarks, and voice information representing an area from the analyzed background image as area information, and transmits the extracted area information to the service device 200, and the service device 200. ), Map information corresponding to the local information can be received. Accordingly, the service execution module 111 may determine the location of each group by using each region information mapped to the map information. In addition, the service execution module 111 maps the received map information to a photo or video corresponding to the analyzed background image and stores the same in a group, and then displays the representative photo or video included in the album together with the map information when the album is output. can do.

In addition, the service execution module 111 analyzes the background images of the taken pictures or videos included in each group, searches for pre-stored pictures or videos including images similar to the analyzed background images, and searches for one or more pictures or videos. The location information may be used to determine the location of each group.

On the other hand, the service execution module 111 according to the third embodiment of the present invention executes the application in order to create a pre-stored photo or video before executing the application, the pre-stored photo according to a preset album generation criteria Alternatively, the read out videos may be classified by grouping the read pictures or videos. At this time, the service execution module 111 determines the location using meta information of each group of pictures or videos, selects one or more representative pictures at the location determined for each group, and automatically uses the set representative picture. You can create an album.

In addition, the service execution module 111 may read the pre-stored pictures or videos taken at the maximum distance set for each time unit of the preset album generation criterion and group the read pictures or videos by time units. The service execution module 111 may collect pictures or videos having similar location information and group them by location using location information included in meta information of the read pictures or videos.

In addition, the service execution module 111 according to the second and third embodiments of the present invention may set the first or last picture taken among the pictures or videos included in each group as the representative picture. In addition, the service execution module 111 may select one or more representative pictures in consideration of one or more of contrast, resolution, brightness, focus, and size of the pictures or videos included in each group. In addition, the representative photo or video of each group may be set in various ways.

In addition, the service execution module 111 according to the second and third embodiments of the present invention may receive map information corresponding to the determined location information of each group from the service device 200 and map and store the map information in each group. . The service execution module 111 outputs a map according to map information on an execution screen when outputting an album generated from a representative picture or a video set in each group, and outputs the set representative picture to a location corresponding to mapped map information. Can be controlled. On the contrary, the service execution module 111 according to the embodiments of the present invention searches for a location in the navigation with the determined location information of each group in association with the navigation function and outputs a map output according to the corresponding location on the album output screen. In addition, it is possible to control to output the representative photo or video to the determined position area of each group. For example, as shown in FIG. 10, when the user selects a location in the output form menu 21, the service execution module 111 displays the representative picture 31a of the t1 group at the corresponding location on the map. In addition, the representative photo 32d of the t2 group may be displayed at the corresponding position on the map, and the representative photo 33b of the t3 group may be displayed at the corresponding position on the map.

In addition, the service execution module 111 according to the second and third exemplary embodiments of the present invention selects a time from the output form menu 21, as shown in FIG. t3) The representative pictures or videos 31a, 32d, and 33b set based on the position in the group may be output on the execution screen.

In addition, the service execution module 111 according to the second and third embodiments of the present invention sequentially sets the representative picture or video according to the shooting time order of the pictures or videos included in each group at predetermined intervals, and for each group. The album can be automatically created using the set representative photo. In addition, the service execution module 111 may change the representative photo set at the time of outputting the album at a predetermined cycle and output it. For example, as shown in FIG. 11, the representative picture or video 31a, 32d, 33b currently set on the execution screen is output, and the picture or video 31a, 32d, 33b currently output in the next cycle. May be output by replacing the representative picture or video 31b, 32c, 33a set in the next cycle.

In addition, the service execution module 111 according to the embodiments of the present invention, as shown in FIG. 12, when the user selects any one representative picture or video 31a from the album output on the execution screen, All the pictures or videos 31a, 31b, and 31c included in the group of the selected representative picture or video 31a may be controlled to be output to the execution screen. In this case, when the representative picture or the video 31a is selected, a photographing time (11:34 am) may be displayed in one region.

In addition, as shown in FIG. 13, the service execution module 111 according to the embodiments of the present invention selects any one representative picture or video 31a from the album output on the execution screen. Output all pictures or videos 31a, 31b, 31c included in the group of the representative picture or video 31a together with the map information to the execution screen, that is, all pictures or videos 31a, 31b, 31c) may be controlled.

The communication unit 120 according to the embodiments of the present invention may communicate with the service device 200 through the communication network 10 to transmit and receive messages related to a mobile service, that is, album generation. It is possible to receive map information according to the application to be executed and the determined location information of each group. The communication unit 120 may transmit and receive data through various communication methods as well as wired and wireless methods. In addition, the communication unit 120 may transmit and receive data using one or more communication methods, and for this purpose, the communication unit 120 may include a plurality of communication modules that transmit and receive data according to different communication methods.

The input unit 130 according to the embodiments of the present invention may generate a user input signal corresponding to a user's request or information according to a user's operation, and may be implemented by various input means that are currently commercialized or that can be commercialized in the future. For example, not only a general input device such as a keyboard, a mouse, a joystick, a touch screen, a touch pad, but also a gesture input means for detecting a user's motion and generating a specific input signal, and a voice recognition means for recognizing a user's voice. It may include. The input unit 130 may generate an input signal according to an execution of an application input from a user and an input signal according to a user manipulation on an album output screen.

The storage unit 140 stores information necessary for the operation of the terminal device 100, and in particular, an application or program for creating or executing an album received from the service device 200, each group. Map information according to the determined position information of the can be stored. In addition, the storage unit 140 may store the photo or video taken by the user in the photo / video DB 140, grouping the photos or video stored in the photo / video DB 140 by time / location You can save photos or videos by each group. In addition, the storage 140 may store an album created using the representative picture or video set for each group in the album DB 141. The storage unit 140 may include an optical media such as a magnetic media such as a hard disk, a floppy disk, and a magnetic tape, a compact disk read only memory (CD-ROM), and a digital video disk (DVD). And magneto-optical media such as floppy disks and ROM, random access memory (RAM), and flash memory.

In addition, the storage 140 may store the screen image to be output to the display unit, as well as the application program required for the operation of the function according to embodiments of the present invention. The storage unit 140 may store a key map or a menu map for operating the touch screen when the display unit is configured as the touch screen. Here, the key map and the menu map may be in various forms. That is, the key map may be a keyboard map, a 3 * 4 key map, a qwerty key map, or the like, or may be a control key map for operation control of an currently activated application program. In addition, the menu map may be a menu map for controlling the currently running application program. The storage 140 is an operating system (OS) for booting the terminal device 100 and operating the above-described components, and various user functions, for example, a user for supporting a call function of the terminal device 100. Function, an MP3 user function for playing other sound sources, an image output function for playing an image such as a photo, and an application program for supporting a video playing function, respectively.

The output unit 150 is a means for providing the user to recognize the operation result or state of the terminal device 100, and includes, for example, a display unit for visually outputting through a screen, a speaker for outputting an audible sound, and the like. can do. In particular, the output unit 150 according to the embodiments of the present invention outputs the album generated on the application execution screen, all the pictures included in the group in the representative photo or video selected according to the user's selection signal in the output album Alternatively, the video can be output on the execution screen. In addition, the output unit 150 may output a map based on map information, and output a representative photo or video included in an album created on the map. In addition, the output unit 150 may output a setting screen for setting album generation criteria in advance in order to automatically generate an album.

The photographing unit 160 is a camera capable of capturing a picture or a video, and transmits the photographed picture or video data to the control unit 110, and meta information (size, resolution, rotation) when the picture is taken under the control of the control unit 110. , File type, focus, contrast, brightness, exposure, shooting time, etc.) may be created and transferred to the controller 110 to be tagged in the captured photo or video data.

Next, a configuration of a service apparatus according to embodiments of the present invention in a mobile service system will be described in detail with reference to the accompanying drawings.

3 is a diagram illustrating a configuration of a service apparatus in a mobile service system according to embodiments of the present invention.

Referring to FIG. 3, the service device 200 may include a communication unit 210, a service providing unit 220, and a storage unit 230.

The communication unit 210 according to the embodiments of the present invention may transmit and receive messages related to mobile service, in particular, album creation or execution, with one or more terminal devices 100 through the communication network 10. The communication unit 210 may transmit and receive data through various communication methods as well as wired and wireless methods. In addition, the communication unit 210 may transmit and receive data using one or more communication methods, and for this purpose, the communication unit 210 may include a plurality of communication modules that transmit and receive data according to different communication methods.

The service provider 220 according to the embodiments of the present invention controls an operation for a mobile service by interworking with two or more terminal devices 100 through the communication network 10, and is functionally connected to the communication unit 210. The terminal device 100 may control to provide an application or a program for generating or executing an album. In addition, the service provider 220 may provide the terminal device 100 to search for map information corresponding to the determined position of each group and output the searched map information together with the output of the generated album.

In particular, the service provider 220 according to the first embodiment of the present invention controls to perform a communication for generating a location-based album in cooperation with one or more terminal devices through the communication network 10, and is taken from the terminal device Receive and save photos or videos.

In addition, the service provider 220 according to the first embodiment of the present invention forms a group by dividing the photos or videos taken by the terminal device according to a preset album generation criterion, and positions each group. By confirming, one or more representative pictures or videos at the determined location may be selected. Accordingly, the service provider 220 may automatically generate an album using the selected representative picture or video. In this case, the service provider 220 analyzes a background image of the taken photo or video included in each group, searches for a pre-stored picture or video including an image similar to the analyzed background image, and retrieves one or more photos or videos. The location information can be estimated by comparing with the video. Accordingly, the service provider 220 determines the final location for each group by using the estimated location information.

In addition, the service provider 220 may provide the terminal device 100 with the album automatically generated according to the request of the terminal device 100.

The service provider 220 may automatically generate an album in the same manner as in the second and third embodiments of the present invention as described above.

In detail, the service provider 220 presets an album generation criterion in consideration of a time and a location for creating an album, sets a group according to the set album creation criterion, and assigns divided shots or videos to the corresponding group. Can be stored. Here, the service provider 220 sets a period and time zone for creating an album, a predetermined time unit for forming a group, and sets a maximum distance that a user can move in the set predetermined time unit to set the album generation criteria. Can be set in advance.

In addition, the service provider 220 may classify the photographed photos or videos by a predetermined time unit based on the album generation standard, and store the divided photos or videos in a group set by the predetermined time unit. In this case, the service provider 220 may extract the region information by analyzing the background images of the pictures or videos stored in each group in a time unit, and determine the photographed location by using the extracted region information. Here, the service provider 220 may extract text, landmark, and voice information indicating a region from the analyzed background image as the region information. In addition, the service provider 220 may classify and store the photographs or videos stored in each group of time units by the captured photographing positions.

In addition, the service provider 220 reads out the stored photos or videos according to a preset album generation criterion, groups the read photos or videos into groups, and determines the location by using meta information of each group of photos or videos. You may. In this case, the service provider 220 may collect the pictures or videos having similar location information by using the location information included in the meta information of the read pictures or videos and group them by location.

In addition, the service provider 220 selects the first or last picture taken among the pictures or videos included in each group as the representative picture, or selects the representative picture, contrast, resolution, and the like of the pictures or videos included in each group. One or more representative photos may be selected in consideration of one or more of brightness, focus, and size.

According to the first embodiment of the present invention, a method of automatically grouping photographed pictures or videos for creating an album in a service device and selecting a location and a representative picture for each group are described in the second and second embodiments of the present invention. Since it is the same as the description of FIGS. 10 to 13 attached to the terminal device according to the third embodiment, a detailed description thereof will be omitted.

The storage unit 230 may store application and map information provided for album generation. The storage unit 230 may include an optical media such as a magnetic media such as a hard disk, a floppy disk, and a magnetic tape, a compact disk read only memory (CD-ROM), and a digital video disk (DVD). And magneto-optical media such as floppy disks and ROM, random access memory (RAM), and flash memory.

Next, a method for generating a location-based album in the mobile service system according to the embodiment of the present invention configured as described above will be described in detail with reference to the accompanying drawings. First, a method for generating a location-based album in a terminal device according to a first embodiment of the present invention will be described.

4 is a diagram illustrating a method for creating a location-based album in a service device according to a first embodiment of the present invention.

Referring to FIG. 4, in operation 1101, the service device 200 presets an album generation criterion for generating an album. At this time, the service device 200 sets the maximum distance (R1: 1km, R2: 2km, R3: 3km) that the user can move in the set predetermined time unit (t1, t2 t3).

In operation 1102, the service device 200 may receive and store a picture or a video captured by interworking with the one or more terminal devices 100 through the communication network 10.

In operation 1103, the service device 200 divides the photo or video taken by the terminal device 100 according to a preset album generation criterion to form a group by time / position. In this case, as illustrated in FIG. 7, the service device 200 divides the time zone of the set period into predetermined time units (for example, 10 minutes), and divides the groups t1 and t2 t3 for each divided time unit. Form.

In operation 1104, the service device 200 analyzes a background image of the pictures or videos included in each group, reads out pictures or videos of similar pre-stored areas corresponding to the analyzed background image, and reads the read pictures or videos. Check the location through meta information included in the field or location information determined when creating an album. Accordingly, the service device 200 may determine the location of each group through the identified location information. For example, as shown in the accompanying FIG. 9, the first pictures 31c are taken in the actual R2 region by the location of the pictures 31a, 31b, and 31c included in the t1 group, and the second and third pictures. 31A and 31B, when a plurality of pictures are taken in the R1 area when the actual pictures are taken in the R1 area, the position of the t1 group may be determined as R1. As another example, the service device 200 may determine the location of each group according to the identified location information of the representative picture set in a later step.

Accordingly, in operation 1105, the service device 200 selects one or more representative pictures at locations determined for each group. In this case, the service device 200 sets the first or last picture taken among the pictures or videos included in each group as the representative picture, or the contrast, resolution, brightness, focus, and size of the pictures or videos included in each group. Select one or more representative photos by considering one or more of them.

In operation 1106, the service device 200 automatically generates and stores an album using the set representative picture. In operation 1107, the service device 200 transmits the generated album to the terminal device 100 according to the request.

Meanwhile, a method for generating a location-based album in a terminal device according to a second embodiment of the present invention will be described with reference to the accompanying drawings.

5 is a diagram illustrating a method for generating a location-based album in a terminal device according to a first embodiment of the present invention. Referring to FIG. 5, in operation 2101, the terminal device 100 receives an application for generating an album from the service device 200 through the communication network 10, and installs and stores the application.

Then, in step 2102, the terminal device 100 executes an application for creating an album according to a user's request, and sets the album generation criteria for generating an album in advance. In this case, the terminal device 100 outputs an album setting screen, and sets a period and time zone for generating an album through a menu displayed on the output album setting screen. Accordingly, the terminal device 100 divides the time zone of the set period into predetermined time units (for example, 10 minutes) and divides the groups t1 and t2 t3 for each divided time unit as shown in FIG. 7. Form. The terminal device 100 sets the maximum distance (R1: 1km, R2: 2km, R3: 3km) that the user can move in the set predetermined time units t1 and t2 t3.

Then, in step 2103, when the user takes a picture or video, the terminal device 100 classifies the picture or video according to a preset album generation criteria and stores the picture or video in the corresponding group. For example, when the user takes a picture at the current time zone t1, the terminal device 100 stores the taken picture in the t1 group. Here, the t1 group may be regarded as being photographed within a radius R1, and since the t1 group is different from the actual photographing position, the detailed position information may be checked through the position information when the meta information of the photographed photo includes the position information, or the position At the time of confirmation, it can be identified through pre-stored pictures or videos of similar areas.

Thereafter, since steps 2104 to 2105 operate in the same manner as steps 1104 to 1106 as described above, a detailed description thereof will be omitted.

In operation 2107, the terminal device 100 outputs the generated album to an execution screen.

Next, a method for generating a location-based album in a terminal device according to a third embodiment of the present invention will be described in detail with reference to the accompanying drawings.

6 is a diagram illustrating a method for generating a location-based album in a terminal device according to a third embodiment of the present invention.

Referring to FIG. 6, in step 3101, the terminal device 100 stores a picture or a video captured by a user. In addition, the terminal device 100 receives and installs and stores an application for creating an album from the service device 200 through the communication network 10 to automatically generate an album based on the location.

Accordingly, when the terminal device 100 executes an application according to a user's request in step 3102, the terminal device 100 reads a pre-stored picture or video according to a preset album generation standard in step 3103.

Then, in step 3104, the terminal device 100 forms a group by time / position by dividing the read picture or video into groups.

Then, in step 3105, the terminal device 100 determines the location using meta information of the pictures or videos of each group, and sets one or more representative pictures or videos of the location determined for each group in step 2106.

Thereafter, in step 3107, the terminal device 100 automatically generates and stores an album using the set representative picture, and then outputs the album generated in step 3108 to the execution screen.

As described above, the present invention may form a group by dividing a photographed picture or a video by time / position even without a separate operation of a user, and automatically generate an album based on the position of each formed group.

Meanwhile, the program instructions to be recorded may be those specially designed and constructed for the present invention, or may be known and available to those skilled in computer software. For example, the recording medium may be magnetic media such as hard disks, floppy disks and magnetic tapes, optical disks such as Compact Disk Read Only Memory (CD-ROM), digital video disks (DVD), Magnetic-Optical Media, such as floppy disks, and hardware devices specially configured to store and execute program instructions, such as ROM, random access memory (RAM), flash memory, and the like. do. Examples of program instructions may include high-level language code that can be executed by a computer using an interpreter as well as machine code such as produced by a compiler. Such hardware devices may be configured to operate as one or more software modules to perform the operations of the present invention, and vice versa.

Furthermore, a computer program (also known as a program, software, software application, script or code) mounted on an apparatus according to the invention and executing a method according to the invention comprises a compiled or interpreted language or a priori or procedural language. It can be written in any form of programming language, and can be deployed in any form, including stand-alone programs or modules, components, subroutines, or other units suitable for use in a computer environment. Computer programs do not necessarily correspond to files in the file system. A program may be in a single file provided to the requested program, in multiple interactive files (eg, a file that stores one or more modules, subprograms, or parts of code), or part of a file that holds other programs or data. (Eg, one or more scripts stored in a markup language document). The computer program may be deployed to run on a single computer or on multiple computers located at one site or distributed across multiple sites and interconnected by a communication network.

On the other hand, the embodiments of the present invention disclosed in the specification and drawings are merely presented specific examples for clarity and are not intended to limit the scope of the present invention. It is apparent to those skilled in the art that other modifications based on the technical idea of the present invention can be carried out in addition to the embodiments disclosed herein.

In addition, although the specification includes numerous specific implementation details, these should not be construed as limited to any invention or scope of the claims, but rather to features that may be specific to a particular embodiment of a particular invention. It should be understood as an explanation. Certain features that are described in this specification in the context of separate embodiments may be implemented in combination in a single embodiment. Conversely, various features that are described in the context of a single embodiment can also be implemented in multiple embodiments individually or in any suitable subcombination. Furthermore, while the features may operate in a particular combination and may be initially depicted as so claimed, one or more features from the claimed combination may in some cases be excluded from the combination, the claimed combination being a subcombination Or a combination of subcombinations.

Likewise, although the operations are depicted in the drawings in a specific order, it should not be understood that such operations must be performed in the specific order or sequential order shown in order to obtain desirable results or that all illustrated operations must be performed. Moreover, the separation of the various system components of the above-described embodiments should not be understood as requiring such separation in all embodiments, and the described program components and systems will generally be integrated together into a single software product or packaged into multiple software products. It should be understood that it can.

The present invention relates to a mobile service system, a method and apparatus for creating a location-based album in the system. By using one or more representative photos or videos, you can automatically create albums based on location without any user interaction, and the created albums make it easy to check the photos in the location identified by time. There is an effect that can provide an album that can be used.

In addition, the present invention has industrial applicability because the present invention is not only sufficiently commercially available or commercially viable, but also practically clearly implemented.

Claims (25)

1. A communication unit performing communication for generating a location-based album in association with at least one terminal device through a communication network; And

   It is functionally connected with the communication unit, receives and stores the photographed or video taken from the terminal device, forms the group by dividing the photographed pictures or videos according to a preset album generation criteria, and sets the position for each formed group. A service provider to select one or more representative pictures or videos at the determined location and automatically create an album using the selected representative pictures or videos;

   Service device comprising a.
2. The method of claim 1, wherein the control unit,

   Analyze the background image of the photographed pictures or videos included in each group, search for a pre-stored picture or video including an image similar to the analyzed background image, estimate the location information by comparing with the searched one or more pictures or videos. And determining a final position for each group by using the estimated position information.
3. The method of claim 1, wherein the control unit,

   And providing the album automatically generated according to a request of the terminal device to the terminal device.
4. The method of claim 1, wherein the service provider,

   In consideration of the time and location for creating the album, the album generation criteria are set in advance, and a group is set according to the set album generation criteria to control to store the divided shots or videos in the set corresponding group. Service device.
5. The method of claim 4, wherein the service provider,

   A service device characterized in that the setting period and time zone for creating an album, a predetermined time unit for forming a group, and set the maximum distance that the user can move in a set predetermined time unit to preset the album generation criteria .
6. The method of claim 1, wherein the service provider,

   And dividing the taken photo or video by a predetermined time unit based on the album creation standard, and storing the divided photo or video in a group set by the predetermined time unit.
7. The method of claim 6, wherein the service providing unit,

   Analyzing background images of pictures or videos stored in each group in the time unit, extracting region information, using the extracted region information to identify the photographed location, and storing pictures or videos stored in each group in the time unit. The service device, characterized in that for storing again classified by the captured location.
8. The method of claim 7, wherein the service providing unit,

   And extracting text, landmark, and voice information representing a region from the analyzed background image as region information.
9. The method of claim 1, wherein the service provider,

   And reading out the stored pictures or videos according to a preset album generation criterion, grouping the read pictures or videos into groups, and determining a location by using meta information of each group of pictures or videos.
10. The method of claim 9, wherein the service providing unit,

    And grouping the pictures or videos having similar location information by grouping them by location using location information included in the meta information of the read pictures or videos.
11. The method of claim 1, wherein the service provider,

    And a first photograph taken at the beginning or the last among photographs or videos included in each group as a representative photograph.
12. The method of claim 1, wherein the service provider,

    And at least one representative picture is selected in consideration of at least one of contrast, resolution, brightness, focus, and size of the pictures or videos included in each group.
13. A communication unit performing communication for generating a location-based album in association with a service device through a communication network;

    Functionally connected with the communication unit, to execute the application for generating the album received from the service device, to form a group by dividing the pictures or videos taken by the user according to a preset album generation criteria, and to position each formed group A controller configured to select one or more representative pictures or videos at the determined location and automatically generate an album using the selected representative pictures or videos; And

    An output unit configured to output the generated album to an execution screen under control of the controller;

    Terminal device comprising a.
14. The method of claim 13, wherein the control unit,

    Each group is formed by time or location, and the extracted region information is analyzed by analyzing the background image of the pictures or videos stored in the formed groups, and the map information corresponding to the region information from the service apparatus. And receiving and mapping the received map information with a picture or video corresponding to the analyzed background image and storing the received map information in a corresponding group.
15. The method of claim 13, wherein the control unit,

    Select a representative picture or video sequentially according to the shooting time of the pictures or videos included in each group at a predetermined cycle, and automatically generate the album using the representative picture selected for each group, and output the album. And outputs the selected representative picture or video by changing the predetermined representative picture or video at the predetermined period.
16. The method of claim 13, wherein the control unit,

    Select a representative picture or video sequentially according to the shooting time of the pictures or videos included in each group at a predetermined cycle, and automatically generate the album using the representative picture selected for each group, and output the album. And outputs the selected representative picture or video by changing the predetermined representative picture or video at the predetermined period.
17. The method of claim 13, wherein the control unit,

    Receiving map information corresponding to the determined location information of each group from the service device, and mapping the selected representative picture or video to the map information when outputting an album generated from the representative picture or video selected from each group Terminal device characterized in that for controlling the output.
18. The method of claim 13, wherein the control unit,

    And if the user selects any one representative picture or video from the album output on the execution screen, controlling to output all the pictures or videos included in the selected representative picture or video group to the execution screen.
19. The method of claim 13, wherein the control unit,

    When the user selects any one representative picture or video in the album output on the execution screen, all the photos or videos included in the selected representative photo or video group with the map information and controls to output to the execution screen, characterized in that Terminal device.
20. Group the photos or videos taken by the user according to preset album creation criteria to form a group, determine the location for each formed group, select one or more representative pictures or videos at the determined location, and select the selected representative picture or A service device for automatically generating an album using a video; And

    A terminal device for communicating with the service device through a communication network, receiving an album generated from the service device, and outputting the received album on an execution screen;

    Mobile service system comprising a.
21. The method of claim 20, wherein the service device,

    And searching for map information corresponding to the information on the determined location, and outputting the searched map information to the terminal device when the generated album is output.
22. Forming a group by dividing the photos or videos taken by the terminal device according to a preset album generation criterion;

    Determining one or more representative pictures or videos at the determined location by determining a location for each formed group;

    Automatically generating an album using the selected representative picture or video; And

    Providing the created album to the terminal device;

    Location-based album generation method in the service device comprising a.
23. Receiving and installing and storing an application for creating an album from a service device through a communication network;

    Executing the application for creating an album to form one or more groups according to preset album creation criteria;

    When the user takes a picture or video, dividing the taken picture or video according to a preset album generation criterion and storing the picture or video in a corresponding group;

    When the photographing is completed, determining a location for each group;

    Selecting at least one representative picture or video at a location determined for each group;

    Automatically generating an album using the selected photo or video; And

    Outputting representative pictures or videos included in the created album to an execution screen by time or location;

    Location-based album generation method in the terminal device comprising a.
24. Receiving and installing and storing an application for creating an album from a service device through a communication network;

    Photographing and storing pictures or videos by a user;

    Reading the stored pictures or videos according to a preset album generation standard by executing the application for creating an album;

    Grouping the read photographs or videos into groups;

    Determining a location using meta information of each group of pictures or videos;

    Selecting at least one representative picture or video at the determined location;

    Automatically generating an album using the selected representative picture or video; And

    Outputting representative pictures or videos included in the created album to an execution screen by time or location;

    Location-based album generation method in the terminal device comprising a.
25. A computer-readable recording medium having recorded thereon a program for executing the method for generating a location-based album according to any one of claims 22 to 24.

Images