WO2015147437A1 - Système de service mobile, et méthode et dispositif de production d'album basé sur l'emplacement dans le même système - Google Patents

Système de service mobile, et méthode et dispositif de production d'album basé sur l'emplacement dans le même système Download PDF

Info

Publication number
WO2015147437A1
WO2015147437A1 PCT/KR2015/000657 KR2015000657W WO2015147437A1 WO 2015147437 A1 WO2015147437 A1 WO 2015147437A1 KR 2015000657 W KR2015000657 W KR 2015000657W WO 2015147437 A1 WO2015147437 A1 WO 2015147437A1
Authority
WO
WIPO (PCT)
Prior art keywords
album
group
videos
location
pictures
Prior art date
Application number
PCT/KR2015/000657
Other languages
English (en)
Korean (ko)
Inventor
이종수
Original Assignee
에스케이플래닛 주식회사
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 에스케이플래닛 주식회사 filed Critical 에스케이플래닛 주식회사
Publication of WO2015147437A1 publication Critical patent/WO2015147437A1/fr

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/02—Services making use of location information
    • H04W4/029—Location-based management or tracking services
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/40—Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
    • G06F16/43—Querying
    • G06F16/432—Query formulation
    • G06F16/434—Query formulation using image data, e.g. images, photos, pictures taken by a user
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/40—Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
    • G06F16/48—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/487—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using geographical or spatial information, e.g. location
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/58—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/587—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using geographical or spatial information, e.g. location
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00—Systems or methods specially adapted for specific business sectors, e.g. utilities or tourism
    • G06Q50/10—Services
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/02—Services making use of location information
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/18—Information format or content conversion, e.g. adaptation by the network of the transmitted or received information for the purpose of wireless delivery to users or terminals
    • H04W4/185—Information format or content conversion, e.g. adaptation by the network of the transmitted or received information for the purpose of wireless delivery to users or terminals by embedding added-value information into content, e.g. geo-tagging
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W88/00—Devices specially adapted for wireless communication networks, e.g. terminals, base stations or access point devices
    • H04W88/02—Terminal devices
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W88/00—Devices specially adapted for wireless communication networks, e.g. terminals, base stations or access point devices
    • H04W88/18—Service support devices; Network management devices

Definitions

  • the present invention relates to a mobile service, and in particular, a mobile service system for automatically generating and providing an album based on a location to a user by dividing pictures or videos taken by a user by time or location, and location-based in the system.
  • An album generating method and apparatus are provided.
  • a mobile terminal has a TV viewing function (e.g., a mobile broadcasting such as Digital Multimedia Broadcasting (DMB) or Digital Video Broadcasting (DVB)), a music playback function (e.g., an MP3) MPEG Audio Layer-3), picture taking function, and internet access function are being added.
  • a TV viewing function e.g., a mobile broadcasting such as Digital Multimedia Broadcasting (DMB) or Digital Video Broadcasting (DVB)
  • DMB Digital Multimedia Broadcasting
  • DVD Digital Video Broadcasting
  • music playback function e.g., an MP3 MPEG Audio Layer-3
  • picture taking function e.g., a MP3 MPEG Audio Layer-3
  • the mobile communication terminal provides a variety of services by using the pictures or videos taken from simply taking a picture or video through a picture taking function or the like.
  • One of them is a service that provides a photo or video taken by making an album.
  • the present invention has been proposed in order to solve the conventional inconvenience, forming a group by dividing the photographed pictures or videos according to a predetermined album generation criteria, and selected from the determined position by determining the position for each formed group
  • the present invention provides a mobile service system for automatically generating an album using the representative photo or video, a method and an apparatus for generating a location-based album in the system.
  • a service device for achieving the above object, the communication unit for performing a communication for generating a location-based album in conjunction with one or more terminal devices through a communication network; And functionally connected with the communication unit to receive and store a photographed picture or a video taken from the terminal device, form a group by dividing the photographed picture or video according to a preset album generation criterion, and position each formed group.
  • the communication unit for performing a communication for generating a location-based album in conjunction with one or more terminal devices through a communication network; And functionally connected with the communication unit to receive and store a photographed picture or a video taken from the terminal device, form a group by dividing the photographed picture or video according to a preset album generation criterion, and position each formed group.
  • control unit analyzes the background image of the photographed picture or video included in each group, and the previously stored picture or video including an image similar to the analyzed background image
  • the location information may be estimated by comparing the searched one or more pictures or videos, and the final location may be determined for each group by using the estimated location information.
  • control unit may provide the terminal device with the album automatically generated according to the request of the terminal device.
  • the service provider in consideration of the time and location for creating the album in advance to set the album generation criteria, by setting a group according to the set album generation criteria
  • the stored photo or video may be controlled to be stored in the set group.
  • the service providing unit, the period and time zone for creating an album, and a predetermined time unit for forming a group, and the user can move in the set predetermined time unit
  • the album generation criteria may be set in advance by setting a distance.
  • the service providing unit, the group of the photographed pictures or videos are divided by a predetermined time unit of the album generation criteria, the group of divided pictures or videos set by the predetermined time unit Can be stored in
  • the service provider may classify and store the pictures or videos stored in each group of the time unit by the photographed location.
  • the service providing unit by analyzing the background image of the photo or video stored in each group of the time unit to extract the region information, and the photographed by using the extracted region information Location can be identified.
  • the service providing unit may extract text, landmarks, and voice information indicating a region from the analyzed background image as region information.
  • the service provider reads the stored pictures or videos according to a preset album generation criterion, groups the read pictures or videos into groups, and divides the read pictures or videos into groups.
  • the location of the location can be determined using the meta information.
  • the service providing unit reads the pre-stored picture or video taken at a maximum distance set for each time unit of the preset album generation criterion and displays the read picture or video at the time. Can be grouped by unit.
  • the service provider may collect the pictures or videos having similar location information and group them by location using location information included in the meta information of the read pictures or videos. have.
  • the service provider may set the first or last picture taken among the pictures or videos included in each group as the representative picture.
  • a terminal device for achieving the above object, the communication unit for performing a communication for generating a location-based album in conjunction with the service device via a communication network; Functionally connected with the communication unit, to execute the application for generating the album received from the service device, to form a group by dividing the pictures or videos taken by the user according to a preset album generation criteria, and to position each formed group
  • a controller configured to select one or more representative pictures or videos at the determined location and automatically generate an album using the selected representative pictures or videos;
  • an output unit configured to output the generated album to an execution screen under the control of the controller.
  • the control unit forms the respective groups by time or location, and analyzes the background image of the pictures or videos stored in each of the formed groups to extract the extracted region information. It may be transmitted to a service device, receive map information corresponding to local information from the service device, map the received map information with a picture or video corresponding to the analyzed background image, and store the received map information in a corresponding group.
  • the control unit by selecting a representative picture or video in sequence according to the shooting time of the pictures or videos included in each group at a predetermined period of the selected representative for each group
  • the album may be automatically generated using a photo, and the selected representative photo or video may be changed at the predetermined period and output when the album is output.
  • the controller may select one or more representative pictures in consideration of one or more of contrast, resolution, brightness, focus, and size of the pictures or videos included in each group. have.
  • the control unit by selecting a representative picture or video in sequence according to the shooting time of the pictures or videos included in each group at a predetermined period of the selected representative for each group
  • the album may be automatically generated using a photo, and the selected representative photo may be changed and output at the preset period when the album is output.
  • the control unit receives map information corresponding to the determined location information of each group from the service device, and is generated as a representative picture or video selected from each group.
  • the selected representative picture may be controlled to be mapped with the map information and output.
  • the terminal device In the terminal device according to the preferred embodiment of the present invention, if the user selects any one representative picture or video from the album output on the execution screen, all the pictures included in the selected representative picture or video group or The video may be controlled to be output on the execution screen.
  • the terminal device if the user selects any one representative picture or video from the album output on the execution screen, all the pictures included in the selected representative picture or video group or The video may be controlled to be output on the execution screen together with the map information.
  • Mobile service system for achieving the object as described above, form a group by dividing the pictures or videos taken by the user according to a preset album generation criteria, and position each group formed A service device for selecting one or more representative pictures or videos at the determined location and automatically generating an album using the selected representative pictures or videos; And a terminal device for communicating with the service device through a communication network, receiving an album generation generated from the service device, and outputting the received album to an execution screen.
  • the service device searches the map information corresponding to the information on the determined position, and outputs the searched map information together when outputting the generated album.
  • a group is formed by dividing a photo or video taken by a terminal device according to a preset album generation criterion. Doing; Determining one or more representative pictures or videos at the determined location by determining a location for each formed group; Automatically generating an album using the selected representative picture or video; And providing the generated album to the terminal device.
  • a location-based album generation method in a terminal device for achieving the above object, comprising: receiving and installing and storing an application for creating an album from a service device through a communication network; Executing the application for creating an album to form one or more groups according to preset album creation criteria; When the user takes a picture or video, dividing the taken picture or video according to a preset album generation criterion and storing the picture or video in a corresponding group; When the photographing is completed, determining a location for each group; Selecting at least one representative picture or video at a location determined for each group; Automatically generating an album by using the selected representative picture or video, and outputting the representative picture or video included in the generated album on the execution screen for each time or location.
  • Location-based album generation method in a terminal device for achieving the object as described above, the step of receiving and installing an application for creating an album from the service device via a communication network; Photographing and storing pictures or videos by a user; Reading the stored pictures or videos according to a preset album generation standard by executing the application for creating an album; Grouping the read photographs or videos into groups; Determining a location using meta information of each group of pictures or videos; Selecting at least one representative picture or video at the determined location; Automatically generating an album using the selected representative picture or video; And outputting representative pictures or videos included in the generated album on an execution screen by time or location.
  • a program for executing a location-based album generation method is recorded.
  • the present invention forms a group of photographs or videos taken by time or by location to determine a location for each group, and thus, based on location without using a user's separate operation using one or more representative pictures or videos selected from the determined location. Since one album can be automatically generated, the created album can easily check the photos of the identified locations by time and can provide an album that the user can use more conveniently.
  • FIG. 1 is a diagram illustrating a configuration of a mobile service system according to embodiments of the present invention.
  • FIG. 2 is a diagram illustrating a configuration of a terminal device in a mobile service system according to embodiments of the present invention.
  • FIG. 3 is a diagram illustrating a configuration of a service apparatus in a mobile service system according to embodiments of the present invention.
  • FIG. 4 is a diagram illustrating a method for creating a location-based album in a service device according to a first embodiment of the present invention.
  • FIG. 5 is a diagram illustrating a method for generating a location-based album in a terminal device according to a second embodiment of the present invention.
  • FIG. 6 is a diagram illustrating a method for generating a location-based album in a terminal device according to a third embodiment of the present invention.
  • FIG. 7 is a diagram illustrating an example of a time and a location set to determine the location of pictures of each group according to embodiments of the present invention.
  • FIG. 8 is a diagram illustrating an example of dividing photographed pictures by time according to embodiments of the present invention.
  • FIG. 9 is a diagram illustrating an example of dividing pictures taken by time and space according to embodiments of the present invention.
  • 10 to 13 are diagrams showing screen examples for showing albums created according to embodiments of the present invention.
  • FIG. 1 is a diagram illustrating a configuration of a mobile service system according to embodiments of the present invention.
  • the mobile service system may include one or more terminal devices 100 and a service device 200 connected through a communication network 10.
  • the terminal device 100 refers to a terminal capable of transmitting and receiving various data via the communication network 10 according to a user's key manipulation, and may be a tablet PC, a laptop, or a personal computer. ), A smart phone, a personal digital assistant (PDA), a smart TV, and a mobile communication terminal (Mobile Communication Terminal).
  • PDA personal digital assistant
  • Mobile Communication Terminal Mobile Communication Terminal
  • the terminal device 100 is a terminal for performing voice or data communication using the communication network 10, and stores a browser, a program, and a protocol for communicating with the service device 200 via the communication network 10. It refers to a terminal having a microprocessor for operating and controlling various programs. That is, the terminal device 100 can perform server-client communication with the service device 200, and any terminal can be used as long as it can execute a messenger service, and all communication computing devices such as a notebook computer, a mobile communication terminal, and a PDA can be used. It is a broad concept to include.
  • the terminal device 100 is preferably manufactured in the form having a touch screen, but is not necessarily limited thereto.
  • the terminal device 100 performs communication for a mobile service by interworking with the service device 200 through the communication network 10, and is automatically generated from the service device 200.
  • the album can be received and the received album can be output to the execution screen.
  • the terminal device 100 may receive and install and store an application for generating a mobile service, in particular, a location-based album, from the service device 200.
  • the terminal device 100 may execute an application for creating an album, and form a group by dividing a photo or video taken by the user according to a preset album generation criterion.
  • the terminal device 100 may determine a location for each formed group, select one or more representative pictures or videos at the determined location, and automatically generate an album using the selected pictures or videos. Can be displayed on the execution screen.
  • the service device 200 receives and stores a picture or video taken from one or more terminal devices 100 through a communication network, and uses a location-based album by using the picture or video. Can be generated automatically.
  • the service apparatus 200 forms a group by dividing the photographed photos or videos according to a preset album generation criterion, and selects one or more representative photos or videos at the determined position by determining a position for each formed group.
  • the album may be automatically generated using the selected representative picture or video.
  • the service device 200 may be a related program for generating a mobile service, in particular, a location-based album, by interworking with one or more terminal devices 100 through a communication network 10. You can provide an application.
  • the service device 200 receives the information on the determined location of each group from the terminal device 100, the service device 200 searches for map information corresponding to the received determined location information, and outputs the generated map information to the generated album. It may be provided to the terminal device 100 to output the time together.
  • the terminal device 100 and the service device 200 are interworked through the communication network 10.
  • the communication network 10 uses an internet protocol using various wired / wireless communication technologies such as an internet network, an intranet network, a mobile communication network, and a satellite communication network.
  • the communication network 10 is combined with the service device 200 to store computing resources such as hardware and software.
  • Such a communication network 10 is not only an open network such as a local area network (LAN), a wide area network (WAN), an open network such as the Internet, but also code division multiple access (CDMA) and wideband code division (WCDMA). It is a concept that collectively refers to networks such as Multiple Access (GSM), Global System for Mobile Communications (GSM), Long Term Evolution (LTE), and Evolved Packet Core (EPC), as well as next-generation networks and computing networks to be implemented.
  • GSM Multiple Access
  • GSM Global System for Mobile Communications
  • LTE Long Term Evolution
  • EPC Evolved Packet Core
  • FIG. 2 is a diagram illustrating a configuration of a terminal device in a mobile service system according to embodiments of the present invention.
  • the terminal device 100 may include a control unit 110, an input unit 120, a communication unit 130, a storage unit 140, an output unit 150, and a photographing unit 160. have.
  • the controller 110 performs overall control of the terminal device 100, and in particular, may control related operations for generating and providing a mobile service and a location-based album.
  • the controller 110 may include a service execution module 111 for providing a location-based album to a user or generating a location-based album.
  • the service execution module 111 is functionally connected with the communication unit 120, after installing an application for executing a location-based album received from the service device 200, the communication network 10.
  • an application for executing a location-based album received from the service device 200
  • the communication network 10 By interworking with the service device through a mobile service for creating and providing albums can be executed at the request of the user.
  • the service execution module 111 transmits a picture or video taken by the service device 100 and automatically generates the picture or video by using the picture or video taken from the service device 200.
  • the created album can be output by time and location on the execution screen.
  • the service execution module 111 installs and stores an application for creating an album received from the service device 200 and an application for creating an album according to a user's request. You can run
  • the service execution module 111 forms a group by dividing the photos or videos taken by the user according to a preset album generation criterion, and determines a location for each formed group to display one or more representative pictures or videos at the determined location.
  • the album can be automatically created using the selected photo or video.
  • the service execution module 111 sets the album generation criteria in advance in consideration of the time and location for generating the album, and sets the group according to the set album generation criteria. It can be controlled to store the captured photo or video in the set group.
  • the service execution module 111 sets a period and time zone for creating an album, a predetermined time unit for forming a group, and sets a maximum distance that a user can move in a predetermined predetermined time unit to preview the album creation criteria. Can be set. For example, when the user sets the photo or video taken from 11:30 to 12:00 on a specific day as an album through the setting window, as shown in FIG. 7, the service execution module 111 is attached.
  • a predetermined time unit for example, 10 minutes
  • t1, t2, t3 may set the maximum distance (1km, 2km 3km) the user can move in a certain time unit in consideration of the walking or moving means.
  • the radius up to the maximum distance that can be moved in a predetermined time unit may be set to R1, R2, and R3.
  • the service execution module 111 may classify the photographed pictures or videos by a predetermined time unit of the album creation standard and store the divided pictures or videos in a group set by the predetermined time unit.
  • the service execution module 111 includes three pictures or videos taken at the starting point s (11:30) and t1 (11:31 to 11:40) time.
  • the service execution module 111 includes three pictures or videos taken at the starting point s (11:30) and t1 (11:31 to 11:40) time.
  • t1 11:31 to 11:40
  • the service execution module 111 includes three pictures or videos taken at the starting point s (11:30) and t1 (11:31 to 11:40) time.
  • t1 group save 4 photos or videos taken at t2 (11:41-11:50) time to the t2 group, and 3 photos taken at t3 (11:51-12:00) Or you can save the video to t3 group.
  • the service execution module 111 may classify and store the pictures or videos stored in each group in a predetermined time unit by the photographed location. For example, as shown in FIG. 9, the service execution module 111 may find similar regions for each of R1, R2, and R3 according to the maximum distance in the t1, t2, and t3 groups, and classify the photographed pictures or videos again. have.
  • the service execution module 111 extracts region information by analyzing a background image of a photo or a video in each group to collect photos of similar regions in each group of a predetermined time unit, and photographs using the extracted region information. Location can be identified. To this end, the service execution module 111 extracts text, landmarks, and voice information representing an area from the analyzed background image as area information, and transmits the extracted area information to the service device 200, and the service device 200. ), Map information corresponding to the local information can be received. Accordingly, the service execution module 111 may determine the location of each group by using each region information mapped to the map information. In addition, the service execution module 111 maps the received map information to a photo or video corresponding to the analyzed background image and stores the same in a group, and then displays the representative photo or video included in the album together with the map information when the album is output. can do.
  • the service execution module 111 analyzes the background images of the taken pictures or videos included in each group, searches for pre-stored pictures or videos including images similar to the analyzed background images, and searches for one or more pictures or videos.
  • the location information may be used to determine the location of each group.
  • the service execution module 111 executes the application in order to create a pre-stored photo or video before executing the application, the pre-stored photo according to a preset album generation criteria
  • the read out videos may be classified by grouping the read pictures or videos.
  • the service execution module 111 determines the location using meta information of each group of pictures or videos, selects one or more representative pictures at the location determined for each group, and automatically uses the set representative picture. You can create an album.
  • the service execution module 111 may read the pre-stored pictures or videos taken at the maximum distance set for each time unit of the preset album generation criterion and group the read pictures or videos by time units.
  • the service execution module 111 may collect pictures or videos having similar location information and group them by location using location information included in meta information of the read pictures or videos.
  • the service execution module 111 may set the first or last picture taken among the pictures or videos included in each group as the representative picture.
  • the service execution module 111 may select one or more representative pictures in consideration of one or more of contrast, resolution, brightness, focus, and size of the pictures or videos included in each group.
  • the representative photo or video of each group may be set in various ways.
  • the service execution module 111 may receive map information corresponding to the determined location information of each group from the service device 200 and map and store the map information in each group. .
  • the service execution module 111 outputs a map according to map information on an execution screen when outputting an album generated from a representative picture or a video set in each group, and outputs the set representative picture to a location corresponding to mapped map information. Can be controlled.
  • the service execution module 111 according to the embodiments of the present invention searches for a location in the navigation with the determined location information of each group in association with the navigation function and outputs a map output according to the corresponding location on the album output screen.
  • the service execution module 111 displays the representative picture 31a of the t1 group at the corresponding location on the map.
  • the representative photo 32d of the t2 group may be displayed at the corresponding position on the map, and the representative photo 33b of the t3 group may be displayed at the corresponding position on the map.
  • the service execution module 111 selects a time from the output form menu 21, as shown in FIG. t3)
  • the representative pictures or videos 31a, 32d, and 33b set based on the position in the group may be output on the execution screen.
  • the service execution module 111 sequentially sets the representative picture or video according to the shooting time order of the pictures or videos included in each group at predetermined intervals, and for each group.
  • the album can be automatically created using the set representative photo.
  • the service execution module 111 may change the representative photo set at the time of outputting the album at a predetermined cycle and output it. For example, as shown in FIG. 11, the representative picture or video 31a, 32d, 33b currently set on the execution screen is output, and the picture or video 31a, 32d, 33b currently output in the next cycle. May be output by replacing the representative picture or video 31b, 32c, 33a set in the next cycle.
  • the service execution module 111 when the user selects any one representative picture or video 31a from the album output on the execution screen, All the pictures or videos 31a, 31b, and 31c included in the group of the selected representative picture or video 31a may be controlled to be output to the execution screen. In this case, when the representative picture or the video 31a is selected, a photographing time (11:34 am) may be displayed in one region.
  • the service execution module 111 selects any one representative picture or video 31a from the album output on the execution screen.
  • Output all pictures or videos 31a, 31b, 31c included in the group of the representative picture or video 31a together with the map information to the execution screen, that is, all pictures or videos 31a, 31b, 31c) may be controlled.
  • the communication unit 120 may communicate with the service device 200 through the communication network 10 to transmit and receive messages related to a mobile service, that is, album generation. It is possible to receive map information according to the application to be executed and the determined location information of each group.
  • the communication unit 120 may transmit and receive data through various communication methods as well as wired and wireless methods.
  • the communication unit 120 may transmit and receive data using one or more communication methods, and for this purpose, the communication unit 120 may include a plurality of communication modules that transmit and receive data according to different communication methods.
  • the input unit 130 may generate a user input signal corresponding to a user's request or information according to a user's operation, and may be implemented by various input means that are currently commercialized or that can be commercialized in the future. For example, not only a general input device such as a keyboard, a mouse, a joystick, a touch screen, a touch pad, but also a gesture input means for detecting a user's motion and generating a specific input signal, and a voice recognition means for recognizing a user's voice. It may include.
  • the input unit 130 may generate an input signal according to an execution of an application input from a user and an input signal according to a user manipulation on an album output screen.
  • the storage unit 140 stores information necessary for the operation of the terminal device 100, and in particular, an application or program for creating or executing an album received from the service device 200, each group. Map information according to the determined position information of the can be stored.
  • the storage unit 140 may store the photo or video taken by the user in the photo / video DB 140, grouping the photos or video stored in the photo / video DB 140 by time / location You can save photos or videos by each group.
  • the storage 140 may store an album created using the representative picture or video set for each group in the album DB 141.
  • the storage unit 140 may include an optical media such as a magnetic media such as a hard disk, a floppy disk, and a magnetic tape, a compact disk read only memory (CD-ROM), and a digital video disk (DVD). And magneto-optical media such as floppy disks and ROM, random access memory (RAM), and flash memory.
  • optical media such as a magnetic media such as a hard disk, a floppy disk, and a magnetic tape, a compact disk read only memory (CD-ROM), and a digital video disk (DVD).
  • magneto-optical media such as floppy disks and ROM, random access memory (RAM), and flash memory.
  • the storage 140 may store the screen image to be output to the display unit, as well as the application program required for the operation of the function according to embodiments of the present invention.
  • the storage unit 140 may store a key map or a menu map for operating the touch screen when the display unit is configured as the touch screen.
  • the key map and the menu map may be in various forms. That is, the key map may be a keyboard map, a 3 * 4 key map, a qwerty key map, or the like, or may be a control key map for operation control of an currently activated application program.
  • the menu map may be a menu map for controlling the currently running application program.
  • the storage 140 is an operating system (OS) for booting the terminal device 100 and operating the above-described components, and various user functions, for example, a user for supporting a call function of the terminal device 100.
  • OS operating system
  • MP3 user function for playing other sound sources
  • image output function for playing an image such as a photo
  • application program for supporting a video playing function, respectively.
  • the output unit 150 is a means for providing the user to recognize the operation result or state of the terminal device 100, and includes, for example, a display unit for visually outputting through a screen, a speaker for outputting an audible sound, and the like. can do.
  • the output unit 150 according to the embodiments of the present invention outputs the album generated on the application execution screen, all the pictures included in the group in the representative photo or video selected according to the user's selection signal in the output album Alternatively, the video can be output on the execution screen.
  • the output unit 150 may output a map based on map information, and output a representative photo or video included in an album created on the map.
  • the output unit 150 may output a setting screen for setting album generation criteria in advance in order to automatically generate an album.
  • the photographing unit 160 is a camera capable of capturing a picture or a video, and transmits the photographed picture or video data to the control unit 110, and meta information (size, resolution, rotation) when the picture is taken under the control of the control unit 110. , File type, focus, contrast, brightness, exposure, shooting time, etc.) may be created and transferred to the controller 110 to be tagged in the captured photo or video data.
  • FIG. 3 is a diagram illustrating a configuration of a service apparatus in a mobile service system according to embodiments of the present invention.
  • the service device 200 may include a communication unit 210, a service providing unit 220, and a storage unit 230.
  • the communication unit 210 may transmit and receive messages related to mobile service, in particular, album creation or execution, with one or more terminal devices 100 through the communication network 10.
  • the communication unit 210 may transmit and receive data through various communication methods as well as wired and wireless methods.
  • the communication unit 210 may transmit and receive data using one or more communication methods, and for this purpose, the communication unit 210 may include a plurality of communication modules that transmit and receive data according to different communication methods.
  • the service provider 220 controls an operation for a mobile service by interworking with two or more terminal devices 100 through the communication network 10, and is functionally connected to the communication unit 210.
  • the terminal device 100 may control to provide an application or a program for generating or executing an album.
  • the service provider 220 may provide the terminal device 100 to search for map information corresponding to the determined position of each group and output the searched map information together with the output of the generated album.
  • the service provider 220 controls to perform a communication for generating a location-based album in cooperation with one or more terminal devices through the communication network 10, and is taken from the terminal device Receive and save photos or videos.
  • the service provider 220 forms a group by dividing the photos or videos taken by the terminal device according to a preset album generation criterion, and positions each group. By confirming, one or more representative pictures or videos at the determined location may be selected. Accordingly, the service provider 220 may automatically generate an album using the selected representative picture or video. In this case, the service provider 220 analyzes a background image of the taken photo or video included in each group, searches for a pre-stored picture or video including an image similar to the analyzed background image, and retrieves one or more photos or videos. The location information can be estimated by comparing with the video. Accordingly, the service provider 220 determines the final location for each group by using the estimated location information.
  • the service provider 220 may provide the terminal device 100 with the album automatically generated according to the request of the terminal device 100.
  • the service provider 220 may automatically generate an album in the same manner as in the second and third embodiments of the present invention as described above.
  • the service provider 220 presets an album generation criterion in consideration of a time and a location for creating an album, sets a group according to the set album creation criterion, and assigns divided shots or videos to the corresponding group. Can be stored.
  • the service provider 220 sets a period and time zone for creating an album, a predetermined time unit for forming a group, and sets a maximum distance that a user can move in the set predetermined time unit to set the album generation criteria. Can be set in advance.
  • the service provider 220 may classify the photographed photos or videos by a predetermined time unit based on the album generation standard, and store the divided photos or videos in a group set by the predetermined time unit.
  • the service provider 220 may extract the region information by analyzing the background images of the pictures or videos stored in each group in a time unit, and determine the photographed location by using the extracted region information.
  • the service provider 220 may extract text, landmark, and voice information indicating a region from the analyzed background image as the region information.
  • the service provider 220 may classify and store the photographs or videos stored in each group of time units by the captured photographing positions.
  • the service provider 220 reads out the stored photos or videos according to a preset album generation criterion, groups the read photos or videos into groups, and determines the location by using meta information of each group of photos or videos. You may. In this case, the service provider 220 may collect the pictures or videos having similar location information by using the location information included in the meta information of the read pictures or videos and group them by location.
  • the service provider 220 selects the first or last picture taken among the pictures or videos included in each group as the representative picture, or selects the representative picture, contrast, resolution, and the like of the pictures or videos included in each group.
  • One or more representative photos may be selected in consideration of one or more of brightness, focus, and size.
  • a method of automatically grouping photographed pictures or videos for creating an album in a service device and selecting a location and a representative picture for each group are described in the second and second embodiments of the present invention. Since it is the same as the description of FIGS. 10 to 13 attached to the terminal device according to the third embodiment, a detailed description thereof will be omitted.
  • the storage unit 230 may store application and map information provided for album generation.
  • the storage unit 230 may include an optical media such as a magnetic media such as a hard disk, a floppy disk, and a magnetic tape, a compact disk read only memory (CD-ROM), and a digital video disk (DVD). And magneto-optical media such as floppy disks and ROM, random access memory (RAM), and flash memory.
  • FIG. 4 is a diagram illustrating a method for creating a location-based album in a service device according to a first embodiment of the present invention.
  • the service device 200 presets an album generation criterion for generating an album. At this time, the service device 200 sets the maximum distance (R1: 1km, R2: 2km, R3: 3km) that the user can move in the set predetermined time unit (t1, t2 t3).
  • the service device 200 may receive and store a picture or a video captured by interworking with the one or more terminal devices 100 through the communication network 10.
  • the service device 200 divides the photo or video taken by the terminal device 100 according to a preset album generation criterion to form a group by time / position.
  • the service device 200 divides the time zone of the set period into predetermined time units (for example, 10 minutes), and divides the groups t1 and t2 t3 for each divided time unit. Form.
  • the service device 200 analyzes a background image of the pictures or videos included in each group, reads out pictures or videos of similar pre-stored areas corresponding to the analyzed background image, and reads the read pictures or videos. Check the location through meta information included in the field or location information determined when creating an album. Accordingly, the service device 200 may determine the location of each group through the identified location information. For example, as shown in the accompanying FIG. 9, the first pictures 31c are taken in the actual R2 region by the location of the pictures 31a, 31b, and 31c included in the t1 group, and the second and third pictures.
  • the position of the t1 group may be determined as R1.
  • the service device 200 may determine the location of each group according to the identified location information of the representative picture set in a later step.
  • the service device 200 selects one or more representative pictures at locations determined for each group.
  • the service device 200 sets the first or last picture taken among the pictures or videos included in each group as the representative picture, or the contrast, resolution, brightness, focus, and size of the pictures or videos included in each group. Select one or more representative photos by considering one or more of them.
  • the service device 200 automatically generates and stores an album using the set representative picture.
  • the service device 200 transmits the generated album to the terminal device 100 according to the request.
  • FIG. 5 is a diagram illustrating a method for generating a location-based album in a terminal device according to a first embodiment of the present invention.
  • the terminal device 100 receives an application for generating an album from the service device 200 through the communication network 10, and installs and stores the application.
  • the terminal device 100 executes an application for creating an album according to a user's request, and sets the album generation criteria for generating an album in advance.
  • the terminal device 100 outputs an album setting screen, and sets a period and time zone for generating an album through a menu displayed on the output album setting screen.
  • the terminal device 100 divides the time zone of the set period into predetermined time units (for example, 10 minutes) and divides the groups t1 and t2 t3 for each divided time unit as shown in FIG. 7. Form.
  • the terminal device 100 sets the maximum distance (R1: 1km, R2: 2km, R3: 3km) that the user can move in the set predetermined time units t1 and t2 t3.
  • step 2103 when the user takes a picture or video, the terminal device 100 classifies the picture or video according to a preset album generation criteria and stores the picture or video in the corresponding group. For example, when the user takes a picture at the current time zone t1, the terminal device 100 stores the taken picture in the t1 group.
  • the t1 group may be regarded as being photographed within a radius R1, and since the t1 group is different from the actual photographing position, the detailed position information may be checked through the position information when the meta information of the photographed photo includes the position information, or the position At the time of confirmation, it can be identified through pre-stored pictures or videos of similar areas.
  • steps 2104 to 2105 operate in the same manner as steps 1104 to 1106 as described above, a detailed description thereof will be omitted.
  • the terminal device 100 outputs the generated album to an execution screen.
  • FIG. 6 is a diagram illustrating a method for generating a location-based album in a terminal device according to a third embodiment of the present invention.
  • the terminal device 100 stores a picture or a video captured by a user.
  • the terminal device 100 receives and installs and stores an application for creating an album from the service device 200 through the communication network 10 to automatically generate an album based on the location.
  • the terminal device 100 executes an application according to a user's request in step 3102, the terminal device 100 reads a pre-stored picture or video according to a preset album generation standard in step 3103.
  • step 3104 the terminal device 100 forms a group by time / position by dividing the read picture or video into groups.
  • step 3105 the terminal device 100 determines the location using meta information of the pictures or videos of each group, and sets one or more representative pictures or videos of the location determined for each group in step 2106.
  • step 3107 the terminal device 100 automatically generates and stores an album using the set representative picture, and then outputs the album generated in step 3108 to the execution screen.
  • the present invention may form a group by dividing a photographed picture or a video by time / position even without a separate operation of a user, and automatically generate an album based on the position of each formed group.
  • the program instructions to be recorded may be those specially designed and constructed for the present invention, or may be known and available to those skilled in computer software.
  • the recording medium may be magnetic media such as hard disks, floppy disks and magnetic tapes, optical disks such as Compact Disk Read Only Memory (CD-ROM), digital video disks (DVD), Magnetic-Optical Media, such as floppy disks, and hardware devices specially configured to store and execute program instructions, such as ROM, random access memory (RAM), flash memory, and the like. do.
  • Examples of program instructions may include high-level language code that can be executed by a computer using an interpreter as well as machine code such as produced by a compiler.
  • Such hardware devices may be configured to operate as one or more software modules to perform the operations of the present invention, and vice versa.
  • a computer program (also known as a program, software, software application, script or code) mounted on an apparatus according to the invention and executing a method according to the invention comprises a compiled or interpreted language or a priori or procedural language. It can be written in any form of programming language, and can be deployed in any form, including stand-alone programs or modules, components, subroutines, or other units suitable for use in a computer environment. Computer programs do not necessarily correspond to files in the file system.
  • a program may be in a single file provided to the requested program, in multiple interactive files (eg, a file that stores one or more modules, subprograms, or parts of code), or part of a file that holds other programs or data. (Eg, one or more scripts stored in a markup language document).
  • the computer program may be deployed to run on a single computer or on multiple computers located at one site or distributed across multiple sites and interconnected by a communication network.
  • the present invention relates to a mobile service system, a method and apparatus for creating a location-based album in the system.
  • a mobile service system By using one or more representative photos or videos, you can automatically create albums based on location without any user interaction, and the created albums make it easy to check the photos in the location identified by time. There is an effect that can provide an album that can be used.
  • the present invention has industrial applicability because the present invention is not only sufficiently commercially available or commercially viable, but also practically clearly implemented.

Abstract

La présente invention concerne un système de service mobile, et une méthode et un dispositif de production d'un album basé sur l'emplacement dans le système. La présente invention peut former des groupes en classifiant des images ou des vidéos en fonction de critères de production d'album prédéterminés, déterminer un emplacement pour chacun des groupes formés, puis sélectionner une ou plusieurs images ou vidéos représentatives à l'emplacement déterminé, et produire automatiquement un album en utilisant les images ou vidéos représentatives sélectionnées, ce qui produit automatiquement un album basé sur l'emplacement sans opération séparée d'un utilisateur. Par conséquent, la présente invention permet à un utilisateur d'identifier de façon simple et pratique des images d'emplacements identifiés en fonction du temps grâce à l'album produit, et peut fournir un album qu'un utilisateur peut utiliser de façon plus commode.
PCT/KR2015/000657 2014-03-25 2015-01-22 Système de service mobile, et méthode et dispositif de production d'album basé sur l'emplacement dans le même système WO2015147437A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR10-2014-0034925 2014-03-25
KR1020140034925A KR20150111552A (ko) 2014-03-25 2014-03-25 모바일 서비스 시스템, 그 시스템에서의 위치 기반 앨범 생성 방법 및 장치

Publications (1)

Publication Number Publication Date
WO2015147437A1 true WO2015147437A1 (fr) 2015-10-01

Family

ID=54195904

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2015/000657 WO2015147437A1 (fr) 2014-03-25 2015-01-22 Système de service mobile, et méthode et dispositif de production d'album basé sur l'emplacement dans le même système

Country Status (2)

Country Link
KR (1) KR20150111552A (fr)
WO (1) WO2015147437A1 (fr)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170192625A1 (en) * 2015-12-31 2017-07-06 Young Kim Data managing and providing method and system for the same
CN114500874A (zh) * 2020-10-26 2022-05-13 蘑菇车联信息科技有限公司 一种生成相册的方法及电子设备
CN114584716A (zh) * 2022-03-08 2022-06-03 北京字跳网络技术有限公司 图片处理方法、装置、设备及存储介质

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20190115930A (ko) * 2018-04-04 2019-10-14 네이버 주식회사 이미지 검색 방법, 장치 및 컴퓨터 프로그램
KR20200101036A (ko) 2019-02-19 2020-08-27 삼성전자주식회사 이미지와 관련된 콘텐트를 어플리케이션에 제공하는 전자 장치 및 방법
US11115597B2 (en) 2019-02-20 2021-09-07 Lg Electronics Inc. Mobile terminal having first and second AI agents interworking with a specific application on the mobile terminal to return search results
WO2020171295A1 (fr) * 2019-02-20 2020-08-27 엘지전자 주식회사 Terminal mobile et procédé de commande correspondant
KR102130448B1 (ko) * 2020-02-11 2020-07-07 네이버 주식회사 이미지 검색 방법, 장치 및 컴퓨터 프로그램

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004221647A (ja) * 2003-01-09 2004-08-05 Fuji Photo Film Co Ltd 旅行アルバム作成方法および装置並びにプログラム
KR20060029908A (ko) * 2004-10-04 2006-04-07 엘지전자 주식회사 위치 정보를 이용한 이동 통신 단말기의 앨범 표현 방법
KR100692792B1 (ko) * 2006-03-10 2007-03-12 에스케이 텔레콤주식회사 위치기반 멀티미디어 데이터를 이용하는 위치기반 서비스시스템 및 방법과 이에 적용되는 이동통신 단말
KR20070039795A (ko) * 2005-10-10 2007-04-13 삼성전자주식회사 사진 분류 방법 및 장치
KR20130026541A (ko) * 2011-07-20 2013-03-14 엔에이치엔(주) 영상을 앨범 단위로 관리 및 공유하는 시스템 및 방법

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004221647A (ja) * 2003-01-09 2004-08-05 Fuji Photo Film Co Ltd 旅行アルバム作成方法および装置並びにプログラム
KR20060029908A (ko) * 2004-10-04 2006-04-07 엘지전자 주식회사 위치 정보를 이용한 이동 통신 단말기의 앨범 표현 방법
KR20070039795A (ko) * 2005-10-10 2007-04-13 삼성전자주식회사 사진 분류 방법 및 장치
KR100692792B1 (ko) * 2006-03-10 2007-03-12 에스케이 텔레콤주식회사 위치기반 멀티미디어 데이터를 이용하는 위치기반 서비스시스템 및 방법과 이에 적용되는 이동통신 단말
KR20130026541A (ko) * 2011-07-20 2013-03-14 엔에이치엔(주) 영상을 앨범 단위로 관리 및 공유하는 시스템 및 방법

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170192625A1 (en) * 2015-12-31 2017-07-06 Young Kim Data managing and providing method and system for the same
CN114500874A (zh) * 2020-10-26 2022-05-13 蘑菇车联信息科技有限公司 一种生成相册的方法及电子设备
CN114584716A (zh) * 2022-03-08 2022-06-03 北京字跳网络技术有限公司 图片处理方法、装置、设备及存储介质

Also Published As

Publication number Publication date
KR20150111552A (ko) 2015-10-06

Similar Documents

Publication Publication Date Title
WO2015147437A1 (fr) Système de service mobile, et méthode et dispositif de production d'album basé sur l'emplacement dans le même système
WO2013141630A1 (fr) Terminal de communication mobile et procédé de recommandation d'une application ou d'un contenu
WO2013118988A1 (fr) Procédé et appareil pour effectuer des services de manière opérationnelle et système le prenant en charge
WO2013103275A1 (fr) Procédé et appareil pour mettre en œuvre un système multi-vision par utilisation de multiples terminaux portables
WO2019093744A1 (fr) Appareil d'affichage et procédé de commande correspondant
WO2012128538A2 (fr) Système de traitement de code d'identification, son procédé et appareil permettant de les prendre en charge
WO2015005732A1 (fr) Procédé de partage de document électronique et dispositifs à cet effet
WO2014069943A1 (fr) Procédé de fourniture d'informations d'intérêt pour les utilisateurs lors d'un appel vidéo, et appareil électronique associé
WO2015076537A1 (fr) Procédé de fourniture de vidéo, et système de fourniture de vidéo
WO2012093839A2 (fr) Procédé et appareil destinés à collecter un contenu
WO2015126060A1 (fr) Dispositif électronique et procédé de traitement d'image
WO2013077643A1 (fr) Appareil et procédé pour la fourniture d'un service de réalité augmentée destiné à un terminal mobile
US20140082465A1 (en) Method and apparatus for generating immersive-media, mobile terminal using the same
WO2019132306A1 (fr) Dispositif électronique permettant de relier de la musique à une photographie et son procédé de commande
WO2017138766A1 (fr) Procédé de regroupement d'image à base hybride et serveur de fonctionnement associé
WO2021167374A1 (fr) Dispositif de recherche vidéo et système de caméra de surveillance de réseau le comprenant
WO2020085675A1 (fr) Serveur, terminal et procédé de fourniture de contenu
WO2013081405A1 (fr) Procédé et dispositif destinés à fournir des informations
WO2014107025A1 (fr) Procédé et appareil permettant de commander des contenus dans un dispositif électronique
WO2016195219A1 (fr) Dispositif d'affichage et son procédé de commande
WO2020116960A1 (fr) Dispositif électronique servant à générer une vidéo comprenant des caractères et procédé associé
WO2015041402A1 (fr) Appareil d'affichage d'image, son procédé de commande, et procédé d'affichage d'image
WO2014061905A1 (fr) Système permettant d'obtenir un signet basé sur le mouvement et la voix, et procédé s'y rapportant
WO2018056587A1 (fr) Appareil électronique et son procédé de commande
WO2020045909A1 (fr) Appareil et procédé pour logiciel intégré d'interface utilisateur pour sélection multiple et fonctionnement d'informations segmentées non consécutives

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15767689

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 15767689

Country of ref document: EP

Kind code of ref document: A1