KR102256640B1 - A system and method for finding the senior memories - Google Patents

Abstract

The present invention relates to a system and method for finding senior memories, and more particularly, in order to provide 2D or 3D memory contents suitable for the emotion of a logged-in user in real time, technical limitations and legal restrictions such as portrait rights are difficult to find in the case of old contents. Data uploaded by all people, data stored in existing media or region, and characteristics of the requestor are converted into a DB to help the seniors' memories trip more easily by overcoming the limitation, and based on the DB above, the request of general users According to the requester's characteristics, features are extracted, and related contents are provided by classifying and presenting the memory space content information generated according to the feature extraction, and rewards or points are accumulated when uploading contents held by general users. It relates to a system and method of finding.

Description

A system and method for finding the senior memories}

The present invention relates to a system and method for finding senior memories, and more particularly, in order to provide 2D or 3D memory contents suitable for the emotion of a logged-in user in real time, technical limitations and legal restrictions such as portrait rights are difficult to find in the case of old contents. Data uploaded by all people, data stored in existing media or region, and characteristics of the requestor are converted into a DB to help the seniors' memories trip more easily by overcoming the limitation, and based on the DB above, the request of general users According to the requester's characteristics, features are extracted, and related contents are provided by classifying and presenting the memory space content information generated according to the feature extraction, and rewards or points are accumulated when uploading contents held by general users. It relates to a system and method of finding.

In order to explain the background in which the present invention was born, it will be described centering on the protagonist we often see around.

Whether the protagonist (user or person) is an elderly or young person, everyone will have memories, and those memories exist as records or data on economy/society/politics/culture, including hometown/school life/scenery of that era, etc. .

So, when you want to recall a specific memory, it is a system that allows you to use your personal terminal anytime, anywhere.

For this, first, the information related to the person must be classified (eg, from whether the hometown is rural or urban, to the city name in more detail), and the social situation and news of that era must be organized, and landscapes by year or year, etc. Data should be organized.

In organizing such data, Google and Naver currently provide individual photo management functions, and many other information such as landscapes are in possession, but there is no detailed function of classifying the data as related to me.

Therefore, since there is no function to find and classify features in the past, it is a function to reclassify the previously performed classification data into characteristics related to the person by applying artificial intelligence technology, and based on this function, it is possible to recall the past by showing the data by classification desired by the person. In addition to the existing data, there is a need for a system that helps social networks or users to collect more data by uploading related data.

On the other hand, in general, memory (追憶) refers to thinking or thinking in retrospect, or the idea or abstraction.

In other words, it refers to reminiscent of events in the past that came today, and that old memory, but it is often used as a term to refer to a special and impressive memory in the past.

However, it is very difficult for a person to reminisce about old events or circumstances that have passed 40-50 years or more due to the limitation of memory without a specific opportunity or motive.

That's why many people prepared albums offline or managed photos online and brought them out when needed.

Nevertheless, people's requests for a complete memory experience have been constantly, and new services are provided based on media technology based on image processing technology that has recently been developed.

Through the service that shows the appearance of the surrounding streets provided by the conventional Google, many people can find directions (roadside) and check (current) buildings, and if desired, they can go back to the photos of the past and find the houses or buildings that have disappeared from the place. Provide services to help.

However, in the case of such a service to find the surrounding streets (street view), only photos from a very short time (e.g., 4 to 5 years) can be provided, and even those are provided only in large cities, which contains memories of seniors. It is very difficult to find the state of the rural area (related to the senior or user as well as the rural).

In particular, there were many cases where the portrait rights or the date taken of the individual's own photos were not accurate, so even though they wanted to share them with others, even if they lived in the same village, they couldn't even try to share them if they lived in other places for a long time or did not know. There were many.

Korean Patent Publication No. 2012-0030789 Korean Patent Publication No. 2015-0135747 Korean Patent Registration No. 1565734 Korean Patent Publication No. 2015-0135747

The present invention has been made to solve the above problems, reclassifying a plurality of data into characteristics related to the person using artificial intelligence technology (feature extraction), and showing the data by classification desired by the person based on this The purpose is to provide a management system that enables users to recall and collect more data by uploading related data in addition to existing data by social networks or users of this system.

In addition, in order to provide 2D or 3D memory content in real time, the present invention solves technical limitations that are difficult to find in the case of old content through external servers and government office servers, and solves legal restrictions such as portrait rights through image processing algorithms, etc. The purpose is to provide a data-based memory management system.

In addition, the present invention is to log in through the user terminal (by accessing the server) and download the memory space content information after paying the cost, and pay points accordingly, and when the visual information is omitted from the memory space content information, the related memory space An object of the present invention is to provide a big data-based memory management system that can provide various services such as controlling to infer time information through content information.

In order to solve the above problems, the present invention includes the steps of converting data uploaded by all people, data stored in existing media companies or regions, and requestor characteristics into a DB; Extracting a feature suitable for a requestor's characteristics at the request of general users based on the DB; Providing related contents by classifying and presenting information on memory space contents generated according to the feature extraction; And accumulating rewards or points when uploading the contents of the general users.

In addition, the present invention is a senior memory search method for transmitting and receiving memory space content information including an old photo or street view, through a user terminal, search and download memory space content information processed by the central processing unit through a network connection with an external server. Requesting to receive; The central processing unit classifies and processes contents related to the requestor among contents stored in the DB according to the download request; Transmitting or receiving related memory space content information through a communication unit; Saving the login information and logging in through the user terminal, uploading the memory space content information, or paying for it, and then downloading and paying or deducting points.

The present invention includes the steps of extracting only a background from the memory spatial content information and deleting the remaining information through a background unit; And arranging the memory space content information in chronological order through a time line unit.

The present invention further includes a step of controlling to infer time information through mutual comparison of related memory spatial content information when visual information is omitted.

The present invention is connected to an external server through a network, the communication unit for transmitting and receiving memory space content information; It manages the memory space content information received from the communication unit, transmits the memory space content information stored in the DB through the communication unit, stores the login information, logs in through the user terminal, and pays for the memory space content information. After downloading, paying points accordingly, deleting the portrait rights violation information from the memory space content information, and controlling to infer time information through the related memory space content information when visual information is omitted from the memory space content information Processing unit; A DB providing memory space content information according to the request of the central processing unit; And a user terminal that retrieves and downloads memory space content information processed by the central processing unit.

The central processing unit may include a display unit for displaying the memory space content information on the user terminal; A payment unit that manages payment of expenses through the user terminal; An input unit for inputting search information of the memory space content information through the user terminal; A download/upload unit for transmitting a request for permission to download the memory space content information through the user terminal; A background unit that extracts only a background from the memory spatial content information and deletes the remaining information; A timeline unit that arranges the memory space content information in chronological order; A point unit that manages payment, deduction, or payment of points; A search unit for searching information in the DB according to a search request from the user terminal; is connected.

Through the communication unit, the central processing unit may include a regional administrative jurisdiction server for managing and storing memory space content information of a specific region; It is connected to a town hall server that manages and stores memory space content information of a specific village.

The central processing unit may include a 2D module for managing and editing information corresponding to a 2D image among the memory spatial content information; A 3D module for managing and editing information corresponding to a 3D image among the memory space content information is further connected.

It is connected to an external social network server that transmits pre-stored memory space content information upon request of the user terminal.

A virtuous cycle is possible in which more data can be collected and disclosed by uploading related data of social networks or users in addition to the existing data that enables the recollection of the past by classifying a plurality of data as described above.

In addition, the present invention has a detailed function of classifying data related to me and a function of reclassifying data by classification into characteristics related to the person, so that the accuracy and convenience of classification can be improved.

In addition, the present invention has an effect of improving the usability of a user who uses the content because it is possible to provide memory content suitable for the user's emotion in real time.

In addition, the present invention makes it possible to promote the memory activity of each user embedded in the spatial information created by a plurality of people even 40 to 50 years ago, thereby allowing users to recall their past more dramatic and three-dimensional memories. Can stimulate.

In addition, the present invention can continuously consume customized spatial information memory content according to a region that is highly related to a life story in which the person has lived, regardless of time and place.

In addition, the present invention provides points to the uploader in order to quickly secure a large amount of memory content, and automatically pays the license fee to the competent authority that manages the memory space content information of a specific region, thereby improving the convenience of the administrator. There is.

In addition, the present invention can maintain the continuity of the business model by solving legal problems that may occur while consuming customized memory content.

1A and 1B are diagrams showing the overall configuration of a system for finding senior memories according to an embodiment of the present invention.
2 is a diagram showing a typical operation process of the senior memory search system according to an embodiment of the present invention.
3 is a diagram showing a detailed configuration of a system for finding senior memories according to an embodiment of the present invention.
4 is a diagram showing a detailed configuration of a system for finding senior memories according to another embodiment of the present invention.
5 is a flowchart of points and the like according to another embodiment of the present invention.
6 is a flow chart of measures for violating portrait rights according to another embodiment of the present invention.
7 is a flowchart of a time line and the like according to another embodiment of the present invention.

In order to fully understand the present invention, preferred embodiments of the present invention will be described with reference to the accompanying drawings. The embodiments of the present invention may be modified in various forms, and the scope of the present invention should not be construed as being limited to the embodiments described in detail below. This embodiment is provided to more completely explain the present invention to those of ordinary skill in the art. Accordingly, the shape of the element in the drawings may be exaggerated to emphasize a clearer description. It should be noted that in each drawing, the same member may be indicated by the same reference numeral. In addition, detailed descriptions of known functions and configurations that are determined to unnecessarily obscure the subject matter of the present invention will be omitted.

1A, the central processing unit 100 according to the present invention includes a personal content unit 105, an artificial intelligence unit 106, a photo classification module 107, a photo search module 108, and the like.

The photo classification module 107 is a module responsible for classifying photo information (content) related to the user himself. It is a module that organizes and categorizes news, etc.

That is, the photo classification module 107 has a classification algorithm (for example, a deep learning face recognition algorithm, a background recognition algorithm, etc.) that automatically classifies data related to the user without manually classifying them.

The photo search module 108 is a module capable of searching the contents classified through the photo classification module 107 by city name, year or year.

For example, the user can enter the year of interest to a specific year by entering numbers or moving the mouse.

The artificial intelligence unit 106 has a function of re-classifying the classified data previously performed by applying artificial intelligence technology to the photograph classification operation through the photo classification module 107 as a characteristic related to the person.

For example, an extension network algorithm (Augmentation Network) that receives multiple images and expands the data into an image that can be easily classified in the convolutional neural network processing unit is used, and a new image generated in the data expansion unit is re-convolutional neural network. It can be reclassified using the network model.

The personal content unit 105 has a function of helping social networks or users upload related data in addition to existing data.

1B, the present invention includes a display unit 140, a payment unit 150, an input unit 160, a download/upload unit 141, a background unit 142, a timeline unit 143, and a point unit ( The central processing unit 100, which is electrically connected to the 151, the search unit 161, and the like, and the communication unit 101, the DB 130, the user terminal 500, and the like are electrically connected to each other through a network.

The communication unit 101 is a device that is connected to an external server through a network to transmit and receive memory space content information.

The communication unit 101 may transmit data to an external device or receive data from an external device using a wired/wireless communication module supporting wired/wireless communication technology. Here, the wired communication technology may include USB (Universal Serial Bus) communication, and the wireless communication technology is a wireless LAN (WLAN), a Wi-Fi, a wireless broadband (Wibro), and a WiMAX. (World Interoperability for Microwave Access; Wimax), High Speed Downlink Packet Access (HSDPA), IEEE 802.16, Long Term Evolution (LTE), Wireless Mobile Broadband Service (WMBS) ) And the like.

3 and 4, the central processing unit 100 uses the communication unit 101 to store the memory space content information stored in the DB 130 in order to manage the memory space content information received from the communication unit 101. After sending through, storing the login information, logging in through the user terminal 500, paying for the memory space content information, downloading, and paying points accordingly.

If you can see the memory space content information uploaded by yourself according to the login information, you can view only the contents that have been converted to full disclosure in the case of the memory space content information uploaded by others, and in the case of downloading, you are encouraged to pay with points or the like.

In addition, the central processing unit 100 is a device that deletes portrait rights violation information from the memory space content information, and controls to infer time information through related memory space content information when visual information is omitted from the memory space content information.

The DB 130 is a server that provides information on memory space contents classified according to log-in information, etc. at the request of the central processing unit 100.

The user terminal 500 is a terminal that searches and downloads memory space content information processed by the central processing unit 100.

The central processing unit 100 includes a display unit 140 for displaying the memory space content information on the user terminal 500 on an external display device such as a display device, and a payment for managing online payment through the user terminal 500 The unit 150, an input unit 160 for inputting search information of the memory space content information through the user terminal 500, and request permission to download or upload the memory space content information through the user terminal 500 It can be processed by being connected to the download/upload unit 141 that transmits or blocks the data.

In addition, the central processing unit 100 includes a background unit 142 that extracts only a necessary background from the memory space content information and deletes the remaining information (person's portrait right information), and a timeline unit that arranges the memory space content information in chronological order. (143) may be included. When the background unit 142 requests the timeline unit 143 to determine a time, the timeline unit 143 stores the time in the DB after the time determination is completed, and the central processing unit 100 Make it available (see Fig. 3).

In addition, the central processing unit 100 includes a point unit 151 that manages payment, deduction, or payment of points, and a search unit 161 that searches information of the DB 130 according to a search request from the user terminal 500. ).

The point unit 151 appropriately uses the points so that the user can use them usefully when receiving differentiated services such as 3D image service of 3D module and processing license fees with external institution servers in addition to online payment by cash or card. to provide.

Through the communication unit 101, the central processing unit 100 is a regional administrative jurisdiction server 200 that manages and stores memory space content information of a specific region, and a town hall server that manages and stores memory space content information of a specific village. Connected to 300.

The town hall server 300 includes, for example, contents stored in the computer device of the head or seniors who manage the village.

And a license unit that processes a license fee for the memory space content information, wherein the license unit manages information on allowing a copyright holder to use his or her work to a specific person.

The license fee may be processed by the point unit 151 or the like.

The central processing unit 100 is a 2D module 110 that manages and edits information corresponding to a 2D image among the memory space content information, and a 3D module that manages and edits information corresponding to a 3D image among the memory space content information ( 120) is more connected.

This is because 2D images and 3D images are often mixed among the memory space content information requested through the user terminal 500, and it is easy to separately manage 3D images for pixel or 4k (HDR) effects. (See Fig. 4).

A senior memory search system, characterized in that it is connected to an external social network server 400 that transmits memory spatial content information stored in advance (in SNS) upon request of the user terminal 500.

The social networking service provided by the external social network server 400 uses image content information to create and reinforce social relationships through free communication and information sharing between multiple users, and expansion of personal networks. However, this information can be downloaded in bulk with the permission of each user.

Accordingly, the present invention may share information about public memory space content in the server 200 having jurisdiction over the local administration, the town hall server 300, etc., or share the memory space content information, which is personal information, from the external social network server 400. I can.

That is, the present invention can stimulate more dramatic and three-dimensional memories by using personal memory space content information of multiple users in recalling their past.

The present invention is connected to an external server through a network to transmit and receive memory space content information including old photos or cadastral maps.

The old photo may be usefully used as information to induce the user's hometown as photo information stored in its own DB of a county office or city hall server.

The cadastral map is a flat map created to indicate the location of the land, lot number, land category, area, etc., and helps to easily find the space where the person was active.

For example, according to the environment in which users grew up, the big data stored by multiple people on the spaces that have lived in each region, such as cities, rural areas, and fishing villages, is indwelled in spatial information created by multiple people according to the life type of individual users. Aftershock It is possible to promote the memory activity of each user, thereby stimulating more dramatic and three-dimensional memories when users recall their past.

That is, the present invention is a familiar object containing memories of the past, such as audiovisual materials such as videos and music, as well as surrounding background images to help users with memory space content information, and dishes, furniture, and farm equipment produced only in the region. Can be made to be used as an auxiliary medium.

For example, the jacquard similarity J (doc1, doc2) between two data doc1 and doc2 that is a textualized video or music title or content is defined as a value obtained by dividing the size of the intersection of the two sets by the size of the union of the two sets.

In conclusion, when the similarity level is 0.1 as follows, the two data are determined to be quite similar contents, and the central processing unit 100 may determine and provide them to the user together.

Hereinafter, with reference to FIGS. 2 and 5 to 7, a detailed description will be given of a method for searching for a senior memory for transmitting and receiving memory space content information including an old photo or cadastral map for the implementation of the present invention.

First, the present invention converts the data uploaded by all people, the data stored in the existing media or region, and the characteristics of the requestor into a DB.

In other words, by reclassifying multiple data into the characteristics related to the person using artificial intelligence technology (feature extraction), and showing the data by classification desired by the person based on this, it is possible to recall the past. System users can collect more data by uploading relevant data.

And, based on the DB, a feature suitable for the requestor's characteristics is extracted at the request of general users.

For example, features that match the requestor's characteristics are extracted (or calculated) by using artificial intelligence technology to randomly select preferred data based on the data collected or selected by the requester.

Related contents are provided by classifying and presenting information on memory space contents generated according to the feature extraction.

Finally, when uploading the contents of the general users' possession, rewards or points are accumulated.

As an embodiment of the present invention, as shown in FIG. 2, the central processing unit 100 requests that the central processing unit 100 retrieve and download memory space content information processed by network connection with an external server through the user terminal 500 as shown in FIG. 2.

In addition, the central processing unit 100 transmits or receives memory space content information stored in the DB 130 through the communication unit 101 according to the download request.

Finally, after logging in through the user terminal 500 by storing the log-in information, the memory space content information is uploaded or the cost is paid for it, and then the point is paid or deducted by downloading.

In addition, in the present invention, only the background is extracted from the memory spatial content information through the background unit 142 and the remaining information is deleted.

In addition, the memory space content information is arranged in chronological order through the timeline unit 143.

In addition, when the time information is omitted, the timeline unit 143 controls to infer time information through mutual comparison of related memory space content information.

Specifically, as shown in FIG. 5, when uploading is performed after logging in (S101), points are paid (S102, S103).

That is, in the present invention, a policy of paying a certain amount of points according to each information is used to activate the upload of memory space content information, and the points may be used according to the same principle as the amount paid by cash or card.

Conversely, when a download request is made after logging in (S101), a payment request is made through the payment unit 150 or the point unit 151, and if there is no point, the payment is induced to general payment, and the download can proceed (S104 to S108). ).

As shown in FIG. 6, in order to solve the legal problem associated with providing the service, the portrait rights violation information must be deleted from the memory space content information, and a general image deletion algorithm can be used.

In the conventional image service, only the face is blurred to protect the portrait right, but it is difficult to produce a perfect background image of the past through an algorithm that infers the surrounding background by completely removing a person's image as in the present invention.

In addition, the central processing unit 100 may compare portrait photos taken at the same or similar place in the memory space content information leading to a series of times, and fill in the background from which the people are deleted according to the location or distance between them.

Alternatively, the present invention can automatically generate an image corresponding to the survivor's environment at that time or the background description text even when there is hardly any photographic data at that time and the photo is too insufficient to make a timeline.

To this end, the present invention provides an input unit for receiving text data for generating memory spatial content information from a user, a main data extracting unit for extracting main data to be converted into an image from the text data input in the input unit, and a situation of the main data. It can automatically generate an image that conforms to.

In particular, since the manager cannot grasp the memory space content information uploaded in large quantities from an external server, it can be deleted through a series of algorithms (S201 to S204).

In addition, as illustrated in FIG. 7, when the timeline function is selected, when the time information is omitted from the memory space content information, time information can be inferred through the related memory space content information.

That is, the memory space content information may be arranged in chronological order through the timeline unit 143 (S301 to S303), or the time information may be inferred through the existence and disappearance time of each landscape and a building (S304, S305). .

100: central processing unit
101: communication department
130: DB
140: display
141: download/upload unit
142: background
143: timeline part
150: payment
151: point
160: input
161: search unit
200: Regional administrative jurisdiction server
300: Town Hall Server
400: external social network server
500: user terminal

Claims (8)

delete Through the user terminal 500, the central processing unit 100 requests by being connected to an external server through a network, or the central processing unit 100 classifies or searches the user-related memory space content information, and downloads it through the user terminal 500. Requesting;
Transmitting or receiving, by the central processing unit 100, the memory space content information stored in the DB 130 through the communication unit 101 according to the download request;
The central processing unit 100 stores login information, logs in through the user terminal 500, uploads memory space content information, or downloads after paying for it, and the central processing unit 100 pays points or Subtracting;
Arranging the memory space content information in chronological order through a timeline unit 143 for listing the memory space content information in chronological order;
Controlling time information to be inferred through mutual comparison of related memory spatial content information when visual information is omitted through the timeline unit 143;
After logging in through the user terminal 500, paying for the memory space content information, downloading, and paying points accordingly;
Deleting, by the central processing unit 100, the portrait rights violation information from the memory space content information;
The central processing unit 100 managing and editing information corresponding to a 2D image among the memory space content information through the 2D module 110;
Managing and editing information corresponding to a 3D image from among the memory space content information through the 3D module 120; delete delete A communication unit 101 connected to an external server through a network to transmit/receive memory space content information;
The memory space content information received from the communication unit 101 is managed, the memory space content information stored in the DB 130 is transmitted through the communication unit 101, and the login information is stored to log in through the user terminal 500. Then, after paying for the memory space content information, download it and pay points accordingly, delete the portrait right violation information from the memory space content information, and if the visual information is omitted from the memory space content information, the related memory space A central processing unit 100 that controls to infer time information through content information;
A DB 130 for providing memory space content information according to the request of the central processing unit 100;
Includes; a user terminal 500 for searching and downloading memory space content information processed by the central processing unit 100,
In the central processing unit 100,
A 2D module 110 for managing and editing information corresponding to a 2D image among the memory space content information;
A 3D module 120 for managing and editing information corresponding to a 3D image among the memory space content information; a senior memory search system, characterized in that connected. The method of claim 5,
The central processing unit 100,
A display unit 140 for displaying the memory space content information on the user terminal 500;
A payment unit 150 for managing payment of expenses through the user terminal 500;
An input unit 160 for inputting search information of the memory space content information through the user terminal 500;
A download/upload unit 141 for controlling downloading or uploading of the memory space content information through the user terminal 500;
A background unit 142 that extracts only a background from the memory spatial content information and deletes the remaining information;
A timeline unit 143 for arranging the memory space content information in chronological order;
A point unit 151 that manages payment, deduction, or payment of points;
A senior memory search system, characterized in that connected to a search unit (161) for searching information of the DB (130) according to a search request from the user terminal (500). The method of claim 5,
Through the communication unit 101, the central processing unit 100,
A regional administrative jurisdiction server 200 for managing and storing memory space content information of a specific region;
A senior memory search system, characterized in that it is connected to a town hall server 300 that manages and stores memory space content information of a specific village. delete

Images