KR20120122196A - Real feeling reproducing system, server, terminal based on lifelog and method thereof - Google Patents
Real feeling reproducing system, server, terminal based on lifelog and method thereof Download PDFInfo
- Publication number
- KR20120122196A KR20120122196A KR1020110040231A KR20110040231A KR20120122196A KR 20120122196 A KR20120122196 A KR 20120122196A KR 1020110040231 A KR1020110040231 A KR 1020110040231A KR 20110040231 A KR20110040231 A KR 20110040231A KR 20120122196 A KR20120122196 A KR 20120122196A
- Authority
- KR
- South Korea
- Prior art keywords
- lifelog
- information
- user
- lifelogging
- server
- Prior art date
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Systems or methods specially adapted for specific business sectors, e.g. utilities or tourism
- G06Q50/10—Services
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
- H04W4/30—Services specially adapted for particular environments, situations or purposes
- H04W4/38—Services specially adapted for particular environments, situations or purposes for collecting sensor information
Abstract
Description
BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a realistic reproduction system, and in particular, a lifelog of a user's life, behavior or surroundings from a terminal device such as a mobile phone carried by a user or various information collection devices for collecting environmental information around the user. (life log) collects information, classifies and tags it, stores it, and if the user wants to reproduce the behavior at a specific time later, the user's body at that time using lifelog information collected at that time The present invention relates to a lifelog-based realistic reproduction system, a server, a terminal device, and a method for realistically reproducing the situation in close proximity to information and surrounding environment.
In general, LifeGrog means all information related to user's activities in daily life. The concept of LifeLog was written in Atlantic Monthly by Vannevar Bush, the director of the National Institute of Science and Technology of the US Department of Defense in 1945. In an article, "As we may think," a camera and a small tape recorder are included in a walnut-sized device attached to the forehead in the future to expand the personal memory while predicting that the individual can see, hear and speak. Memex (Memory Extender) was first proposed.
In 2003, the Information Processing Technology Office (DTO) under the Defense Advanced Research Projects Agency (DARPA) attempted to develop lifelog technology to improve military training efficiency. We conducted a Life Log for Ubiquitous Environment study that collects user information through GPS, Gyro sensor, and acceleration sensor, and stores and manages it in a notebook.
Since 2005, Microsoft's Gordon Bell has been working on a project called MyLifeBits for recording, storing, managing, and retrieving information that can be seen, heard, and moved in daily life using a dedicated device called SensorCam. There is a case of LifeBlog software development that manages individual history information based on various multimedia information such as message, image, video and voice information.
However, the related art related to the lifelog has a limitation that it is limited to a function of recording, storing, managing, and retrieving the user's lifelog information, and utilizing the recorded personal lifelog information, the user desires When attempting to reproduce this at a time point, it has not been possible to publish a sensory reproducing method and system that reproduces the lifelog in a situation close to the time when the lifelog was collected.
Therefore, the present invention collects and logs tagging and tagging and storing lifelog information of a user's life, behavior, or surroundings from various information collection devices that collect environmental information around a user or a terminal device such as a mobile phone that a user carries. And, if the user wants to reproduce the behavior at a specific time later, the lifelog base enables the user to realistically reproduce the user's body information at that time and the surrounding environment by using the lifelog information collected at that time. To provide a realistic reproduction system, server, terminal device and method.
The present invention described above is a lifelog-based realistic reproduction system, comprising: a lifelog collection device for collecting lifelog information related to a user; a lifelog management server for managing lifelog information for each user; and the lifelog information collection device. A terminal device for transmitting the collected lifelog information to the lifelog management server on a wired or wireless communication network, and a lifelog for receiving the lifelog information of the user from the lifelog management server to realistically reproduce the content requested to be reproduced by the user. Includes a reproducing device.
In addition, the lifelog collection device, characterized in that it comprises an environment information collection device for collecting environmental information around the user, and a user information collection device that is carried by the user to collect the body information of the user.
The terminal apparatus may receive the lifelog information from the lifelog information collecting apparatus through short-range communication.
The terminal device may be a mobile communication terminal using a smartphone or a tablet PC capable of transmitting data to the server through the wired / wireless communication network.
In addition, the content is characterized in that the picture or video.
In addition, the present invention provides a terminal device, a first communication unit for performing short-range communication with the lifelog collection device, a server for managing the lifelog on the wired / wireless communication network and a second communication unit for performing data transmission and reception, And a control unit for receiving the lifelog information of the user from the lifelog collecting device through the first communication unit and transmitting the lifelog information to the server on the wired / wireless communication network through the second communication unit.
The lifelog information may include environmental information around the user or information related to the user's body measured by the user's body.
In addition, the present invention is a lifelog management server, a user terminal device that provides lifelog information, a communication unit for performing data transmission and reception through a wired / wireless communication network, and lifelog information for storing the lifelog information for each user And a server control unit for receiving the lifelog information of the user from the terminal device and storing the user's lifelog information in the lifelog information DB, and searching and providing the user's lifelog information when the lifelog information request is received from the lifelog reproducing apparatus. do.
The lifelog information may include environmental information around the user or information related to the user's body measured by the user's body.
In addition, the present invention is a lifelog reproduction apparatus, requesting the lifelog information of the user requesting the realistic reproduction to the wired / wireless communication network server that manages the lifelog information for each user, the user from the lifelog information received according to the request A lifelog data processor for generating metadata for realistic reproduction of the content requested to be reproduced by the user; and a sensory playback device for receiving the metadata from the lifelog data processor and applying the metadata to reproduce the content; do.
In addition, the content is characterized in that the picture or video.
The lifelog information may include environmental information around the user or information related to the user's body measured by the user's body.
In addition, the present invention provides a method for collecting lifelog information, the method comprising: collecting environmental information around the user through an environment information collection device; and collecting body information of the user from a user information collection device carried by the user; And generating lifelog information including the collected environmental information and body information and transmitting the generated lifelog information to a server on a wired / wireless communication network in a terminal device which is carried by the user and has a wide area communication function.
The body information and environment information may be transmitted to the terminal device through short-range communication.
The body information may be information related to the body of the user measured from the body of the user through the user information collecting device.
The environment information may include a location, an illuminance, or an ambient temperature of a place where the user is located.
In addition, as a lifelog-based realistic reproduction method, a lifelog reproduction apparatus connects to a wired / wireless communication network server that manages lifelog information for each user and requests lifelog information of a corresponding user; Extracting metadata for the realistic reproduction of the content requested to be reproduced from the lifelog information, and transmitting the metadata to the sensory playback device for playing the content to control the content to be played along with the metadata; It includes.
The lifelog information may include environmental information around the user or information related to the user's body measured by the user's body.
In the present invention, lifelog-based realistic reproduction service, lifelog information on the life, behavior or surrounding situation of the user from the terminal device, such as a mobile phone carried by the user, or various information collection devices that collect the environmental information around the user Collect, classify and tag them, store them, and if the user wants to reproduce the behavior at a specific point in time later, use the lifelog information collected at that point of time to view the user's physical information and the surrounding environment. There is an advantage that can be realistically reproduced.
1 is a network diagram of a lifelog-based sensory reproduction system according to an embodiment of the present invention;
2 is a conceptual diagram of a lifelog-based realistic reproduction system according to an embodiment of the present invention;
3 is a detailed block diagram of a terminal device according to an embodiment of the present invention;
4 is a detailed block diagram of a lifelog management server according to an embodiment of the present invention;
5 is a signal processing flowchart for lifelog based sensory reproduction according to an embodiment of the present invention.
Hereinafter, with reference to the accompanying drawings will be described in detail the operating principle of the present invention. In the following description of the present invention, if it is determined that a detailed description of a known function or configuration may unnecessarily obscure the subject matter of the present invention, the detailed description thereof will be omitted. The following terms are defined in consideration of the functions of the present invention, and may be changed according to the intentions or customs of the user, the operator, and the like. Therefore, the definition should be based on the contents throughout this specification.
1 illustrates a network configuration of a lifelog-based sensory playback system according to an exemplary embodiment of the present invention.
The environmental
The user
The
The wide area information providing device (GPS) 220 provides GPS information and the like to the
The
At this time, when looking at the communication range in terms of managing the lifelog information in the
The
The sensory reproducing
2 illustrates a configuration of a virtual reproduction system for reproducing a travel record as an example of a lifelog-based realistic reproduction system according to an embodiment of the present invention.
Referring to FIG. 2, the user
Hereinafter, the operation of the virtual reproduction system for reproducing the user's travel record will be described in detail with reference to FIG. 2.
First, a user wears a health care device provided by a
The
In the data collection step, when a user moves to a specific travel area and takes a tour, when the user takes a picture or a video, the picture and video data are classified and stored based on the time value and the GPS location value at that time. In addition, a healthcare device, which is a user
That is, when a user returns home after traveling, he or she can use a lifelog data processor 410 (a personal computer or a smartphone, etc.) at home to return to the travel experience or share the travel experience with others. Get your own logged lifelog information.
In addition, the reproduction program installed in the
In this case, the user may add body temperature or heart rate information from the lifelog information to reflect the user's body information at the time of taking a picture or video, and may reflect the user's excitement with information such as sound. By using the service, when a user wearing a VR helmet turns or turns his head, Google Street View or Google Satellite Maps can be overlaid on the user's photo or video. Realistic reproduction is possible.
3 illustrates a detailed block diagram of a user terminal device according to an exemplary embodiment of the present invention.
First, the
The
The
The
The
In addition, the
Subsequently, the
4 is a detailed block diagram of the
First, the
The
The
Thereafter, when there is a request for the lifelog information of the user from the
5 illustrates a signal processing flow for lifelog-based sensory reproduction in a lifelog-based sensory reproduction system according to an exemplary embodiment of the present invention. Hereinafter, embodiments of the present invention will be described in detail with reference to FIGS. 1 to 5.
First, the user
In addition, the environmental
Then, the
Then, the
On the other hand, the life log that performs a realistic reproduction of the photo or video taken by the user during the trip, etc. later on the life log information collected and stored during the external activities such as the user's travel using the user's life log information You can request a realistic representation through the data processor.
Then, the
Subsequently, the
Then, the
In addition, the
Accordingly, when the sensory reproducing apparatus, for example, plays a picture or a video at a specific point in time, the body information collected at the same point in time, for example, body temperature, heart rate, etc., is reproduced together with information such as sound to increase the excitability of the user. I can reflect it.
As described above, in the present invention, the lifelog-based realistic reproduction service includes a terminal device such as a mobile phone carried by the user or various information collection devices for collecting environmental information around the user. Collecting, tagging, tagging and storing lifelog information for the user, and if the user wants to reproduce the behavior at a specific time later, the user's body information and the surrounding environment using the lifelog information collected at that time point It can be reproduced more realistically in a situation close to the.
Meanwhile, in the above description of the present invention, specific embodiments have been described, but various modifications may be made without departing from the scope of the present invention. Accordingly, the scope of the invention should not be limited by the described embodiments but should be defined by the appended claims.
100: BAN 120: terminal device
130: user information collection device 200: PAN
210: environmental information collection device 220: wide area information providing device
Claims (18)
Lifelog management server that manages lifelog information for each user,
A terminal device for transmitting the lifelog information collected from the lifelog information collecting device to the lifelog management server on a wired / wireless communication network;
Lifelog reproducing apparatus for realistically reproducing the content requested to be reproduced by the user by receiving the lifelog information of the user from the lifelog management server
Lifelog-based realistic reproduction system comprising a.
The lifelog collection device,
An environmental information collection device for collecting environmental information around the user;
User information collection device that is carried by the user to collect the body information of the user
Lifelog-based realistic reproduction system comprising a.
The terminal apparatus comprises:
Lifelog based sensory reproduction system for receiving the lifelog information from the lifelog information collecting device through the near field communication.
The terminal apparatus comprises:
Lifelog-based realistic reproduction system that is a mobile communication terminal of a smartphone or tablet PC capable of transmitting data to the server through the wired / wireless communication network.
The content is,
Lifelog-based realistic reproduction system that is the picture or video.
A second communication unit performing data transmission / reception and a server managing a lifelog on a wired / wireless communication network;
A control unit for receiving the lifelog information of the user from the lifelog collecting device through the first communication unit, and transmitting the lifelog information to the server on the wired / wireless communication network through the second communication unit
Terminal device comprising a.
The lifelog information,
And terminal information including environmental information around the user or information related to the user's body measured by the user's body.
A lifelog information DB for storing the lifelog information for each user;
The server control unit receives the lifelog information of the user from the terminal device and stores it in the lifelog information DB, and retrieves and provides the lifelog information of the user when the lifelog information request is received from the lifelog reproducing apparatus.
Lifelog management server comprising a.
The lifelog information,
Lifelog management server including environmental information around the user or information related to the user's body measured in the user's body.
Sensor for reproducing the content by receiving the metadata from the lifelog data processor and applying the metadata
Lifelog reproduction device comprising a.
The content is,
Lifelog reproduction device that is the picture or video.
The lifelog information,
Life-log reproduction apparatus including environmental information around the user or information related to the user's body measured in the user's body.
Collecting environmental information around the user through an environmental information collection device;
Collecting body information of the user from a user information collecting device carried by the user;
Generating lifelog information including the collected environmental information and body information and transmitting the generated lifelog information to a server on a wired / wireless communication network in a terminal device which is carried by the user and has a wide area communication function;
Lifelog information collection method comprising a.
The body information and environmental information,
Lifelog information collection method is transmitted to the terminal through the short-range communication.
The body information,
Life log information collection method which is information related to the body of the user measured from the body of the user through the user information collecting device.
The environmental information,
Lifelog information collection method comprising the location, illuminance or ambient temperature of the place where the user is located.
Extracting, by the lifelog reproducing apparatus, metadata for realistic reproduction of content requested to be reproduced from the lifelog information;
Transmitting the metadata to a sensory playback device for playing the content to control the content to be played along with the metadata;
Lifelog-based realistic reproduction method comprising a.
The lifelog information,
Lifelog-based sensory reproduction method including environmental information around the user or information related to the user's body measured in the user's body.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020110040231A KR20120122196A (en) | 2011-04-28 | 2011-04-28 | Real feeling reproducing system, server, terminal based on lifelog and method thereof |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020110040231A KR20120122196A (en) | 2011-04-28 | 2011-04-28 | Real feeling reproducing system, server, terminal based on lifelog and method thereof |
Publications (1)
Publication Number | Publication Date |
---|---|
KR20120122196A true KR20120122196A (en) | 2012-11-07 |
Family
ID=47508490
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
KR1020110040231A KR20120122196A (en) | 2011-04-28 | 2011-04-28 | Real feeling reproducing system, server, terminal based on lifelog and method thereof |
Country Status (1)
Country | Link |
---|---|
KR (1) | KR20120122196A (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR20190130447A (en) * | 2018-05-14 | 2019-11-22 | 울산과학기술원 | Health enhancement information providing apparatus and method |
US11024083B2 (en) | 2015-04-20 | 2021-06-01 | Samsung Electronics Co., Ltd. | Server, user terminal device, and control method therefor |
-
2011
- 2011-04-28 KR KR1020110040231A patent/KR20120122196A/en not_active Application Discontinuation
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11024083B2 (en) | 2015-04-20 | 2021-06-01 | Samsung Electronics Co., Ltd. | Server, user terminal device, and control method therefor |
KR20190130447A (en) * | 2018-05-14 | 2019-11-22 | 울산과학기술원 | Health enhancement information providing apparatus and method |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2021018154A1 (en) | Information representation method and apparatus | |
CN105122771B (en) | For providing the method and apparatus of service in bluetooth equipment | |
KR101485458B1 (en) | Method For Creating Image File Including Information of Individual And Apparatus Thereof | |
CN100432913C (en) | Incident command post | |
CN103916473B (en) | Travel information processing method and relevant apparatus | |
US20130252637A1 (en) | Mobile communication terminal and method of recommending application or content | |
EP3660688A1 (en) | Information processing system, information processing device, information processing method, and recording medium | |
US20150261775A1 (en) | Content management method and cloud server therefor | |
WO2021232913A1 (en) | Voice information processing method and apparatus, and storage medium and electronic device | |
JP7067484B2 (en) | Information processing equipment, information processing methods, programs, and information processing systems | |
CN109274405A (en) | Data transmission method, device, electronic equipment and computer-readable medium | |
CN102667707B (en) | For showing method and the display unit of information | |
US20190279250A1 (en) | Audio content engine for audio augmented reality | |
EP3384693B1 (en) | Immersive telepresence | |
US20180027090A1 (en) | Information processing device, information processing method, and program | |
JPWO2014136466A1 (en) | Information processing apparatus, system, information processing method, and program | |
US20220246135A1 (en) | Information processing system, information processing method, and recording medium | |
Paterson et al. | The world through Glass: developing novel methods with wearable computing for urban videographic research | |
CN114693890A (en) | Augmented reality interaction method and electronic equipment | |
Elder et al. | Towards uniformity for smart glasses devices: An assessment of function as the driver for standardisation | |
CN106687944A (en) | Activity based text rewriting using language generation | |
KR20120122196A (en) | Real feeling reproducing system, server, terminal based on lifelog and method thereof | |
US20170097985A1 (en) | Information processing apparatus, information processing method, and program | |
JP6375597B2 (en) | Network system, server, program, and training support method | |
CN114079730A (en) | Shooting method and shooting system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
WITN | Withdrawal due to no request for examination |