KR101542402B1 - Inclination-based Realistic Moving Picture Playing System - Google Patents
Inclination-based Realistic Moving Picture Playing System Download PDFInfo
- Publication number
- KR101542402B1 KR101542402B1 KR1020130107703A KR20130107703A KR101542402B1 KR 101542402 B1 KR101542402 B1 KR 101542402B1 KR 1020130107703 A KR1020130107703 A KR 1020130107703A KR 20130107703 A KR20130107703 A KR 20130107703A KR 101542402 B1 KR101542402 B1 KR 101542402B1
- Authority
- KR
- South Korea
- Prior art keywords
- information
- user
- real
- image
- tendency
- Prior art date
Links
Images
Abstract
The present invention is configured to control a real image content reproduction apparatus with different control patterns according to a tendency of a user derived from text information, photograph and image information and multimedia information collected through a user's mobile terminal as basic data And a real-feeling image reproduction system for each user's characteristic.
The present invention relates to a real-life image reproduction system including a user's mobile terminal, a management server, a control unit and a real image content reproduction apparatus, wherein the mobile terminal comprises: inputting text information, generated photo / image information, and reproduced multimedia information The management server analyzes the text information, the photo / video information, and the multimedia information according to a predetermined method to infer the user tendency and transmits the analyzed information to the control unit, Searches the control pattern corresponding to the user tendency received from the control pattern database for each user tendency and transmits a control signal to the real feeling image contents reproducing apparatus according to the corresponding control pattern, And to reproduce a real feeling image in accordance with the control signal Quot; real-life image playback system for each user "
Description
The present invention is configured to control a real image content reproduction apparatus with different control patterns according to a tendency of a user derived from text information, photograph and image information and multimedia information collected through a user's mobile terminal as basic data And to a real-life image playback system for each user's tendency.
UI (User Interface) is a medium for communication between a user (person) and a computer. Current UI technology is based on a human body based interface (GUI) It is evolving into the NUI (Natural User Interface).
[Reference Figure 1]
Since NUI is based on human hand movements, voice, and gestures, it has an advantage that it is easy to use. As the spread of connected devices becomes common, NUI is also evolving variously. NUI's main technologies include Multi-Touch, Gesture, Voice, Eye Tracking, Facial Expression, Device Movement, Biometrics, and Brain-based. Table 1 below shows the existing NUI technologies classified by type.
[Table 1]
In recent years, UX (User Experience), which emphasizes the user experience by utilizing NUI, has been attracting attention. In addition, it has developed a system (or software) to help sense sensing and experience of the whole human body, It is believed that two-way experiential technology that interacts and communicates with a realistic image through analysis of meta information such as emotion / tendency / personality / feeling by each user after the detection and further predicts the behavior of the user based on this .
Problems to be solved by the present invention are as follows.
1. A real-life image playback system for each user's tendency in which playback of real-life image contents is controlled in response to a user's tendency.
2. A real-life image reproduction system for each user's tendency, in which recommendation information or notification information is additionally provided together with real image content according to the user's interest information.
The present invention relates to a real-life image reproduction system including a user's mobile terminal, a management server, a control unit and a real image content reproduction apparatus, wherein the mobile terminal comprises: inputting text information, generated photo / image information, and reproduced multimedia information The management server analyzes the text information, the photo / video information, and the multimedia information according to a predetermined method to infer the user tendency and transmits the analyzed information to the control unit, Searches the control pattern corresponding to the user tendency received from the control pattern database for each user tendency and transmits a control signal to the real feeling image contents reproducing apparatus according to the corresponding control pattern, And to reproduce a real feeling image in accordance with the control signal Quot; real-life image playback system for each user "
The management server analyzes the text information, the photo / video information, and the multimedia information according to a predetermined method to further extract user interest information and transmit the extracted user interest information to the control unit. And a real-life image content reproduction apparatus generates a list by searching for a recommended content in the Internet network with interest information as a keyword, and the real-image image content reproduction apparatus is configured to display the list. In this case, the real image content reproduced by the real image content reproduction apparatus is accompanied by an information layer including background region information, building information, character information, metabolism information and article information related to the image, And generate the notification information when the included information matches the user interest information, and the real image content reproduction apparatus reproduces the notification information.
Further, the present invention is characterized in that the mobile terminal additionally provides at least one of real-time location information, gyroscope sensing information and point of interest (POI) designated by the user to the management server, Quot; realistic image playback system for each user "
The present invention also provides a real-life image content reproduction apparatus according to the present invention, wherein the real image content reproduction apparatus includes a display device, a lighting device, a sound device, and a vibration device.
The present invention also provides a real-life image content reproduction apparatus according to the present invention, wherein the real image content reproduction apparatus comprises a main reproduction apparatus and a sub-reproduction apparatus. In this case, the sub-playback apparatus is configured to be implemented as a mobile terminal of a user synchronized with the control unit and controlled by the control unit.
According to the present invention described above, the following effects can be expected.
1. Since the real image contents reproducing apparatus is controlled according to the tendency of the user who views the real image contents, the satisfaction of the real image contents of the user can be increased.
2. Appropriate additional information can be provided according to the interest information of the user who watches the real image contents, so efficient information distribution is realized through the real image contents of the user.
3. It is possible to utilize various devices as sub1, sub2, etc. as a device for reproducing realistic image contents up to the user's mobile terminal (center / sub, etc.), thereby making it possible to produce more realistic image contents.
1 is a schematic diagram of a real-life image reproducing system for each user's tendency according to the present invention.
[FIG. 2] is a schematic diagram of a process in which a control unit compares and analyzes an information layer of user interest information and real image content to extract notification information.
The present invention relates to a real-life image reproduction system including a user's mobile terminal, a management server, a control unit and a real image content reproduction apparatus, wherein the mobile terminal comprises: inputting text information, generated photo / image information, and reproduced multimedia information The management server analyzes the text information, the photo / video information, and the multimedia information according to a predetermined method to infer the user tendency and transmits the analyzed information to the control unit, Searches the control pattern corresponding to the user tendency received from the control pattern database for each user tendency and transmits a control signal to the real feeling image contents reproducing apparatus according to the corresponding control pattern, And to reproduce a real feeling image in accordance with the control signal Quot; real-life image playback system for each user "
Hereinafter, the present invention will be described in detail with reference to the accompanying drawings.
1 is a schematic diagram of a real-life image reproducing system for each user's tendency according to the present invention.
The real-life image playback system according to the present invention includes a user's mobile terminal, a management server, a controller, and a real image content playback apparatus.
The mobile terminal refers to a user terminal that is carried by a user such as a smart phone or a tablet PC, and is capable of mobile computing, photographing and photographing, multimedia reproduction, and internet connection. The mobile terminal basically provides the management server with the text information input to the mobile terminal, the photo / video information generated by the mobile terminal, and the reproduced multimedia information. Specifically, in a state where an application program for providing various kinds of information is installed and executed on the management server, text information entered by a text message, an Internet search word, a chat message, etc., And provides one multimedia information to the management server. Meanwhile, among such information, many information belonging to an area of an individual's personal privacy information is preferably included, and it is desirable that a guide and a consent procedure for providing various privacy information when installing and executing the application program are required.
Also, the mobile terminal may further provide at least one of real-time location information, gyroscope sensing information, and point of interest (POI) designated by the user to the management server as additional data of user propensity inference by the management server It is possible. The location information is a data indicating a user's visiting area, a moving route, etc., and the gyroscope sensing information is information indicating whether the user is moving or not, and indirectly deducing the user's activity amount according to the sensing time or degree And the interest information is highly utilized for accurate inference of the user tendency directly specified by the user as the location information of the specific area in which the user is interested.
The management server analyzes the text information, the photo / video information, and the multimedia information in accordance with a preset method, and deduces the user's tendency and transmits the analyzed information to the controller. The mobile terminal and the control unit can exchange information through various wired / wireless communication networks including the Internet.
In the case of the text information or the reproduced multimedia information, the management server stores various vocabularies included in the information in the form of metadata, and then, based on the metadata, A method of extracting a user tendency as a keyword can be applied. To do this, metadata ontology, which is a set of technical vocabularies and criteria for semantic connection of database information, is used. There are RDF, OWL, and SWRL languages that are mainly used in ontologies. RDF is developed in XML, and consists of subject, object, and predicate. RDF is a language commonly used when evaluating generic applications that do not require complex constraints, and OWL is a language that includes the hierarchy of relations and the logical constraints within a relationship instance. It is used when precise and logical reasoning is needed. SWRL is used to define rules for reasoning.
In the case of the above-mentioned photo / image information, the photographed data can be digitalized as it is. However, the background of the photo / image information can be distinguished through the image analysis, It is possible to reduce the amount of information of photograph and image information by a method of recording coordinate change information by taking a point at each part of the body and recording the coordinate change of each point. Also, as shown in [Reference Fig. 2] below, it is possible to reduce the information amount of photograph / image information by a method of simplifying the bending of a person or a background by a line and recording a change of a line.
[Reference Figure 1]
[Reference Figure 2]
The pattern and the image information can be compared with the data stored in the pre-built photo / image pattern database, and the user's tendency can be extracted by keyword inferring the meaning. The photo / image pattern DB is a kind of a pattern of a person's behavior (laughing, frowning, sitting, lying, moving, etc.) or a background image (mountains, buildings, The keyword can be given in advance.
In the same manner as the above-mentioned concrete example, if a keyword for a user tendency is duplicated, it is possible to deduce a frequently extracted keyword as a user tendency, or to deduce a representative keyword additionally on the extracted keywords It is possible. Also, it is desirable that the representative keyword deduced as the user tendency is stored and utilized as metadata for inferring the user tendency in the future.
The control unit searches the control pattern DB corresponding to the user tendency received from the management server for a control pattern corresponding to the user tendency and transmits a control signal to the realistic image content reproducing apparatus according to the control pattern . The controller may be implemented as a computing module capable of storing, comparing, and controlling data, and may be included in the real-life image content reproducing apparatus. More specifically, depending on the control pattern, there arises a difference between the basic value and the degree of change of the brightness or saturation of the display of the real image content reproducing apparatus, the intensity of the sound or the intensity of the specific sound, do. For example, if the user's tendency is classified as static, quiet, etc., if the sound reproduction such as explosion sound or roar sound is somewhat reduced to reproduce the corresponding sound or if the user's tendency is classified as dynamic or vigorous, And the vibration intensity is increased to reproduce.
Meanwhile, if the management server analyzes the text information, the photo / video information, and the multimedia information according to a predetermined method to further extract user interest information and transmit the user interest information to the control unit, It is possible to search the recommended content in the Internet network as a keyword, create a list, and cause the real image content reproduction apparatus to display it.
In this case, the real image content reproduced by the real image content reproduction apparatus may be accompanied by an information layer including background region information, building information, person information, metabolism information, and article information related to the image, And if the user interest information matches the information included in the user interest information, the real-life image content reproduction apparatus reproduces the notification information. Generally, the sensory image contents are produced in a digital manner, and in addition to the present image information, an information layer including various information is accompanied. In many cases, the user is interested in only a part of the information included in the information layer. Accordingly, selecting and informing the user of the information included in the information layer accompanied by the real image content, which is expected to be of interest to the user, plays an important role in the efficient consumption of the real image content. FIG. 2 is a schematic diagram illustrating a process in which a control unit compares and analyzes an information layer of user interest information and real image content to extract notification information. The user interest information is a golf equipment, And the control unit reproduces the alert information when the information is displayed as golf equipment. More specifically, the notification information may be a list of a visually displayed list, or may be a specific notification sound.
The real-life image content reproduction apparatus collectively refers to all the devices whose operation is controlled by a control signal transmitted from the control unit, and plays the real-feeling image according to the control signal. Specifically, the real image content reproducing apparatus may include a display device, a lighting device, a sound device, and a vibration device. The control signal of the control unit also corresponds to the configuration of the real image content playback apparatus. For example, when the real image content reproduction apparatus does not include an illumination device, the control signal does not need to include the illumination device control signal, but when the illumination device is included, the illumination device control signal is naturally included in the control signal do.
Further, the real image content reproducing apparatus may include a main reproducing apparatus and a sub reproducing apparatus. In this case, the sub reproducing apparatus may be implemented as a mobile terminal of a user synchronized with the control unit and controlled by the control unit . The control unit and the mobile terminal can be connected through a short-range wireless communication method, and a separate application program for synchronization can be used.
When a scene in which a telephone call is made is displayed in a real image content to be played when the mobile terminal is activated as a sub playback apparatus of the real image content playback apparatus, the content of the real image is reproduced through the mobile terminal of the user, The contents can be reproduced in various ways. Furthermore, since various elements can be constituted from the realistic image contents production stage, it is possible to induce the production of a wider realistic image contents.
Hereinafter, the real-feeling image reproducing system according to the present invention will be described in detail with reference to the accompanying drawings. However, the present invention is not limited to the embodiments described with reference to the accompanying drawings, and various modifications and variations are possible without departing from the gist of the present invention. It is therefore intended that the appended claims cover such modifications and variations as fall within the true scope of the invention.
Not applicable
Claims (7)
Wherein the mobile terminal provides the management server with the input text information, the generated photo / video information, and the reproduced multimedia information,
The management server analyzes the text information, the photo / video information, and the multimedia information in accordance with a preset method to deduce a user's tendency, and stores the text information or various vocabularies included in the reproduced multimedia information as metadata The user's tendency is extracted as a keyword through logical reasoning based on the vocabulary based on the metadata, and the change of the coordinate information or the change of the line is patterned through the image analysis of the photograph and image information, Analyzes and analyzes the data stored in the pattern DB, deduces the meaning of the data, extracts the user tendency by keyword, and transmits the deduced user tendency to the controller,
The control unit retrieves a control pattern corresponding to the user tendency received from the management server in a control pattern database for each user tendency and transmits a control signal to the realistic image content reproducing apparatus according to the control pattern,
Wherein the real image content reproducing apparatus reproduces the real image in accordance with the control signal, the apparatus comprising: a main reproducing apparatus including a display apparatus, a lighting apparatus, an audio apparatus and a vibration apparatus, and a sub reproduction apparatus And the real-life image is reproduced through the user's body.
The management server analyzes the text information, the photo / video information, and the multimedia information according to a predetermined method to further extract user interest information and transmit the user interest information to the controller,
The control unit searches a recommended content in the Internet network using the user interest information as a keyword to create a list,
And the real-life image content reproduction apparatus is configured to display the list.
The realistic image content reproduced by the real image content reproduction apparatus is accompanied by an information layer including background region information, building information, character information, metabolism information and article information related to the image,
Wherein the controller generates notification information when the information included in the information layer matches the user interest information,
And the real-life image content reproduction apparatus is configured to reproduce the notification information.
Wherein the mobile terminal further provides at least one of real-time location information, gyroscope sensing information, and point of interest (POI) designated by the user to the management server,
Wherein the management server is configured to additionally utilize the inference of the user tendency.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| KR1020130107703A KR101542402B1 (en) | 2013-09-09 | 2013-09-09 | Inclination-based Realistic Moving Picture Playing System |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| KR1020130107703A KR101542402B1 (en) | 2013-09-09 | 2013-09-09 | Inclination-based Realistic Moving Picture Playing System |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| KR20150029786A KR20150029786A (en) | 2015-03-19 |
| KR101542402B1 true KR101542402B1 (en) | 2015-08-07 |
Family
ID=53024031
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| KR1020130107703A KR101542402B1 (en) | 2013-09-09 | 2013-09-09 | Inclination-based Realistic Moving Picture Playing System |
Country Status (1)
| Country | Link |
|---|---|
| KR (1) | KR101542402B1 (en) |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR100350792B1 (en) | 1999-09-22 | 2002-09-09 | 엘지전자 주식회사 | Multimedia data browsing system based on user profile |
| JP2004152174A (en) | 2002-10-31 | 2004-05-27 | Sony Corp | Content reproducing device, content providing system, content retrieving method, and program |
-
2013
- 2013-09-09 KR KR1020130107703A patent/KR101542402B1/en active IP Right Grant
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR100350792B1 (en) | 1999-09-22 | 2002-09-09 | 엘지전자 주식회사 | Multimedia data browsing system based on user profile |
| JP2004152174A (en) | 2002-10-31 | 2004-05-27 | Sony Corp | Content reproducing device, content providing system, content retrieving method, and program |
Also Published As
| Publication number | Publication date |
|---|---|
| KR20150029786A (en) | 2015-03-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11526720B2 (en) | Artificial intelligence system for supporting communication | |
| US11061972B2 (en) | Computing architecture for multiple search bots and behavior bots and related devices and methods | |
| Vinciarelli et al. | A survey of personality computing | |
| KR101927706B1 (en) | Method for recommending music for various situations and apparatus using the same | |
| US20180101776A1 (en) | Extracting An Emotional State From Device Data | |
| US20140255003A1 (en) | Surfacing information about items mentioned or presented in a film in association with viewing the film | |
| CN103760968B (en) | Method and device for selecting display contents of digital signage | |
| US10346480B2 (en) | Systems, apparatus, and methods for social graph based recommendation | |
| US20130121591A1 (en) | Systems and methods using observed emotional data | |
| US9691183B2 (en) | System and method for dynamically generating contextual and personalized digital content | |
| US20200357382A1 (en) | Oral, facial and gesture communication devices and computing architecture for interacting with digital media content | |
| AU2014241373A1 (en) | Systems and methods for interactive synthetic character dialogue | |
| JP2013088906A (en) | Knowledge information processing server system with image recognition system | |
| CN107038197A (en) | The content transmission and interaction of situation and activity-driven | |
| US10437332B1 (en) | System and method for emotional context communication | |
| US11948594B2 (en) | Automated conversation content items from natural language | |
| Yu et al. | Inferring user profile attributes from multidimensional mobile phone sensory data | |
| JP7192086B2 (en) | Systems and methods for extracting temporal information from animated media content items using machine learning | |
| CN113569037A (en) | Message processing method and device and readable storage medium | |
| EP4075411A1 (en) | Device and method for providing interactive audience simulation | |
| US20220246135A1 (en) | Information processing system, information processing method, and recording medium | |
| KR20190034035A (en) | Method for providing vicarious experience service using virtual reality based on role-playing and bigdata | |
| CN114817755A (en) | User interaction content management method, device and storage medium | |
| CN113688231A (en) | Abstract extraction method and device of answer text, electronic equipment and medium | |
| JP2012168862A (en) | Behavior information recording apparatus |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| A201 | Request for examination | ||
| E902 | Notification of reason for refusal | ||
| E701 | Decision to grant or registration of patent right | ||
| FPAY | Annual fee payment |
Payment date: 20180523 Year of fee payment: 4 |