KR101855852B1 - Service system for providing digital photo frame with curation information - Google Patents

Abstract

According to one embodiment of the present invention, the applicability of image content can be maximized by transmitting image content selected by a user to a display device through a cloud server. According to one embodiment of the present invention, to achieve the purpose, an electronic picture frame service system, capable of providing curation information, comprises: a terminal which carries out a user application configured to perform display, editing, and selection of a virtual image; a display device which receives image content corresponding to the virtual image selected from the user application, and displays the received image content; and a first server which receives request information of the image content based on the selected virtual image, and transmits the image content to the display device. In this regard, the user application provides a first user interface to be capable of display, editing, and selection of the virtual image, and the first server includes an artificial intelligence curation engine which provides content recommendation information or active curation information based on the image content searched, uploaded, or selected by the user application.

Description

FIELD OF THE INVENTION [0001] The present invention relates to an electronic frame service system capable of providing curation information,

The present invention relates to an electronic frame service system for displaying contents on a display device using a terminal.

Digital Photo Frame refers to an apparatus that displays image content photographed by a camera or the like, image content obtained by digitizing a work of a painter, or the like on a display device such as an LCD. Conventionally, electronic frames are capable of displaying image content on a display device through control of a terminal.

On the other hand, recently, technologies for storing image contents separately in a network storage or the like of a cloud server and using the terminal to transfer image contents stored in a network storage or the like to a display device have appeared. These prior arts have been in the process of qualitative expansion and quantitative expansion of services such as development of various applications due to commercial needs of content providers and development of cloud servers.

However, these prior art technologies are devoted to the commercial needs of content providers, while others overlook the need of the consumer and overlook the environment where various services can be provided together. Therefore, there is a need for an advanced form of electronic frame service system that combines a variety of services that maximize the emotion of the consumer while satisfying the necessary parts of the electronic frame service system.

The present invention has been made in view of the above needs, and it is a first object of the present invention to provide an electronic frame service system capable of maximizing utilization of image contents by transmitting image contents selected by a user to a display device through a cloud server .

A second object of the present invention is to analyze a user's interest in image content with his / her behavior information, optimize recommendation of image content through such analysis, or provide a new type of artificial intelligence curation service.

A third object of the present invention is to provide an electronic frame service system capable of providing the best curation service to a user by expanding the curation service of image contents to an Internet portal, a blog or a social network service.

The above-described object of the present invention can be achieved by an electronic frame service system comprising: a terminal for executing a user application configured to display, edit and select a virtual image; A display device for receiving image content corresponding to the selected virtual image in the user application and displaying the received image content; And a first server receiving the request information of the image content based on the selected virtual image and transmitting the image content to the display device, wherein the user application has a first user interface to display, edit and select the virtual image Wherein the first server comprises an artificial intelligence execution engine that provides content recommendation information or active curation information based on image content retrieved or uploaded through a user application or selected image content, Frame service system.

The artificial intelligence curation engine may be to acquire behavior information of the user by analyzing color information, art category information, artist information, and hash tag information of the image contents retrieved or uploaded or selected.

The service system of the present invention may further include a database that stores behavioral information of a user and is periodically updated.

The behavior information of the user may be big data information obtained through collection, processing, and analysis of the user's activity on the Internet portal or the social network service. The service system may further include a big data management unit for obtaining big data information.

The active curation information includes information on display order, display time, screen division and editing with respect to each other when a plurality of image contents are included, and includes synchronization information of a plurality of display devices when there are a plurality of display devices can do.

The user application is configured with a curation information editing toolkit for editing active curation information. The curation information editing toolkit is capable of moving or rotating the virtual images corresponding to the display device through the user's touch or drag motion Lt; / RTI >

According to an embodiment of the present invention as described above, an electronic frame service system can maximize utilization of image contents by transmitting image contents selected by a user to a display device through a cloud server.

In addition, it is possible to analyze the interest of the user's image content as the behavior information of the user, to optimize the recommendation of the image content through such analysis, or to provide a new type of artificial intelligence curation service.

In addition, by expanding the image content curation service to an Internet portal, a blog, or a social network service, it is possible to provide a user with the best curation service.

BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 is a diagram showing an example of a display configuration of image contents among constitutions of an electronic frame service system according to the present invention;
2 is a diagram illustrating an example of a configuration for providing a DRM service in a configuration of an electronic frame service system according to the present invention;
3 is a diagram illustrating an example of the overall configuration of an electronic frame service system according to the present invention;
4 is a diagram showing an example of a first user interface of a user application of a terminal in the structure of an electronic frame service system according to the present invention,
5 is a diagram showing an example of a second user interface of the user application of the terminal in the structure of the electronic frame service system according to the present invention,
FIG. 6 is a flow chart sequentially showing an electronic frame service method according to the present invention,
FIG. 7 is a flowchart sequentially illustrating a method of matching sound contents in an electronic frame service method according to the present invention.

Display system of image contents

BRIEF DESCRIPTION OF THE DRAWINGS Fig. 1 is a diagram showing an example of a display configuration of image contents among constitutions of an electronic frame service system according to the present invention. Fig. One embodiment of a display configuration of image content, as shown in Figure 1, is basically related to an electronic frame service system for display of image content, comprising: a display device 120 for displaying image content; A terminal 110 in which a user application configured to display and edit a virtual image of the image content for display and to select and edit the image content on the display device 120 in response to the image content request information of the terminal 110; And a first server 130 for transferring the data.

First, a display system of image content will be described with reference to FIG. The image content may be a high-resolution still image, such as a picture or a photograph, made of media data that can be output to a pixel of the LCD or LED screen of the display device 120, And is transmitted from the first server 130 to the display device 120 through the control.

The display device 120 is not limited to merely displaying passively transmitted image contents, but includes a process unit and a memory, and a Wi-Fi communication module capable of bi-directional communication, A smart launcher is mounted and operated to edit, process and display image contents transmitted from the first server 130 to fit the screen of the display device 120, and display various functions manipulated by the terminal 110 . For example, when a screen setting request such as a location at which the image content is to be displayed on the display device 120, a time at which the image is displayed, a display mode setting, and the like is transmitted through the terminal 110, 130, and the corresponding screen setting request is transmitted to the display device 120 as it is. In this case, in the smart launcher, the display position of the image content, the time to be displayed, and the display mode setting are performed in response to the screen setting request.

The smart launcher is configured to effectively manage and utilize an application required to perform a function of the display device 120, and the application may be configured to control the color, resolution, and device performance of the screen. The smart launcher is basically configured so that the content display application 1210 that displays media data of the image content transmitted from the first server 130 through the display unit 1220 of the display device 120 can be executed. On the other hand, the display device 120 can be managed at the server level by transmitting the response message to the first server 130 based on the periodic confirmation message of the push server 160, such as the launcher update information.

In addition, a DRM client 1200 for digital rights management (DRM) may be configured in the display device 120. The content display application 1210 displays the media data, which is the DRM content received by the communication unit 1230, on the display unit 1220 under the control of the DRM client 1200. [ At this time, the content display application 1210 can perform decoding of the encoded media data.

The first server 130 includes a DRM manager 1300 for providing a DRM service and a server 130 for optimizing content provision through editing, resizing and encoding of media data, a contents management unit 1330 that receives an upload or display request of the user application 1110 and authenticates the rights, an electronic commerce unit 1330 that charges the use of image contents, Gt; 1310 < / RTI > The user application 1110 executing in the terminal 110 can transmit an upload request of the image content to be stored in the storage 140 to the content management unit 1330 and selects the image content to be displayed on the display device 120 And may transmit a display request of the selected image content to the content management unit 1110. [ A detailed description of the DRM service will be given later.

The first server 130 and the storage 140 may be configured as a cloud server and a cloud storage. Considering the transmission of various user creative contents or high resolution media data, the first server 130, which processes, edits, and stores image contents and processes requests of a plurality of terminals 110, performs load balancing It is desirable to be a cloud server with available and auto-extending IT resources. The first server 130 may be a conventional public cloud such as an Amazon cloud or a private cloud having a separate own cloud environment or a hybrid cloud combining the two. Lt; / RTI >

Public cloud cloud computing architecture typically consists of a physical system layer such as servers, storage and networks, a virtual layer that virtualizes servers, storage and networks, Provisioning Layer, a technology that enables users to allocate / deploy / distribute resources according to their needs, and cloud computing services such as operational process automation functions such as workflow and other performance and potential management services. Cloud Service Service Management Layer, and Cloud Service Layer such as Infrastructure as a Service (IaaS), Platform as a Service (PaaS) and Software as a Service (SaaS) And can be applied to an embodiment of the present invention as it is.

Meanwhile, the smart launcher of the display device 120 can configure a widget interface and can be configured to receive live data directly from an external source. Specifically, the first server 130 obtains authority and coordinate information from an external source and transmits the acquired authority and coordinate information to the terminal 110, and the Smart Launcher transmits live data such as weather data or news data to an external Can be received directly from the source.

The terminal 110 may include a desktop PC, a laptop PC, a tablet PC such as a pad or a tab, and a mobile communication terminal such as a smart phone. A terminal 110 outputs a virtual image corresponding to a screen of the display device 120 and executes a user application having a first user interface configured to select various image contents. The terminal 110 is provided with a CPU and a memory so that a user application can be executed, and a wireless communication module for data communication with the first server 130 is mounted. Such a wireless communication module may be a module for wireless data communication using a wireless data network or a wireless wireless communication module using a local area network such as Bluetooth, WiFi, Zigbee ), NFC (Near Field Communication), or the like.

Image content Curation  Electronic frame service system providing service

Meanwhile, the electronic frame service system may include an artificial intelligence curation engine 1340 in the first server 130 as shown in FIG. The artificial intelligence curation engine 1340 collects behavior information of a user searching or selecting through the user application 1110 and provides a curation service to the user through pattern analysis. Specifically, the behavior information acquired from the user may be information retrieved or uploaded, or information of the user's content preference information that can be grasped as color information, art category information, artist information, and hash tags information of the selected image contents.

The color information of the image content is related to the color information of the image content that the user searches or uploads or selects, for example, whether the image content is a color image or a monochromatic image, . The art category information is related to an art category in which image contents that the user searches or uploads or selects are classified and classified according to regions such as oriental paintings, western paintings, and Korean paintings, and classification according to materials such as still images, landscape paintings, Classification according to sanction such as painting, painting, and sphericalization, and classification according to other expression methods. The artist information is artist information of the image content selected to be searched, uploaded or selected, and users can collect the hash tag information created by the users by allowing the users to attach the hash tag to the image contents that they uploaded or selected.

The artificial intelligence curation engine 1340 may analyze the pattern of search or selection of the image content from the image information that the user searches or uploads or collects the above-mentioned behavior information from the selected image content, Can be presented. Such user's behavior information or content recommendation information may be stored in the database 150 and updated periodically.

The artificial intelligence curation engine 1340 not only outputs the content recommendation information through the user application 1110 but also actively displays the display order, display time, screen division, and editing between the image contents to be displayed on the display device 120 And a plurality of display devices 120, present active curation information such as mutual synchronization.

The active curation information may be temporally or spatially divided into two or more pieces of image content on the screen of one display device 120. [ It also suggests how to destroy and create image content when switching. For example, it suggests a switching method such that the trailing image content appears in the disappearing part of the preceding image in a mosaic manner, the trailing image content appears in the opposite part where the preceding image content disappears and disappears in a slide manner.

Of course, the user can edit and use the curation information through the user application 1110 in addition to the basic curation information. To this end, the user application 1110 may be provided with a curation information editing toolkit. Such a curation information editing toolkit may be composed of a virtual art gallery in which two or more image contents and virtual images corresponding to two or more display devices 120 are displayed. Such a virtual art gallery is displayed on the terminal 110 in a form in which a plurality of display devices 120 are arranged in 2D or 3D with each other and moves or rotates virtual images by touching or dragging the virtual images of the displayed display device 120 .

Meanwhile, the artificial intelligence curation engine 1340 collects, processes, and analyzes user activities on an Internet portal, a blog, or a social network service using a big data management unit 180, Behavior information or content recommendation information may be formed and stored in the database 150 for updating.

Of electronic frame service system DRM  Service delivery method

1, the electronic frame service system according to the present invention provides digital rights management (DRM) services for image contents stored or requested to be displayed at the request of the user application 1110. [ Since the image content is a digital content subject to copyright, the DRM service of the present embodiment can be safely managed and protected through encryption (generation, distribution, use, and discarding) throughout the circulation process, It is provided to protect and manage copyright.

Specifically, the DRM service is performed by the DRM manager 1300 of the first server 130 and the DRM client 1200 of the display device 120. The image content uploaded according to the request of the user application 1110 is stored in the storage 140 through the content management unit 1330 under the control of the DRM management unit 1300. [ That is, the image content stored in the storage 140 is encrypted and stored by the DRM manager 1300.

On the other hand, when the user application 1110 requests the content management unit 1330 to display a specific image content on the display device 120, the content processing unit 1320 may edit and resize the requested image content, And transmits the processed image content to the communication unit 1230 of the display device 120. [ At this time, the DRM manager 1300 encrypts the media data of the processed image content and transmits the encrypted media data to protect the image content.

The DRM client 1200 of the display device 120 performs decryption of the encrypted image content based on the decryption key and appropriate authorities. The decoded image content is decoded in the content display application 1210 and displayed through the display unit 1220. [ In order to receive a normal electronic frame service through such decryption, the user must acquire a usage right for the corresponding image content through the user application 1110. Such usage rights include the metadata of the DRM content and the license . Here, the license includes data on the decryption key and data on the access right (for example, the image content utilization period).

The DRM service provided by the electronic frame service system according to the present invention basically provides encryption and decryption, as well as an additional security method for protecting image contents by originally blocking an abnormal access. 2 is a diagram showing an example of a configuration for providing a DRM service in the structure of the electronic frame service system according to the present invention. 2, the DRM client 1200, which is a component of the electronic frame service system of the present invention, includes the following four configurations. The four configurations include a DRM module 1202 for performing decryption, an access detection unit 1204 for detecting a physical access such as an abnormal port connection of the display device 120 or a hacking code inflow through a network, An initialization unit 1206 for terminating and initializing all processes and memories related to the image content, and an access warning unit 1208 for transmitting a warning message for physical accesses.

Hereinafter, a DRM service providing method of the electronic frame service system will be described with reference to FIG. The media data of the image content transmitted to the display device 120 is encrypted and encoded data. Accordingly, a decryption process of the DRM module 1202 is performed at the system kernel 1240 level, and then a decoding process is performed based on the content display application 1210. Alternatively, the decoding of the DRM module 1202 may be performed at the level of the content display application 1210.

The access detection unit 1204 can use the system API of the operating system and can detect physical accesses using a firewall or a vaccine program. The port connection signal detection may be a detection of a connection signal of an external digital device not being applied to the display device 120 or an unauthorized access of the network port. Hacking code detection can also be detected by obtaining real-time detection results of a firewall or anti-virus program.

If there is a detection of the approach detection unit 1204, the initialization unit 1206 receives the detection signal and terminates all processes of the media data of the kernel 1240 and the content display application 1210, and deletes and initializes the allocated work memory .

In addition, the access warning unit 1208 transmits a physical access warning message to the DRM manager 1300 of the first server 130. Based on this warning message, the security for the image content can be reset. Such a security reset may be, for example, a warning message regarding an ID and a password change to the user application of the terminal 110, and may notify the certificate change of the authority for the image content.

Electronic frame service system providing sound matching service

3 is a diagram showing an example of the overall configuration of an electronic frame service system for providing a sound matching service according to the present invention. An embodiment of an electronic frame service system for providing a sound matching service will be described with reference to FIG. In the description of the embodiment of the electronic frame service system for providing the sound matching service, one example of the display system of the image content and the DRM service method described above can be applied as they are, and the description thereof will be omitted in the overlapping limitations.

The terminal 110 is a hardware configuration in which a user application 1100 configured to display, edit, and select a virtual image is executed, and has a process unit, a memory, and a data communication module. The display device 120 serves to receive image content corresponding to the virtual image selected in the user application 1100 and to display the received image content, and the first server 130 displays the image content based on the selected virtual image Receives the request information and performs transmission of the image content to the display device 120. [ Here, the user application 1100 provides a first user interface 1110 for displaying, editing, and selecting a virtual image, and the user application 1100 displays and selects sound information of sound content matched with the selected image content .

4 is a diagram illustrating an example of a first user interface of a user application of a terminal in a configuration of an electronic frame service system that provides a sound matching service according to the present invention. Referring to FIG. 4, a plurality of thumbnail images 11112, which are virtual images of image contents displayed on the first user interface 1110 through the screen of the terminal 110, are arranged and thumbnail images May be configured to be displayed as low resolution image content in the virtual frame 1114 of the first user interface 1110. [ When the user touches the thumbnail image, the first server 130 transmits the low resolution image content by referring to the display resolution information of the terminal 110 based on the touch signal.

The user application 1100 provides a second user interface 1120 to enable display and selection of sound information. 4 is a diagram illustrating an example of a second user interface of a user application of a terminal in the structure of an electronic frame service system that provides a sound matching service according to the present invention. The second user interface 1210 may include sound information 1212 (e.g., title of the sound, album information, output time of the sound, creator information of the sound, etc.) corresponding to the low resolution image content displayed in the virtual frame 1114 ). The user can alternatively touch them, and the sound content can be selected based on the touch of the sound information.

The service system further includes sound output means for outputting the selected sound content via the second user interface 1120. The sound output means may include a built-in speaker 170 attached to the terminal 110 or the display device 120, Or a wireless speaker 170 equipped with a communication module.

The first server 130 may include a sound content search engine that searches for sound content that matches the image content based on the search request information input via the second user interface 1120. [ Such a sound content search engine can search based on the matching rate of the content information of the image content and the sound information of the sound content. The sound information of a plurality of sound contents can be presented in the order of high matching rate. Here, the matching rate between the content information and the sound information is determined by classifying the common sentiment of sound and image as sad, happy, and surprise, and assigning weight to the sad, happy, and surprise, The matching rate can be calculated to the extent that the location is derived and is close to it. This common sense may be further subdivided.

The service system may further include a second server 135 for transmitting the sound source data of the sound content to the sound output means based on the request of the first server 130, May be a server of a contents provider, and the first server 130 may be configured to obtain a user's sound content usage right.

The content information of the image content includes sound recommendation information or emotion tag information. Here, the sound recommendation information may include copyright holder recommendation information of the image content or recommendation information of the downloaded user. The sentiment tag information is information collected, stored, extracted and analyzed from at least one of search data, web page data, social network data, and user created contents data. .

The service system according to the present embodiment may further include a big data management unit 180 to provide emotion tag information. The information collected by the big data management unit 180 may be stored in the database 150, Can be utilized immediately.

Meanwhile, the big data management unit 180 includes a module for forming the behavior information of the user required by the artificial intelligence curation engine 1340 and a module for providing emotional tag information for the sound matching service of this embodiment In this case, the culling service can be extended to the sound matching service.

The service system according to the present embodiment may further include an image recognition management unit 190 for analyzing and extracting image sensibility information based on image recognition from image contents. Since the image sensibility information can be determined by the facial expression of the person, the image content such as the photograph including the person can be selectively utilized or added to the image content used by the user and utilized for searching the sound contents.

Electronic frame service method providing sound matching service

FIG. 5 is a flowchart sequentially illustrating an electronic frame service method for providing a sound matching service according to the present invention. 5, an embodiment of the electronic frame service method first determines whether the first server 130 has selected the selected image content through the user application 1100 running on the terminal 110, (S1000).

Next, the first server 130 transmits the image data of the selected image content to the display device 120, and the second server 135 transmits the sound source data of the selected sound content to the sound output means, Or sequentially (S2000). Between step S1000 and step S2000, the first server 130 may transmit the output request information of the selected sound content to the second server 135 (S1100).

A method of matching sound contents will be described with reference to FIG.

The electronic frame service method for providing the sound matching service may further perform the sound content matching method including steps S100 to S500 below step S1000. In this sound content matching method, an image to be selected is first selected through the first user interface 1110 of the user application 1100 (S100).

Next, a sound content search is requested through the second user interface 1210 of the user application 1100 (S200).

Next, the sound content search engine analyzes the sound information stored in the database 150 and the matching rate based on the content information of the selected image content or the image recognition information recognized by the image recognition management unit 190 (S300).

Next, the sound content search engine outputs sound title information having a high matching rate based on the sound information through the second user interface (S400).

Finally, one of the sound title information output through the second user interface is selected (S500).

In the matching rate analysis step S300, the content information of the image content includes sound recommendation information or emotional tag information, and the emotional tag information is transmitted to the big data management unit 180 through search data, web page data, Stored, extracted and analyzed from at least one of the data (e.g., data) and user created contents data.

Meanwhile, in the matching rate analysis step S300, the content information of the image content may include image sensibility information analyzed and extracted based on image recognition from the image content.

In the matching rate analysis step S300, the content information of the image content may include image sensibility information, and the sound content search engine may search the sound content based on the matching rate of the sound information and the image sensibility information.

The apparatus described above may be implemented as a hardware component, a software component, and / or a combination of hardware components and software components. For example, the apparatus and components described in the embodiments may be implemented within a computer system, such as, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable array (FPA) A programmable logic unit (PLU), a microprocessor, or any other device capable of executing and responding to instructions.

The software may include a computer program, code, instructions, or a combination of one or more of the foregoing, and may be configured to configure the processing device to operate as desired or to process it collectively or collectively Device can be commanded. The software and / or data may be in the form of any type of machine, component, physical device, virtual equipment, computer storage media, or device , Or may be permanently or temporarily embodied in a transmitted signal wave.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments. For example, it is to be understood that the techniques described may be performed in a different order than the described methods, and / or that components of the described systems, structures, devices, circuits, Lt; / RTI > or equivalents, even if it is replaced or replaced.

110: terminal
120: Display device
130: first server
135: Second server
140: Storage
150: Database
160: push server
170: Speaker
180: Big data management unit
190: Image recognition management unit
1100: User application
1110: First user interface
1120: Second user interface
1200: DRM client
1202: DRM module
1204:
1206:
1208: Access warning section
1210: Content display application
1220:
1230:
1240: Kernel
1300: DRM manager
1310: Electronic Commerce Department
1320:
1330:
1340: AI Curation Engine

Claims (7)

In the electronic frame service system,
A terminal for executing a user application configured to display, edit, and select a virtual image displayed in a virtual frame at a low resolution;
A display device for receiving image content corresponding to the selected virtual image in the user application and displaying the received image content; And
And a first server receiving request information of the image content from the terminal based on the selected virtual image and transmitting the image content to the display device,
The display device edits, processes and displays the image content to fit the screen, and transmits a response message to the first server in response to the periodic confirmation message of the push server, thereby managing launcher update information at the first server level However,
The user application providing a first user interface to display, edit and select the virtual image,
Wherein the first server includes an artificial intelligence execution engine that provides active curation information based on the image content retrieved or uploaded or selected through the user application,
The artificial intelligence curation engine includes:
And acquires the behavior information of the user by analyzing color information, art category information, artist information, and hash tag information of the retrieved, uploaded, or selected image contents,
Wherein the active curation information comprises:
Wherein the image content includes a plurality of information about the display order, a display time, a screen division and an edit between the plurality of image contents, and the display device includes a plurality of display devices and synchronization information of the plurality of display devices ,
Wherein the user application comprises a curation information editing toolkit for editing the active curation information,
Wherein the curation information editing tool kit is capable of providing curation information that is capable of moving or rotating a virtual image corresponding to the display device through a touch or a drag motion of a user.
The method according to claim 1,
Wherein the service system further comprises a database that stores the behavior information of the user and is periodically updated.
3. The method of claim 2,
Wherein the behavior information of the user further includes big data information acquired through collection, processing, and analysis of a user's activity on an Internet portal or a social network service.
The method of claim 3,
Wherein the service system further comprises a big data management unit for obtaining the big data information. delete delete delete

Images