KR102614762B1 - Electronic Picture Frame, Method and Computer Program for Driving Thereof - Google Patents

Abstract

An electronic picture frame according to an embodiment of the present invention includes a display unit that displays a target image; a speaker unit that reproduces a target sound source related to the target image; and a processor that controls output of content through the display unit and the speaker unit, wherein the processor obtains first metadata of the target image including a shooting time of the target image from a user terminal, and the first Receive first source data including sound source data having second metadata whose relevance to metadata satisfies a predetermined standard, and link the first source data with the target video according to a predetermined playback rule to create a first source data. 1 Output data is generated, and the target image and the target sound source according to the first output data are output using the display unit and the speaker unit.

Description

Electronic Picture Frame, Method and Computer Program for Driving Thereof}

The present invention relates to an electronic picture frame, a method of driving the same, and a computer program, and more specifically, to an electronic picture frame, a method of driving the same, and a computer program that displays an image and associated music together using metadata of the image.

Due to the recent development of electronic technology, technologies for providing various contents such as videos and music to users are also becoming more diverse and evolving. In particular, a digital picture frame or electronic picture frame can effectively deliver content by outputting the video the user wants to receive in various output formats such as a slideshow, or by outputting the video and sound together.

However, the sound source provided through the digital picture frame is mainly selected independently from the video and has a low correlation with the video, limiting the ability to transmit content. Accordingly, the need for technology to process content in a customized manner and deliver it more effectively is increasing.

Embodiments of the present invention use a speaker-combined electronic picture frame to display an image and related music together based on metadata about the time when the image was captured, thereby providing a rich recall experience for a specific point in time to provide user-customized content. The goal is to provide an electronic picture frame that can effectively transmit information and a method of driving it.

An electronic picture frame according to an embodiment of the present invention includes a display unit that displays a target image; a speaker unit that reproduces a target sound source related to the target image; and a processor that controls output of content through the display unit and the speaker unit, wherein the processor obtains first metadata of the target image including a shooting time of the target image from a user terminal, and the first Receive first source data including sound source data having second metadata whose relevance to metadata satisfies a predetermined standard, and link the first source data with the target video according to a predetermined playback rule to create a first source data. 1 Output data is generated, and the target image and the target sound source according to the first output data are output using the display unit and the speaker unit.

The second metadata includes information on the date and time at which the sound source data was reproduced, the number of reproductions of the sound source data corresponding to the reproduced date and time, and when generating the first output data, the processor 1 metadata and the second metadata can be linked from a time perspective.

In the step of receiving the first source data, the first source data is received from the user terminal and is selected based on the user's playback record, or the first source data is received from the user terminal and It is received from another service server and can be selected based on the playback records of the user and users other than the user.

In the step of generating the first output data, the processor selects the target sound source from the first source data according to the playback rule, and applies the playback rule to the target sound source to determine the playback order and playback time. And the playback mode may be set differently to generate second source data, and the first output data may be generated by linking the second source data with the target image.

The electronic picture frame includes a first plate and a second plate disposed to face the first plate, the first plate is provided to slide through a sliding member with respect to the second plate, and the first plate and the At least a portion of the speaker unit may be exposed through a sliding operation of at least one of the second plates.

The electronic picture frame includes a sensing unit that detects a sliding motion of at least one of the first plate and the second plate, and the sensing unit generates a voltage by a magnet portion and a magnetic field applied according to the movement of the magnet portion. It may include a Hall sensor.

The processor generates an output control signal based on the voltage generated by the sensing unit, displays the target image through the display unit and plays the target sound source through the speaker unit according to the output control signal. .

A method of driving an electronic picture frame according to an embodiment of the present invention includes obtaining first metadata of the target image including the shooting time of the target image from a user terminal; Receiving first source data including sound source data having second metadata whose relevance to the first metadata satisfies a predetermined criterion; generating first output data by linking the first source data with the target image according to a predetermined playback rule; and outputting the target image and target sound source according to the first output data using a display unit and a speaker unit.

The second metadata includes information about the time at which the sound source data was reproduced, the number of reproductions of the sound source data corresponding to the reproduced time, and in the step of generating the first output data, the first metadata Data and the second metadata may be linked from a time perspective.

In the step of receiving the first source data, the first source data is received from the user terminal and is selected based on the user's playback record, or the first source data is received from a service server different from the user terminal. As such, the selection may be made based on the playback records of the user and users other than the user.

Generating the first output data may include selecting a target sound source from the first source data according to the playback rule; generating second source data by applying the playback rule to the target sound source and setting different playback order, playback time, and playback mode; and generating the first output data by linking the second source data with the target image.

The electronic picture frame includes a first plate and a second plate disposed to face the first plate, the first plate is provided to slide with respect to the second plate through a sliding member, and the first plate and the At least a portion of the speaker unit may be exposed through a sliding operation of at least one of the second plates.

The electronic picture frame includes a sensing unit that detects a sliding motion of at least one of the first plate and the second plate, and the sensing unit generates a voltage by a magnet portion and a magnetic field applied according to the movement of the magnet portion. It may include a Hall sensor.

Outputting the first output data may include generating an output control signal based on the voltage generated by the sensing unit; and displaying the target image through the display unit and reproducing the target sound source through the speaker unit according to the output control signal.

Meanwhile, a computer program according to an embodiment of the present invention may be stored in a computer-readable storage medium in order to execute the above-described method using a computer.

According to embodiments of the present invention, a speaker-combined electronic picture frame is used to display an image and music related to it based on metadata about the time when the image was captured, thereby providing a rich recollection experience for a specific point in time to the user. Customized content can be provided effectively.

1 is a diagram briefly illustrating the configuration of a content delivery system according to an embodiment of the present invention.
Figure 2 is a multi-side view of the configuration of an electronic picture frame according to an embodiment of the present invention.
Figure 3 is an exploded perspective view of the structure of an electronic picture frame according to an embodiment of the present invention.
Figure 4 is a top view of the internal structure of the electronic picture frame according to an embodiment of the present invention, disassembled and viewed from the top.
Figure 5 is a diagram for explaining the physical operation of an electronic picture frame according to an embodiment of the present invention.
Figure 6 is a flowchart for explaining a driving method for displaying content of an electronic picture frame according to an embodiment of the present invention.

Since the present invention can be modified in various ways and can have various embodiments, specific embodiments will be illustrated in the drawings and described in detail in the detailed description. The effects and features of the present invention and methods for achieving them will become clear by referring to the embodiments described in detail below along with the drawings. However, the present invention is not limited to the embodiments disclosed below and may be implemented in various forms.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. When describing with reference to the drawings, identical or corresponding components will be assigned the same reference numerals and redundant description thereof will be omitted. .

In the following embodiments, terms such as first and second are used not in a limiting sense but for the purpose of distinguishing one component from another component. In the following examples, singular terms include plural terms unless the context clearly dictates otherwise. In the following embodiments, terms such as include or have mean that the features or components described in the specification exist, and do not exclude in advance the possibility of adding one or more other features or components. In the drawings, the sizes of components may be exaggerated or reduced for convenience of explanation. For example, the size and shape of each component shown in the drawings are arbitrarily shown for convenience of explanation, so the present invention is not necessarily limited to what is shown.

In the following embodiments, when a part such as a region, component, unit, block, module, etc. is said to be on or on another part, it is not only the case that it is directly on top of the other part, but also the other area, component, or module in between. , blocks, modules, etc. are included.

In the following embodiments, when areas, components, parts, blocks, modules, etc. are connected, not only are the areas, components, parts, blocks, and modules directly connected, but also the areas, components, parts, blocks, and modules are connected. This also includes cases where other areas, components, parts, blocks, and modules are interposed and indirectly connected. For example, in this specification, when areas, components, parts, blocks, modules, etc. are said to be electrically connected, not only are the areas, components, parts, blocks, modules, etc. directly electrically connected, but also other areas in between, It also includes cases where components, parts, blocks, modules, etc. are indirectly electrically connected.

Figure 1 is a configuration diagram briefly illustrating the configuration of a content delivery system 1000 according to an embodiment of the present invention.

The content delivery system 1000 of the present invention can be implemented using an electronic photo frame 100, a user terminal 200, and a service server 300. Depending on the embodiment, the content delivery system 1000 may be implemented using only the electronic photo frame 100 and the user terminal 200 without using the service server 300. The electronic picture frame 100 of the present invention can communicate with the user terminal 200 and/or the service server 300 through the network 400 using a wireless or wired communication method.

Hereinafter, 'metadata' refers to data containing various and detailed information about video data or sound source data, including photos (images) and videos.

Metadata of video data may include various information about the shooting environment at the time of video acquisition. For example, the metadata of the image (hereinafter referred to as first metadata) may include the shooting time, shooting location, image size (capacity), resolution, number of re-checks, and device specifications regarding the device on which the image was acquired. , device settings information, file formats stored on the device, orientation information, and artist/copyright information, etc.

Metadata of a sound source may include various information at the time of sound source creation/playback. For example, metadata of a sound source (hereinafter referred to as second metadata) may include the artist, genre, release time, song length (file size), and file format of a music album or individual song. You can. In particular, the second metadata of the present invention may include the play date (date, time), play/streaming time, and number of plays when the sound source was heard through the user terminal 200 and/or service server 300 of the sound source. there is.

The electronic picture frame 100 and its driving method according to embodiments of the present invention output video content including images and videos taken at a specific point in time, and sound source content sharing the specific point in time as metadata. By providing a rich reminiscence experience, there is an advantage in that the user who provided the content can have a three-dimensional recollection through music listening history beyond instantaneous and fragmentary recollection through photos regarding a specific point in time.

The electronic picture frame 100 of the present invention may include a communication unit 110, a processor 120, a memory 130, and an input/output device. The input/output device may include a display 140 and a speaker 150, for example.

The communication unit 110 communicates with external devices such as various types of user terminals 200 and/or external servers such as the service server 300 according to various types of communication methods through the network 400. Functions for doing so can be provided. As an example, a request generated by the processor 120 of the electronic photo frame 100 according to a program code stored in a recording device such as memory 130 is sent to an external device and/or through the network 400 under the control of the communication unit 110. Can be passed on to the server.

The processor 120 of the present invention obtains first metadata including the shooting time (date and time) of the target image to be displayed from the user terminal 200, and generates sound source data having second metadata related to the first metadata. First source data may be received. Thereafter, the target image and the first source data are fused according to a predetermined standard to generate first output data, and then the first output data is output using the display 140 and speaker 150, which will be described later. You can.

The processor 120 can effectively deliver user-customized content by combining different types of digital content that share temporal metadata, such as shooting time and playback time, to provide the user with a rich recall experience regarding a specific point in time. The method of outputting content using the metadata of the image and sound source of the electronic photo frame 100 using the processor 120 of the present invention will be described in more detail with reference to FIG. 6 described later.

The processor 120 may perform an operation to generally control the electronic picture frame 100 using various programs stored in the memory 130. The processor 120 may be configured to process instructions of a computer program by performing basic arithmetic, logic, and input/output operations. Commands may be provided to the processor 120 by the communication unit 110 or the memory 130. For example, the processor 120 may be configured to execute received instructions according to program codes stored in a recording device such as memory 130. The processor 120 includes a microprocessor, a central processing unit (CPU), a processor core, a multiprocessor, an application-specific integrated circuit (ASIC), and a field programmable gate array (FPGA). ) may include processing devices such as, but are not limited to this.

The memory 130 functions to temporarily or permanently store data processed by the electronic picture frame 100. The memory 130 may include a non-permanent mass storage device such as RAM (Random Access Memory), ROM (Read Only Memory), and a disk drive, but the scope of the present invention is not limited thereto. .

The display unit 140 is an example of an output device and can display video content such as photos (images), videos, or a slideshow consisting of a collection of these.

The speaker unit 150 is another example of an output device and can output sound source data to be played along with the video content.

In this drawing, each component of the electronic picture frame 100 is shown as a separate component, but depending on the embodiment, each component may be integrated into one module or implemented as a separate module, if necessary. Of course it exists.

The user terminal 200 may transmit image content and/or sound source content related thereto to be output through the electronic photo frame 100 to the electronic photo frame 100 according to the user's operation. The user terminal 200 may be a fixed terminal or a mobile terminal implemented as a computer device. The user terminal 200 may be, for example, a smartphone, mobile phone, navigation device, computer, laptop, digital broadcasting terminal, PDA (Personal Digital Assistants), PMP (Portable Multimedia Player), tablet PC, etc., but is not limited thereto. Depending on the embodiment, the user may control output data to be output through the electronic photo frame 100 through the processor of the user terminal 200.

The service server 300 is an external server provided separately from the electronic photo frame 100 and the user terminal 200, and may be a music streaming server, for example. The service server 300 may serve to provide digital sound sources to a streaming device such as the user terminal 200 (or the electronic picture frame 100). The service server 300 may store a database regarding music streaming records of multiple users, and this database is transmitted to the electronic picture frame 100 and/or the user terminal 200 through the network 400 to display the electronic picture frame ( 100) can be used to provide content.

Although not shown in this drawing, the user terminal 200 and the service server 300 may also include a communication unit, a processor, and memory, and each component may have a function corresponding to each component of the electronic picture frame 100. there is. As an example, the user terminal 200, the service server 300, and control signals, commands, contents, files, etc. provided according to the control of each processor are transmitted to the electronic picture frame 100 through each communication unit and the network 400. It can be received by the electronic picture frame 100 through the communication unit 110.

The network 400 may include, for example, a Personal Area Network (PAN), a Local Area Network (LAN), a Campus Area Network (CAN), a Metropolitan Area Network (MAN), a Wide Area Network (WAN), a Broad Band Network (BBN), It may include one or more arbitrary networks such as the Internet.

Of course, the content delivery system 1000 of the present invention may further include other components in addition to those shown in FIG. 1.

Hereinafter, the physical configuration of the electronic photo frame 100 according to an embodiment of the present invention will be described using FIGS. 2 to 4. Hereinafter, the display unit 30 corresponds to the display unit 140 described in FIG. 1, and the speaker unit 40 corresponds to the speaker unit 150 described in FIG. 1.

Figure 2 is a multi-side view of the configuration of the electronic photo frame 100 according to an embodiment of the present invention. 100a is a front view of the electronic photo frame 100, 100b is a side view of the electronic photo frame 100, 100c is a rear view of the electronic photo frame 100, and 100d is a top view of the electronic photo frame 100.

Referring to 100a to 100d of FIG. 2 together, the electronic picture frame 10 may include an upper plate 10 and a lower plate 20 disposed and assembled below the upper plate 10. The description will be based on the fact that the upper plate 10 and the lower plate 20 are arranged parallel to the D1-D2 plane in the first direction D1 and the second direction D2 based on the drawing. Hereinafter, the upper plate 10 may be referred to as a first plate and the lower plate 20 may be referred to as a second plate. The upper plate 10 and the lower plate 20 may be arranged to face each other in the final assembled state into the electronic picture frame 100.

The display unit 30 is placed between the upper plate 10 and the lower plate 20, and when the two panels 10 and 20 are assembled, the display unit 30 may be exposed through the open space of the upper plate 10. . An upper frame 11 with a central area partially open is positioned on the upper plate 10 to determine the exposed area of the display unit 30. The display unit 30 may be assembled with the upper plate 10 while being accommodated inside the lower plate 20, particularly within the protrusion 201 protruding in the third direction D3 of the lower plate 20. . The upper plate 10 may slide in one direction, for example, in the first direction D1, with respect to the lower plate 20, which will be described in more detail in the drawings described later.

Figure 3 is an exploded perspective view of the electronic picture frame 100 according to an embodiment of the present invention, and Figure 4 is an exploded view of the internal structure of the electronic picture frame 100 according to an embodiment of the present invention. This is a top view from the top.

Referring to FIGS. 3 and 4 together, the electronic picture frame 100 includes an upper plate 10, an upper frame 11, a lower plate 20, a display unit 30, a speaker unit 40, and a sliding unit 50. ) and, depending on the embodiment, may further include a sensing unit 60 including a Hall sensor 61 and a magnet portion 62.

The top plate 10 is a plate located on the top of the electronic picture frame 100, and may have internal grooves formed so that the top frame 11 and the first sliding member 51 can be assembled therein. The upper plate 10 and the upper frame 11 have a central portion opened so that the display unit 30 disposed below is exposed when viewed from the outside. The upper plate 10 may have a first horizontal width w1 in the first direction D1.

The lower plate 20 is located below the upper plate 10 and forms the lower surface of the electronic picture frame 100. The lower plate 20 has a predetermined thickness in one direction (D3), and inside it is a single-board computer (hereinafter referred to as 'SBC') 21, a button sensor 22, Internal grooves in which various components such as the display unit 30, the speaker unit 40, the plurality of second sliding members 52, and the sensing unit 60 can be installed may be formed. The lower plate 20 may have a second horizontal width w2 in the first direction D1.

The upper plate 10 may be provided to slide with respect to the lower plate 20 through a sliding portion 50, which will be described later.

Referring to FIG. 4, the upper plate 10 shown in FIG. 4 can be assembled into an electronic picture frame 100 by folding the other side opposite to the central line cl toward the lower plate 20. . For example, the two plates (10, 20) are folded about the center line (cl) so that one side border (l1) of the upper plate (10) and one side border (l2) of the lower plate (20) overlap the electronic picture frame (100). ) can be assembled.

The first horizontal width (w1) is greater than the second horizontal width (w2), and as an example, the first horizontal width (w1) is equal to the second horizontal width (w2) and the horizontal width (ws) of the speaker unit 40, which will be described later. It can be greater than or equal to the sum of (w2=w1+ws).

The SBC 21 may include the communication unit 110, processor 120, and memory 130 described above in FIG. 1, and may have a configuration corresponding to these configurations. The SBC 21 may be provided in the form of an SBC, for example, but the form of the SBC 21 does not limit the present invention. The SBC 21 is connected wired or wirelessly to the processors of the display unit 30 and the speaker unit 40, which will be described later, and can control the output of content through the respective devices 30 and 40.

The display unit 30 is inserted between the upper plate 10 and the lower plate 20 or inside the lower plate 20, and at least a portion thereof is directed to the front of the electronic picture frame 100 (direction D3 in this drawing). It is exposed so that the content is visually provided to the user. The display unit 30 may display a target image according to the first output data generated according to embodiments of the present invention through control of the SBC 21.

The speaker unit 40 may include various speaker members such as a speaker device 41, a speaker cover 42, and a speaker bonnet 43. At least part or all of the speaker unit 40 may be exposed when the upper plate 10 moves relative to the lower plate 20 through a sliding motion.

The speaker device 41 can reproduce a target sound source according to the first output data generated according to embodiments of the present invention through control of the SBC 21.

The speaker cover 42 is assembled between the two plates 10 and 20 to cover one side of the speaker device 41, so that the sound source data output through the speaker device 41 can be transmitted to the user more effectively. It can play a role in conveying. Additionally, the speaker cover 42 may be a part exposed to the user when the upper plate 10 slides by a predetermined range relative to the lower plate 20 by the sliding portion 50.

The speaker unit 40 may have a third horizontal width ws in the first direction D1.

The sliding part 50 may include a first sliding member 51 assembled with the upper plate 10 and a second sliding member 52 assembled with the lower plate 20. In this drawing, an example of one first sliding member 51 and a plurality of second sliding members 52 is shown, but the number of each sliding member 51 and 52 does not limit the present invention. For example, the second sliding member 52 may be formed in plural pieces and assembled together. Here, referring to FIG. 4, the first sliding member 51 disposed at the upper portion is third than the second sliding member 52 (or the entire assembly member of the plurality of second sliding members 52) disposed at the lower portion. When viewed in the direction D3, the area by the outermost edge may be larger. In this way, the sliding operation can be easily implemented by sliding in one direction D1 while the upper first sliding member 51 covers the lower second sliding member 52. Additionally, the external appearance of the electronic picture frame 100 can be provided with a more clean aesthetic. Depending on the embodiment, the total area of the first sliding member 51 may be smaller than that of the second sliding member 52. In this case, the first sliding member 51 may slide in one direction D1 while being assembled inside the second sliding member 52.

Referring again to FIG. 4, the first sliding member 51 may be provided on both sides of one direction (for example, D2 direction) of the upper plate 10, and similarly, the second sliding member 52 may also be provided on the lower plate. It may be provided on both sides of one direction (for example, the D2 direction) of (20). Since sliding members 51 and 52 are provided on both sides in one direction, the sliding operation of the electronic picture frame 100 can be operated more easily and stably. Of course, depending on the embodiment, the sliding members 51 and 52 may be provided on only one side of each plate 10 and 20 in one direction.

Here, the sliding operation of the electronic photo frame 100 of the present invention will be described with reference to FIG. 5. Figure 5 is a diagram for explaining the physical operation of the electronic picture frame 100 according to an embodiment of the present invention.

Referring to FIG. 5 , a user may slide and move the upper plate 10 using the sliding member 50 while the lower plate 20 is fixed to the electronic picture frame 100. Before the sliding operation of the electronic picture frame 100, only the upper plate 10 with the display unit 30 exposed can be seen when viewed from the front, as shown in the front view 100a of FIG. 2. After the sliding operation shown in FIG. 5, at least a portion of the lower plate 20 on one side of the upper plate 10, or at least a portion or the entire speaker unit 40 may be exposed to the front. At this time, the exposure width of the speaker unit 40 may also vary depending on the sliding width of the upper plate 10.

In the above, the sliding of the upper plate 10 has been described as an example, but the sliding operation of the present invention means relative movement between the two plates 10 and 20, so of course the lower plate 20 can also slide. . That is, the sliding operation of the electronic picture frame 100 of the present invention can be implemented by moving at least one of the upper plate 10 and the lower plate 20.

The output content output through the electronic photo frame 100 may vary depending on whether the electronic photo frame 100 is in a sliding operation. For example, in a closed mode, such as the front view 100a of FIG. 1, only image content is displayed through the display unit 30, and in a sliding open mode, as shown in FIG. 5, the display unit 30 Video content is displayed through and sound source content is played through the speaker unit 40, so that the video and sound source can be output together.

Referring again to FIGS. 3 and 4, the sensing unit 60 of the present invention may include a Hall sensor 61 and a magnet portion 62. The Hall sensor 61 and the magnet portion 62 are attached to the upper plate 10 or the lower plate 20, respectively, and detect relative movement between the plates 10 and 20, such as sliding of one plate 10 and 20. can do.

The Hall sensor 61 is a sensor that uses the Hall Effect, and can serve to detect movements such as the rotation speed and direction of movement of an object by measuring changes in the magnetic field due to the Hall Effect. The Hall effect refers to the effect in which a voltage (electromotive force) is generated in a direction perpendicular to the direction of current flow when a magnetic field is applied to a conductor through which a current flows.

The Hall sensor 61 may be attached to one boundary of the plates 10 and 20 to effectively detect movement during the sliding operation of the plates 10 and 20. For example, the Hall sensor 61 may be attached near the reference line bl parallel to the second direction D2 shown in FIG. 3 or the center line cl shown in FIG. 4 . Figure 4 shows an example in which the Hall sensor 61 is attached to one side of the single board computer (SBC) 21. However, the attachment position of the Hall sensor 61 facilitates relative movement between the plates 10 and 20. Of course, the design can be changed in various ways within the range that can be easily detected.

The magnet unit 62 may serve to detect the movement of the plates 10 and 20 by applying a magnetic field to the Hall sensor 61 described above and generating electromotive force by the Hall sensor 61. The magnet unit 62 may include at least one magnet. The magnet portion 62 may be attached to one boundary of the plates 10 and 20 like the Hall sensor 61, and may be placed, for example, near the reference line bl in FIG. 3 or the center line cl in FIG. 4. You can. As an example, the magnet unit 62 may be attached to one side of the speaker unit 40, but the attachment position of the magnet unit 62 is within a range where the relative movement between the plates 10 and 20 can be easily detected. Of course, the design can be changed in various ways.

The processor 120 of the present invention can generate an output control signal based on the voltage generated by the sensing unit 60. According to the output control signal, the target image can be displayed through the display unit 30 and the target sound source can be played through the speaker unit 40. Depending on the embodiment, it goes without saying that the output of the first output data including the target image and the target sound source may be operated by other controls rather than detection by the detection unit 60. For example, the output of content through the electronic photo frame 100 can be controlled by receiving a control signal from another external terminal such as a remote control through another input/output interface included in the electronic photo frame 100.

Since the voltage generated due to the relative movement of the Hall sensor 61 and the magnet portion 62 is proportional to the strength of the current and magnetic field, the sensing unit 60 can detect the sliding motion of the plates 10 and 20 in various ways. You can. For example, the voltage and current intensity by the sensing unit 60 depending on the speed of the sliding operation described in FIG. 5, the position of one boundary of the upper plate 10, or the degree of sliding according to the exposed width of the speaker unit 40. may vary. Accordingly, output performance such as volume and sound level output from the speaker unit 40 can be controlled. For example, the processor 120 of the electronic picture frame 100 can set the volume output through the speaker unit 40 to be larger as the exposure width of the speaker unit 40 increases depending on the degree of sliding operation.

FIG. 6 is a flowchart illustrating a driving method for displaying content of the electronic picture frame 100 according to an embodiment of the present invention. The method of driving the electronic picture frame 100 of the present invention can be implemented by using the user terminal 200 and/or the service server 300 included in the content delivery system 1000 described in FIG. 1.

Hereinafter, steps S100, S200, and S300 may be performed by the processor 120 of the electronic picture frame 100, and step S400 may be performed by the output devices 130 and 140 (see FIG. 1) under the control of the processor 120. It can be performed by . A method of driving an electronic picture frame according to an embodiment of the present invention may include steps described later.

First, the electronic picture frame 100 may obtain first metadata of the target image including the shooting time (date and time) of the target image from the user terminal 200 (S100). At this time, the user terminal 200 may transmit the target image and first metadata, which is its metadata, to the electronic picture frame 200 (S101). The first metadata includes information about the shooting time (date and time) of the target image.

Thereafter, the electronic photo frame 100 may receive first source data including sound source data having second metadata whose relevance to the first metadata satisfies a predetermined standard (S200).

The second metadata may include information about the time/period on which the sound source data was reproduced, and the number of reproductions of the sound source data corresponding to the reproduced date and time.

For example, assume that the shooting date and time among the first metadata of the target image acquired by the processor 120 is 'March 10, 20xx'. The processor 120 may determine second metadata that satisfies a predetermined standard based on the date and time of ‘March 10, 20xx’. The predetermined standard may be the presence or absence of playback and recording at the same date and time as the first metadata, or the presence or absence of playback and recording several or more times at the same date and time.

As another example, step S200 may include the following steps. First extended metadata extended to a predetermined period of time can be extracted from the first metadata. Thereafter, the first source data including sound source data having the second metadata satisfying a predetermined criterion in relation to the first extended metadata may be received. For example, the first extended metadata that extends from the standard date and time of ‘March 10, 20xx’ of the above-described first metadata to a predetermined period of time, such as a week before or after, or a month before or after, can be extracted. When the predetermined period range is one week before and after, the first extended metadata is the period from 'March 3, 20xx' to 'March 17, 20xx', including the period of one week before and after 'March 10, 20xx'. You can. Thereafter, second metadata that satisfies a predetermined criterion may be determined based on the first extended metadata.

The first source data is sound source data that satisfies the second metadata, for example, the playback date/period that satisfies the above-described first metadata or the first extended metadata, and the second metadata of the number of plays within the playback date/period. It may be sound source data having .

Predetermined criteria for determining the above-described first extended metadata and second metadata may be set in advance on the processor 120 based on various criteria.

Meanwhile, the processor 120 may receive the above-described first source data from the service server 300 (S210), may receive it from the user terminal 200 (S220), or may receive the first source data from the service server 300 (S220). It may also be received from both 300 and the user terminal 200.

In step S210, the processor 120 requests first source data having second metadata from the service server 300 (S201), and the service server 300 sends the first source data to the processor 120. Can be transmitted (S202). At this time, the first source data may be selected based on the playback records of not only the user of the electronic picture frame 100 (or the user terminal 200) but also other users stored in the DB of the service server 300. For example, sound sources played by the user may be played during the period according to the first metadata in which the target image was captured, and sound sources that were popular at that time, which were also listened to by many users other than the user, may be played during the period. .

In step S220, the processor 120 requests first source data having second metadata from the user terminal 200 (S203), and the user terminal 200 sends the first source data to the processor 120. Can be transmitted (S204). At this time, the first source data is selected based on the user's playback record, so that a user-customized sound source can be output when the content of the electronic picture frame 100 is output.

Thereafter, the processor 120 may generate first output data by linking the first source data with the target image according to a predetermined playback rule (S300). Linkage in step S300 is linkage of the first metadata and the second metadata from a temporal perspective, that is, as described above, information on the shooting date and time of the target image included in the first metadata and the second metadata include This may mean linking information about the date and time of playback.

Step S300 may specifically include the following steps.

First, a target sound source can be selected from the first source data according to the playback rule. For example, all sound source data of the first source data may be listed and linked to the target image, or depending on the embodiment, only some sound source data of the first source data may be linked. At this time, sound source data stored in conjunction with the target image among the first source data may be referred to as the target sound source.

Thereafter, the playback rule can be applied to the target sound source and the playback order, playback time, and playback mode can be set differently to generate second source data. The predetermined playback rule determines the number of sound source data according to the number of plays within the period of the second meta data, determines the playback order of the sound source data in descending order according to the playback number, or determines the playback section of the selected sound source data. It can contain various rules, such as:

Thereafter, the first output data may be generated by linking the second source data with the target image.

After step S300, the target image and target sound source according to the first output data can be output using the display unit 140 and the speaker unit 150 (S400). At this time, like the step of receiving the first source data (S200), the processor 120 may receive the above-described second source data from the service server 300 (S410) or from the user terminal 200. (S420), and although not shown in this drawing, it may be received from both the service server 300 and the user terminal 200.

In step S410, the processor 120 requests second source data according to the first output data to the service server 300 (S401), and the service server 300 sends the second source data to the processor 120. Can be transmitted (S402). In step S420, the processor 120 requests second source data according to the first output data to the user terminal 200 (S403), and the user terminal 200 sends the second source data to the processor 120. Can be transmitted (S404).

Hereinafter, the output step (S400) will be described in terms of physical operation of the electronic photo frame 100 with reference to FIGS. 3 to 5 described above. Contents that overlap with the above description will be omitted or simplified.

The electronic picture frame 100 may be provided so that at least a portion of the speaker unit 40 is exposed through a sliding operation of at least one of the upper plate 10 and the second plate 20. At this time, the electronic picture frame 100 includes a sensing unit 60 that detects the sliding motion between the plates 10 and 20, and the sensing unit 60 detects the magnet portion 62 and the movement of the magnet portion 62. It may include a Hall sensor 61 that generates a voltage by a magnetic field applied accordingly.

At this time, step S400 includes generating an output control signal based on the voltage by the sensing unit 60, displaying the target image through the display unit 30 according to the output control signal, and displaying the target image through the speaker unit 40. It may include the step of playing the target sound source.

The electronic photo frame 100 may detect a sliding motion between the two plates 10 and 20 of the electronic photo frame 100 through the sensing unit 60 . Depending on whether or not the detection occurs, the processor 120 can control the target image to be displayed through the display unit 30 and the target sound source to be played through the speaker unit 40.

As such, according to embodiments of the present invention, an image and related music are displayed together based on metadata about the time when the image was captured using a speaker-combined electronic picture frame, thereby providing a rich experience of recalling a specific point in time. This allows you to effectively provide customized content to users. Specifically, based on the shooting time when the video was acquired, the video and the sound source played by the user at that time, or the sound source that was popular at the time, are combined and provided together, in contrast to displaying only the video or outputting music unrelated to the user's history. This has the advantage of being able to deliver three-dimensional content beyond fragmentary delivery of a specific past point in time.

The operations of the processor 120 according to the embodiments of the present invention described above may be implemented in the form of a computer program that can be executed through various components on a computer, and such a computer program may be recorded on a computer-readable medium. It can be. At this time, the medium may be one that stores a program executable on a computer. Examples of media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical recording media such as CD-ROMs and DVDs, magneto-optical media such as floptical disks, And there may be something configured to store program instructions, including ROM, RAM, flash memory, etc.

Meanwhile, the computer program may be designed and configured specifically for the present invention, or may be known and available to those skilled in the art of computer software. Examples of computer programs may include not only machine language code such as that created by a compiler, but also high-level language code that can be executed by a computer using an interpreter or the like.

In addition, although preferred embodiments of the present invention have been shown and described above, the present invention is not limited to the specific embodiments described above, and the technical field to which the invention pertains without departing from the gist of the present invention as claimed in the claims. Of course, various modifications can be made by those skilled in the art, and these modifications should not be understood individually from the technical idea or perspective of the present invention.

Therefore, the spirit of the present invention should not be limited to the embodiments described above, and the scope of the claims described below as well as all scopes equivalent to or equivalently modified from the scope of the claims are included in the spirit of the present invention. It would be said to fall into the category.

100: Electronic picture frame
120: processor
200: user terminal
300: service server
10: upper plate
20: lower plate
30: Display unit
40: speaker unit
50: sliding part
60: detection unit

Claims (15)

A display unit that displays a target image;
a speaker unit that reproduces a target sound source related to the target image; and
A processor that controls output of content through the display unit and the speaker unit, wherein the processor includes,
Obtaining first metadata of the target image including information on the shooting date and time of the target image from the user terminal,
Receiving first source data including sound source data having second metadata whose relevance to the first metadata satisfies a predetermined criterion,
Generating first output data by linking the first source data with the target image according to a predetermined playback rule,
The second metadata includes information on the date and time at which the sound source data was reproduced, and the number of reproductions of the sound source data corresponding to the reproduced date and time,
When generating the first output data, the processor links information on the capture date and time of the target image included in the first metadata with information on the playback date and time included in the second metadata,
An electronic photo frame that outputs the target image and the target sound source according to the first output data using the display unit and the speaker unit. delete According to paragraph 1,
In receiving the first source data, the processor
The first source data is received from the user terminal and is selected based on the user's playback record, or
The first source data is received from a service server different from the user terminal, and is selected based on the playback records of the user and users other than the user. According to paragraph 1,
In generating the first output data, the processor
Selecting the target sound source from the first source data according to the playback rule,
Generating second source data by applying the playback rule to the target sound source and setting different playback order, playback time, and playback mode,
An electronic picture frame that generates the first output data by linking the second source data with the target image. According to paragraph 1,
The electronic picture frame includes a first plate and a second plate disposed to face the first plate, and the first plate is provided to slide with respect to the second plate through a sliding member,
An electronic picture frame in which at least a portion of the speaker unit is exposed through a sliding operation of at least one of the first plate and the second plate. According to clause 5,
The electronic picture frame includes a sensing unit that detects a sliding motion of at least one of the first plate and the second plate,
The sensing unit is an electronic picture frame including a magnet unit and a Hall sensor that generates voltage by a magnetic field applied according to movement of the magnet unit. According to clause 6,
The processor,
Generating an output control signal based on the voltage generated by the sensing unit,
An electronic picture frame that controls to display the target image through the display unit and reproduce the target sound source through the speaker unit according to the output control signal. Obtaining first metadata of the target image including information on the shooting date and time of the target image from a user terminal;
Receiving first source data including sound source data having second metadata whose relevance to the first metadata satisfies a predetermined criterion;
generating first output data by linking the first source data with the target image according to a predetermined playback rule; and
A step of outputting the target image and the target sound source according to the first output data using a display unit and a speaker unit,
The second metadata includes information on the date and time at which the sound source data was reproduced, and the number of reproductions of the sound source data corresponding to the reproduced date and time,
The step of generating the first output data includes linking information on the capture date and time of the target image included in the first metadata with information on the playback date and time included in the second metadata to generate the first output data. A method of driving an electronic picture frame, which is a step of generating a. delete According to clause 8,
In receiving the first source data,
The first source data is received from the user terminal and is selected based on the user's playback record, or
The first source data is received from a service server different from the user terminal, and is selected based on the playback records of the user and users other than the user. According to clause 8,
The step of generating the first output data is,
selecting a target sound source from the first source data according to the playback rule;
generating second source data by applying the playback rule to the target sound source and setting different playback order, playback time, and playback mode; and
generating the first output data by linking the second source data with the target image;
A method of driving an electronic picture frame, including. According to clause 8,
The electronic picture frame includes a first plate and a second plate disposed to face the first plate, and the first plate is provided to slide with respect to the second plate through a sliding member,
A method of driving an electronic picture frame, wherein at least a portion of the speaker unit is exposed through a sliding operation of at least one of the first plate and the second plate. According to clause 12,
The electronic picture frame includes a sensing unit that detects a sliding motion of at least one of the first plate and the second plate,
The sensing unit includes a magnet unit and a Hall sensor that generates voltage by a magnetic field applied according to movement of the magnet unit. According to clause 13,
The step of outputting the first output data is,
generating an output control signal based on the voltage generated by the sensing unit; and
A method of driving an electronic photo frame comprising: displaying the target image through the display unit and reproducing the target sound source through the speaker unit according to the output control signal. A computer program stored in a computer-readable storage medium to execute the method of any one of claims 8 and 10 to 14 using a computer.

Images