KR101935000B1 - Method and apparatus for controlling device - Google Patents

Abstract

Discloses a device control method for identifying a registered device on a screen input through a camera, receiving a user input for the identified device, and transmitting a control command corresponding to the input to the identified device.

Description

TECHNICAL FIELD [0001] The present invention relates to a method and apparatus for controlling a device,

An embodiment of the present invention relates to a device control method and apparatus, and more particularly, to a content playback device control method for displaying content of a device recognized in an image through a camera and playing the content on another device connected thereto, and ≪ / RTI >

Recently, as augmented reality technology has been developed, it has become widely used in social and cultural terms. In particular, the application of augmented reality related application software is becoming more and more popular with the launch of high performance smartphones or tablet PCs. Augmented Reality (AR) is a technique for superimposing virtual objects on the real world that the user sees. It is also referred to as Mixed Reality (MR) because it combines the virtual worlds with additional information in real time in real time and displays them as one image. The hybrid VR system is a hybrid VR system that combines the real environment with the virtual environment. Since the late 1990s, research and development have been conducted mainly in the United States and Japan.

Augmented reality, a concept that complements the real world with a virtual world, uses a virtual environment created by computer graphics, but the protagonist is a real environment. Computer graphics serve to provide additional information needed for the real world. By overlapping the three-dimensional virtual image on the real image that the user is viewing, it means that the distinction between the real environment and the virtual screen becomes blurred.

Virtual reality technology allows a user to be immersed in a virtual environment, and the real environment can not be seen. However, augmented reality technology, which is a mixture of real environment and virtual objects, allows the user to see the real environment and provides better realism and additional information. For example, if you use a smartphone camera to illuminate the surroundings, information such as the location of a nearby store, phone number, and the like is displayed as a stereoscopic image.

Remote medical diagnosis, broadcasting, architectural design, manufacturing process management, etc. Recently, smartphones have become widely used and commercialized, and various products are being developed in the game and mobile solution industry and education field.

An object of the present invention is to provide a method and apparatus for controlling a content playback device to intuitively share content while watching a device to be played back and a content having the content.

According to an aspect of the present invention, there is provided a method of controlling a device, the method comprising: identifying a registered device on a screen input through a camera; Receiving a user input for the identified device; And transmitting a control command corresponding to the input to the identified device.

Wherein the device control method comprises: requesting the identified device for content information; Receiving content information from the identified device; And displaying the received content information, wherein receiving the user input may include receiving a user input for the displayed content information.

The device control method may further comprise displaying content information for pre-stored content, and wherein receiving the user input may include receiving a user input for the displayed content information.

The content information may include at least one of a content thumbnail, a content metadata, and a content file name.

Wherein receiving the user input for the displayed content information comprises receiving a user input for moving the displayed content information to an identifiable device capable of being reproduced and transmitting a control command corresponding to the input to the identified device May include transmitting a content reproduction command corresponding to the moved content information to the reproducible identified device.

The step of transmitting the content reproduction command to the reproducible identified device may further include transmitting the address of the content to the reproducible identified device.

The step of receiving a user input for moving the content information to a reproducible identified device may include receiving a user input for moving the content information to an identified device capable of being dragged and reproduced.

According to another aspect of the present invention, there is provided a method of controlling a content playback apparatus, the method comprising: identifying a registered device on a screen input through a camera; Receiving and displaying content information from the identified device; Receiving user input for the displayed content information; And executing a control command corresponding to the input.

The step of executing the control command corresponding to the input may include reproducing the content corresponding to the content information.

Wherein the content reproducing apparatus control method further comprises a step of matching and registering predetermined device video information recognized through a predetermined camera with the recognized predetermined device information and registering the registered device on the screen input through the camera The step of identifying comprises: recognizing the device through a predetermined image analysis on a screen input through the camera; Comparing the image information of the recognized device with predetermined image information registered; And identifying the recognized device as a result of the comparison.

According to another aspect of the present invention, there is provided a content playback apparatus control apparatus including a controller for identifying a registered device on a screen input through a camera; And a user input unit for receiving a user input for the identified device, wherein the control unit transmits a control command corresponding to the user input to the identified device.

According to another aspect of the present invention, there is provided a content playback apparatus control apparatus including a controller for identifying a registered device on a screen input through a camera; A display unit for receiving and displaying content information from the identified device; And a user input unit for receiving a user input for the displayed content information, wherein the control unit executes a control command corresponding to the input.

1 is a flowchart illustrating a method of controlling a content playback apparatus according to an embodiment of the present invention.
2 is a flowchart illustrating a registration method according to an embodiment of the present invention.
3 is a flowchart illustrating a method of controlling a content reproducing apparatus according to an embodiment of the present invention.
Figures 4A and 4B are diagrams illustrating a scenario for the method of Figure 3;
5 is a flowchart illustrating a method of controlling a content reproducing apparatus according to another embodiment of the present invention.
Figures 6A and 6B are diagrams illustrating a scenario for the method of Figure 5;
7 is a flowchart illustrating a method of controlling a content reproducing apparatus according to another embodiment of the present invention.
Figures 8A and 8B are diagrams illustrating a scenario for the method of Figure 7;
9 is a view showing a scenario related to a method of controlling a content reproducing apparatus according to another embodiment of the present invention.
10 is a block diagram of a content playback device control apparatus according to an embodiment of the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a flowchart illustrating a content playback control method according to an embodiment of the present invention.

Referring to FIG. 1, the content playback device control device identifies registered devices on a screen input through a camera. Registered device means a device in which image recognition information of a predetermined device is stored in advance in the content reproduction device control device. The content reproduction device control device previously stores the image recognition information of the device recognized through the camera by matching with the device information of the device selected by the user. Thereafter, the content playback device control device compares the image recognition information of the device recognized on the screen input through the camera with the stored image recognition information, and if it matches, the device information matching the compared image recognition information Identify the corresponding device.

In step 120, the content playback device control device receives a user input for the identified device. For example, the content playback device control apparatus can request content information from the identified device, receive and display the content information, or display the content information stored in itself. In this case, the content reproduction device control device may receive a user input for moving the displayed content information to the reproducible identified device, or may receive a user input for reproducing the content corresponding to the content information in the content reproduction device control device itself . In another example, when the content playback device control device displays content information for stored content, the content playback device control device may receive user input to move to the identified device. In the present invention, as an example of moving the content information, the user drags one of the displayed content information and drops it to the identified device.

In step 130, the content reproduction device control device transmits a control command corresponding to the user input to the identified device. In the example of step 120, the control command indicates a playback command of the content corresponding to the content information. The playback command is merely an example, and is not limited, and the control command may vary according to the characteristics of the user input.

Hereinafter, specific embodiments will be described.

2 is a flowchart illustrating a registration method according to an embodiment of the present invention.

Referring to FIG. 2, in step 210, the content playback device control device captures an image through a camera included in the content playback device control device and inputs an image of the device being displayed.

In step 220, the content reproduction device control device analyzes the device image recognition information from the input device image. Further, the content playback device control apparatus searches for devices connectable through a predetermined network. Examples of a given network include Zigbee, Wi-Fi, bluetooth, IEEE 802.11, HomeRF, Infrared Data Association, USB (Ultra WireBand), NFC Near Field Communication (RFID), Radio Frequency Identification (RFID), and wireless 1394, or wired protocol based protocols such as Ethernet, Phoneline Networking Alliance, PLC (Power Line Communication), IEEE 1394, Network.

In step 230, the content reproduction device control device matches the analyzed device video recognition information with corresponding device information. The content playback device control device displays the analyzed device video recognition information and the searched connectable devices. Thereafter, when the user selects the displayed device image recognition information and the searched connectable device, the selected display device image recognition information is matched with the searched connectable device.

In step 240, the content reproduction device control device stores device image recognition information and device information. For example, the content reproduction device control device stores the image recognition information of the displayed device and the device information of the connected device (for example, the unique ID of the device) in a predetermined storage of the content playback device control device. Of course, matching information of both pieces of information is also stored.

3 is a flowchart illustrating a content playback control method according to an embodiment of the present invention.

Referring to FIG. 3, in step 310, the content playback device control device identifies registered devices on the screen input through the camera. First, the content playback device control device recognizes the displayed device on the screen input through the camera. Thereafter, the image recognition information of the recognized device is extracted and compared with the image recognition information of the device registered by the method of FIG. If they match, the content reproduction device control device identifies the device that is matched with the compared image recognition information. The content playback device control device may indicate that the identified device is an identified device through a predetermined indication (for example, displayed in a border on the border with other devices). Further, in the case of a device in which the content can be reproduced from among the identified devices, the content reproduction device control device may be further displayed by a method different from the identification display.

In step 320, the content playback device control device requests content information from the identified device. In one embodiment of the present invention, the content information may include at least one of a thumbnail of the content, address information of the content, such as the storage folder name of the device and the content, and the file name of the content. In addition, the thumbnail of the content and the file name of the content may include the address information of the content.

In step 330, the content reproduction device control device receives and displays the content information. There is no limitation on the method of displaying the content information. For example, the content playback device control device may be arranged around the device that transmitted the content information and may be displayed on a menu screen such as a play list regardless of the position of the identified device. When there is a plurality of pieces of content information, the content reproduction device control device may limit the number of pieces of content to display the content, and may further display other pieces of content according to the input of the user. For example, the content playback device control device displays content information received in the form of a semicircle around the device that transmitted the content information, and when receiving a drag signal of the user's clock or counterclockwise direction, Information may be displayed. In another embodiment, when the content reproduction device control device provides the focusing function in steps 310 to 330, the content information for all the registered devices is not displayed but the steps 310 to 330 are performed only for the focused devices .

In step 340, the content playback device control device receives a user input that moves the displayed content information to a reproducible identified device. The user moves the displayed content information to a device identified by a predetermined input means. For example, the user may drag one of the displayed content information and drop it on the reproducible identified device.

In step 350, the content reproduction device control device transmits a reproduction command of the content corresponding to the moved content information to the reproduced identifiable device. In this case, the content reproduction device control device can transmit the address information of the content corresponding to the moved content information to the content reproduction device together with the content reproduction command. If the content address information is stored in the content reproduction apparatus control apparatus, the content reproduction apparatus control apparatus transmits the content address information together with the content reproduction apparatus control apparatus. If the content address information is not stored in the content reproduction apparatus control apparatus, It is possible. Further, the content reproduction device control apparatus may request the device that transmitted the content information to transmit the content address information to the directly reproduced identified device. Of course, this is not the case when the content address information is stored in the content information itself. Thereafter, the content reproduction device receives and reproduces the content according to the content address information.

Figures 4A and 4B are diagrams illustrating a scenario for the method of Figure 3;

Referring to FIG. 4A, the content playback device control apparatus 400 includes a display 410 and a camera 420. FIG. The content playback device control device 400 identifies the devices registered on the screen input through the camera 420. [ In Fig. 4A, devices displayed on the screen of the display 410 include a television 411, a notebook 412, a refrigerator 413, and the like. Thereafter, the content reproduction device control device 400 identifies the device registered in the device displayed on the screen of the display 410 through the camera 420. [ The identified device may be provided with a predetermined indication (for example, a color indication on the border, etc.) unlike a general device. In FIG. 4A, it is assumed that the identified device is a television 411 and a notebook 412. After the registered device is identified, the device 400 requests the content information from the identified device. Thereafter, when receiving the requested content information, the content reproduction device control apparatus 400 displays the received content information on the screen of the display 410. [ In FIG. 4A, as an example of the content information, thumbnails 401 to 404 of respective contents are displayed on the screen of the display 410. FIG. In FIG. 4A, content thumbnails 401 to 404 are displayed in the vicinity of the device that transmitted the content information, that is, the notebook 412. When the user drags the thumbnail clockwise or counterclockwise, the semicircular thumbnails 401 to 404 rotate and other thumbnails are displayed. When the user 430 drag and drop a thumbnail 403 displayed on the television 411 as a reproducible device, the content reproduction device control apparatus 400 controls the content playback device 403 included in the content thumbnail 403 Extracts the content address, transfers it to the television 411, and transmits the playback command to the television 411. Thereafter, the television 411 receives and reproduces the content according to the received content address. 4B shows that the content corresponding to the content thumbnail 403 is reproduced on the television 411. FIG.

5 is a flowchart illustrating a content playback control method according to another embodiment of the present invention.

Referring to FIG. 5, step 510 is the same as step 310 of FIG. 3, and thus will be omitted to avoid redundant description.

In step 520, the content reproduction device control device displays the previously stored content information. That is, the content reproduction apparatus control apparatus displays the content information stored in the content reproduction apparatus control apparatus itself. The content information is the same as the content information described in step 320 of FIG. In step 520, the content reproduction device control device requests content information from the identified device, such as step 320 and step 330 in FIG. 3, displays the received content information, and then displays the content stored in the content reproduction device control device itself More information can be displayed.

Steps 530 and 540 are similar to steps 340 and 350 of FIG. However, there is a difference in that the content information that can be moved by the user is the content information about the content stored in the content player control device itself. Of course, when the content information is received from the identified device and further displayed, the content information that can be moved by the user is not only the content information about the content stored in the content player control device itself, but also the received content information There is a difference.

Figures 6A and 6B are diagrams illustrating a scenario for the method of Figure 5;

Referring to FIG. 6A, the content playback device control apparatus 600 includes a display 610 and a camera 620. FIG. The content playback device control apparatus 600 identifies the registered device on the screen input through the camera 620. [ 6A, there are a television 611, a notebook 612, and the like as devices displayed on the screen of the display 610. FIG. Thereafter, the content reproduction device control device 600 identifies the device registered in the device displayed on the screen of the display 610 through the camera 620. [ The identified device may be provided with a predetermined indication (for example, a color indication on the border, etc.) unlike a general device. In Fig. 6A, it is assumed that the identified device is a television 611 and a notebook 612. [ The content playback device control apparatus 600 displays content thumbnails 605 to 608, which are self-stored content information, in a predetermined area 630. Or, in addition, the content reproduction device control apparatus 600 requests content information from the identified device. Then, when receiving the requested content information, the content reproduction device control device 600 displays the received content information on the screen of the display 610. [ In FIG. 6A, as an example of content information, thumbnails 601 to 604 of respective contents are displayed on the screen of the display 610. In this case, the user can move one of the self-stored content thumbnails 605 to 608 to a device that can be reproduced by drag & drop, and can select one of the received content thumbnails 601 to 604 to be reproducible by drag & Can be moved. 6A, in the case where the user 640 drag and drop a displayed thumbnail 606 of self-stored content to the notebook 612, which is a reproducible device, the content playback device control apparatus 600 controls the content thumbnail 606 Extracts the content address corresponding to the content 606, delivers it to the notebook 612, and transmits the playback command to the notebook 612. [ Thereafter, the notebook computer 612 receives and reproduces the content according to the received content address. 6B shows that the content corresponding to the content thumbnail 606 in the notebook 612 is reproduced.

7 is a flowchart illustrating a content playback control method according to another embodiment of the present invention.

Referring to FIG. 7, steps 710 to 730 are the same as steps 310 to 330 of FIG. 3, and therefore, the description will be omitted to avoid redundant description.

At step 740, the content playback device control device receives a user input for the displayed content information. In Fig. 7, unlike the method of Fig. 3 or Fig. 5, the content reproduction apparatus control apparatus itself reproduces the content corresponding to the displayed content information. That is, the user input is a user input to reproduce the content corresponding to the content information selected by the content reproduction apparatus control apparatus itself. As an example of the interface, a button for simply recognizing the click of the content information as a user input according to the present step or providing an interface that can be reproduced by the content reproduction apparatus control apparatus itself is provided, and the button is activated (for example, A case where one of the displayed content information is dragged and dropped on a button) is recognized as a user input according to this step.

In step 750, the content reproduction device control apparatus reproduces the content corresponding to the content information. The content reproduction device control device receives and reproduces the content according to the address information of the content corresponding to the content information according to the user input.

9 is a diagram illustrating a scenario related to a content playback control method according to another embodiment of the present invention.

In the case of a television, it is unlikely to move, but in the case of a laptop, it may not be in a fixed position due to frequent movement. In this case, a device (for example, a refrigerator, a washing machine, etc.) which does not have a content can be registered by a method of FIG. 2 as a virtual notebook. In the case where the virtually registered device is illuminated through the camera, the content reproducing device control device identifies the device as a device registered with the notebook, and can request and display the content information. However, in this case, the virtual registered device and the notebook must be communicatively connected. 9, when the refrigerator 912 is recognized on the screen of the display 910 through the camera 920, the content reproducing device control device 900 recognizes the information as a registered device, 904, and perform the method of FIGS. 3 through 8.

According to another embodiment of the present invention, if only the communication state with the content reproduction device control device and the device registered by the method of FIG. 2 is maintained, if there is an obstacle (e.g., a wall) You can also request and display content information on a registered device. Thereafter, the method of Figs. 3 to 8 can be performed.

10 is a block diagram of an apparatus for controlling a content reproducing apparatus according to an embodiment of the present invention.

10, the content playback device control apparatus 1000 includes an image input unit 1010, a control unit 1020, a storage unit 1030, a user input unit 1040, a display unit 1050, and a communication unit 1060 do. The content playback apparatus control apparatus 1000 is connected to a device to be recognized through a video input unit 1010 through a predetermined network. Examples of a given network include Zigbee, Wi-Fi, bluetooth, IEEE 802.11, HomeRF, Infrared Data Association, USB (Ultra WireBand), NFC Near Field Communication (RFID), Radio Frequency Identification (RFID), and wireless 1394, or wired protocol based protocols such as Ethernet, Phoneline Networking Alliance, PLC (Power Line Communication), IEEE 1394, Network.

The video input unit 1010 means a camera. However, the present invention is not limited to a camera, and there is no restriction as long as it is an apparatus for photographing a subject and providing an image.

The display unit 1050 displays an image input through the image input unit 1010. Also, content information to be described later is also displayed.

The control unit 1020 identifies the device registered on the screen displayed on the display unit 1050 through the image input unit 1010. The registered device means a device in which image recognition information of a predetermined device is stored in the storage unit 1030 in advance. The control unit 1020 stores the image recognition information of the recognized device through the image input unit 1010 and stores it by matching with the device information of the device selected by the user. Thereafter, the control unit 1020 compares the image recognition information of the device recognized on the screen input through the image input unit 1010 with the stored image recognition information, and if the image recognition information matches the stored image recognition information, And identifies the device corresponding to the device information.

The user input 1040 receives a user input for the identified device. For example, the control unit 1020 requests the identified device through the communication unit 1030 to receive the content information, displays the received content information, or displays the content information stored in the storage unit 1030 on the display unit 1050 . In this case, the user input unit 1040 may receive a user input for moving the displayed content information to an identifiable device capable of being reproduced, or may receive a user input for reproducing content corresponding to the content information stored in the storage unit 1030 . In another example, if the display portion 1050 displays content information for the stored content, the user input 1040 may receive user input to move to the identified device. In the present invention, as an example of moving the content information, the user drags one of the displayed content information and drops it to the identified device. The user input unit 1040 may be a touch screen or may be formed integrally with the display unit 1050.

Thereafter, the control unit 1020 transmits a control command corresponding to the user input to the device identified through the communication unit 1060. [ The control command indicates a playback command of the content corresponding to the content information. The playback command is merely an example, and is not limited, and the control command may vary according to the characteristics of the user input.

Each specific embodiment will be described below.

Hereinafter, an embodiment of a content playback device control apparatus 1000 that performs a method of registering a predetermined device will be described.

The control unit 1020 captures an image through the image input unit 1010 and inputs an image of the device being displayed on the display unit 1050. [ Thereafter, the control unit 1020 analyzes the device image recognition information from the input device image. In addition, the control unit 1020 searches for devices connectable through a predetermined network. Thereafter, the control unit 1020 displays the analyzed device image recognition information and the searched connectable devices on the display unit 1050. Then, when the user selects the device image recognition information displayed on the display unit 1050 and the searched connectable device through the user input unit 1040, the control unit 1020 displays the selected display device image recognition information and the searched connectable device Match. Thereafter, the control unit 1020 stores the device image recognition information and the device information in the storage unit 1030.

Hereinafter, a first embodiment of a content playback device control apparatus 1000 that performs a content playback control method will be described.

The control unit 1020 identifies the registered device on the screen input through the image input unit 1010. [ First, the control unit 1020 recognizes the displayed device on the screen input through the image input unit 1010, extracts the image recognition information of the recognized device, and recognizes the image of the registered device stored in the storage unit 1030 Compare with information. Thereafter, when the image recognition information matches, the control unit 1020 identifies the device that is matched with the compared image recognition information. In addition, the control unit 1020 may display the identified device in the display unit 1050 through a predetermined display (for example, display on the rim differently from other devices). Further, in the case of a device whose content can be reproduced from among the identified devices, the control unit 1020 may further display the content on the display unit 1050 in a manner different from the identification display.

The control unit 1020 requests content information from the identified device through the communication unit 1060. [ In one embodiment of the present invention, the content information may include at least one of a thumbnail of the content, address information of the content, such as the storage folder name of the device and the content, and the file name of the content. In addition, the thumbnail of the content and the file name of the content may include the address information of the content.

The display unit 1050 receives and displays the content information. There is no limitation on the method of displaying the content information. For example, the display unit 1050 may display the content information around the transmitted device, and the display unit 1050 may display the content information on a menu screen such as a play list regardless of the location of the identified device It is possible. When there is a plurality of pieces of content information, the display unit 1050 may limit the number of pieces of content to display the content, and may further display other pieces of content according to the input of the user. For example, the display unit 1050 displays the content information received in the form of a semicircle around the device that transmitted the content information, and receives the drag signal of the user's clock or counterclockwise through the user input unit 1040 , It may be rotated to display other content information. In another embodiment, when the content playback device control apparatus 1000 provides a focusing function, the display unit 1050 does not display content information about all registered devices, but displays only content information related to the focused device You may.

The user input unit 1040 receives a user input for moving the displayed content information to a reproducible identified device. The user moves the content information displayed through the user input unit 1040 to a device identified by a predetermined input means. For example, the user may drag one of the displayed content information and drop it on the reproducible identified device.

Thereafter, the control unit 1020 transmits the reproduction command of the content corresponding to the moved content information to the reproduced identifiable apparatus. In this case, the control unit 1020 can transmit the address information of the content corresponding to the moved content information to the content playback device together with the content playback command through the communication unit 1060. [ If the content address information is stored in the storage unit 1030, the control unit 1020 transmits the content address information together. If the content address information is not stored in the storage unit 1030, the content address information may be transmitted to an apparatus have. In addition, the control unit 1020 may request the device that transmitted the content information to transmit the content address information to the directly reproduced identified device. Of course, this is not the case when the content address information is stored in the content information itself. Thereafter, the content reproduction device receives and reproduces the content according to the content address information.

Hereinafter, a second embodiment of the content playback device control apparatus 1000 that performs the content playback control method will be described.

The display unit 1050 displays content information corresponding to the content stored in the storage unit 1030. That is, the display unit 1050 displays the content information stored in the content player control apparatus 1000 itself. Of course, the display unit 1050 may further display the content information received from the external device described in the first embodiment.

The user input unit 1040 receives a user input for moving the displayed content information to a reproducible identified device. Thereafter, the control unit 1020 transmits the reproduction command of the content corresponding to the moved content information to the reproduced identifiable apparatus.

That is, the second embodiment differs from the first embodiment in that the content stored in the content playback device control apparatus 1000 itself is also displayed and can be transmitted to a registered device that can reproduce the content.

Hereinafter, a third embodiment of the content playback device control apparatus 1000 that performs the content playback control method will be described.

The user input unit 1040 receives user input for the displayed content information. The user input is a user input to reproduce the content corresponding to the selected content information in the content reproduction apparatus control apparatus 1000 itself. As an example of the interface, there is provided a button for recognizing as a user input when simply clicking the content information, or providing a user interface 1040 with an interface that can be reproduced by the content reproduction apparatus control apparatus 1000 itself, (For example, when dragging one of the displayed content information and dropping it on a button) is recognized as a user input.

The control unit 1020 reproduces the content corresponding to the content information. The control unit 1020 receives and reproduces the content according to the address information of the content corresponding to the content information according to the user input.

The third embodiment is different from the first embodiment in that the content corresponding to the displayed content information is reproduced from the content reproducing apparatus control apparatus 1000 itself.

In another embodiment, the control unit 1020 can register a device (e.g., a refrigerator, a washing machine, etc.) that does not have content as a virtual device having content. When the control unit 1020 illuminates a device having no content through the image input unit 1010, the control unit 1020 identifies the device as a registered device, and can request and display the content information. However, in this case, the device that does not have the content and the virtual device should be connected in communication.

Further, in another embodiment, the control unit 1020 may display registered devices even when there is an obstacle (e.g., a wall) if only the communication state with the content playback device control apparatus 1000 and registered devices is maintained , Requests the registered device for content information, displays the content information, and performs the above-described method for controlling the content reproducing device.

The content playback device control method as described above can also be implemented as a computer readable code on a computer readable recording medium. A computer-readable recording medium includes all kinds of recording media in which data that can be read by a computer system is stored. Examples of the computer-readable recording medium include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, and the like. The computer readable recording medium may also be distributed over a networked computer system so that computer readable code can be stored and executed in a distributed manner. And, functional programs, codes, and code segments for implementing the disk management method can be easily deduced by the programmers of the present invention.

The present invention has been described with reference to the preferred embodiments. It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims. Therefore, the disclosed embodiments should be considered in an illustrative rather than a restrictive sense. The scope of the present invention is defined by the appended claims rather than by the foregoing description, and all differences within the scope of equivalents thereof should be construed as being included in the present invention.

Claims (25)

A method for an electronic device to control a device,
Identifying at least one registered device in an image photographed through a camera of the electronic device;
Receiving, at the identified registered device, a thumbnail image representing the content of the identified registered device;
And displaying the received thumbnail image on a screen of the electronic device together with a predetermined area corresponding to the electronic device and a first device image representing the identified registered device, Displaying on the periphery of the image;
Receiving a user input for selecting the displayed thumbnail image; And
Receiving a content corresponding to the selected content information from the identified registered device;
/ RTI >
Wherein the step of receiving a user input for selecting the thumbnail image comprises the steps of: touching the thumbnail image among the first device image and the thumbnail image displayed together on the screen; and displaying the touched thumbnail image on the screen To the predetermined area corresponding to the predetermined area. The method according to claim 1,
Requesting the identified registered device for the thumbnail image;
Receiving the thumbnail image from the identified registered device; And
Gt; a < / RTI > The method according to claim 1,
Wherein receiving the thumbnail image comprises receiving at least one of content metadata and a content file name. The method according to claim 1,
Receiving an address of the content from the identified registered device;
Further comprising the steps of: delete An electronic device for controlling a device,
A control unit for identifying at least one registered device in an image photographed through a camera of the electronic device;
A communication unit for receiving a thumbnail image representing the content stored in the identified registered device from the identified registered device;
Displaying the first device image representing the registered registered device, the received thumbnail image, and a predetermined area corresponding to the electronic device together, and displaying the received thumbnail image on the periphery of the first device image A display unit; And
A user input for receiving a user input for selecting the displayed thumbnail image;
/ RTI >
Wherein the control unit controls the communication unit to receive the content corresponding to the selected thumbnail image from the identified registered device when the user input is received,
Wherein the user input unit is configured to touch the thumbnail image among the first device image and the thumbnail image displayed together on the screen and to display the touched thumbnail image on the screen of the electronic device, And receiving user input to move to the area. The method according to claim 6,
Wherein the communication unit requests a thumbnail image from the identified registered device and receives a thumbnail image from the identified registered device. A method for an electronic device to transmit content,
Receiving a request from a first device to send a thumbnail image thumbnail image of the content stored in the electronic device;
Transmitting the thumbnail image thumbnail image to the first device in response to the request;
Receiving, from the first device, a control command related to playback of the content corresponding to the thumbnail image thumbnail image; And
Transmitting the content to a second device based on the control command;
/ RTI >
The electronic device communicating with the first device and the second device via at least one wireless communication,
Wherein the transmitted thumbnail image is displayed on a screen of the first device together with a first device image of the first device and a predetermined area corresponding to the first device,
Wherein the control command is a command that is transmitted from the first device to the electronic device as the thumbnail image is touched and moved from the first device image and the thumbnail image displayed on the screen to the predetermined area, , Way. 9. The method of claim 8,
Wherein a device image representing the electronic device is registered with the first device. 10. The method of claim 9,
Receiving a search signal from the first device; And
Transmitting device information of the electronic device to the first device in response to receipt of the search signal;
/ RTI >
Wherein the device information of the electronic device is used by the first device to register the device image of the electronic device. 10. The method of claim 9,
Wherein the electronic device is identified by the first device by comparing the device image of the electronic device currently photographed by the first device and the registered device image of the electronic device. 9. The method of claim 8,
Wherein the step of transmitting the thumbnail image comprises transmitting a thumbnail image of transmitting at least one of the content metadata and the content file name. 10. The method of claim 9,
Wherein the thumbnail image thumbnail is displayed on the screen of the first device at a periphery of the registered device image representing the electronic device. 9. The method of claim 8,
Wherein the device image of the second device, the device image of the electronic device, and the thumbnail image are displayed together on the screen of the first device. 9. The method of claim 8,
Providing address information of content to the second device;
≪ / RTI > An electronic device for transmitting content,
Communication interface;
A memory for storing one or more instructions;
Receiving from the first device a request to send a thumbnail image of content stored in the electronic device by executing one or more instructions stored in the memory, sending the thumbnail image to the first device in response to the request, A processor for receiving, from the first device, a control command related to playback of the content corresponding to the thumbnail image, and transmitting the content to a second device based on the control command;
/ RTI >
The processor communicating with the first device and the second device via at least one wireless communication by controlling the communication interface,
Wherein the transmitted thumbnail image is displayed on a screen of the first device together with a first device image of the first device and a predetermined area corresponding to the first device,
Wherein the control command is a command that is transmitted from the first device to the electronic device as the thumbnail image is touched and moved from the first device image and the thumbnail image displayed on the screen to the predetermined area, , An electronic device. 17. The method of claim 16,
Wherein the device image representing the electronic device is registered with the first device. 18. The method of claim 17,
Wherein the processor receives the search signal from the first device by executing the at least one instruction and transmits the device information of the electronic device to the first device in response to receipt of the search signal,
Wherein the device information of the electronic device is used by the first device to register the device image of the electronic device. 18. The method of claim 17,
Wherein the electronic device is identified by the first device by comparing the device image of the electronic device currently photographed by the first device with the registered device image of the electronic device. 17. The method of claim 16,
Wherein the processor is operable to transmit the at least one of the content metadata and the content file name to the first device by controlling the communication interface. 18. The method of claim 17,
Wherein the thumbnail image is displayed on the screen of the first device at a periphery of the registered device image representing the electronic device. 17. The method of claim 16,
Wherein the device image of the second device, the device image of the electronic device, and the thumbnail image are displayed together on the screen of the first device. 17. The method of claim 16,
Wherein the processor is operable to execute the at least one instruction to provide address information of the content to the second device. A computer-readable recording medium recording a program for causing a computer to execute the method of claim 1. A computer-readable recording medium storing a program for causing a computer to execute the method of claim 8.

Images