KR101971911B1 - Method for displaying for image and an electronic device thereof - Google Patents

Method for displaying for image and an electronic device thereof Download PDF

Info

Publication number
KR101971911B1
KR101971911B1 KR1020120089692A KR20120089692A KR101971911B1 KR 101971911 B1 KR101971911 B1 KR 101971911B1 KR 1020120089692 A KR1020120089692 A KR 1020120089692A KR 20120089692 A KR20120089692 A KR 20120089692A KR 101971911 B1 KR101971911 B1 KR 101971911B1
Authority
KR
South Korea
Prior art keywords
electronic device
image
detected
information
display
Prior art date
Application number
KR1020120089692A
Other languages
Korean (ko)
Other versions
KR20140023079A (en
Inventor
최영근
Original Assignee
삼성전자주식회사
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 삼성전자주식회사 filed Critical 삼성전자주식회사
Priority to KR1020120089692A priority Critical patent/KR101971911B1/en
Publication of KR20140023079A publication Critical patent/KR20140023079A/en
Application granted granted Critical
Publication of KR101971911B1 publication Critical patent/KR101971911B1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device; Cooperation and interconnection of the display device with other functional units
    • G06F3/1423Digital output to display device; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device; Cooperation and interconnection of the display device with other functional units
    • G06F3/1454Digital output to display device; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2356/00Detection of the display position w.r.t. other display screens

Abstract

The present invention relates to a method and an electronic apparatus for displaying an image, the method comprising: displaying an image; detecting at least one other electronic device; Transmitting the image and divided display information to the at least one other electronic device to request display of the image if at least one other electronic device is located within a first threshold distance; And partially displaying the image based on the number of the at least one other electronic device and the divided display information when at least one other electronic device is located within the second threshold distance.

Description

≪ Desc / Clms Page number 1 > METHOD FOR DISPLAY FOR IMAGE AND AN ELECTRONIC DEVICE THEREOF &

The present invention relates to an electronic device, and more particularly, to a method and apparatus for displaying a shared image in a plurality of electronic devices.

2. Description of the Related Art Recently, electronic devices capable of wireless voice communication and information exchange have become a necessity of life in accordance with rapid development of electronic devices such as a smart phone and a tablet PC (Personal Computer). However, as the technology has been developed and the wireless Internet has been introduced, the electronic device has come out of the portable device capable of simply making a wireless call, and has been used for a variety of applications such as a schedule management, a game, a remote control, Function as a multimedia device to meet the needs of users.

Particularly, as the convenience and portability of electronic devices become more important in recent years, miniaturized electronic devices are being released. However, when an application is executed using miniaturized electronic devices, the user suffers inconvenience of content use due to a small-sized display device. For example, when an Internet application is run on a miniaturized smart phone, a small-sized touch screen displays only a part of the web browser or a reduced portion of the contents of the web browser, so that the user can view other contents of the web browser A control operation for moving the screen to the left or right or enlarging and displaying the contents of the web browser must be performed. As another example, when running a video application on a miniaturized smartphone, the user may feel stuck in watching the video due to the small size of the touch screen. Accordingly, there is a need to provide a method of displaying a larger image even in a display device of a miniaturized electronic device.

Accordingly, an embodiment of the present invention is to provide a method and apparatus for sharing and displaying an image according to the distance between electronic devices in a plurality of electronic devices.

Another embodiment of the present invention is to provide a method and apparatus for dividing an image in an electronic device to share an image with another electronic device.

Another embodiment of the present invention is to provide a method and apparatus for sharing and displaying divided images in an electronic device with other electronic devices.

Another embodiment of the present invention provides a method and apparatus for outputting an audio signal according to a user's position when displaying an image in a plurality of electronic devices.

Another embodiment of the present invention is to provide a method and apparatus for determining a display area of a shared image based on a display device size of each of a plurality of electronic devices when displaying a shared image in a plurality of electronic devices.

Yet another embodiment of the present invention is to provide a method and apparatus for determining a display area of a shared image based on user input in a plurality of unaligned electronic devices to display a shared image.

Another embodiment of the present invention provides a method and an apparatus for performing an additional function using an area other than an area where an image is displayed when displaying a shared image in a plurality of electronic apparatuses of different sizes have.

According to an embodiment of the present invention, an image display method of an electronic device includes the steps of displaying an image, detecting at least one other electronic device, and detecting the electronic device and the detected at least one other electronic device 1 threshold distance, requesting the display of the image by sending the image and split display information to the at least one other electronic device; and if the detected at least one other electronic device 2 < / RTI > threshold distance, partially displaying the image based on the number of the at least one other electronic device detected and the divided display information.

According to another embodiment of the present invention, an image display method of an electronic device includes the steps of: detecting at least one other electronic device; and when the electronic device and the detected at least one other electronic device are located within a first critical distance Receiving image and segmented display information from the detected one other electronic device; and displaying the received image, wherein the electronic device and the detected at least one other electronic device are within a second critical distance And partially displaying the image on the basis of the divided display information.

According to another embodiment of the present invention, an image display electronic device comprises at least one processor; A display device; A communication device; Memory; And one or more programs stored in the memory and configured to be executed by the one or more processors, the program comprising: displaying an image; detecting at least one other electronic device; And requesting display of the image by sending the image and split display information to the at least one other electronic device if at least one other electronic device is located within a first threshold distance, And partially displaying the image based on the number of the detected at least one other electronic device and the divided display information when one other electronic device is located within the second threshold distance.

According to another embodiment of the present invention, an image display electronic device comprises at least one processor; A display device; A communication device; Memory; And one or more programs stored in the memory and configured to be executed by the one or more processors, the program comprising instructions for: detecting at least one other electronic device; Receiving image and segmented display information from the detected one other electronic device when the electronic device is located within a first threshold distance, displaying the received image, and receiving the detected at least one other electronic And partially displaying the image based on the divided display information when the apparatus is located within a second threshold distance.

In the present invention, an electronic device detects another electronic device in the vicinity, and an image being displayed in the electronic device is transmitted to the detected other electronic device so that the same image in each electronic device Or a predetermined area of the same image, thereby providing a larger image to the user, and outputting different audio signals according to the user's position, thereby providing stereoscopic sound to the user.

BRIEF DESCRIPTION OF THE DRAWINGS Fig. 1A is a block diagram showing an electronic device for sharing and displaying an image according to an embodiment of the present invention. Fig.
Figure 1B illustrates a processor of an electronic device sharing and displaying an image in accordance with an embodiment of the present invention;
2A is a diagram showing an example in which an image is divided into two images having the same size and then enlarged in the electronic device according to the embodiment of the present invention,
FIG. 2B is a diagram showing an example of dividing an image into three images having the same size in an electronic device according to an embodiment of the present invention,
FIG. 2C is a diagram showing an example of dividing an image into two images having different sizes and enlarging it in the electronic device according to the embodiment of the present invention; FIG.
FIG. 3A illustrates a procedure for displaying an image according to distance in an electronic device according to an embodiment of the present invention; FIG.
Figure 3B is a diagram illustrating the means for displaying an image in an electronic device according to an embodiment of the present invention;
4A is a diagram illustrating a procedure for sharing and displaying an image with another electronic device having a display device of the same size in an electronic device according to an embodiment of the present invention;
FIG. 4B is a view showing a procedure of sharing and displaying an image with another electronic device having a different size display device in an electronic device according to another embodiment of the present invention; FIG.
Figures 4C and 4D are diagrams illustrating an example of displaying a shared image in two electronic devices having different sized display devices according to another embodiment of the present invention;
5 is a diagram showing an example of displaying an image when the distance to another electronic device detected in an electronic device according to another embodiment of the present invention is equal to or larger than a first threshold distance,
6 is a view showing an example of displaying a shared image when the distance to another electronic device detected in an electronic device according to another embodiment of the present invention is less than a first threshold distance,
FIG. 7 is a view showing an example of displaying a shared image when the distance to another electronic device detected in an electronic device according to another embodiment of the present invention is equal to or less than a second threshold distance;
Figure 8 illustrates a procedure for receiving and displaying a shared image from another electronic device detected in an electronic device according to another embodiment of the present invention;
9 is a diagram illustrating a procedure for outputting an audio signal according to a user's position in an electronic device according to another embodiment of the present invention;
10A and 10B illustrate an example of outputting an audio signal in a plurality of electronic devices displaying a shared image according to another embodiment of the present invention;
11A to 11D are diagrams illustrating an example of transmitting and displaying an image including a moving picture UI (User Interface) to another electronic device detected in an electronic device according to another embodiment of the present invention;
12A to 12C are diagrams illustrating an example of sharing and displaying an Internet image according to the distance between electronic devices in a plurality of electronic devices according to another embodiment of the present invention;
13A to 13B are diagrams illustrating an example of determining a display area of a shared image in a plurality of unaligned electronic devices according to another embodiment of the present invention.

Hereinafter, preferred embodiments of the present invention will be described with reference to the accompanying drawings. In the following description of the present invention, a detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear. In addition, the terms described below are defined in consideration of the functions of the present invention, which may vary depending on the intention of the user, the operator, or the custom. Therefore, the definition should be based on the contents throughout this specification.

In the following description, the electronic device includes a mobile communication terminal equipped with a display device, a smart phone, a tablet PC, MP3, a laptop, a netbook, a computer, a television ) And the like.

FIG. 1A shows a block configuration of an electronic device 100 for sharing and displaying an image according to an embodiment of the present invention.

1A, an electronic device 100 includes a memory 110, a processor 120, an input / output (I / O) unit 130, an operation sensor 140, a communication unit 142, a camera 144, an audio control unit 146, a speaker 147, and a microphone 148. [ Each of the memory 110 and the processor 120 may include a plurality of memories 110 and a plurality of processors 120. [

The memory 110 includes a data storage 111, an operating system program 112, an application program 113, a graphical user interface program 114, a communication program 115, a distance recognition program 116, 117, an audio control program 118, a coordinate conversion program 119, and the like. In addition, a program that is a software component can be expressed as a set of instructions, so a program is sometimes referred to as an instruction set. Programs can also be expressed in modules.

Memory 110 may store one or more programs including instructions for performing the embodiments of the present invention.

The data storage unit 111 stores data generated while performing a function corresponding to a program stored in the memory 110. [ The data storage unit 111 according to the present invention may store model information of the electronic device 100. At this time, the model information of the electronic device 100 may include display device size information and resolution information of the electronic device 100, and the size information of the display device may include information on the size of an area Size information. The data store 111 may also store a threshold distance for the distance between the electronic device 100 and at least one other electronic device detected by the communication program 115. [ That is, the data storage unit 111 may store the first threshold distance and the second threshold distance, wherein the first threshold distance is stored as a value larger than the second threshold distance. Here, the first threshold distance represents a distance for the electronic device 100 and at least one other electronic device to operate in a switching mode, and the second threshold distance represents the distance between the electronic device 100 and at least one other electronic device Indicates the distance for the device to switch to Split mode to operate. Here, the sharing mode means a mode in which the electronic device 100 and at least one other electronic device display the same portion of the same image, and the split mode is a mode in which the electronic device 100 and at least one other electronic device have the same image Means a mode for displaying different parts. In addition, the data storage unit 111 can store a predetermined acoustic filter for each user position. Here, the acoustic filter for each user position can be obtained in advance according to the experiment, and can be updated by learning of the electronic device.

An operating system program 112 (e.g., an embedded operating system such as WINDOWS, LINUX, Darwin, RTXC, UNIX, OS X, or VxWorks) ≪ / RTI > For example, control of general system operations refers to memory management and control, storage hardware (device) control and management, power control and management, and the like. The operating system program 112 functions to facilitate communication between various hardware (devices) and software components (programs).

The application program 113 may be a browser, an email, a message, word processing, an address book, a widget, a digital rights management (DRM) Voice recognition, voice duplication, position determining functions, location based services, video and music, and the like.

The graphical user interface program 114 includes at least one software component for providing a graphical user interface between the user and the electronic device 100. [ That is, the graphical user interface program 114 includes at least one software component for displaying user interface information on a display device (e.g., a touch screen) included in the input / output unit 130. [ The graphic user interface program 114 includes instructions for displaying an image and an associated user interface (UI) in the input / output unit 130 according to the present invention. For example, the graphical user interface program 114 may include an instruction to display a moving image application in the input / output unit 130, and may include an instruction to visually display an associated UI for the displayed moving image application. In another example, the graphical user interface program 114 may include an instruction to divide and visually display the moving image and the related UI for the moving image application in the input / output unit 130. [

The communication program 115 can enable communication with another electronic device such as a server and / or a portable terminal through the communication unit 142. [ The communication program 115 transmits and receives information necessary for the electronic device 100 and another electronic device to display a shared image. That is, the communication program 115 transmits and receives at least one of the detected electronic device and model information, size information of the display device, resolution information, image, division information, user voice signal reception time and audio signal.

The distance recognition program 116 may determine the distance between the motion sensor 140 and at least one other electronic device detected by the communication unit 142. [ The distance recognition program 116 determines the operation to the sharing mode when the distance to the detected at least one other electronic device is less than or equal to the first threshold distance stored in the data storage 111, Or less, the operation to the split mode is determined.

The distance recognition program 116 may also analyze the image taken by the camera 144 to determine the distance between the electronic device 100 and the user. In more detail, the distance recognition program 116 may analyze the image photographed by the camera 144 and measure the distance and position of each user included in the photographed image. At this time, the distance recognition program 116 can determine the position of each user using the image captured by the camera 144 of the electronic device as well as the image captured by the camera 144 of the electronic device. In addition, the distance recognition program 116 compares the time at which the voice signal is received via the microphone 148 of the electronic device 100 with the time at which the voice signal is received by the other electronic device 100 received via the communication unit 142 And determine the location of the user. At this time, the distance recognition program 116 analyzes the reception time of a plurality of audio signals received by the microphone 148 and the reception time of a plurality of audio signals received through the communication unit 142 for each user, Based on the distance between the electronic device 100 and another electronic device.

The image control program 117 can recognize and control a screen displayed by the input / output unit 130 as an image. In other words, the image control program 117 can control a function for sharing an image to be displayed with a display device (not shown) of the input / output unit 130 with another electronic device according to the execution of the application. For example, the image control program 117 may control a function for sharing a moving image to be displayed on a display device (not shown) of the input / output unit 130 with another electronic device according to the execution of the moving image application program. For example, the image control program 117 may control the function for sharing a web browser image to be displayed on a display device (not shown) of the input / output unit 130 with another electronic device according to the execution of the internet application .

The image control program 117 receives the model information, the resolution information, the number information, and the position information of the other electronic devices detected from the operation sensor 140 and the communication unit 142 in the shared mode, And generates partition information for the shared image. Here, the position information means information indicating which direction of the detected electronic device is located in the electronic device 100. Further, the division information is information necessary for the electronic device 100 and the detected other electronic device to operate in a split mode and display different portions of the same image, Information on an area to be displayed in the display device, enlargement information for each mode, and information on an area to display an image among the entire area of the display device. Thereafter, the image control program 117 may include an image to be displayed and an image to be displayed stored in an image being displayed by the input / output unit 130 or a buffer, and instructions for transmitting the generated division information to the detected other electronic device. In addition, the image control program 117 may include an instruction to transmit, in real time, an image to be displayed that is updated according to a running application or user control. Here, the image transmitted to the detected other electronic device includes a graphic element representing the UI (User Interface) of the application being executed in the electronic device 100. [ For example, when the moving picture application is running in the electronic device 100, the image control program 117 not only displays the moving image but also the UI of the moving picture application (e.g., a pause icon, a playback start icon, And transmitting the containing image to another detected image.

In the case of the split mode, the image control program 117 divides the original image to be displayed based on the split information generated in advance in the shared mode into a plurality of divided images, and then displays a plurality of divided images in the electronic device 100 The image to be displayed on the electronic device 100 can be displayed while the image to be displayed on the other electronic device is divided into the image to be displayed and the image to be displayed on the other electronic device can be transmitted to the other electronic device. The image control program 117 also determines the area of the image to be displayed in the electronic device 100 among the entire area of the original image to be displayed based on the division information previously generated in the shared mode, And may transmit the original image to be displayed to another electronic device. At this time, another electronic device divides the received original image into a plurality of pieces according to the division information, and then displays only the corresponding image among the divided images, or determines the corresponding image area according to the division information in the received original image, can do.

In addition, the image control program 117 may generate image segmentation information according to the size of the display device of the electronic device 100 and the size of the display device of the detected electronic device. That is, when at least one other electronic device having a display device of the same size as that of the display device of the electronic device 100 is detected, the image control program 117 changes the image to the same size As shown in FIG. For example, when the image control program 117 detects one electronic device having a display device of the same size as the display device size of the electronic device 100, May divide the image into two images and generate division information for enlarging each of the two divided images by the size of the display device of the electronic device 100. [ As another example, the image control program 117 may be configured so that when two electronic devices having a display device of the same size as the display device size of the electronic device 100 are detected, , And then generate division information for enlarging the three divided images by the size of the display device of the electronic device 100. [

On the other hand, if the image control program 117 detects another electronic device having a display device of a different size than the display device size of the electronic device 100, the image control program 117 causes the original image to be displayed on the electronic device 100 and / It is possible to generate partition information for partitioning into a plurality of images having different sizes corresponding to the sizes of display devices of other electronic devices. For example, when the image control program 117 detects one electronic device having a display device of a size smaller than the size of the display device of the electronic device 100, It is possible to divide the image into two images corresponding to the size of the display device of the device 100 and the other electronic device detected and to generate the division information for enlarging each of the two divided images by the size of the display device of each electronic device have. At this time, the image control program 117 may change the resolution of the image to be displayed according to the number of other electronic devices detected and the arrangement of the electronic device 100 and other electronic devices detected.

In addition, the image control program 117 determines an area to display an image among the entire area of the display device of each electronic device, based on the size of the display device of the electronic device 100 and the size of the display device of the detected electronic device , And information on the display area of the display device is included in the division information. For example, as shown in FIG. 4C, when the display device size of the electronic device 100 is larger than the size of the display device of the detected electronic device, the image control program 117 sets the display device size of the detected electronic device as The entire area of the display device of the electronic device 100 can be divided into the divided image display area and the additional area. As another example, if the display device size of the electronic device 100 is smaller than the size of the display device of the detected electronic device, as shown in Fig. 4D, the image control program 117 may be displayed on the display device of the electronic device 100 The entire area of the display device of the electronic device detected on the basis of the size can be divided into the divided image display area and the additional area. At this time, the image control program 117 includes an instruction for displaying an image indicating execution of another application in the additional area. For example, the image control program 117 includes an instruction to display information about the shared image in the additional area during the display of the shared image, or to display an image for an application for which further execution is requested according to a user request.

In addition, the image control program 117 controls the function for matching the sync of the shared image displayed on the two electronic devices with the electronic device and other electronic devices detected unaligned. For example, as shown in FIG. 13A, when two electronic devices are not aligned in a row, guide lines 1301 and 1303 for aligning the shared image displayed on the two electronic devices are presented, By recognizing the user control and determining the area to be displayed by each electronic device in the area of the entire display device of each electronic device to display the image and the entire area of the original image, as shown in Fig. 13B, So as to be displayed in an aligned state. Here, the image control program 117 may use various types of user input to match the sync of the shared image. For example, after requesting the user to perform a straight touch on a plurality of electronic devices, the coordinate corresponding to a straight touch on each electronic device is analyzed to display an image among the entire area of the display device of each electronic device By determining the area to be displayed by each electronic device among the area and the entire area of the original image, the shared image can be displayed in an aligned state without being misaligned in a plurality of electronic devices.

Further, the image control program 117 can receive the image and the division information of the other electronic device detected through the operation sensor 140 and the communication unit 142, and display the received image. The image control program 117 controls the display device (not shown) to display an image received in real time from the detected other electronic device in the shared mode. At this time, if the size of the display device of the electronic device 100 differs from the size of the display device of the detected other electronic device, the image control program 117 does not divide the received image, The received image can be enlarged and displayed. Accordingly, the electronic device 100 in the shared mode can display the same image as the detected other electronic device.

In the case of the split mode, the image control program 117 receives and displays the divided images from the detected other electronic devices in real time, or receives images in a non-divided state from the detected other electronic devices in real time, It is possible to display an image of a predetermined area in the entire area of the original image. That is, when the divided image including only the area to be displayed by the electronic device 100 among the entire area of the original image from the detected other electronic device is received, the image control program 117 is divided according to the enlarged information among the divided information The size of the received image can be enlarged or maintained and displayed on the display device. On the other hand, when the image containing the entire area of the original image is received from the detected other electronic device, the image control program 117 determines the area to be displayed by the electronic device 100 among the entire area of the original image according to the division information do. Then, the image control program 117 cuts out the area determined from the original image, enlarges or maintains the size of the image of the cut-out area according to the enlarged information and displays it on the display device, enlarges the size of the original image according to the enlarged information So that only the determined area can be displayed.

The audio control program 118 may determine the number of other electronic devices detected by the motion sensor 140 and the communication unit 142, the number of users determined by the distance recognition program 116, And controls the audio signal to be output to the speaker 148 according to the position. In other words, the audio control program 118 separates the audio channels according to the number of other electronic devices detected and provides an acoustic filter designed optimally according to the number of users and the location of each user, in order to provide a stereophonic and surround system And controls the audio controller 146 to output the audio signal through the generated filter. At this time, the acoustic filter can be generated using various known techniques such as HRTF (Head Room Transfer Filter) and the like. At this time, the audio control program 118 may generate an acoustic filter having a direction according to the number of users and the location of each user, or may read out the acoustic filter calculated in advance according to the user's location from the data storage 111 and apply . The audio control program 118 also includes instructions for transmitting information about the generated acoustic filter to the other electronic devices detected.

The coordinate conversion program 119 controls the other electronic device to execute a function corresponding to the coordinates of the received image when the coordinate information of the image in which the data is input is received and sends the execution result to the communication unit 142 via the communication unit 142 And transmits it to the detected other electronic device. When the user touches the image in the state that the image is received from the detected other electronic device and is being displayed, the coordinate conversion program 119 converts the coordinates of the image in which the touch is detected, To the electronic device. As a result, the coordinate conversion program 119 enables the electronic device 100 and the detected other electronic device to display the same result according to the data input from the detected other electronic device.

The processor 120 may be configured with at least one processor and peripheral interface (not shown). In addition, the processor 120 executes a specific program (instruction set) stored in the memory 110 and performs a plurality of specific functions corresponding to the program.

An input / output (I / O) unit 130 includes an input device capable of inputting data and an output device capable of outputting data, thereby providing an interface to a user. For example, the input / output unit 130 may be a touch screen capable of simultaneously inputting and outputting data. The input / output unit 130 according to the present invention can display an image, input data on an image, and display a result according to input data.

The motion sensor 140 can detect the movement and the position of the object. The motion sensor 140 according to the present invention can detect at least one other electronic device in the vicinity. In addition, the motion sensor 140 can determine the number and location of other electronic devices detected. For example, the motion sensor 140 may determine that there is one other electronic device detected on the left side of the electronic device 100 and one other electronic device detected on the right side.

The communication unit 142 may include a radio frequency receiver and a transceiver and / or an optical (e.g., infrared) receiver and a transceiver. For example, the communication unit 142 may be a GSM (Global System for Mobile Communication) network, an EDGE (Enhanced Data GSM Environment) network, a CDMA (Code Division Multiple Access) network, a W- A wireless network supporting either a Long Term Evolution (LTE) network, an Orthogonal Frequency Division Multiple Access (OFDMA) network, a Wireless Fidelity (WiFi) network, a Near Feild Communication (NFC), an IrDA, a WiMax network, Communication system. The wireless communication system according to the embodiment of the present invention is not limited to the wireless communication system supporting the network, but may be a wireless communication system supporting other networks. According to the present invention, the communication unit 142 can detect at least one other electronic device and can communicate with the detected other electronic device. The communication unit 142 can measure the distance between the electronic device 100 and the detected other electronic device through signal transmission / reception with the detected other electronic device. The communication unit 142 transmits at least one of the detected electronic device and model information, size information of the display device, resolution information, image, division information, user voice signal reception time, audio signal, do.

The audio control unit 146 is coupled to the speaker 147 and the microphone 148 to perform audio stream input and output functions such as voice recognition, voice reproduction, digital recording, and telephone functions. That is, the audio control unit 146 directs the audio signal using the acoustic filter generated by the audio control program 118, outputs a speaker 147, and transmits the audio signal through the microphone 148 to the user And performs a function for receiving a voice signal. The audio control unit 146 receives the data stream through the processor 120, converts the received data stream into an electric stream, and transmits the converted electric stream to the speaker 147. The audio control unit 146 receives the converted electrical stream from the microphone 148, converts the received electrical stream into an audio data stream, and transmits the converted audio data stream to the processor 120. [ The audio control 146 may include an attachable and detachable ear phone, a head phone, or a head set. The speaker 147 converts the electric stream received from the audio control unit 146 into a sound wave that can be heard by a person and outputs the sound wave. The microphone 148 converts sound waves delivered from a person or other sound source into an electrical stream.

1B illustrates a processor of an electronic device 100 for sharing and displaying images in accordance with an embodiment of the present invention.

1B, the processor 120 of the electronic device 100 includes a communication processor 121, a distance recognition processor 122, an image control processor 123, an audio control processor 124, 125, and includes a memory 110, an input / output (I / O) unit 130, a motion sensor 140, a communication unit 142, a camera 144, an audio control unit 146, 147 and the microphone 148, thereby performing the functions described in Fig.

3A shows a procedure for displaying an image according to distance in the electronic device 100 according to the embodiment of the present invention.

Referring to FIG. 3A, the electronic device 100 displays an image in step 301. FIG. At this time, the image means an image including all graphic elements (e.g., icons, UI, images, etc.) displayed on the display device of the electronic device 100.

The electronic device 100 then proceeds to step 303 and transmits the image and related information to the at least one other electronic device if the electronic device 100 and at least one other electronic device are located within a first distance. In detail, the electronic device 100 detects at least one other electronic device in the vicinity, and displays the image to be displayed and the image in the electronic device 100 when the detected other electronic device is located within the first threshold distance In real time to the detected other electronic device. For example, when the moving image is reproduced and displayed on the electronic device 100, the electronic device 100 transmits the moving image to another detected electronic device located within the first threshold distance, Lt; / RTI > At this time, the related information includes one of the model information of the electronic device 100, the display device size information of the electronic device 100, and resolution information.

Thereafter, the electronic device 100 proceeds to step 305, and if the electronic device 100 and the at least one other electronic device are located within a second critical distance, the electronic device 100 partially locally processes the image based on the number of the at least one other electronic device. Display. For example, the electronic device 100 may divide the image into two and then display one of the two images if another electronic device located within the second threshold distance is detected.

Figure 3B illustrates a means for displaying an image in an electronic device 100 according to an embodiment of the present invention

Referring to FIG. 3B, the electronic device 100 includes means 311 for displaying an image. At this time, the image means an image including all graphic elements (e.g., icons, UI, images, etc.) displayed on the display device of the electronic device 100. The electronic device 100 also includes means 313 for transmitting the image and related information to the at least one other electronic device when the electronic device 100 and at least one other electronic device are located within a first critical distance do. Whether or not at least one other electronic device is located within the first critical distance can be determined through the operation sensor 140 and the communication unit 142. [ In addition, electronic device 100 may include means 315 for partially displaying an image based on the number of at least one other electronic device when electronic device 100 and at least one other electronic device are located within a second threshold distance ). At this time, the partially displayed image may be an enlarged image than the originally divided image.

FIG. 4A shows a procedure for sharing and displaying an image with another electronic device having the same-sized display device in the electronic device 100 according to an embodiment of the present invention.

Referring to FIG. 4A, the electronic device 100 displays an image in step 401. FIG. At this time, the image means an image including all graphic elements (e.g., icons, UI, images, etc.) displayed on the display device of the electronic device 100. In addition, the image may be an image according to the execution of the content stored in advance in the electronic device 100, and may be an image obtained from a server or other electronic device.

Then, the electronic device 100 checks in step 403 whether at least one other electronic device is detected. At this time, the electronic device 100 may detect a plurality of sensors such as an NFC, a motion sensor, and IrDA, and at least one other electronic device through wireless communication, and may detect the distance to the detected other electronic device, The direction or the position of the object.

If at least one other electronic device is not detected, the electronic device 100 returns to step 403 and re-executes the following steps. On the other hand, if at least one other electronic device is detected, the electronic device 100 proceeds to step 405 to determine whether the distance between the electronic device 100 and the at least one other electronic device detected is below a first threshold distance Check. At this time, the first threshold distance may be set in advance at the designing stage, and may be changed by the user. At this time, the distance between the electronic device 100 and another electronic device can be measured using the operation sensor 140 and the communication unit 142.

If the distance between the electronic device 100 and the detected at least one other electronic device is greater than or equal to the first threshold distance, the electronic device 100 returns to step 405 and re-executes the following steps. On the other hand, if the distance between the electronic device 100 and the at least one other electronic device detected is less than or equal to the first threshold distance, then the electronic device 100 proceeds to step 407 to detect the associated information from at least one other electronic device . At this time, the related information includes one of the detected display device size information and resolution information of another electronic device detected as model information of another electronic device.

Then, the electronic device 100 proceeds to step 409 to transmit the image and the division information to be displayed to the detected at least one other electronic device. Here, the division information is information necessary for the electronic device 100 and the detected other electronic device to operate in a split mode and display different portions of the same image, Information on an area to be displayed in the display device, enlargement information for each mode, and information on an area to display an image among the entire area of the display device. At this time, the division information can be generated in each electronic device 100 without being transmitted by the design method and user control of the electronic device 100. [

Thereafter, the electronic device 100 proceeds to step 411 and determines whether the distance between the electronic device 100 and the detected at least one other electronic device is less than or equal to a second threshold distance. If the distance between the electronic device 100 and the at least one other electronic device detected is greater than or equal to the second threshold distance, the electronic device 100 returns to step 411 and re-executes the following steps. On the other hand, if the distance between the electronic device 100 and the at least one other electronic device detected is less than or equal to the second threshold distance, then the electronic device 100 proceeds to step 413 and transmits the received related information and the detected at least one other electronic device Partially displays the image according to the number of devices. That is, the electronic device 100 partially displays an image based on the received related information and the division information generated according to the number of detected at least one other electronic device. At this time, the image to be displayed in the electronic device 100 can be transmitted in real time while the distance between the electronic device 100 and the detected at least one electronic device is equal to or less than the first threshold distance.

The electronic device 100 then proceeds to step 415 to determine whether the distance between the electronic device 100 and the at least one other electronic device detected is greater than or equal to a second threshold distance. If the distance between the electronic device 100 and the detected at least one other electronic device is less than or equal to the second threshold distance, then the electronic device 100 returns to step 415 and re-executes the following steps. On the other hand, if the distance between the electronic device 100 and the detected at least one other electronic device is greater than or equal to the second threshold distance, the electronic device 100 proceeds to step 417 to display the image in its initial state. In other words, when the distance between the electronic device 100 and the detected other electronic device is greater than the second threshold distance during partial display of the image in accordance with the division information, the electronic device 100 and / The detected other electronic devices operate in a shared mode, and independently display each image without dividing the image, as shown in Fig.

The electronic device 100 checks in step 419 whether the distance between the electronic device 100 and the detected at least one other electronic device is equal to or greater than a first threshold distance. If the distance between the electronic device 100 and the detected at least one other electronic device is less than or equal to the first threshold distance, then the electronic device 100 returns to step 419 and re-executes the following steps. On the other hand, if the distance between the electronic device 100 and the at least one other electronic device detected is greater than or equal to the first threshold distance, the electronic device 100 terminates the procedure according to the present invention.

For example, if the distance between the electronic device 100 and the other electronic device detected is greater than or equal to the first threshold distance, as shown in FIG. 5, then the electronic device 100 and the other electronic device Display another image. Thereafter, when the distance between the electronic device 100 and the other electronic device detected is less than or equal to the first threshold distance, as shown in FIG. 6, the electronic device 100 can detect the presence of the electronic device 100 By transmitting image and segmentation information, the electronic device 100 and the other electronic devices detected will display the same image to each other. In addition, if the distance between the electronic device 100 and the other electronic device detected is less than or equal to the second threshold distance, as shown in FIG. 7, then the electronic device 100 and the other electronic device detected, The two electronic devices cooperate to display one image. Accordingly, the electronic device 100 and the detected other electronic device can provide an image through a screen having a size larger than the screen size of the electronic device 100. [

4B shows a procedure for sharing and displaying an image with another electronic device having a different size display device in the electronic device 100 according to another embodiment of the present invention. Here, it is assumed that the electronic device 100 has performed the steps 401 to 405 of FIG. 4A.

Referring to FIG. 4B, after the electronic device 100 receives the related information from at least one other electronic device detected in step 407, the electronic device 100 proceeds to step 421 and checks the size information of the display device based on the received related information do. In this case, if the received related information includes model information of other electronic devices detected, the electronic device 100 displays display device size information of other electronic devices detected using the display device size information of each electronic device previously stored . Then, the electronic device 100 proceeds to step 423 to check whether the size of the display device of the electronic device 100 is larger than the size of the display device of the detected other electronic device.

If the size of the display device of electronic device 100 is greater than the size of the detected display device of another electronic device, electronic device 100 proceeds to step 425 to determine the size of the electronic device 100, The display area is divided into an area 441 and an additional area 443 where the divided image is to be displayed. After that, the electronic device 100 determines the application to be executed in the additional area 443. At this time, an application to be executed in the additional area 443 of the electronic device 100 includes all applications that can be executed in the electronic device 100. [ The electronic device 100 then proceeds to step 431 where it transmits the image and segmentation information transmission to be detected to the at least one other electronic device detected and then proceeds to step 433 where the electronic device 100 and the detected at least one other Whether the distance between the electronic devices is less than or equal to the second threshold distance. If the distance between the electronic device 100 and the detected at least one other electronic device is greater than or equal to the second threshold distance, then the electronic device 100 returns to step 433 and re-executes the following steps. On the other hand, if the distance between the electronic device 100 and the at least one other electronic device detected is less than or equal to the second threshold distance, then the electronic device 100 proceeds to step 435 and transmits the received related information and the detected at least one other electronic device Partially displays the partitioned image according to the number of devices and partition information, and executes the determined application in the additional area 441 of the electronic device 100. [ Thereafter, the electronic device 100 proceeds to step 415 of FIG. 4A to perform the following steps. At this time, the electronic device 100 displays the image in the area 441 determined as the display area of the divided image.

On the other hand, if the size of the display device of the electronic device 100 is smaller than the size of the detected display device of the other electronic device, the electronic device 100 proceeds to step 427, The display area is divided into an area 445 and an additional area 447 where the divided image is to be displayed. Thereafter, the electronic device 100 determines the application to be executed in the additional area 447. At this time, the application to be executed in the additional area 447 of the detected other electronic device includes all the applications that can be executed in the electronic device 100. [ Thereafter, the electronic device 100 proceeds to step 431 and transmits image and division information to be displayed to the detected at least one other electronic device. The electronic device 100 determines in step 433 whether the distance between the electronic device 100 and the detected at least one other electronic device is below a second threshold distance. At this time, the electronic device 100 further transmits application information to be executed in the additional area 445 of the detected other electronic device when transmitting the displayed image and the divided information. At this time, the division information includes information about an area 445 and an additional area 447 where an image is to be displayed. Accordingly, the detected other electronic device executes and displays the application in accordance with the application information to be executed in the additional area 447. [

If the distance between the electronic device 100 and the detected at least one other electronic device is greater than or equal to the second threshold distance, then the electronic device 100 returns to step 433 and re-executes the following steps. On the other hand, if the distance between the electronic device 100 and the at least one other electronic device detected is less than or equal to the second threshold distance, then the electronic device 100 proceeds to step 435 and transmits the received related information and the detected at least one other electronic device After partially displaying the image according to the number of devices, the electronic device 100 proceeds to step 415 of FIG. 4A to perform the following steps.

FIG. 8 shows a procedure for receiving and displaying a shared image from another electronic device detected in an electronic device 100 according to another embodiment of the present invention.

Referring to FIG. 8, the electronic device 100 displays an image in step 801. FIG. At this time, the image means an image including all graphic elements (e.g., icons, UI, images, etc.) displayed on the display device of the electronic device 100. Then, the electronic device 100 checks in step 803 whether at least one other electronic device is detected. At this time, the electronic device 100 may detect a plurality of sensors such as an NFC, a motion sensor, and IrDA, and at least one other electronic device through wireless communication, and may detect the distance to the detected other electronic device, The direction or the position of the object.

If at least one other electronic device is not detected, the electronic device 100 returns to step 803 and re-executes the following steps. On the other hand, if at least one other electronic device is detected, the electronic device 100 proceeds to step 805 to determine whether the distance between the electronic device 100 and the at least one other electronic device detected is below a first threshold distance Check. At this time, the first threshold distance may be set in advance at the designing stage, and may be changed by the user. If the distance between the electronic device 100 and the detected at least one other electronic device is greater than or equal to the first threshold distance, the electronic device 100 returns to step 805 and re-executes the following steps. On the other hand, if the distance between the electronic device 100 and the detected at least one other electronic device is less than or equal to the first threshold distance, then the electronic device 100 proceeds to step 807 and sends the associated information to the detected at least one other electronic device send. At this time, the related information includes one of the model information of the electronic device 100, the display device size information of the electronic device 100, and resolution information.

The electronic device 100 then proceeds to step 809 and receives image and segmentation information from the detected at least one other electronic device. That is, the electronic device 100 receives image and segmentation information from the detected other electronic device. At this time, the division information is information necessary for the electronic device 100 and the detected other electronic device to operate in a split mode and display different portions of the same image, Information on an area to be displayed in the display device, enlargement information for each mode, and information on an area to display an image among the entire area of the display device.

Then, the electronic device 100 proceeds to step 811 and displays the received image. For example, if the received image is a moving image of another electronic device that has been detected, the electronic device 100 may receive and display the moving image. At this time, the electronic device 100 can receive the moving image from the detected other electronic device in real time, and display it as if the moving image application is executed in the electronic device 100. [

The electronic device 100 determines in step 813 whether the distance between the electronic device 100 and the detected at least one other electronic device is less than or equal to a second threshold distance. If the distance between the electronic device 100 and the detected at least one other electronic device is greater than or equal to the second threshold distance, then the electronic device 100 returns to step 813 and re-executes the following steps. If, on the other hand, the distance between the electronic device 100 and the at least one other electronic device detected is less than or equal to the second threshold distance, then the electronic device 100 proceeds to step 815 where the received image is partially Display. That is, the electronic device 100 divides and displays the received image according to the division information from the detected other electronic device, or determines an area to be displayed in the received image according to the division information, can do.

Then, the electronic device 100 proceeds to step 817 and checks whether the distance between the electronic device 100 and the detected at least one other electronic device is equal to or greater than a second threshold distance. If the distance between the electronic device 100 and the detected at least one other electronic device is less than or equal to the second threshold distance, then the electronic device 100 returns to step 817 and re-executes the following steps. On the other hand, if the distance between the electronic device 100 and the detected at least one other electronic device is greater than or equal to the second threshold distance, the electronic device 100 proceeds to step 819 to display the image in its initial state. In other words, when the distance between the electronic device 100 and the detected other electronic device is greater than the second threshold distance during the segmented image display, As shown in Fig. 6, displays the images independently of each other without dividing them.

The electronic device 100 determines in step 821 whether the distance between the electronic device 100 and the detected at least one other electronic device is equal to or greater than a first threshold distance. If the distance between the electronic device 100 and the detected at least one other electronic device is less than or equal to the first threshold distance, then the electronic device 100 returns to step 821 and re-executes the following steps. On the other hand, if the distance between the electronic device 100 and the at least one other electronic device detected is greater than or equal to the first threshold distance, the electronic device 100 terminates the procedure according to the present invention. At this time, if the distance between the electronic device 100 and the at least one other electronic device detected is greater than or equal to the first threshold distance, then the electronic device 100 is able to detect an image of the electronic device 100, The displayed image can be displayed.

FIG. 9 shows a procedure for outputting an audio signal according to a user's position in the electronic device 100 according to another embodiment of the present invention.

Referring to FIG. 9, the electronic device 100 detects at least one other electronic device in step 901. FIG. At this time, the electronic device 100 may detect a plurality of sensors such as an NFC, a motion sensor, and IrDA, and at least one other electronic device through wireless communication, and may detect the distance to the detected other electronic device, The direction or the position of the object.

 The electronic device 100 then proceeds to step 903 where it determines whether the distance between the electronic device 100 and the detected at least one other electronic device is below a first threshold distance. If the distance between the electronic device 100 and the detected at least one other electronic device is greater than or equal to the first threshold distance, the electronic device 100 returns to step 901 and re-executes the following steps. On the other hand, if the distance between the electronic device 100 and the detected at least one other electronic device is less than or equal to the first threshold distance, the electronic device 100 proceeds to step 905 and receives a voice signal from the user. At this time, the electronic device 100 can receive a voice signal from the user via the microphone 148, and when another electronic device below the first threshold distance is detected, the microphone 148 is activated automatically or by user control .

In step 907, the electronic device 100 receives the time at which the detected voice signal of at least one other electronic device is received. In step 909, The difference of the time when the voice signal of the other electronic device is received is analyzed, and the location of the user is determined according to the analyzed time difference in step 911. In detail, the electronic device 100 analyzes the time at which the voice signal reaches the electronic device 100 and the time at which the voice signal reaches the other electronic device, and determines the distance between the electronic device 100 and the detected other electronic device The position of the user can be determined. At this time, the voice signal received by the electronic device 100 from the user and the voice signal received by the at least one other electronic device are voice signals generated at the same time from the same user, and the electronic device 100 receives voice When a signal is received, it is possible to analyze the time difference in which the voice signal is received for each user.

Thereafter, the electronic device 100 proceeds to step 913 and outputs an audio signal having a specific direction according to the determined position of the user. At this time, the electronic device 100 separates the audio channel and generates an acoustic filter having a direction according to the number of users and the location of each user to provide a stereophonic sound and a surround system according to the determined position of the at least one user , And the audio signal can be output through the generated filter. In addition, the acoustic filter can be applied in real time, or a pre-calculated filter according to the user's position can be applied according to the user's position.

Thereafter, the electronic device 100 proceeds to step 915 and determines whether the distance between the electronic device 100 and the detected at least one other electronic device is equal to or greater than a first threshold distance. If the distance between the electronic device 100 and the detected at least one other electronic device is less than or equal to the first threshold distance, the electronic device 100 returns to step 915 and re-executes the following steps. On the other hand, if the distance between the electronic device 100 and the at least one other electronic device detected is greater than or equal to the first threshold distance, the electronic device 100 terminates the procedure according to the present invention.

For example, if the electronic device 100 is located within a second threshold distance and operates in a split mode, as shown in FIG. 10A, the electronic device 100 and another electronic device, Each of the detected other electronic devices 100 estimates the position of each of the two users and provides an audio signal based on an acoustic filter having a direction corresponding to the position of each of the users. In addition, even if the electronic device 100 is located in a shared mode with the electronic device 100 located between the first critical distance and the second critical distance, as shown in FIG. 10B, Each of the electronic device 100 and the detected other electronic device 100 estimates the position of each of the two users and provides an audio signal based on an acoustic filter having a direction corresponding to the position of each of the users.

Although the user's position is estimated using the user's voice signal input from the microphone 148, the user's position is estimated by analyzing the image input from the camera 144, and each user It is possible to output an audio signal having a directionality corresponding to the position of the audio signal.

11A to 11D show an example of transmitting and displaying an image including a moving image UI (User Interface) to another electronic device detected in the electronic device 100 according to another embodiment of the present invention.

Referring to Figs. 11A to 11D, the electronic device 100 can detect other electronic devices in the vicinity while executing a moving image application, as shown in Fig. 11A. The electronic device 100 may then transmit the moving image and segmentation information of the electronic device 100 to the detected other electronic device when the distance between the detected other electronic devices is less than or equal to the second threshold distance. At this time, the electronic device 100 may transmit a UI (User Interface) image for controlling the video execution in addition to the moving image and the division information. Accordingly, the electronic device 100 and the detected other electronic device can simultaneously display the moving image and the UI image for controlling the moving image execution, as shown in FIG. 11B. At this time, if a detected touch of the moving image UI image is detected in the other electronic device, the detected other electronic device transmits coordinates of the UI image in which the touch is detected to the electronic device 100, and the electronic device 100 receives (E.g., pause, start playback, stop playback, fast forward and rewind, etc.) corresponding to the coordinates of the UI image, and transmit the image representing the execution result to the detected other electronic device.

 If the size of the display device of the electronic device 100 is larger than the size of the detected display device of another electronic device, another application can be executed in an additional area of the electronic device 100, as shown in Fig. 11C.

In addition, even when two or more different electronic devices are detected, the electronic device 100 and the other electronic device detected can simultaneously display the image and the UI image, as shown in Fig. 11D.

12A to 12C show an example of sharing and displaying an Internet image according to the distance between electronic devices in a plurality of electronic devices 100 according to another embodiment of the present invention

12A to 12C, when the distance between the electronic device 100 and another electronic device detected is equal to or greater than the first threshold distance, as shown in FIG. 12A, the electronic device 100 displays the Internet image, The detected other electronic device displays an idle screen (or home screen) image. Thereafter, when the distance between the electronic device 100 and the detected other electronic device is less than or equal to the first threshold distance, as shown in FIG. 12B, the electronic device 100 can detect the presence of the electronic device 100 By transmitting the Internet image and the segmentation information, the electronic device 100 and the detected other electronic devices display the same Internet image with each other. In addition, when the distance between the electronic device 100 and the detected other electronic device is less than or equal to the second threshold distance, as shown in Fig. 12C, the electronic device 100 displays the image of the left area And the detected other electronic device displays an image of the right area in the divided internet image.

Accordingly, the electronic device 100 is capable of displaying an image magnified larger than the originally displayed image in the electronic device 100 through the electronic device 100 and the detected other electronic device.

13A to 13B illustrate an example of determining a display area of a shared image in a plurality of unaligned electronic devices according to another embodiment of the present invention. Here, for convenience of explanation, a case where one electronic device is detected will be described as an example. However, the description of Figs. 13A to 13B below can be applied in the same manner even when a plurality of electronic devices are detected.

13A-13B, when the electronic device 100 and another electronic device detected are located within a second threshold distance, the electronic device 100 and the other electronic device detected are guided to adjust the position of the displayed image Lines 1301 and 1303 can be displayed. The guide line 1301 displayed on the electronic device 100 and the guide line 1303 displayed on the other electronic device can be displayed at different positions or at the same position. Even if the two electronic devices display the guide line at the same position, since the electronic device 100 and the other electronic devices detected are not aligned in a line and are located offset from each other, the electronic device 100 and the detected other electronic device The displayed guide lines 1301 and 1303 are also displayed to be shifted from each other.

Then, the electronic device 100 and the detected other electronic device detect a user touch for moving the position of the displayed guide lines 1301 and 1303, and detect at least one guide line (1301, 1303) can be moved. In other words, the user can move the guide lines 1301 and 1303 of the two electronic devices so that they do not misalign with each other in order to match the synch of the shared image to be displayed through the two electronic devices. Here, it is shown that the detected other electronic device guide line is moved 1305 by touching and dragging the guide line 1303 of another electronic device detected by the user downward. At this time, the electronic device can exchange coordinate information in which the guide line is located.

Accordingly, the electronic device 100 and the detected other electronic device can display the changed position according to the user's touch on the basis of the position of the guide lines 1301 and 1305, And the area of the entire image of the original image to be displayed by each of the electronic devices, the shared images can be displayed in a line-aligned manner without being shifted in the two electronic devices. For example, as shown in FIG. 13B, the electronic device may display an image in the entire area of the display device, and the detected electronic device may display an image in some area of the entire area of the display device. At this time, an area where the image is not displayed in the detected electronic device may be determined as an additional area, thereby displaying another application execution image.

In the above description, the method of displaying an image after receiving the image in the electronic device 100 or at least one of the other electronic devices detected has been described. However, the present invention is not limited to this, ) And the detected other electronic device may receive the image from the specific server providing the image and display the image.

In the above description, the electronic device 100 and the detected other electronic device transmit and receive the coordinates of the data input to the image and the image so that the electronic device 100 and the other electronic device However, the present invention is not limited to this, and if there is an application corresponding to the image in the detected other electronic device, the electronic device 100 transmits the content and the content execution command corresponding to the image A method of executing the received content in another detected electronic device may also be performed. For example, if another electronic device having a moving picture application is detected while displaying the moving image in the electronic device 100, if the electronic device 100 transmits the moving picture content and moving picture application execution command, May display or partially display the entire moving image and UI image according to the execution of the corresponding moving picture content according to the sharing mode or the division mode.

While the present invention has been described in connection with what is presently considered to be the most practical and preferred embodiment, it is to be understood that the invention is not limited to the disclosed embodiments. Therefore, the scope of the present invention should not be limited by the illustrated embodiments, but should be determined by the scope of the appended claims and equivalents thereof.

Claims (32)

  1. A method of displaying an image of an electronic device,
    Displaying an image in the electronic device;
    Detecting at least one other electronic device;
    If the electronic device and the detected at least one other electronic device are located within a first critical distance,
    Receiving information about a size of a display device of the at least one other electronic device from the at least one other electronic device,
    Wherein the electronic device and the at least one other electronic device display different portions of the image based on information about the size of the display device of the at least one other electronic device and the number of the at least one other electronic device Generates division information for operating in a split mode,
    Transmitting the image to the at least one other electronic device such that the at least one other electronic device displays the image;
    Displaying a portion of different portions of the image based on the partition information if the electronic device and the detected at least one other electronic device are located within a second threshold distance that is closer to the first threshold distance than the first threshold distance; And displaying the image on the display device.
  2. The method according to claim 1,
    Wherein the step of receiving information on the size of the display device of the at least one other electronic device comprises:
    And receiving model information and resolution information of the at least one other electronic device from the at least one other electronic device.
  3. 3. The method of claim 2,
    The step of generating the division information includes:
    Comparing the size of the display device of the electronic device with the size of the display device of the at least one other electronic device;
    Further comprising dividing an area of the display device having a larger size into an image display area and an additional area,
    Wherein the additional area displays an image according to a separate application execution in addition to the image display.
  4. delete
  5. delete
  6. delete
  7. delete
  8. delete
  9. A method of displaying an image of an electronic device,
    Detecting at least one other electronic device;
    If the electronic device and the at least one other electronic device are located within a first critical distance,
    Transmitting information about a size of a display device of the electronic device to the at least one other electronic device,
    To cause the electronic device and the at least one other electronic device to operate in a split mode that displays different portions of the image based on information about the size of the display device of the electronic device Division information for receiving the image,
    Displaying the received image;
    And displaying one of the different portions of the image based on the partition information if the electronic device and the at least one other electronic device are located within a second threshold distance that is closer than the first threshold distance Of the electronic device.
  10. 10. The method of claim 9,
    Further comprising transmitting model information and resolution information of the electronic device to the at least one other electronic device when the electronic device and the detected at least one other electronic device are located within a first threshold distance, / RTI >
  11. delete
  12. delete
  13. delete
  14. delete
  15. delete
  16. delete
  17. In an electronic device,
    A display device;
    Memory; And
    And one or more programs stored in the memory and configured to be executed by one or more processors,
    Wherein the one or more programs include:
    Displaying an image on the electronic device;
    Detecting at least one other electronic device;
    If the electronic device and the detected at least one other electronic device are located within a first critical distance,
    Receiving information about a size of a display device of the at least one other electronic device from the at least one other electronic device,
    Wherein the electronic device and the at least one other electronic device display different portions of the image based on information about the size of the display device of the at least one other electronic device and the number of the at least one other electronic device Generates division information for operating in a split mode,
    Transmitting the partition information and the image to the at least one other electronic device such that the at least one other electronic device displays the image; And
    Displaying one portion of the different portions of the image based on the segmentation information if the electronic device and the detected at least one other electronic device are located within a second threshold distance that is closer to the first threshold distance than the first threshold distance; The method comprising the steps of:
  18. 18. The method of claim 17,
    Wherein the program further comprises instructions for performing an operation of receiving further model information and resolution information of the at least one other electronic device from the at least one other electronic device.
  19. 19. The method of claim 18,
    The program comprising instructions for comparing a size of a display device of the electronic device with a size of a display device of the detected at least one other electronic device to divide the area of the larger display device into an image display area and an additional area Further comprising:
    Wherein the additional area displays an image according to a separate application execution in addition to the image display.
  20. 18. The method of claim 17,
    Wherein the program displays a guide line on the display device of the electronic device for alignment of the image to be displayed on the electronic device and the detected other electronic device and displays a guide line on the display device of the electronic device corresponding to the guide line from the detected at least one other electronic device And receiving the coordinates to generate the division information based on the coordinates indicated by the guide lines of the electronic device and the coordinates received from the detected at least one other electronic device.
  21. 18. The method of claim 17,
    A microphone for receiving a voice signal from at least one user;
    Further comprising a speaker for outputting an audio signal,
    Wherein the program further comprises the steps of: receiving from the detected at least one other electronic device time information on the detected voice signal received at the at least one other electronic device; Determining at least one user's location based on the time difference by analyzing a time difference at which the voice signal was received on at least one other electronic device having the determined location, And outputting the audio signal.
  22. 18. The method of claim 17,
    A camera for photographing at least one user image using the camera;
    Further comprising a speaker for outputting an audio signal,
    Wherein the program further comprises a command for determining a position of the at least one user based on the photographed image and outputting an audio signal using an acoustic filter corresponding to the determined per-user position.
  23. 18. The method of claim 17,
    Wherein the image transmitted to the at least one other electronic device comprises at least one of an icon, an image, and a graphical element representing a user interface.
  24. 24. The method of claim 23,
    The program includes:
    Receiving coordinates of an image from the detected at least one electronic device, performing a function of a user interface corresponding to the coordinates of the image, transmitting an image corresponding to an execution result to the detected at least one electronic device, And displaying the image corresponding to the execution result on the electronic device.
  25. In an electronic device,
    A display device;
    Memory; And
    And one or more programs stored in the memory and configured to be executed by one or more processors,
    Wherein the one or more programs include:
    Detecting at least one other electronic device;
    If the electronic device and the detected at least one other electronic device are located within a first critical distance,
    Transmitting information about a size of a display device of the electronic device to the at least one other electronic device,
    To cause the electronic device and the at least one other electronic device to operate in a split mode that displays different portions of the image based on information about the size of the display device of the electronic device Division information for receiving the image,
    Displaying the received image; And
    If the electronic device and the at least one other electronic device are located within a second threshold distance that is closer than the first threshold distance, performing an operation of displaying one of the different portions of the image based on the partitioning information Wherein the electronic device comprises:
  26. 26. The method of claim 25,
    The program further comprising instructions for transmitting model information and resolution information of the electronic device to the detected at least one other electronic device when the electronic device and the detected at least one other electronic device are located within a first threshold distance, Lt; / RTI >
  27. delete
  28. 26. The method of claim 25,
    The program displays a guide line on the display device of the electronic device for alignment of the image to be displayed on the electronic device and the detected at least one other electronic device and moves the position of the guide line based on the user input And transmitting the moved position of the guide wire to the detected at least one other electronic device.
  29. 26. The method of claim 25,
    A microphone for receiving a voice signal from at least one user;
    Further comprising a speaker for outputting an audio signal,
    Wherein the program is operable to transmit the time at which the voice signal was received to the detected at least one other electronic device to receive acoustic filter information corresponding to the location of the at least one user from the detected at least one other electronic device And outputting an audio signal using the received acoustic filter information.
  30. 26. The method of claim 25,
    A camera for photographing at least one user image using the camera;
    Further comprising a speaker for outputting an audio signal,
    The program comprising the steps of: transmitting the photographed image to the detected at least one other electronic device, receiving acoustic filter information corresponding to the position of the at least one user from the detected at least one other electronic device, And outputting an audio signal using the received acoustic filter information.
  31. 26. The method of claim 25,
    Wherein the image received from the detected at least one other electronic device comprises at least one of an icon, an image, and a graphical element representing a user interface.
  32. 32. The method of claim 31,
    The display device is a touch-sensitive display device,
    Wherein the program further comprises instructions for detecting a user touch while displaying the received image and transmitting coordinates of the image corresponding to the detected user touch to the detected at least one other electronic device.
KR1020120089692A 2012-08-16 2012-08-16 Method for displaying for image and an electronic device thereof KR101971911B1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR1020120089692A KR101971911B1 (en) 2012-08-16 2012-08-16 Method for displaying for image and an electronic device thereof

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
KR1020120089692A KR101971911B1 (en) 2012-08-16 2012-08-16 Method for displaying for image and an electronic device thereof
EP13179702.9A EP2698704B1 (en) 2012-08-16 2013-08-08 Method and device for displaying image
US13/969,269 US20140049447A1 (en) 2012-08-16 2013-08-16 Method and device for displaying image
CN201310358938.6A CN103593154B (en) 2012-08-16 2013-08-16 Method and apparatus for showing image

Publications (2)

Publication Number Publication Date
KR20140023079A KR20140023079A (en) 2014-02-26
KR101971911B1 true KR101971911B1 (en) 2019-04-24

Family

ID=48951340

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020120089692A KR101971911B1 (en) 2012-08-16 2012-08-16 Method for displaying for image and an electronic device thereof

Country Status (4)

Country Link
US (1) US20140049447A1 (en)
EP (1) EP2698704B1 (en)
KR (1) KR101971911B1 (en)
CN (1) CN103593154B (en)

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI568253B (en) * 2013-12-19 2017-01-21 Alpha Networks Inc Playback system and method for playing
CN103809758A (en) * 2014-02-28 2014-05-21 北京智谷睿拓技术服务有限公司 Content display method and device
CN103823653A (en) * 2014-02-28 2014-05-28 北京智谷睿拓技术服务有限公司 Content display method and content display equipment
US20150268917A1 (en) * 2014-03-20 2015-09-24 Nokia Technologies Oy Apparatus, method, and computer program product for aligning images viewed across multiple displays
CN103986504B (en) * 2014-05-20 2017-01-18 深圳市同洲电子股份有限公司 An image sharing method and an electronic device
US9986086B2 (en) * 2014-07-31 2018-05-29 Samsung Electronics Co., Ltd. Mobile terminal and method of operating the same
WO2016182133A1 (en) * 2015-05-14 2016-11-17 엘지전자 주식회사 Display device and operation method therefor
KR20160134043A (en) * 2015-05-14 2016-11-23 엘지전자 주식회사 Display device and operating method thereof
KR20170029900A (en) * 2015-09-08 2017-03-16 엘지전자 주식회사 Mobile terminal and method for controlling the same

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080130923A1 (en) * 2006-12-05 2008-06-05 Apple Computer, Inc. System and method for dynamic control of audio playback based on the position of a listener
US20110225330A1 (en) * 2010-02-03 2011-09-15 Tal Lavian Portable universal communication device
US20110230178A1 (en) * 2010-03-17 2011-09-22 Microsoft Corporation Mobile communication device having multiple, interchangeable second devices

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7525511B2 (en) * 2004-07-02 2009-04-28 Microsoft Corporation System and method for determining display differences between monitors on multi-monitor computer systems
EP1909473A1 (en) * 2006-10-02 2008-04-09 Philips Electronics N.V. Digital photo frame
US20080216125A1 (en) * 2007-03-01 2008-09-04 Microsoft Corporation Mobile Device Collaboration
WO2010025557A1 (en) * 2008-09-03 2010-03-11 Smart Technologies Ulc Method of displaying applications in a multi-monitor computer system and multi-monitor computer system employing the method
JP4706985B2 (en) * 2009-03-04 2011-06-22 コニカミノルタビジネステクノロジーズ株式会社 The content display device
US20110183654A1 (en) * 2010-01-25 2011-07-28 Brian Lanier Concurrent Use of Multiple User Interface Devices
CN102222493A (en) * 2010-04-19 2011-10-19 英业达股份有限公司 Method and device for expanding display image
KR101712666B1 (en) * 2010-05-14 2017-03-06 엘지전자 주식회사 Electronic device and contents sharing method for electronic device
US8789131B2 (en) * 2010-05-14 2014-07-22 Lg Electronics Inc. Electronic device and method of sharing contents thereof with other devices
CN102298917B (en) * 2011-05-24 2013-06-19 福州瑞芯微电子有限公司 Wireless automatic detection screen associated display method and devices
CN102495712B (en) * 2011-12-15 2014-02-05 王飞 Map splicing display method based on plurality of display terminals
US8786517B2 (en) * 2012-02-21 2014-07-22 Blackberry Limited System and method for displaying a user interface across multiple electronic devices
US9800731B2 (en) * 2012-06-01 2017-10-24 Avaya Inc. Method and apparatus for identifying a speaker

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080130923A1 (en) * 2006-12-05 2008-06-05 Apple Computer, Inc. System and method for dynamic control of audio playback based on the position of a listener
US20110225330A1 (en) * 2010-02-03 2011-09-15 Tal Lavian Portable universal communication device
US20110230178A1 (en) * 2010-03-17 2011-09-22 Microsoft Corporation Mobile communication device having multiple, interchangeable second devices

Also Published As

Publication number Publication date
CN103593154A (en) 2014-02-19
KR20140023079A (en) 2014-02-26
US20140049447A1 (en) 2014-02-20
CN103593154B (en) 2018-11-13
EP2698704A3 (en) 2014-05-21
EP2698704B1 (en) 2017-09-13
EP2698704A2 (en) 2014-02-19

Similar Documents

Publication Publication Date Title
US9781484B2 (en) Techniques for acoustic management of entertainment devices and systems
US9081477B2 (en) Electronic device and method of controlling the same
EP2385689B1 (en) Mobile terminal and controlling method thereof
US8675024B2 (en) Mobile terminal and displaying method thereof
US9491501B2 (en) Mobile terminal, television broadcast receiver, and device linkage method
US9071724B2 (en) Method and apparatus for providing a video call service
KR101948645B1 (en) Method and apparatus for controlling contents using graphic object
KR20130064796A (en) Adaptive media content scrubbing on a remote device
KR101952682B1 (en) Mobile terminal and method for controlling thereof
KR20140033896A (en) Mobile terminal and method for controlling of the same
CN103685729B (en) A method for transmitting an image and an electronic device
JP2014533391A (en) Inter-device content sharing method and apparatus
KR101660742B1 (en) Mobile terminal and method for controlling thereof
CN102033704B (en) Mobile terminal and method for controlling the same
US9553972B2 (en) Method and system for reproducing contents, and computer-readable recording medium thereof
US20130176255A1 (en) Method and apparatus for implementing multi-vision system by using multiple portable terminals
KR101761615B1 (en) Mobile terminal and method for controlling the same
KR20100083054A (en) Mobile terminal and method for controlling the same
US9360943B2 (en) Display device and method of providing feedback for gestures thereof
EP2487578A1 (en) Method for controlling screen of mobile terminal
CN103581856B (en) Comprising a plurality of electronic apparatus and a method sim card
KR101608770B1 (en) Mobile terminal and method for controlling the same
CN105653486A (en) Mobile terminal and method for reusing USB ports of processors thereof
KR20130134603A (en) Mobile terminal and method for controlling thereof
JP2018505463A (en) External visual interaction of speech-based devices

Legal Events

Date Code Title Description
E902 Notification of reason for refusal
E701 Decision to grant or registration of patent right
GRNT Written decision to grant