WO2018070564A1

WO2018070564A1 - Sound output method and device for multiple displays

Info

Publication number: WO2018070564A1
Application number: PCT/KR2016/011447
Authority: WO
Inventors: 최원준
Original assignee: 라인 가부시키가이샤
Priority date: 2016-10-13
Filing date: 2016-10-13
Publication date: 2018-04-19
Also published as: CN109804644B; CN109804644A

Abstract

A sound output method and device for multiple displays are provided. A sound output method of a computer device, which includes a plurality of display devices or is connected to the plurality of display devices, comprises: a step of determining a first coordinate of a specific object on a full screen being displayed through the plurality of display devices; a step of determining a display device corresponding to the specific object among the plurality of display devices on the basis of the determined first coordinate; and a step of outputting a sound set for the specific object through a sound output device contained by the determined display device, when the determined display device does contain a sound output device.

Description

Sound output method and device for multiple displays

The following description relates to a sound output method and apparatus for multiple displays, and a computer program stored in a computer readable recording medium in combination with a computer for causing the computer to execute the sound output method.

Various prior arts exist for outputting sound in connection with a screen displayed through a display device. For example, Korean Patent Laid-Open Publication No. 10-2008-0108839 relates to a screen sound source positioning apparatus, a speaker set information generating method for screen sound source positioning, and a screen sound source reproducing method. Disclosed is a technique for selecting a specific speaker set from among a plurality of speakers set to have the same gain installed on the outside of the display device so as to position the virtual screen sound source in synchronization with the image object.

However, the above-described prior art relates to a technique for locating a virtual sound source in relation to one screen displayed through one display apparatus, and thus, the related arts are related to one screen displayed through one display apparatus. It only considers a case of outputting sound, but does not consider a case where a plurality of screens (for example, a plurality of windows) exist through multiple displays. Therefore, there is a problem in that the direction of the sound to be output in relation to a specific object is not accurately provided through the multi display, and awkward sound is output depending on which display device among the multi display devices is to display content such as a game or a video. There is a problem.

When a computer device including a plurality of display devices or connected to a plurality of display devices displays a specific object through the plurality of display devices, a sound set for the specific object depending on which display device the specific object is located at which position And a sound output method and system capable of outputting a computer, and a computer program stored in a computer readable recording medium for executing the sound output method on a computer in combination with a computer.

A sound output method and system capable of outputting sound set for a specific object according to which display device a certain object exists in consideration of a sound output device included in the display device, and a sound output in combination with a computer A computer program stored on a computer readable recording medium for executing the method on a computer is provided.

A sound output method of a computer device including or connected to a plurality of display devices, the method comprising: determining first coordinates of a specific object on an entire screen displayed through the plurality of display devices; Determining a display device corresponding to the specific object from among the plurality of display devices based on the determined first coordinates; And outputting a sound set for the specific object through the sound output device included in the determined display device when the determined display device includes the sound output device. .

A computer program comprising a plurality of display devices or associated with a computer device connected to the plurality of display devices and stored in a computer readable recording medium for executing a sound output method on the computer device, the sound output method comprising: Determining first coordinates of a specific object on a full screen displayed through the plurality of display devices; Determining a display device corresponding to the specific object from among the plurality of display devices based on the determined first coordinates; And outputting a sound set for the specific object through the sound output device included in the determined display device when the determined display device includes the sound output device.

A computer device for executing a sound output method, comprising: at least one processor implemented to execute computer readable instructions, the at least one processor further comprising a plurality of computer devices further connected to or connected to the computer device; Determining a first coordinate of a specific object on the entire screen being displayed through the display device, determining a display device corresponding to the specific object among the plurality of display devices based on the determined first coordinates, and the determined display device being When the sound output device is included, the sound output device configured for the specific object is output through the sound output device included in the determined display device.

When a computer device including a plurality of display devices or connected to a plurality of display devices displays a specific object through the plurality of display devices, a sound set for the specific object depending on which display device the specific object is located at which position You can output

In consideration of the sound output device included in the display device, the sound set for the specific object may be output according to which position of the display device the specific object exists.

1 is a diagram illustrating an example of a sound output environment according to an embodiment of the present invention.

2 is a diagram illustrating an example of sound output according to an embodiment of the present invention.

3 is a block diagram illustrating an internal configuration of a computer device according to an embodiment of the present invention.

4 is a block diagram illustrating an example of a component that may be included in a processor of a computer device according to one embodiment of the present invention.

5 is a flowchart illustrating an example of a sound processing method that may be performed by a computer device according to one embodiment of the present invention.

6 is a flowchart illustrating an example of outputting sound through a sound output device included in the determined display device according to an embodiment of the present invention.

FIG. 7 is a flowchart illustrating an example of outputting sound when the determined display device does not include an audio output device according to an embodiment of the present disclosure.

8 is a diagram for describing a first coordinate and a second coordinate of an object according to an embodiment of the present invention.

9 is a diagram for one example of determining coordinates of layered objects according to one embodiment of the present invention.

FIG. 10 is a diagram for one example of determining coordinates of a minimized window object according to one embodiment of the present invention.

FIG. 11 illustrates an example of an object located outside a screen of a display apparatus according to an exemplary embodiment.

12 is a diagram for one example of determining a first coordinate of an object deviating from the screen through a virtual coordinate system according to one embodiment of the present invention.

FIG. 13 is a diagram for one example of displaying a screen in which a plurality of display devices are connected to each other according to one embodiment of the present invention.

FIG. 14 is a diagram for one example of displaying a plurality of display devices independently of each other according to an embodiment of the present invention.

Hereinafter, exemplary embodiments will be described in detail with reference to the accompanying drawings.

The sound output method according to embodiments of the present invention may be performed by a computer device including a plurality of display devices directly or connected to the plurality of display devices through a network. For example, a computer program (for example, an operating system or an application) according to an embodiment of the present invention may be installed and run on a computer device, and the computer device may be implemented according to the control of the driven computer program. Sound output method according to the present invention can be performed. The computer program described above may be stored in a computer-readable recording medium in combination with the computer device described above to cause the computer device to execute a sound output method.

1 is a diagram illustrating an example of a sound output environment according to an embodiment of the present invention. FIG. 1 illustrates an example in which the computer apparatus 100 is connected to a plurality of

display devices

111, 112, and 113, and a plurality of

speakers

121 and 122.

In this case, a specific object (for example, a computer window object) output by the computer device 100 may be displayed through one of the plurality of

display devices

111, 112, and 113 or through two or more. . In other words, as the plurality of

display devices

111, 112, and 113 are used, various cases in which a specific object can be displayed are made.

Also, the plurality of

speakers

121 and 122 may be omitted when the sound output device is included in at least one of the plurality of

display devices

111, 112, and 113. In addition, the plurality of

speakers

121 and 122 may be included regardless of whether a sound output device is included in at least one of the plurality of

display devices

111, 112, and 113. In addition, the number of sound output devices included in the plurality of

display devices

111, 112, and 113 may be two or more than one. In other words, a more various number of cases in which sound can be output than the case of using only the plurality of

speakers

121 and 122 by the plurality of

display devices

111, 112, and 113 is made.

As such, the multi-display environment may not only vary paths through which a specific object can be displayed, but also paths through which a sound set for a specific object is output. Accordingly, the computer device 100 may output a sound set for a specific object in accordance with various situations so that a sound suitable for the specific object displayed on the screen may be output from the viewpoint of the user 130.

2 is a diagram illustrating an example of sound output according to an embodiment of the present invention. 2 illustrates an example in which the object 210 is displayed through the third display device 113 among the plurality of

display devices

111, 112, and 113. In this case, the sound set for the object 210 is simply output through the plurality of

speakers

121 and 122 or through the sound output device included in the first display device 111 or the second display device 112. If so, the user may feel awkward in the output sound. Therefore, the computer device 100 may output the sound set for the object 210 through the sound output device included in the third display device 113 on which the object 210 is displayed.

In addition, as shown in FIG. 2, when the object 210 is displayed on the right side of the third display device 113 and when the sound set for the object 210 is a multi-channel sound, the computer device 100 The multi-channel is generated to adjust the left and right balancing of the multi-channel sound to be output through the sound output device included in the third display device 113 to generate a virtual sound source for the object 210 displayed on the right side of the third display device 113. Sound can also be output. The prior art of adding directionality to multi-channel sound is already well known, and it will be readily understood by those skilled in the art that the above-described balancing of multi-channel sound can be handled using one of the well-known prior arts.

As such, in the multi-display environment, the user 130 outputs the sound set for the object 210 through the sound output device of the appropriate display device (the third display device 113) according to the display position of the object 210. To provide a more natural sound.

3 is a block diagram illustrating an internal configuration of a computer device according to an embodiment of the present invention. FIG. 3 illustrates the memory 310, the processor 320, the communication module 330, and the input / output interface 340 as physical internal components for implementing the computer device 100.

The memory 310 is a computer-readable recording medium. The memory 310 may include a permanent mass storage device such as random access memory (RAM), read only memory (ROM), and a disk drive. The ROM and the non-volatile mass recording device may be separated from the memory 310 and included in the computer device 100 as a separate permanent storage device. In addition, the memory 310 is stored in a recording medium including the operating system and / or at least one program code (for example, the computer device 100 to perform the sound output method according to an embodiment of the present invention) computer device 100 Computer program for controlling c) may be stored. Such software components may be loaded into the memory 310 from a computer readable recording medium separate from the memory 310. The computer-readable recording medium may include a floppy drive, a disk, a tape, a DVD / CD-ROM drive, a memory card, and the like. In other embodiments, software components may be loaded into memory 310 via communication module 330 rather than on a computer readable recording medium.

The processor 320 may be configured to process instructions according to a computer program by performing basic arithmetic, logic, and input / output operations. Instructions may be provided to the processor 320 by the memory 310 or the communication module 330. For example, the processor 320 may be configured to execute an instruction received from the memory 310 according to the program code loaded into the memory 310. As a more specific example, the processor 320 may control the computer apparatus 100 to execute a sound output method by sequentially executing instructions according to code of a computer program loaded in the memory 310.

The communication module 330 may optionally be included in the computer device 100, and may provide a function for communicating with other physical devices through an actual computer network. In one example, data for processing by the processor 320 of the computer device 100 is received from the other physical device on the computer network to the computer device 100 through the computer network and the communication module 330 to the memory 310 or It may be delivered to the processor 320. Conversely, the processing result of processing the data received by the computer device 100 may be transmitted to the other physical device through the communication module 330 and the computer network.

The input / output interface 340 may be a means for interfacing with the input / output device 350. For example, in the input / output device 350, the input device may include a device such as a keyboard or a mouse, and the output device may include the plurality of

display devices

111, 112, and 113 or the plurality of speakers 121, as described above. 122). In this case, the input / output interface 340 may include an input / output port for connection with the input / output device 350. In FIG. 3, the input / output device 350 is represented as a separate device from the computer device 100, but the computer device 100 may be implemented such that the input / output device 350 is included in the computer device 100 according to an embodiment. .

In addition, in other embodiments, the computer device 100 may include more components than the components of FIG. 3. However, it is not necessary to clearly show most of the prior art components. For example, the computer device 100 may be implemented to further include various components such as various physical buttons or sensors.

4 is a block diagram illustrating an example of a component that a processor of a computer apparatus may include in an embodiment of the present invention, and FIG. 5 is a computer apparatus that may be performed in an embodiment of the present invention. Is a flowchart illustrating an example of a sound processing method. 4 may include a coordinate determiner 410, a display device determiner 420, and a sound output controller 430 as components that may be included in the processor 320 of the computer device 100. The processor 320 and the components of the processor 320 may perform steps 510 to 550 included in the sound output method illustrated in FIG. 5. In this case, the processor 320 and the components of the processor 320 may be implemented to execute instructions according to code of an operating system included in the memory 310 and / or code of at least one computer program. Here, the components of the processor 320 may include different functions of the processor 320 performed by the processor 320 according to a control command provided by a code of a computer program stored in the computer device 100. May be expressions. For example, the coordinate determination unit 410 may be used as a representation of the function of the processor 320 to control the computer device 100 so that the processor 320 determines coordinates of a specific object in the screen.

In operation 510, the coordinate determiner 410 may determine first coordinates of a specific object on the entire screen displayed through the plurality of display devices. Here, a specific object is one of the components that are displayed on the screen and individually identified, such as a skin of a computer window or a video player, a button or area included in a computer window or a skin of a video player. Can be.

1 and 2, the coordinate determination unit 410 may determine coordinates of an object to be displayed on the entire screen being displayed through the plurality of

display devices

111, 112, and 113. As a specific example, identifying the pixels of the entire screen being displayed through the virtual coordinate system (or the plurality of

display devices

111, 112, and 113) having the upper left corner of the first display device 111 as the origin (0, 0). First coordinates for a specific object may be determined. In this case, the first coordinate may be determined as a specific coordinate point among coordinates formed by the specific object, such as a center point among coordinates formed by the specific object or a coordinate point in the upper leftmost corner. As another example, the first coordinate may be a pair of coordinates including a leftmost coordinate and a rightmost coordinate among coordinates of the specific object. As another example, the first coordinate may be a set of coordinates including a leftmost coordinate, a rightmost coordinate, and an uppermost coordinate and a lowermost coordinate among coordinates forming a specific object. The first coordinate is to identify which of the plurality of

display devices

111, 112, and 113 is the object being displayed on the display device. If the object is a coordinate or a set of coordinates for determining the display device, It is not limited and can be utilized.

In operation 520, the display apparatus determiner 420 may determine a display apparatus corresponding to a specific object among the plurality of display apparatuses based on the determined first coordinates. For example, the display device determiner 420 may identify a part corresponding to each of the display devices in the coordinate system for the entire screen, and display the device corresponding to the specific object according to which part of the first coordinate is included. Can be determined.

In operation 530, the sound output controller 430 determines whether the determined display device includes the sound output device, and then, if the sound output device includes the sound output device, performs step 540. Can be done. For example, the operating system of the computer device 100 may determine whether the corresponding display device includes a sound output device from an interface such as a high definition multimedia interface (HDMI) or a display port. For example, the operating system may acquire information such as whether an external device such as a display device includes a separate sound output device through handshaking on the external device information. Therefore, the processor 320 of the computer device 100 may determine whether the connected display device includes the sound output device through the operating system. If the sound output controller 430 operates under the control of a specific application, the application may obtain information on whether the sound output device of the display device is included from the operating system. When the operating system cannot obtain information about the presence or absence of the sound output device from the display device, the computer device 100 may receive or store separate data on whether the sound output device is included for each display device. In this case, additional data received or stored through the identifier, the device name, or the model name of the display device may be searched to determine whether the corresponding display device includes the sound output device.

In operation 540, the sound output controller 430 may output a sound set for a specific object through the sound output device included in the determined display device. In this case, the sound set for the specific object is output through the sound output device of the display apparatus corresponding to the current specific object, so that a more natural sound can be output to the user. If the position of the object is changed so that the display device corresponding to the object is changed, the sound set for the object may be output through the sound output device of the changed other display device.

In operation 550, the sound output controller 430 may output sound set for a specific object through the speaker device included in the computer device 100 or connected to the computer device 100.

Although the above steps 510 to 550 have described a case in which a single channel sound is output, when the sound to be output is a multi channel sound, a more natural sound can be output to the user by outputting the sound in various ways according to conditions. Will be.

6 is a flowchart illustrating an example of outputting sound through a sound output device included in the determined display device according to an embodiment of the present invention. Steps 610 to 630 shown in FIG. 6 may be included in step 540 described above.

In operation 610, when the set sound is a multi-channel sound, the sound output controller 430 may check the second coordinates of the specific object in the virtual coordinate system for the first screen being displayed through the determined display device. Here, the virtual coordinate system for the first screen may be a virtual coordinate system having an upper left virtual point of the first screen as the origin (0, 0). For example, the coordinate determination unit 410 may determine the second coordinate in the virtual coordinate system for the screen of the determined display device, not the virtual coordinate system for the entire screen, and the sound output controller 430 may determine the coordinate determination unit 410. The second coordinate of the object determined by may be checked. In other words, the second coordinate may include coordinates on the screen for the determined one display device, not coordinates on the full screen for the plurality of display devices, and the second coordinates may include the coordinates of the object in the determined display device. It can be used to determine the location.

In operation 620, the sound output controller 430 may balance the multi-channel sound based on the relative position of the specific object according to the identified second coordinate. For example, in order to balance the multi-channel sound, the sound output controller 430 may balance the multi-channel sound so that the multi-channel sound output through the sound output device generates a virtual sound source at a virtual position indicated by the second coordinate. Can be. As already described, balancing multi-channel sound to create a virtual sound source at a specific location may be implemented using one of a variety of existing techniques that already exist.

In operation 630, the sound output controller 430 may output the balanced multi-channel sound through the sound output device. Therefore, the user can not only be provided with a natural sound related to the position of the object through the sound output through the sound output device of the display device corresponding to the specific object on the screen displayed through the multiple display device, but also within the selected display device. The virtual sound source generated in correspondence with the position of the object is provided with a balanced multi-channel sound in order to produce an effect such as sound is generated, thereby providing a more natural sound.

In addition, the above-described balancing may be utilized when outputting multi-channel sound through general speaker devices. In this case, the first coordinate that is the coordinate of the object in the virtual coordinate system of the entire screen for the plurality of display devices may be utilized, rather than the second coordinate that is the coordinate of the object in the virtual coordinate system of the screen for the determined display device.

Steps

710 and 720 shown in FIG. 7 may be included in step 550 described above.

In operation 710, the sound output controller 430 may balance the multichannel sound such that the multichannel sound output through the speaker device generates a virtual sound source at a virtual position indicated by the first coordinate of the specific object. Therefore, the sound output control unit 430 may process the balancing of the multi-channel sound to give the effect that the multi-channel sound is generated in the virtual sound source. According to an exemplary embodiment, the computer device 100 may store data on the arrangement of the display devices and data on how to balance the multi-channel sound according to the arrangement of the display devices. The position for the virtual sound source may be determined through position information obtained through data on the arrangement and second coordinates, which are relative coordinates obtained in each display. As already described, the balancing of multi-channel sounds can be handled using one of the well known prior arts (eg, 3D sound generation scheme such as Head-Related Transfer Function (HRTF)).

In operation 720, the sound output controller 430 may output the balanced multi-channel sound through the speaker device. Therefore, even when outputting sound through the speaker device, the position of the virtual sound source is determined according to the position of the object on the entire screen for the plurality of display devices, not the position of the object on one display device, and through the determined virtual sound source. Since the multi-channel sound can be balanced and displayed to obtain the same effect as the sound is output, more natural sound can be output to the user using the plurality of display devices.

In the above-described embodiments, the first coordinate may be determined as two-dimensional coordinates of a specific object on the entire screen regardless of the depth of objects layered and displayed on the entire screen. For example, even if the first object is hidden by the second object and is not displayed on the screen, the first coordinate may be determined as two-dimensional coordinates on the entire screen regardless of the depth on the screen of the first object. The second coordinate may also be determined as two-dimensional coordinates regardless of the depth on the screen of the display device determined similarly to the first coordinate.

In addition, the specific object may include a computer window object according to an embodiment. For example, it may be a window in which a specific game is running or a window in which a video is playing. Such a window may disappear from the screen through minimization, but even in this case, a sound of a game or a video being played or played may be continuously output. In this case, the first coordinate may include the coordinate where the window object was last displayed on the entire screen. Similarly, the second coordinate may also include a coordinate where the window object was last displayed on the determined screen of the display device. Therefore, the user may receive a more natural sound because a sound may be output from the virtual sound source where the window object is finally displayed, even though a specific window object is not displayed on the screen through minimization.

8 is a diagram for describing a first coordinate and a second coordinate of an object according to an embodiment of the present invention. 8 illustrates an example in which a virtual coordinate system is set on the entire screen 810 for a plurality of display devices. In this case, in the virtual coordinate system, the horizontal axis is the x axis, the vertical axis is the y axis, the coordinates of the virtual coordinate system are represented by (x, y), and the coordinate of the upper left point of the entire screen 810 is (0, 0), Assume that the coordinates at the bottom right are (30, 7). 8 illustrates an example in which the virtual coordinate system set in the entire screen 810 is applied to

individual screens

820, 830, and 840 for a plurality of display devices. In this case, the first coordinates of the object 850 displayed on the second screen 830 may be determined as shown in (17, 6) through a virtual coordinate system for the entire screen 810. On the other hand, since the second coordinate is a position in the coordinate system for the second screen 830, it may be determined as (7, 6). In other words, the first coordinate may be determined using a virtual coordinate system for the entire screen, and the second coordinate may be determined using the virtual coordinate system for the corresponding display device. Determination of these coordinates is one example, the position of the object and the

individual screens

820, 830 in the entire screen 810, such as a pixel coordinate system for the

individual screens

820, 830, 840 as a virtual coordinate system is utilized. It will be readily understood by those skilled in the art that any method capable of relatively expressing the position of the object in FIG. 840 can be utilized.

9 is a diagram for one example of determining coordinates of layered objects according to one embodiment of the present invention. 9 illustrates the second object 930 overlaid on the first object 920 on the screen 910 of one display device. In FIG. 9, the first object 920 is slightly visible. However, this is only for convenience of explanation, and the first object 920 is completely hidden by the second object 930 on the screen 910. Assume that no. In this case, although the first object 920 is not displayed to the user, the computer device 100 knows the existence of the first object 920 and the first coordinate or the second coordinate for the first object 920. Can be determined. If the output of the sound set for the first object 920 is required even though the first object 920 is not displayed, the computer device 100 may output the sound using the determined first coordinate or the second coordinate. Can be.

FIG. 10 is a diagram for one example of determining coordinates of a minimized window object according to one embodiment of the present invention. 10 illustrates an example in which the window object 1011 is displayed on the first screen 1010 of one display apparatus. At this time, the dotted circle 1012 represents an example of a user interface that can minimize the window object 1011. If the user selects a corresponding user interface (for example, by clicking a region where the corresponding user interface is displayed with a mouse), the first screen 1010 is a window object 1011 disappeared like the second screen 1020. Can be changed to In this case, the computer device 100 may determine the first coordinate or the second coordinate as the coordinates on which the window object 1011 was last displayed. For example, if a video is being played through the window object 1011, even if the window object 1011 disappears as shown in the second screen 1020 according to the minimization, the computer device 100 may determine that the window object 1011 is the last. By outputting the sound of the video based on the coordinates indicated by, it is possible to naturally provide the sound of the video to the user even if the window object 1011 suddenly disappears.

In the above embodiments, the cases where the object is located in the screen of the display device have been described. However, the object may be off the screen of the display device.

FIG. 11 illustrates an example of an object located outside a screen of a display apparatus according to an exemplary embodiment. 1 illustrates an example in which a portion of the window object 1120 is moved out of the screen 1110 according to the arrangement of the window object 1120 as an example of the screen 1110 of the display device. In this case, the object A 1130 included in the window object 1120 may also be moved out of the screen 1110. As such, in the case where the sound set in relation to the object A 1130 deviating from the screen 1110 needs to be output, the computer device 100 may include the first coordinate and the second coordinate with respect to a point outside the screen 1110 in the virtual coordinate system. You need to determine the coordinates.

FIG. 12 illustrates an example of determining coordinates of an object deviating from the screen through a virtual coordinate system according to an embodiment of the present invention. 12 illustrates an example of a virtual coordinate system 1240 that is not limited to the

screens

1210, 1220, and 1230 of the plurality of display devices. In this case, in the virtual coordinate system 1240, the horizontal axis is the x axis, the vertical axis is the y axis, the coordinates of the virtual coordinate system 1240 are represented as (x, y), and the coordinates (0, 0) are used as the origin 1250 of the virtual coordinate system 1240. ) Is set to the leftmost coordinate of the first screen 1210 of FIG. 12. In this case, the coordinates of the first point 1260 shown in FIG. 12 may be (8, -2). Also, the coordinates of the second point 1270 may be (18, 9). Similarly, the coordinates of the third point 1280 may be (29, -3).

In this case, the object located at the first point 1260 is on the first screen 1210, the object located at the second point 1270 is on the second screen 1220, and the object located at the third point 1270 is third It may be determined to correspond to the screen 1230.

As a more specific example, the computer device 100 may determine the display device providing the second screen 1220 among the plurality of display devices by using the coordinates 18 and 9 of the second point 1270, and the determined display. It may be determined whether the device includes a sound output device. Coordinates 18 and 9 herein may be determined as first coordinates of the second point 1270. If the display device providing the second screen 1220 does not include the sound output device, the computer device 100 may output sound set for the object using the speaker devices. In addition, when the sound to be output is a multi-channel sound, the multi-channel sound may be balanced to generate the virtual sound source at the position of the virtual coordinates 18 and 9 according to the existing 3D sound source generation method.

In addition, when the display device providing the second screen 1220 does not include the sound output device, the computer device 100 may output the sound set for the object through the sound output device of the determined display device. In this case, when the sound to be output is a multi-channel sound, the computer device 100 may determine the second coordinate for the object. In this case, the virtual coordinate system for the second screen 1220 may have the leftmost uppermost point of the second screen 1220 as the origin, and in this case, the second coordinate of the second point 1270 may be (8, 9). Can be. The computer apparatus 100 may balance the multi-channel sound to generate the virtual sound source at the position of the virtual second coordinates 8 and 9 according to the existing 3D sound source generation method through the sound output device included in the determined display device. have.

In addition, the above embodiments have described examples in which screens of a plurality of display devices are connected to each other. However, the screens of the plurality of display devices may display separate independent screens that are not connected to each other.

FIG. 13 illustrates an example in which a plurality of display devices display screens connected to each other in an embodiment of the present invention, and FIG. 14 illustrates a plurality of display devices that are independent of each other in an embodiment of the present invention. It is a figure which shows the example which displays each screen.

First, FIG. 13 is a diagram illustrating an example of a screen in which a first screen 1310 and a second screen 1320 are connected to each other. In this case, the display device on which the object 1330 is output may be determined through various methods such as a center point of the object 1330 or a ratio at which the object 1330 is displayed. In the example of FIG. 13, the display device displaying the second screen 1320 is displayed on the display device on which the object 1330 is output as the first coordinate determined by the computer device as the center point of the object 1330 exists on the second screen 1320. Can be determined by the device. In this case, the sound set for the object 1330 may be output through the sound output device of the display device displaying the second screen 1320.

Meanwhile, as shown in FIG. 14, the first screen 1410 and the second screen 1420 may display screens that are independent of each other. In this case, the same problem as exposing the object 1410 through one display rather than multiple displays. In other words, it is immediately understood that the object 1410 is displayed through the display device displaying the first screen 1410, and the object 1410 is provided through the sound output device of the display device displaying the first screen 1410. You can output the sound set for.

If the display device displaying the first screen 1410 does not include a sound output device, sound may be output through a separate speaker device. In this case, however, it may be difficult to process balancing of multi-channel sounds. To this end, as described above, the computer apparatus 100 may previously have data on the arrangement of the display apparatuses and data on how to process the balancing according to the arrangement of the display apparatuses. Multi-channel sound can be balanced using the data stored in. If the placement of display devices reveals where to create the virtual sound source, balancing multi-channel sound to generate the virtual sound source at that location uses one of the prior art techniques for 3D sound generation as described above. It will be readily understood by those skilled in the art that this can be achieved by In addition, if the information on the arrangement of the display apparatuses is known in advance, the position where the virtual sound source should be generated may be known based on the absolute position of the specific display apparatus and the second coordinate which is a relative coordinate in the display apparatus.

As described above, according to embodiments of the present invention, when a computer device including a plurality of display apparatuses or connected to a plurality of display apparatuses displays a specific object through the plurality of display apparatuses, the specific object is a display apparatus. The sound set for a specific object may be output depending on the location of the. In addition, in consideration of the sound output device included in the display device, the sound set for the specific object may be output according to which position of the display device the specific object exists.

The system or apparatus described above may be implemented as a hardware component, a software component or a combination of hardware components and software components. For example, the devices and components described in the embodiments are, for example, processors, controllers, arithmetic logic units (ALUs), digital signal processors, microcomputers, field programmable gate arrays (FPGAs). Can be implemented using one or more general purpose or special purpose computers, such as a programmable logic unit (PLU), a microprocessor, or any other device capable of executing and responding to instructions. The processing device may execute an operating system (OS) and one or more software applications running on the operating system. The processing device may also access, store, manipulate, process, and generate data in response to the execution of the software. For convenience of explanation, one processing device may be described as being used, but one of ordinary skill in the art will appreciate that the processing device includes a plurality of processing elements and / or a plurality of types of processing elements. It can be seen that it may include. For example, the processing device may include a plurality of processors or one processor and one controller. In addition, other processing configurations are possible, such as parallel processors.

The software may include a computer program, code, instructions, or a combination of one or more of the above, and configure the processing device to operate as desired, or process it independently or collectively. You can command the device. Software and / or data may be any type of machine, component, physical device, virtual equipment, computer storage medium or device in order to be interpreted by or to provide instructions or data to the processing device. It may be embodied permanently or temporarily. The software may be distributed over networked computer systems so that they may be stored or executed in a distributed manner. Software and data may be stored on one or more computer readable recording media.

The method according to the embodiment may be embodied in the form of program instructions that can be executed by various computer means and recorded in a computer readable medium. The computer readable medium may include program instructions, data files, data structures, etc. alone or in combination. The program instructions recorded on the media may be those specially designed and constructed for the purposes of the embodiments, or they may be of the kind well-known and available to those having skill in the computer software arts. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tape, optical media such as CD-ROMs, DVDs, and magnetic disks, such as floppy disks. Magneto-optical media, and hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like. Examples of program instructions include not only machine code generated by a compiler, but also high-level language code that can be executed by a computer using an interpreter or the like.

Although the embodiments have been described by the limited embodiments and the drawings as described above, various modifications and variations are possible to those skilled in the art from the above description. For example, the described techniques may be performed in a different order than the described method, and / or components of the described systems, structures, devices, circuits, etc. may be combined or combined in a different form than the described method, or other components. Or even if replaced or substituted by equivalents, an appropriate result can be achieved.

Therefore, other implementations, other embodiments, and equivalents to the claims are within the scope of the claims that follow.

Claims

In the sound output method of a computer device including a plurality of display devices or connected to the plurality of display devices,

Determining first coordinates of a specific object on a full screen displayed through the plurality of display devices;

Determining a display device corresponding to the specific object from among the plurality of display devices based on the determined first coordinates; And

If the determined display device includes a sound output device, outputting a sound set for the specific object through the sound output device included in the determined display device;

Sound output method comprising a.
The method of claim 1,

The outputting of the sound set for the specific object through the sound output device included in the determined display device may include:

If the set sound is a multi-channel sound, checking the second coordinates of the specific object in a virtual coordinate system for the first screen being displayed through the determined display device;

Balancing the multi-channel sound based on the relative position of the specific object according to the identified second coordinates; And

Outputting the balanced multi-channel sound through the sound output device

Sound output method comprising a.
The method of claim 2,

Balancing the multi-channel sound,

And balancing the multi-channel sound so that the multi-channel sound output through the sound output device generates a virtual sound source at a virtual position indicated by the second coordinate.
The method of claim 2,

And the second coordinate is determined as virtual coordinates outside the first screen in the virtual coordinate system for the first screen when the specific object is located outside the first screen.
The method of claim 1,

If the determined display device does not include a sound output device, outputting a sound set for the specific object through the speaker device further included or further connected to the computer device;

Sound output method further comprises.
The method of claim 5,

Outputting the sound set for the specific object through the speaker device,

When the set sound is a multi-channel sound, the multi-channel sound is output through the speaker device, and the multi-channel sound output through the speaker device uses a virtual sound source at a virtual position indicated by the first coordinate of the specific object. And outputting by balancing the multi-channel sound to generate.
The method of claim 1,

And the first coordinate is determined as two-dimensional coordinates of the specific object on the full screen regardless of the depth of the objects displayed layered on the full screen.
The method of claim 1,

The specific object includes a window object,

And the first coordinates include coordinates last displayed on the full screen when the window object disappears from the full screen by minimizing the window object.
The method of claim 1,

And the first coordinate is determined as virtual coordinates outside the full screen in the virtual coordinate system for the full screen when the specific object is located outside the full screen.
A computer program comprising a plurality of display devices or associated with a computer device connected to the plurality of display devices, the computer program stored on a computer readable recording medium for executing a sound output method on the computer device,

The sound output method,

Determining first coordinates of a specific object on a full screen displayed through the plurality of display devices;

Determining a display device corresponding to the specific object from among the plurality of display devices based on the determined first coordinates; And

If the determined display device includes a sound output device, outputting a sound set for the specific object through the sound output device included in the determined display device;

Computer program comprising a.
The method of claim 10,

The outputting of the sound set for the specific object through the sound output device included in the determined display device may include:

If the set sound is a multi-channel sound, checking the second coordinates of the specific object in a virtual coordinate system for the first screen being displayed through the determined display device;

Balancing the multi-channel sound based on the relative position of the specific object according to the identified second coordinates; And

Outputting the balanced multi-channel sound through the sound output device

Computer program comprising a.
The method of claim 11,

Balancing the multi-channel sound,

And balancing the multi-channel sound such that the multi-channel sound output through the sound output device generates a virtual sound source at a virtual position indicated by the second coordinate.
The method of claim 10,

The sound output method,

If the determined display device does not include a sound output device, outputting a sound set for the specific object through the speaker device further included or further connected to the computer device;

Computer program characterized in that it further comprises.
The method of claim 13,

Outputting the sound set for the specific object through the speaker device,

When the set sound is a multi-channel sound, the multi-channel sound is output through the speaker device, and the multi-channel sound output through the speaker device uses a virtual sound source at a virtual position indicated by the first coordinate of the specific object. And output the balanced multi-channel sound to produce.
The method of claim 10,

And the first coordinate is determined as virtual coordinates outside the full screen in the virtual coordinate system for the full screen when the specific object is located outside the full screen.
A computer device for executing a sound output method,

At least one processor implemented to execute computer readable instructions

Including,

The at least one processor,

Determine a first coordinate of a specific object on the entire screen that the computer device further includes or displays via a plurality of display devices connected to the computer device,

Determine a display device corresponding to the specific object among the plurality of display devices based on the determined first coordinates,

Outputting a sound set for the specific object through the sound output device included in the determined display device when the determined display device includes a sound output device;

Computer device characterized in that.
The method of claim 16,

The at least one processor,

When the set sound is a multi-channel sound in outputting a sound set for the specific object through the sound output device included in the determined display device,

Confirm second coordinates of the specific object in a virtual coordinate system with respect to the first screen being displayed through the determined display device;

Balance the multi-channel sound based on the relative position of the specific object according to the identified second coordinates,

Outputting the balanced multi-channel sound through the sound output device

Computer device characterized in that.
The method of claim 16,

The at least one processor,

If the determined display device does not include a sound output device, outputting sound set for the specific object through the speaker device further included or further connected to the computer device;

Computer device characterized in that.
The method of claim 18,

The at least one processor is configured to output a sound set for the specific object through the speaker device, when the set sound is a multi-channel sound.

The multi-channel sound is output through the speaker device, and the multi-channel sound output through the speaker device is balanced by the multi-channel sound so as to generate a virtual sound source at a virtual position indicated by the first coordinate of the specific object. To do

Computer device characterized in that.