TWI485576B - Multimedia interaction system and related computer program product capable of avoiding unexpected interaction behavior - Google Patents

Description

Multimedia interactive system and related computer program products that can prevent unintended interactions from occurring

The invention relates to a multimedia interactive system, in particular to a multimedia interactive system and related computer program products comprising a plurality of displays and avoiding unintended interactions.

With the advancement of technology, multimedia interactive systems and related applications that allow multimedia interactions of different electronic devices have received increasing attention. The design of many interactive applications related to multimedia content expects that the relative positions of multiple electronic devices participating in multimedia interactions in space must meet certain conditions to allow specific multimedia interactions. However, in the traditional multimedia interactive system, the transmitting end electronic device of the multimedia interactive instruction cannot judge the relative position of itself and other electronic devices in space, nor can it restrict the transmission direction of the multimedia content or the interactive instruction. Therefore, there is often a multimedia interaction result between the electronic devices that does not conform to the general user experience, should not appear in the design of the multimedia interactive application, violates the rules set by the interactive application, or is unintended.

For example, some multimedia interactive applications are designed to expect the receiving electronics and its The user must be located in front of the user of the transmitting electronic device, and the specific image object or command can be transmitted from the transmitting electronic device to the receiving electronic device. However, in actual operation, the receiving end electronic device and its user can receive the specific image object or instruction transmitted by the transmitting end electronic device even if it is located behind the user of the transmitting end electronic device. Such unintended interactions are not in line with the general user experience and should not occur in the design of multimedia interactive applications, but they often occur. This is because in order to enable the electronic device to achieve better signal transmission quality, the communication circuits in the electronic device are generally designed to transmit and receive signals in various directions, rather than transmitting and receiving signals in a specific direction.

One of the ways to reduce the above problem is to design the communication circuit of the electronic device to only transmit and receive signals in a specific direction, but this method will seriously affect the signal transmission capability and the receiving range of the electronic device. If the user experience presented by the multimedia interactive system cannot be ensured, and the original design intention of the multimedia interactive application can be met, the development and application range of the multimedia interactive application across the electronic device will be seriously hindered.

In view of this, how to reduce the number of electronic devices participating in multimedia interactive applications, which may not be in line with the general user experience, should not appear in the design of multimedia interactive applications, violate the rules set by interactive applications, or unintended multimedia The possibility of interactive results to improve the user experience of multimedia interactive systems is a problem that the industry has yet to resolve.

The present specification provides an embodiment of a multimedia interactive system having a plurality of displays, including: a plurality of electronic devices; a plurality of displays respectively disposed on the plurality of electronic devices; and a position detecting circuit configured to dynamically detect The individual locations and directivity of the plurality of electronic devices in space, and the information related to the detection results, The line transmission mode is transmitted to at least one of the plurality of electronic devices. When a user instructs a source electronic device of the plurality of electronic devices to transmit a target image object toward a target direction, the source electronic device determines that a candidate electronic device of the other electronic device is in space with the target direction Whether the relative position meets a predetermined condition, and only if the position of the candidate electronic device and the relative position of the target direction in the space meet the predetermined condition, the source electronic device will correspond to the target image object. The target instruction is transmitted to the candidate electronic device, so that the candidate electronic device performs a multimedia operation corresponding to the target image object by using a corresponding candidate display according to the target instruction.

This specification provides an embodiment of a computer program product. The computer program product is stored in a non-transitory storage device of a source electronic device. The source electronic device includes a source display. When a control circuit of the source electronic device executes the computer program product, the source electronic device is caused to perform a multimedia interactive operation. The multimedia interactive operation includes: dynamically transmitting, by means of a communication circuit of the source electronic device, information related to individual locations and directivity of the source electronic device and the one or more electronic devices in space by wireless transmission; When the source electronic device instructs the source electronic device to transmit a target image object in a target direction, the control circuit determines whether a relative position of the candidate electronic device in the one or more electronic devices in the space meets a predetermined condition And transmitting, by the communication circuit, a target instruction corresponding to the target image object to the candidate electronic device only if the position of the candidate electronic device and the relative position of the target direction in the space meet the predetermined condition And causing the candidate electronic device to perform a multimedia operation corresponding to the target image object by using a corresponding candidate display according to the target instruction.

One of the advantages of the above embodiments is that the source of the multimedia interactive instruction can be effectively reduced. Electronic devices and other electronic devices may not be suitable for general user experience, should not appear in the design of multimedia interactive applications, violate the rules set by interactive applications, or unintended multimedia interaction results.

Another advantage of the above embodiment is that it may cause the multimedia interactive system to appear to be inconsistent with the general user experience, should not appear in the design of the multimedia interactive application, violate the rules set by the interactive application, or the unintended multimedia interaction. The resulting multimedia interactive instructions are filtered or blocked to ensure that the multimedia interactions presented by the multimedia interactive system are consistent with the original design intent of the multimedia interactive application. As a result, the user experience provided by the multimedia interactive system can be greatly improved.

Other advantages of the invention will be explained in more detail by the following description and drawings.

100‧‧‧Multimedia interactive system

110‧‧‧ position detection circuit

120‧‧‧Electronic devices

121‧‧‧Control circuit

123‧‧‧Storage device

125‧‧‧Communication circuit

127‧‧‧ display

128‧‧‧Multimedia interactive module

130‧‧‧Network

211, 212, 213, 214, 221, 222, 223, 224, 231, 232, 233, 234 ‧ ‧ reference points

215, 235‧‧‧ control keys

216, 226‧‧‧ browser window

225‧‧‧ brand logo

400‧‧‧ Target image objects

1300‧‧‧Projected objects of the target image object

2400‧‧‧Multimedia interactive screen

2410‧‧‧Master image screen

2420‧‧‧ thumbnail picture

2421, 2422, 2423‧‧‧ portrait

2424‧‧‧Image objects

2425‧‧‧Track line

FIG. 1 is a simplified functional block diagram of a multimedia interactive system according to an embodiment of the present invention.

FIG. 2 is a schematic diagram showing the simplified position of a portion of the electronic device in FIG. 1 in space. FIG.

FIG. 3 is a simplified flowchart of a multimedia interaction method according to an embodiment of the present invention.

4 to 12 are simplified schematic views showing different states of relative positions of the electronic devices in FIG. 1 in space.

13 to 21 are simplified schematic views showing different states of relative positions of projections of a portion of the electronic device of FIG. 1 on a reference horizontal plane.

22 to 23 are simplified flowcharts of a multimedia interaction method according to various embodiments of the present invention.

FIG. 24 is a schematic diagram of a simplified multimedia interactive screen according to an embodiment of the present invention.

Embodiments of the present invention will be described below in conjunction with the associated drawings. In the drawings, the same reference numerals are used to refer to the same or similar elements or process steps.

Please refer to FIG. 1 , which is a simplified functional block diagram of a multimedia interactive system 100 according to an embodiment of the present invention. The multimedia interactive system 100 includes a locatin detection circuit 110 and a member electronic device (120-a~120-n is taken as an example). In the multimedia interactive system 100, different users perform interactive operations related to multimedia content by using various electronic devices 120-a~120-n, such as various multimedia content sharing, multimedia content interaction, multimedia content collaborative editing, online sports. Games, card games, Role-playing Game (RPG), Action Game, Adventure Game, Strategy Game (SLG), Real Time Strategy Game (RSG) and many more.

The position detecting circuit 110 can use one or more magnetic sensing circuits, ultrasonic positioning circuits, infrared sensing circuits, image sensing and identification circuits, WiFi signal positioning circuits, motion detection circuits, indoor GPS circuits, and gesture sensing. Various existing object positioning circuits, such as circuits, are implemented. In practice, the position detecting circuit 110 can be disposed above all the electronic devices 120-a~120-n, such as the position of the ceiling, so that the position detecting circuit 110 is positioned higher than all the electronic devices 120-a~120. -n to improve the accuracy of position detection.

The lowercase English indexes a~n in the component numbers and device numbers used in the present specification and drawings are merely for convenience of referring to individual components and devices, and are not intended to limit the number of the aforementioned components and devices to a specific number. In the present specification and drawings, if a component number or device number is used, the component number or device is not specified. The index of the number indicates that the component number or device number refers to any component or device that is not specific to the component group or device group to which it belongs. For example, the component number 121-a refers to the control circuit 121-a, and the component number 121 refers to any of the control circuits 121-a to 121-b. For another example, the device number 120-b refers to the electronic device 120-b, and the device number 120 refers to any of the electronic devices 120-a to 120-n.

In the embodiment of FIG. 1 , the electronic devices 120-a 120 120-n respectively include a control circuit 121 , a storage device 123 coupled to the control circuit 121 , a communication circuit 125 , and a display 127 . In practice, the control circuit 121 can be implemented by one or more processor units, and the communication circuit 125 can be a wired network interface, a wireless network interface, or a circuit that integrates both functions. In addition, the multimedia interaction module 128 is stored in the storage device 123. The multimedia interaction module 128 can be composed of one or more application modules. For convenience of explanation, other elements and connection relationships in the electronic device 120 are not shown in FIG.

In operation, the electronic devices 120-a~120-n can communicate with each other via the network 130. The aforementioned network 130 may be an internet or internal network employing various communication protocols.

In use, the electronic devices 120-a-120-n may be a plurality of electronic devices having the same hardware specifications and operating systems, or a plurality of electronic devices having different hardware specifications and operating systems. In other words, the electronic devices 120-a~120-n can be various desktop computers, desktop game machines, transaction machines, and mobile electronic devices (such as mobile phones, tablets, notebook computers, small devices) having networking functions. Various combinations of notebooks, e-books, handheld game consoles, etc., or various types of home appliances (such as televisions, refrigerators, stereos, etc.).

The operation of the multimedia interactive system 100 will be further described below in conjunction with FIG.

3 is a simplified flowchart 300 of an embodiment of a multimedia interaction method for use in a multimedia interactive system 100 of the present invention.

In flowchart 300, the process located in the field to which a particular device belongs is representative of the flow performed by that particular device. For example, in flowchart 300, the portion of the field labeled "Location Detection Circuit" represents the flow performed by position detection circuit 110, in the field labeled "source electronic device". The portion of the field that represents the electronic device that generates the multimedia interactive command, and the portion of the field labeled "candidate electronic device" represents the electronic device that may receive or execute the multimedia interactive command. Process. The same orchestration logic is also used in subsequent flowcharts.

When the multimedia interaction method in the flowchart 300 is performed, the control circuit 121 in the electronic device 120 executes the multimedia interaction module 128 to cause the electronic device 120 to perform some or all of the processes in the corresponding fields.

For convenience of understanding, the operation mode of the multimedia interactive system 100 will be described below by taking the source electronic device as the electronic device 120-a and the candidate electronic device as one of the other electronic devices 120-b-120-n.

In the process 302, the position detecting circuit 110 can dynamically detect the individual positions and directivity of the electronic devices 120-a~120-n in space to generate individual devices in the space with the electronic devices 120-a~120-n. Information related to location and directivity, and wirelessly transmitting information related to the detection result to at least one of the electronic devices 120-a~120-n by wireless transmission.

In the multimedia interactive system 100, the location of the particular geometric feature of the electronic device 120, a particular logo, a particular component, a particular region, a particular geometric feature of the display 127, or a particular geometric feature of a particular display region on the display 127 in space may be utilized. To represent the location of the electronic device 120 in space.

For example, the position detecting circuit 110 can detect and utilize the position of a centroid of the electronic device 120 to represent the position of the electronic device 120 in space. Alternatively, the position detecting circuit 110 can detect and utilize the centroid position of the display 127 to represent the position of the electronic device 120 in space.

In practice, the position detecting circuit 110 and the individual electronic devices 120-a~120-n can also be used to jointly calculate the position of the individual electronic devices 120-a~120-n in space. The position detecting circuit 110 can detect and transmit the spatial coordinates of the plurality of reference points in the electronic device 120 to the electronic device 120, and the electronic device 120 uses the control circuit 121 to calculate the spatial coordinate of the received multiple reference points. The centroid position of the electronic device 120 represents the position of the electronic device 120 in space. For example, in the embodiment of FIG. 2, the position detecting circuit 110 can detect and transmit the spatial coordinates of the reference points 211 to 214 in the electronic device 120-a to the electronic device 120-a, and the detecting and transmitting electronic device 120- The spatial coordinates of the reference points 221-224 in b are given to the electronic device 120-b, and the spatial coordinates of the reference points 231-234 in the detecting and transmitting electronic device 120-n are given to the electronic device 120-n.

Since the length and width of the electronic device 120-a are given values, the electronic device 120-a can calculate the electronic device by using the control circuit 121-a according to the spatial coordinates of some or all of the reference points in the reference points 211 to 214. The position of the centroid of 120-a represents the position of the electronic device 120-a in space. Since the length and width of the electronic device 120-b are given values, the electronic device 120-b can utilize the control circuit 121-b according to the reference point. The spatial coordinates of some or all of the reference points in 221 to 224 calculate the position of the centroid of the electronic device 120-b to represent the position of the electronic device 120-b in space. Similarly, since the length and width of the electronic device 120-n are given values, the electronic device 120-n can be calculated by the control circuit 121-n according to the spatial coordinates of some or all of the reference points 231-234. The three-dimensional coordinates of the centroid of the electronic device 120-n are represented to represent the position of the electronic device 120-n in space.

Alternatively, the electronic device 120 may also use the control circuit 121 to calculate the position of the centroid of the display 127 according to the spatial coordinates of the received plurality of reference points to represent the position of the electronic device 120 in the space. For example, in the embodiment of FIG. 2, the position detecting circuit 110 can detect and transmit the spatial coordinates of the reference points 211 to 214 in the electronic device 120-a to the electronic device 120-a, and the detecting and transmitting electronic device 120- The spatial coordinates of the reference points 221-224 in b are given to the electronic device 120-b, and the spatial coordinates of the reference points 231-234 in the detecting and transmitting electronic device 120-n are given to the electronic device 120-n.

Since the length and width of the electronic device 120-a are given values, and the size of the display 127-a and the set position in the electronic device 120-a are also given, the electronic device 120-a can utilize the control circuit 121. -a calculates the position of the centroid Ca of the display 127-a based on the spatial coordinates of some or all of the reference points in the reference points 211 to 214 to represent the position of the electronic device 120-a in space. Since the length and width of the electronic device 120-b are given values, and the size of the display 127-b and the set position in the electronic device 120-b are also given, the electronic device 120-b can utilize the control circuit 121. -b calculates the position of the centroid Cb of the display 127-b based on the spatial coordinates of some or all of the reference points 221-224 to represent the position of the electronic device 120-b in space. Likewise, since the length and width of the electronic device 120-n are given values, and the size of the display 127-n and the set position in the electronic device 120-n are also given Therefore, the electronic device 120-n can calculate the three-dimensional coordinates of the centroid Cn of the display 127-n by using the control circuit 121-n according to the spatial coordinates of some or all of the reference points 231-234 to represent the electronic device 120. -n position in space.

Alternatively, the electronic device 120 can also use the control circuit 121 to calculate the location of a specific geometric feature of a multimedia interactive program window (eg, a browser window) displayed on the display 127 according to the received spatial coordinates of the plurality of reference points (eg, The position of the center point) represents the position of the electronic device 120 in space. For example, in the embodiment of FIG. 2, electronic device 120-a utilizes display 127-a to display a target browser window 216, and electronic device 120-b utilizes display 127-b to display a target browser window 226. Since the size of the target browser window 216 displayed on the display 127-a and the relative position in the display 127-a are both set by the control circuit 121-a, they are all known parameters. Therefore, the position detecting circuit 110 can detect and transmit the spatial coordinates of the reference points 211 to 214 in the electronic device 120-a to the electronic device 120-a, and the electronic device 120-a can use the control circuit 121-a according to the reference. The spatial coordinates of some or all of the reference points in points 211 to 214 calculate the three-dimensional coordinates of the center point Wa of the target browser window 216 to represent the position of the electronic device 120-a in space. Similarly, since the size of the target browser window 226 displayed on the display 127-b and the relative position in the display 127-b are both set by the control circuit 121-b, they are all known parameters. Therefore, the position detecting circuit 110 can detect and transmit the spatial coordinates of the reference points 221 to 224 in the electronic device 120-b to the electronic device 120-b, and the electronic device 120-b can utilize the control circuit 121-b according to the reference. The spatial coordinates of some or all of the reference points in points 221 to 224 calculate the three-dimensional coordinates of the center point Wb of the target browser window 226 to represent the position of the electronic device 120-b in space.

In addition, the position detecting circuit 110 can also identify and detect one or more of the electronic devices 120. The position of the reference object or the mark is compared with the position of the other reference points to determine the orientation of the electronic device 120 in space. For example, in the embodiment of FIG. 2, the position detecting circuit 110 can identify and detect the position of the control key 215 in the electronic device 120-a and some or all of the reference points 211-214. The spatial coordinates are compared to determine the directivity of the electronic device 120-a in space. The position detecting circuit 110 can identify and detect the position of the brand mark 225 of the electronic device 120-b, and compare with the spatial coordinates of some or all of the reference points 221 to 224 to determine the electronic The directivity of device 120-b in space. The position detecting circuit 110 can identify and detect the position of the control key 235 of the electronic device 120-n, and compare with the spatial coordinates of some or all of the reference points 231-234 to determine the electronic The directivity of device 120-n in space.

Alternatively, the position detecting circuit 110 can also transmit the detection result of the position of the one or more reference objects or flags to the electronic device 120 together with the detection result of the position of the other reference points. The electronic device 120 uses the control circuit 121 to compare the position of the one or more reference objects or flags with the positions of other reference points to determine the directivity of the electronic device 120 in space to reduce the position detection. The computational burden of the circuit 110.

In the following description, the directivity of the electronic device 120-a in the space is represented by the pointing direction Da, and the directivity of the electronic device 120-b in the space is represented by the pointing direction Db, and the electronic device 120-n is The directivity in space is represented by the pointing direction Dn. It should be noted that the "directivity" and the "directing direction" referred to in the present invention are description terms regarding the manner in which the electronic device 120 is placed in the use state, and are not used to indicate the signal transmission and reception direction of the communication circuit 125 of the electronic device 120.

For convenience of explanation, it is assumed below that the multimedia interactive system 100 utilizes the position of the centroid of the display 127 to represent the position of the electronic device 120 in space.

In operation, the position and directivity of each electronic device 120 in space may change due to a change in the position of the user or a change in the posture of the operating electronic device 120. Therefore, the position detecting circuit 110 performs the foregoing process 302 continuously or intermittently, and dynamically detects the individual positions and directivity of the electronic devices 120-a-120-n in the space to generate the electronic device 120-a~ 120-n information about individual locations and directivity in space, and the generated information is transmitted wirelessly to one or more electronic devices in need.

In the process 304, the multimedia interaction module 128 of each electronic device 120 can dynamically receive information related to the position and directivity of the electronic device 120 in the space from the position detection circuit 110 by using the communication circuit 125 in a wireless transmission manner. And record it. In addition, the multimedia interaction module 128 can also use the communication circuit 125 to dynamically receive and record information related to individual positions and directivity of other electronic devices in the space from the position detection circuit 110 or other electronic devices. The electronic device 120 can perform the foregoing process 304 periodically or intermittently to dynamically receive the latest information generated by the position detecting circuit 110 or other electronic devices, and update the electronic devices 120-a~120-n in space accordingly. The individual location and directivity related records.

When the user of the source electronic device 120-a operates the source electronic device 120-a, the multimedia interaction module 128-a performs a process 306 to determine whether the user's current operation is an indication that a target image object is facing one. Target direction transfer. If the operation is only another operation that is not related to the target image object, the control circuit 121-a performs a corresponding operation according to the user's operation.

If the user of the source electronic device 120-a performs a predetermined operation (for example, a specific touch mode, a specific mouse operation, or a specific voice control command) on the source electronic device 120-a, the source electronic device 120 is indicated. -a transmits a target image object in a target direction, and the multimedia interaction module 128-a performs a process 308.

In the process 308, the multimedia interaction module 128-a can select other electronic devices 120-b~120-n one by one as a candidate electronic device, and according to the latest information about the position and directivity of the candidate electronic device in space. Information, to determine whether the selected candidate electronic device and the relative position of the target direction in space meet a predetermined condition. If the selected candidate electronic device and the relative position of the target direction in the space meet the predetermined condition, the multimedia interaction module 128-a performs the process 310; otherwise, if the selected candidate electronic device and the target direction are in space relative to each other; If the location does not meet the predetermined condition, the multimedia interaction module 128-a performs flow 316.

In the process 310, the multimedia interaction module 128-a transmits the target command corresponding to the target image object and the user's instruction to the candidate electronic device that meets the predetermined condition by using the communication circuit 125-a. The foregoing target instructions include one or more instructions used by the source electronic device 120-a to set, control, change, or adjust the multimedia content presented by the display on the candidate electronic device (hereinafter referred to as the candidate display), and may also include Parameter values related to image attributes such as shape, size, color, position, duration, moving direction, and moving speed of one or more image objects.

In the process 312, the multimedia interaction module of the candidate electronic device utilizes the communication circuit of the candidate electronic device to receive the target instruction.

In the process 314, the multimedia interaction module of the candidate electronic device uses the candidate display to perform the multimedia operation corresponding to the target image object according to the target instruction. E.g The multimedia interaction module of the candidate electronic device can use the control circuit to set or adjust the shape, size, color, position, duration, moving direction, moving speed, etc. of the one or more image objects corresponding to the target image object according to the target instruction. Image attributes to generate one or more corresponding images and display the one or more corresponding images on the candidate display to perform a multimedia interactive operation.

In practice, the multimedia interaction module 128-a can perform the foregoing process 308 on the other electronic devices 120-b~120-n one by one to find all eligible electronic devices that meet the requirements. Alternatively, the multimedia interaction module 128-a may also find the first candidate electronic device that meets the determination condition of the process 308 from the electronic devices 120-b~120-n, and then terminate the operation of the process 308 instead of The position of the other electronic device is judged relative to the relative position of the target direction in space.

In flow 316, the multimedia interaction module 128-a will reject the delivery of the target command to the candidate electronic device.

In the process 318, the multimedia interaction module 128-a can be rendered by using a display 127-a (hereinafter referred to as a source display), a speaker, a light source circuit, or a vibrator on the source electronic device 120-a. Rejecting the target instruction to the corresponding multimedia effect of the candidate electronic device. For example, the multimedia interaction module 128-a can control the display 127-a to present an animation effect in which the target image object collides with the edge of the display 127-a and then bounces back, can control the speaker to present a specific sound effect, and can control the vibrator to perform a specific mode. The vibrating, controllable light source circuit (such as an LED or a flash) presents a specific visual effect, or can perform a specific multimedia effect by using a combination of the foregoing various devices to let the user know that the source electronic device 120-a does not target the image. The object or target command is transmitted to the candidate electronic device.

It can be seen from the foregoing description that the source electronic device 120-a transmits the target command corresponding to the target image object to the target only if the target direction and the relative position of the selected candidate electronic device in the space meet the predetermined condition. The selected candidate electronic device causes the candidate electronic device to perform a multimedia operation corresponding to the target image object by using the corresponding candidate display according to the target instruction. If the target direction and the relative position of the candidate electronic device in the space do not meet the predetermined condition, the source electronic device 120-a does not transmit the target command to the candidate electronic device, and therefore, the candidate electronic device does not execute the target command. . Similarly, the source electronic device 120-a does not transmit the target command to other electronic devices that do not meet the predetermined condition, so as to prevent the electronic device that does not meet the predetermined condition from performing multimedia operations corresponding to the target image object. In other words, the multimedia interaction method in FIG. 3 can effectively avoid the generation of strange and unreasonable multimedia interaction results in the multimedia interactive system 100.

The manner in which the source electronic device 120-a operates in the foregoing process 308 is further described below in conjunction with FIGS. 4-12.

4 to 12 are the relative positions of a part of the electronic devices in the multimedia interactive system 100 in the space when the user of the source electronic device 120-a indicates that the source electronic device 120-a transmits a target image object 400 toward a target direction Dt. A simplified schematic of different aspects.

In practice, the multimedia interactive system 100 can determine whether the relative position of the candidate electronic device and the target direction Dt in the space meets the predetermined condition referred to in the foregoing process 308 according to the three-dimensional position of the candidate electronic device.

In the first embodiment, the aforementioned predetermined condition means that the candidate electronic device must be located on a target path Pt to which the target direction Dt is directed.

In the second embodiment, the aforementioned predetermined condition means that the distance between the position of the candidate electronic device and the target path Pt is smaller than a first predetermined value R1.

In the third embodiment, the aforementioned predetermined condition means that the target path Pt passes through any position of the candidate display on the candidate electronic device.

In the fourth embodiment, the aforementioned predetermined condition means that the candidate electronic device is located on a target vertical plane (not shown) where the target path Pt is located and perpendicular to the ground.

In the fifth embodiment, the aforementioned predetermined condition means that the distance between the position of the candidate electronic device and the aforementioned target vertical plane is smaller than the first predetermined value R1.

In the aspect of FIG. 4, the target path Pt pointed by the target direction Dt passes through the centroid Cb of the display 127-b, and represents that the electronic device 120-b is located on the target path Pt, and is also located at the target vertical plane where the target path Pt is located. on. Since the electronic device 120-b is located on the target path Pt and the target vertical plane, the distance between the position of the electronic device 120-b and the target path Pt is zero, and the position of the electronic device 120-b is between the target and the target vertical plane. The distance is also zero. As shown in FIG. 4, the target path Pt passes through the display 127-n, but does not pass through the centroid Cn of the display 127-n, indicating that the electronic device 120-n is not located on the target path Pt, nor is it located at the target path Pt. Vertical plane.

Therefore, for the aspect of FIG. 4, when the candidate electronic device is the electronic device 120-b, the multimedia interactive module 128-a determines the position of the electronic device 120-b in the foregoing first to fifth embodiments. The relative position in the space with the target direction Dt meets a predetermined condition. When the candidate electronic device is the electronic device 120-n, the multimedia interaction module 128-a determines in the foregoing third embodiment that the relative position of the position of the electronic device 120-n and the target direction Dt in the space meets a predetermined condition. However, in the foregoing first or fourth embodiment, the multimedia interaction module 128-a determines the candidate electronic device 120-n. The relative position of the position and target direction Dt in the space does not meet the predetermined condition.

In the aspect of FIG. 5, the target path Pt pointed by the target direction Dt passes through the area of the display 127-b, but does not pass through the centroid Cb of the display 127-b, indicating that the electronic device 120-b is not located on the target path Pt. It is not located on the target vertical plane where the target path Pt is located. The distance between the centroid Cb and the target path Pt is G1, and the distance between the position of the electronic device 120-b and the target path Pt is G1. In addition, the target path Pt passes through the peripheral area of the electronic device 120-n, but does not pass through the area of the display 127-n, and the representative electronic device 120-n is not located on the target path Pt, nor is it located at the target vertical plane where the target path Pt is located. on. As shown in FIG. 5, the distance G1 between the centroid Cb of the display 127-b and the target path Pt is smaller than the first predetermined value R1, but the distance between the centroid Cn of the display 127-n and the target path Pt is conspicuous. Greater than the first predetermined value R1.

Therefore, for the aspect of FIG. 5, when the candidate electronic device is the electronic device 120-b, the multimedia interactive module 128-a determines the electronic device 120 in the foregoing second, third, and fifth embodiments. The position of b and the relative position of the target direction Dt in space satisfy a predetermined condition, but in the foregoing first and fourth embodiments, the position of the candidate electronic device 120-b and the relative position of the target direction Dt in space are determined. Not meeting the predetermined conditions. When the candidate electronic device is the electronic device 120-n, the multimedia interactive module 128-a determines the relative position of the candidate electronic device 120-n and the target direction Dt in space in the foregoing first to fifth embodiments. Not meeting the predetermined conditions.

In the sixth embodiment, the foregoing predetermined condition means that the candidate electronic device is located in a columnar region S1 pointed by the target direction Dt, wherein the columnar region S1 has the target direction Dt as an axis and the radius is the first predetermined value. R1.

In the aspect of FIG. 5, the centroid Cb of the display 127-b is located in the columnar region S1 to which the target direction Dt is directed, and the representative electronic device 120-b is located in the columnar region S1. The centroid Cn of the display 127-n is located outside the columnar region S1, and the representative electronic device 120-n is not located in the columnar region S1.

Therefore, for the aspect of FIG. 5, when the candidate electronic device is the electronic device 120-b, the multimedia interactive module 128-a determines the position and target of the candidate electronic device 120-b in the foregoing sixth embodiment. The relative position of the direction Dt in the space satisfies a predetermined condition. When the candidate electronic device is the electronic device 120-n, the multimedia interactive module 128-a determines in the foregoing sixth embodiment that the position of the candidate electronic device 120-n and the relative position of the target direction Dt in the space do not meet the predetermined schedule. condition.

In the seventh embodiment, the predetermined condition is that the candidate electronic device is located in a pyramidal or cone region S2 pointed by the target direction Dt, wherein the tapered region S2 is oriented with the target direction Dt as an axis. The position of the target image object 400 is a vertex and the vertex angle is an acute angle. In practice, the tapered region S2 may be a conical or pyramidal region.

In the aspect of Fig. 6, the tapered region S2 is a conical region, and the centroid Cb of the display 127-b is located in the tapered region S2, and the representative electronic device 120-b is located in the tapered region S2. The centroid Cn of the display 127-n is located outside the tapered region S2, indicating that the electronic device 120-n is not located within the tapered region S2.

Therefore, for the aspect of FIG. 6, when the candidate electronic device is the electronic device 120-b, the multimedia interactive module 128-a determines the position and target of the candidate electronic device 120-b in the foregoing seventh embodiment. The relative position of the direction Dt in the space satisfies a predetermined condition. When the candidate electronic device is the electronic device 120-n, the multimedia interaction module 128-a In the foregoing seventh embodiment, it is determined that the position of the candidate electronic device 120-n and the relative position of the target direction Dt in space do not satisfy the predetermined condition.

In the eighth embodiment, the predetermined condition is that the target direction Dt is parallel to a target shifting direction Dts, and a first angle between the target shifting direction Dts and a first direction is an acute angle and less than one. The critical angle Ath, wherein the target shift direction Dts and the first direction both start from the position of the source electronic device 120-a, and the first direction points to the position of the candidate electronic device.

In the aspect of FIG. 7, the multimedia interaction module 128-a can translate the target direction Dt to the position of the source electronic device 120-a (in this example, the position of the centroid Ca) as a starting point to define the target. Shift direction Dts. When the candidate electronic device is the electronic device 120-b, the first direction is the direction D1 of the centroid Cb of the display 127-b starting from the centroid Ca of the display 127-a. The line L1 pointed by the direction D1 passes through the centroid Cb of the display 127-b. The first angle is the angle A1 between the direction D1 and the target shift direction Dts. The smaller the angle A1 is, to some extent, the closer the position of the candidate electronic device 120-b is to the target path Pt pointed by the target direction Dt. Therefore, if the angle A1 is an acute angle and is smaller than the critical angle Ath, the multimedia interaction module 128-a determines in the foregoing eighth embodiment that the position of the electronic device 120-b and the relative position of the target direction Dt in the space are consistent. Predetermined conditions. On the other hand, if the angle A1 is greater than the critical angle Ath, the multimedia interaction module 128-a determines in the foregoing eighth embodiment that the position of the candidate electronic device 120-b and the relative position of the target direction Dt in the space do not meet the predetermined condition. .

In the aspect of FIG. 7, when the candidate electronic device is the electronic device 120-n, the first direction is the direction D2 of the centroid Cn of the display 127-n starting from the centroid Ca of the display 127-a. The line L2 pointed by the direction D2 passes through the centroid Cn of the display 127-n . The first angle is the angle A2 between the direction D2 and the target shift direction Dts. The smaller the angle A2 is, to some extent, the closer the position of the candidate electronic device 120-n is to the target path Pt pointed by the target direction Dt. Therefore, if the angle A2 is an acute angle and is smaller than the critical angle Ath, the multimedia interaction module 128-a determines in the foregoing eighth embodiment that the position of the electronic device 120-n and the relative position of the target direction Dt in the space are consistent. Predetermined conditions. On the other hand, if the angle A2 is greater than the critical angle Ath, the multimedia interaction module 128-a determines in the foregoing eighth embodiment that the position of the candidate electronic device 120-n and the relative position of the target direction Dt in the space do not meet the predetermined condition. .

In the aspect illustrated in FIG. 7 and subsequent sections, if the centroids Ca, Cb, and Cn are not in the same spatial plane, the target direction Dt, the direction D1, and the direction D2 are not in the same spatial plane. on. At this time, the target shift direction Dts, the direction D1, and the direction D2 are not in the same spatial plane.

If the position of the candidate electronic device and the relative position of the target direction Dt in space meet any of the predetermined conditions in the foregoing first to eighth embodiments, to some extent, the target electronic device is located at the target path pointed by the target direction Dt. Within an error tolerance range near Pt. Therefore, when the multimedia interactive system 100 is to manufacture the target image object is a multimedia interactive effect transmitted from the source electronic device 120-a to the candidate electronic device, the candidate condition setting manner in the foregoing first to eighth embodiments can be used to avoid the candidate. The distance between the electronic device and the target path Pt pointed by the target direction Dt is too far, but the unexpected situation of the target image object can still be received.

In addition, when the multimedia interactive application performed by the multimedia interactive system 100 requires a lower accuracy of the determination of the relative position of the candidate electronic device and the target direction Dt in space, the aforementioned first predetermined value R1 or critical angle Ath may be relaxed. . Conversely, when the multimedia interactive application is in the space for the candidate electronic device and the target direction Dt When the judgment accuracy of the position is required to be high, the aforementioned first predetermined value R1 or critical angle Ath may be lowered, or the predetermined condition setting manner of the first embodiment may be employed.

In the ninth embodiment, the predetermined condition is that a second angle between the target shifting direction Dts and a second direction is an acute angle, and the first angle is smaller than the second angle, wherein the second direction is The location of the source electronic device 120-a is a starting point and is directed to a location of a third one of the electronic devices 120-a-120-n.

In the aspect of FIG. 8, when the candidate electronic device is the electronic device 120-b, the multimedia interactive module 128-a selects another electronic device 120-n that is close to the target path Pt as the third electronic device. At this time, the first direction is also the direction D1 of the centroid Cb of the display 127-b, and the first angle is the direction D1 and the target shift direction Dts. The angle between the angles A1. The second direction is the direction D2 of the centroid Cn of the display 127-n starting from the centroid Ca of the display 127-a, and the second angle is the angle A2 between the direction D2 and the target shifting direction Dts. . The smaller the angle A2 is, to some extent, the closer the position of the third electronic device 120-n is to the target path Pt pointed by the target direction Dt. In the aspect of FIG. 8, since the included angle A1 is an acute angle and smaller than the included angle A2, the position of the candidate electronic device 120-b is represented to some extent closer to the target direction Dt than the third electronic device 120-n. Target path Pt. Therefore, in the foregoing ninth embodiment, the multimedia interactive module 128-a determines that the position of the candidate electronic device 120-b and the relative position of the target direction Dt in the space meet predetermined conditions.

In the aspect of FIG. 8, when the candidate electronic device is the electronic device 120-n, the multimedia interactive module 128-a selects another electronic device 120-b that is close to the target path Pt as the third electronic device. At this time, the first direction is the direction D2 of the centroid Cn of the display 197-n starting from the centroid Ca of the display 127-a, and the first angle is square. An angle A2 between D2 and the target shift direction Dts. The second direction is the direction D1 of the centroid Cb of the display 127-b starting from the centroid Ca of the display 127-a, and the second angle is the angle A1 between the direction D1 and the target shifting direction Dts. In the aspect of FIG. 8, since the included angle A2 is larger than the included angle A1, the position of the third electronic device 120-b is represented to some extent closer to the target path Pt pointed by the target direction Dt than the candidate electronic device 120-n. Therefore, in the foregoing ninth embodiment, the multimedia interactive module 128-a determines that the position of the candidate electronic device 120-n and the relative position of the target direction Dt in the space do not meet the predetermined condition.

When the multimedia interactive system 100 is to manufacture a single candidate electronic device having only the target path Pt pointed to by the target direction Dt, the multimedia interactive effect of the target image object or the target instruction transmitted by the source electronic device 120-a can be received. By adopting the predetermined condition setting manner in the foregoing ninth embodiment, the target image object or the target instruction transmitted by the source electronic device 120-a can be avoided, and an unexpected situation received by the plurality of candidate electronic devices occurs.

In the tenth embodiment, the foregoing predetermined condition means that the candidate electronic device is located on the target path Pt, and the segment of the target path Pt between the source electronic device 120-a and the candidate electronic device does not contact the electronic device 120. Other electronic devices in -a~120-n.

In the eleventh embodiment, the foregoing predetermined condition means that the distance between the position of the candidate electronic device and the target path Pt is smaller than the first predetermined value R1, and the target path Pt is at the source electronic device 120-a and the candidate electronic device. The segments between them do not touch other electronic devices in the electronic devices 120-a~120-n.

In the twelfth embodiment, the aforementioned predetermined condition means that the target path Pt passes through the candidate A candidate display on the electronic device, and the segment of the target path Pt between the source electronic device 120-a and the candidate electronic device does not contact other electronic devices in the electronic devices 120-a-120-n.

In the thirteenth embodiment, the foregoing predetermined condition means that the candidate electronic device is located on the target vertical plane where the target path Pt is located, and the target vertical plane is not in the region between the source electronic device 120-a and the candidate electronic device. Contacting other electronic devices in the electronic devices 120-a~120-n.

In the fourteenth embodiment, the foregoing predetermined condition means that the distance between the position of the candidate electronic device and the target vertical plane is smaller than the first predetermined value R1, and the target vertical plane is at the source electronic device 120-a and the candidate electronic device. The area between them does not touch other electronic devices in the electronic devices 120-a~120-n.

In the aspect of FIG. 9, the target path Pt pointed by the target direction Dt passes through the centroid Cb of the display 127-b, and represents that the electronic device 120-b is located on the target path Pt, and is also located at the target vertical plane where the target path Pt is located. on. Since the electronic device 120-b is located on the target path Pt and the target vertical plane, the distance between the electronic device 120-b and the target path Pt is zero, and the distance between the electronic device 120-b and the target vertical plane is also zero. . Further, the target path Pt does not contact other electronic devices in the section between the source electronic device 120-a and the electronic device 120-b. This represents to some extent between the source electronic device 120-a and the electronic device 120-b, and is not blocked by other electronic devices.

Therefore, for the aspect of FIG. 9, when the candidate electronic device is the electronic device 120-b, the multimedia interactive module 128-a determines the candidate electronic device 120-b in the foregoing tenth to fourteenth embodiments. Position and target direction Dt relative position in space Meet the predetermined conditions.

Compared with FIG. 9, in the foregoing aspect of FIG. 4, the segment of the target path Pt between the source electronic device 120-a and the electronic device 120-b passes through the display 127-n of the electronic device 120-n. Area. This represents to some extent the blocking of the electronic device 120-n between the source electronic device 120-a and the electronic device 120-b.

Therefore, for the aspect of FIG. 4, when the candidate electronic device is the electronic device 120-b, the multimedia interactive module 128-a determines the candidate electronic device 120-b in the foregoing tenth to fourteenth embodiments. The relative position of the position and the target direction Dt in the space does not meet the predetermined condition.

If the position of the candidate electronic device and the relative position of the target direction Dt in space meet any of the predetermined conditions in the tenth to fourteenth embodiments, the representative electronic device is located to the target pointed by the target direction Dt to some extent. Within an error tolerance range near the path Pt, and between the candidate electronic device and the source electronic device 120-a is not blocked by other electronic devices. Therefore, when the multimedia interactive system 100 is to be manufactured, only if the candidate electronic device and the source electronic device 120-a are not blocked by other electronic devices, the target image object can be transmitted from the source electronic device 120-a to the candidate electronic device. In the multimedia interaction effect, the predetermined condition setting manner in the tenth to fourteenth embodiments can prevent the candidate electronic device from being blocked by other electronic devices between the source electronic device 120-a, and the candidate electronic device can still be used. Unexpected conditions of receiving the target image object occurred.

In the fifteenth embodiment, the predetermined condition is that a first angle is formed between the first direction and the second direction, and the first angle is less than half of the third angle.

In the sixteenth embodiment, the predetermined condition is that the second vertical surface (not shown), where the second direction is located and perpendicular to the ground, cuts the space into a first side space and a second side. Space, the target direction Dt points to the first side space, and the candidate electronic device is located in the first side space.

In the aspect of FIG. 10, when the candidate electronic device is the electronic device 120-b, the multimedia interactive module 128-a selects another electronic device 120-n that is close to the target path Pt as the third electronic device. At this time, the first direction is also the direction D1 of the centroid Cb of the display 127-b, and the first angle is the direction D1 and the target shift direction Dts. The angle between the angles A1. The second direction is the direction D2 of the centroid Cn of the display 127-n starting from the centroid Ca of the display 127-a, and the third angle is the angle A3 between the direction D1 and the direction D2. If the angle A1 is less than half of the angle A3, the position of the candidate electronic device 120-b is represented to some extent closer to the target path Pt pointed by the target direction Dt than the third electronic device 120-n. In addition, a second vertical plane, where the direction D2 is located and perpendicular to the ground, cuts the space into a first side space SR and a second side space SL. As shown in FIG. 10, the target direction Dt points to the first side space SR, and the electronic device 120-b is located in the first side space SR. Therefore, in the fifteenth and sixteenth embodiments, the multimedia interactive module 128-a determines that the position of the candidate electronic device 120-b and the relative position of the target direction Dt in space meet predetermined conditions.

When the multimedia interactive system 100 is to manufacture a single candidate electronic device having only the target path Pt pointed to by the target direction Dt, the multimedia interactive effect of the target image object or the target instruction transmitted by the source electronic device 120-a can be received. By adopting the predetermined condition setting manner in the fifteenth or sixteenth embodiment, the target image object or the target instruction transmitted by the source electronic device 120-a can be avoided. Unexpected situations received by the candidate electronic devices occur.

In the seventeenth embodiment, the predetermined condition is that a source of the source electronic device 120-a is directed to the direction Da, and is perpendicular to the ground, a source vertical plane, with the position of the source electronic device 120-a as the axis. Rotating a first viewing angle VA1 to both sides of the source pointing direction Da defines a target viewing angle area, and the source vertical plane cuts the target viewing area into a first half area and a second half area, and the target direction Dt points The first half of the area, and the candidate electronic device is located within the first half of the area.

In the eighteenth embodiment, the predetermined condition is that a fourth angle is formed between the source pointing direction Da and the target shifting direction Dts, and the first direction forms a fifth angle with the source pointing direction Da, and The fourth angle and the fifth angle are both smaller than the first angle of view VA1.

In the aspect of FIG. 11, the source is directed to the source vertical plane (not shown) where the direction Da is located, and the position of the source electronic device 120-a (in this example, the position of the centroid Ca of the display 127-a) is Rotating the first viewing angle VA1 from the axis to the source pointing direction Da on both sides defines a target viewing angle region composed of the right half region VR and the left half region VL. The centroid Cb of the display 127-b is located in the right half area VR, and the representative electronic device 120-b is located in the right half area VR. As shown in FIG. 11, the target direction Dt points to the right half area VR. The fourth included angle is an angle A4 between the source pointing direction Da and the target shifting direction Dts. When the angle A4 is smaller than the first angle of view VA1, the representative target direction Dt is directed into the target viewing angle area of the source electronic device 120-a.

For the aspect of FIG. 11, when the candidate electronic device is the electronic device 120-b, the first direction is also the direction from the centroid Ca of the display 127-a and points to the centroid Cb of the display 127-b. D1, and the fifth angle is the direction D1 and the source pointing An angle A5 between Da. Since the angle A4 and the angle A5 are both smaller than the first angle of view VA1, the multimedia interaction module 128-a determines in the foregoing seventeenth and eighteenth embodiments that the position of the candidate electronic device 120-b and the target direction Dt are in space. The relative position is in accordance with the predetermined conditions.

As shown in FIG. 11, the centroid Cn of the display 127-n is located outside the target viewing angle area, and the representative electronic device 120-n is located outside the target viewing angle area.

For the aspect of FIG. 11, when the candidate electronic device is the electronic device 120-n, the first direction is the direction D2 of the centroid Cn of the display 127-n starting from the centroid Ca of the display 127-a. And the fifth angle is the angle A5' between the direction D2 and the source pointing direction Da. As shown in FIG. 11, the angle A5' is larger than the first angle of view VA1, and the representative electronic device 120-n is located outside the target angle of view. Therefore, the multimedia interaction module 128-a determines the candidate in the seventeenth and eighteenth embodiments. The position of the electronic device 120-n and the relative position of the target direction Dt in the space do not meet the predetermined condition.

When the multimedia interactive system 100 is to be manufactured only if the candidate electronic device is located in the target viewing area of the source electronic device 120-a, the candidate electronic device can receive the target image object or target command transmitted by the source electronic device 120-a. In the multimedia interaction effect, by using the predetermined condition setting manner in the seventeenth or eighteenth embodiment, the target image object or the target command transmitted by the source electronic device 120-a can be prevented from being located at the source electronic device 120-a. Unexpected situations received by other electronic devices outside the target viewing angle area occur.

In the nineteenth embodiment, the predetermined condition is that a first opposite direction forms a sixth angle with a candidate pointing direction of the candidate electronic device, and the fourth angle and the fifth angle are smaller than the first angle. VA1, and the sixth angle is less than a second The viewing angle VA2, wherein the first reverse direction starts from the position of the candidate electronic device and points to the location of the source electronic device 120-a.

In the twentieth embodiment, the predetermined condition is that a candidate vertical plane of the candidate electronic device is located in a direction perpendicular to the ground, and the position of the candidate electronic device is taken as an axis to the two sides of the candidate pointing direction. Rotating the second viewing angle VA2 defines a candidate viewing angle region, the source electronic device 120-a is located in the candidate viewing angle region, the target direction Dt is directed to the first half-side region, and the candidate electronic device is located in the first half-side region. .

When the fifth angle is smaller than the first angle of view VA1, the representative candidate electronic device is located within the target viewing angle region of the source electronic device 120-a. When the sixth angle is smaller than the second angle of view VA2, the representative source electronic device 120-a is located within the candidate viewing area of the candidate electronic device.

In the aspect of FIG. 12, the source is directed to the source vertical plane (not shown) where the direction Da is located, and the position of the source electronic device 120-a (in this example, the position of the centroid Ca of the display 127-a) is The axis rotates the first viewing angle VA1 to both sides of the source pointing direction Da, and also defines a target viewing angle region composed of the right half region VR and the left half region VL. The centroid Cb of the display 127-b is located in the right half area VR, and the representative electronic device 120-b is located in the right half area VR. As shown in FIG. 12, the target direction Dt points to the right half area VR. The fourth included angle is an angle A4 between the source pointing direction Da and the target shifting direction Dts. When the angle A4 is smaller than the first angle of view VA1, the representative target direction Dt is directed into the target viewing angle area of the source electronic device 120-a. When the candidate electronic device is the electronic device 120-b, the first direction is also the direction D1 of the centroid Cb of the display 127-b starting from the centroid Ca of the display 127-a. The fifth angle is the angle A5 between the direction D1 and the source pointing direction Da. The multimedia interaction module 128-a can translate the first direction D1 to The position of the candidate electronic device 120-b (in this example, the position of the centroid Cb) is the starting point, and the direction D1 is inverted by 180 degrees to define the first reverse direction D1'. The sixth angle is an angle A6 between the first reverse direction D1' and the candidate pointing direction Db of the electronic device 120-b. The candidate vertical plane (not shown) where the candidate pointing direction Db of the candidate electronic device 120-b is located is the axis of the position of the candidate electronic device 120-b (in this example, the position of the centroid Cb of the display 127-b) To rotate the second angle of view VA2 on both sides of the candidate pointing direction Db, a candidate viewing angle area is defined. As shown in FIG. 12, since the angle A5 is smaller than the first angle of view VA1, and the angle A6 is smaller than the second angle of view VA2, the multimedia interaction module 128-a determines the candidate electronic device in the foregoing nineteenth and twentieth embodiments. The position of the 120-b and the relative position of the target direction Dt in the space meet predetermined conditions. In the nineteenth embodiment, the fifth angle is limited to be smaller than the first angle of view VA1, and the sixth angle is limited to be smaller than the second angle of view VA2, for limiting the source electronic device 120-a and the candidate electrons. The relative position of both devices 120-b in space must be in or near face to face, and source electronic device 120-a can communicate the target command to candidate electronic device 120-b to avoid strange user experience.

In practice, the aforementioned first viewing angle VA1 may be the same as the second viewing angle VA2 or different from the second viewing angle VA2.

When the multimedia interactive system 100 is to be manufactured, only if the relative position of the source electronic device 120-a and the candidate electronic device in the space belongs to or is close to the face-to-face aspect, the candidate electronic device can receive the source electronic device 120-a. When the multimedia image interaction effect of the target image object or the target command is transmitted, the predetermined condition setting method in the above-mentioned nineteenth or twentieth embodiment can avoid the candidate electronic device facing away from the source electronic device 120-a, but still can Receiving the source from the source electronic device 120-a Unexpected conditions of the target image object or target instruction. On the other hand, with the predetermined condition setting method in the above-mentioned nineteenth or twentieth embodiment, the source electronic device 120-a can be prevented from being turned away from the candidate electronic device, and the candidate electronic device can still receive the source electronic device 120- A unexpected occurrence of the target image object or target command.

In practice, the multimedia interactive system 100 can also determine whether the relative position of the candidate electronic device and the target direction Dt in the space meets the predetermined condition referred to in the foregoing process 308 according to the two-dimensional position of the candidate electronic device. The multimedia interaction system 100 can utilize the position detection circuit 110 to detect individual projection positions, shapes, and directivity of the individual electronic devices 120-a-120-n on the same reference level plane parallel to the ground. The multimedia interactive system 100 can utilize the particular geometric features of the electronic device 120, particular markers, particular elements, or projected locations of particular regions on a reference horizontal plane to represent the location of the electronic device 120 in space.

For example, the position detecting circuit 110 can detect and utilize the projection position of the centroid of the electronic device 120 on the reference horizontal plane to represent the position of the electronic device 120 in the space. Alternatively, the position detecting circuit 110 can detect and utilize the projection position of the centroid of the display 127 on the reference horizontal plane to represent the position of the electronic device 120 in space.

Similarly, the position detecting circuit 110 and the individual electronic devices 120-a~120-n can be used together to calculate the position of the individual electronic devices 120-a~120-n in space. For example, in the embodiment of FIG. 2, the position detecting circuit 110 can detect and transmit the two-dimensional coordinate of the projection position of the plurality of reference points in the electronic device 120 on the reference horizontal plane to the electronic device 120, and the electronic device The control circuit 121 calculates the centroid of the electronic device 120 or the projection position of the centroid of the display 127 on the reference horizontal surface according to the coordinates of the received plurality of reference points, to represent The location of the electronic device 120 in space.

Since the gyroscope is usually installed inside the electronic device 120, the control circuit 121 of the electronic device 120 can obtain the tilt angle of the electronic device 120 by using the gyroscope. Moreover, the length and width of the electronic device 120, the length and width of the display 127, and the location of the display 127 in the electronic device 120 are all given values. Therefore, the electronic device 120 can use the control circuit 121 to calculate the centroid of the electronic device 120 or the projection position of the centroid of the display 127 on the reference horizontal surface according to the coordinates of the projection position of the reference point to represent the electronic device 120. The location in space.

Alternatively, the electronic device 120 can also use the control circuit 121 to calculate a specific geometric feature (eg, a center point) of a multimedia interactive program window (eg, a browser window) displayed on the display 127 according to the received spatial coordinates of the plurality of reference points. The projection position on the reference horizontal plane represents the position of the electronic device 120 in space. For example, in the embodiment of FIG. 2, electronic device 120-a utilizes display 127-a to display target browser window 216, and electronic device 120-b utilizes display 127-b to display target browser window 226. Since the size of the target browser window 216 displayed on the display 127-a and the relative position in the display 127-a are both set by the control circuit 121-a, they are all known parameters. Therefore, the position detecting circuit 110 can detect and transmit the two-dimensional coordinates of the projection positions of the reference points 211 to 214 in the electronic device 120-a on the reference horizontal plane to the electronic device 120-a, and the electronic device 120-a The control circuit 121-a can calculate the two-dimensional coordinates of the projection position of the center point Wa of the target browser window 216 on the reference horizontal plane according to the coordinates of part or all of the reference points, to represent the electronic device 120-a in the space. s position. Similarly, since the size of the target browser window 226 displayed on the display 127-b and the relative position in the display 127-b are set by the control circuit 121-b, they are all known. number. Therefore, the position detecting circuit 110 can detect and transmit the spatial coordinates of the reference points 221 to 224 in the electronic device 120-b to the electronic device 120-b, and the electronic device 120-b can utilize the control circuit 121-b according to the reference. Calculating the two-dimensional coordinates of the projection position of the center point Wb of the target browser window 226 on the reference horizontal plane, representing the spatial coordinates of some or all of the reference points in the points 221 to 224, to represent the electronic device 120-b in space. position.

The following is a description of the source electronic device 120-a according to FIG. 13 to FIG. 21 to determine whether the relative position of the candidate electronic device and the target direction Dt in the space meets the predetermined condition in the foregoing process 308 according to the two-dimensional position of the candidate electronic device. Mode of operation.

13 to 21 are projections of a portion of the electronic devices in the multimedia interactive system 100 on the same reference level when the user of the source electronic device 120-a indicates that the source electronic device 120-a transmits the target image object 400 toward the target direction Dt. A simplified schematic of the different aspects of the relative position. In FIGS. 13 to 21, the projection area of the electronic device 120-a on the reference horizontal plane is 120-ap, the projection of the display 127-a on the reference horizontal plane is the projection area 127-ap, and the centroid Ca of the display 127-a is The projection position on the reference horizontal plane is Cap. The projection of the electronic device 120-b on the reference horizontal plane is the projection area 120-bp, the projection of the display 127-b on the reference horizontal plane is the projection area 127-bp, and the projection position of the centroid Cb of the display 127-b on the reference horizontal plane. Is Cbp. The projection of the electronic device 120-n on the reference horizontal plane is the projection area 120-np, the projection of the display 127-n on the reference horizontal plane is the projection area 127-np, and the projection position of the centroid Cn of the display 127-n on the reference horizontal plane. For Cnp. The projection of the target direction Dt on the reference horizontal plane is the target projection direction Dtp. The projection of the target image object 400 on the reference horizontal plane is the target projection object 1300.

For convenience of explanation, it is assumed below that the multimedia interactive system 100 utilizes a display. The position of the centroid of 127 on the reference horizontal plane represents the projected position of the electronic device 120 on the reference horizontal plane.

In the twenty-first embodiment, the predetermined condition in the foregoing flow 308 refers to a projection position of the candidate electronic device on a reference horizontal plane parallel to the ground (hereinafter referred to as a candidate projection position), and the target direction Dt is at a reference horizontal plane. A target projection direction Dtp is directed to a target projection path Ptp.

In the twenty-second embodiment, the aforementioned predetermined condition means that the distance between the aforementioned candidate projection position and the target projection path Ptp is smaller than the first predetermined value R1.

In the twenty-third embodiment, the aforementioned predetermined condition means that the target projection path Ptp passes through a display projection area of the candidate display of the candidate electronic device on the reference horizontal plane.

In the aspect of FIG. 13, the target direction Dt is the target projection path Ptp pointed by the target projection direction Dtp on the reference horizontal plane, and the projection position Cbp passing through the centroid Cb of the display 127-b on the reference horizontal plane represents the electronic device. The projection position of 120-b on the reference horizontal plane is located on the target projection path Ptp. Since the projection position of the electronic device 120-b is located on the target projection path Ptp, the distance between the projection position of the electronic device 120-b and the target projection path Ptp is zero. As shown in FIG. 13, the target projection path Ptp passes through the projection area 127-np of the display 127-n, but does not pass through the projection position Cnp of the centroid Cn of the display 127-n on the reference horizontal plane, representing the electronic device 120-n. The projection position is not located on the target projection path Ptp.

Therefore, for the aspect of FIG. 13, when the candidate electronic device is the electronic device 120-b, the multimedia interactive module 128-a determines the electronic device 120 in the foregoing twenty-first to twenty-third embodiments. -b position and target direction Dt relative in space The location meets the predetermined conditions. When the candidate electronic device is the electronic device 120-n, the multimedia interactive module 128-a determines in the foregoing twenty-third embodiment that the position of the electronic device 120-n and the relative position of the target direction Dt in the space meet the predetermined schedule. Condition, but in the aforementioned twenty-first embodiment, it is determined that the position of the candidate electronic device 120-n and the relative position of the target direction Dt in space do not satisfy the predetermined condition.

In the aspect of FIG. 14, the target projection path Ptp pointed by the target projection direction Dtp passes through the projection area 127-bp of the display 127-b, but does not pass through the projection position Cbp of the centroid Cb of the display 127-b, representing the electron The projected position of the device 120-b is not located on the target projection path Ptp. The distance between the projection position Cbp of the centroid Cb and the target projection path Ptp is G1p, and the distance between the projection position of the electronic device 120-b and the target projection path Ptp is G1p. Further, the target projection path Ptp passes through the projection area 127-np of the display 127-n, but does not pass through the projection position Cnp of the centroid Cn of the display 127-n, and the projection position of the representative electronic device 120-n is not located at the target projection path Ptp. on. As shown in FIG. 14, the distance G1p between the projection position Cbp of the centroid Cb of the display 127-b and the target projection path Ptp is smaller than the first predetermined value R1, but the projection position Cnp of the centroid Cn of the display 127-n and the target The distance between the projection paths Ptp is significantly larger than the first predetermined value R1.

Therefore, for the aspect of FIG. 14, when the candidate electronic device is the electronic device 120-b, the multimedia interactive module 128-a determines the electronic device 120 in the foregoing twenty-second and twenty-third embodiments. The position of the -b and the relative position of the target direction Dt in the space satisfy a predetermined condition, but in the aforementioned twenty-first embodiment, the position of the candidate electronic device 120-b and the relative position of the target direction Dt in the space are determined. Not meeting the predetermined conditions. When the candidate electronic device is the electronic device 120-n, the multimedia interactive module 128-a determines the candidate power in the foregoing twenty-first and twenty-second embodiments. The position of the sub-device 120-n and the relative position of the target direction Dt in the space do not meet the predetermined condition, but in the aforementioned twenty-third embodiment, the position of the candidate electronic device 120-n and the target direction Dt are determined to be in the space. The relative position in the middle meets the predetermined conditions.

In the twenty-fourth embodiment, the foregoing predetermined condition means that the target projection direction Dtp points to the target projection path Ptp and a strip-shaped region S1p, and the aforementioned candidate projection position is located in the strip-shaped region S1p, wherein the strip-shaped region S1p is The target projection path Ptp is a center line and has a width twice the first predetermined value R1.

In the aspect of FIG. 14, the projection position Cbp of the centroid Cb of the display 127-b is located in the strip-shaped region S1p to which the target projection direction Dtp is directed, and the projection position of the representative electronic device 120-b is located in the strip-shaped region S1p. The projection position Cnp of the centroid Cn of the display 127-n is located outside the strip region S1p, and the projection position of the electronic device 120-n is not located in the strip region S1p.

Therefore, for the aspect of FIG. 14, when the candidate electronic device is the electronic device 120-b, the multimedia interactive module 128-a determines the position of the candidate electronic device 120-b in the aforementioned twenty-fourth embodiment. The relative position in the space with the target direction Dt meets a predetermined condition. When the candidate electronic device is the electronic device 120-n, the multimedia interactive module 128-a determines in the foregoing twenty-fourth embodiment that the position of the candidate electronic device 120-n and the relative position of the target direction Dt in the space are not Meet the predetermined conditions.

In the twenty-fifth embodiment, the foregoing predetermined condition means that the target projection direction Dtp points to a triangular area S2p, and the aforementioned candidate projection position is located in the triangular area S2p, wherein the triangular area S2p is centered on the target projection path Ptp, The projection position of the target image object 400 on the reference horizontal plane (that is, the position of the projection object 1300) is a vertex, and the vertex angle is an acute angle.

In the aspect of Fig. 15, the projection position Cbp of the centroid Cb of the display 127-b is located in the triangular area S2p, and the projection position of the representative electronic device 120-b is located in the triangular area S2p. The projection position Cnp of the centroid Cn of the display 127-n is located outside the triangular area S2p, and the projection position of the representative electronic device 120-n is not located in the triangular area S2p.

Therefore, for the aspect of FIG. 15, when the candidate electronic device is the electronic device 120-b, the multimedia interactive module 128-a determines the location of the candidate electronic device 120-b in the foregoing twenty-fifth embodiment. The relative position in the space with the target direction Dt meets a predetermined condition. When the candidate electronic device is the electronic device 120-n, the multimedia interactive module 128-a determines in the foregoing twenty-fifth embodiment that the position of the candidate electronic device 120-n and the relative position of the target direction Dt in the space are not Meet the predetermined conditions.

In the twenty-sixth embodiment, the predetermined condition is that an eleventh angle between the target projection direction Dtp and a first projection direction is an acute angle and less than a critical angle Ath, wherein the first projection direction The projection position of the source electronic device 120-a on the reference horizontal plane (hereinafter referred to as the source projection position) Cap is used as a starting point, and the first projection direction is directed to the aforementioned candidate projection position.

In the aspect of FIG. 16, when the candidate electronic device is the electronic device 120-b, the first projection direction is based on the projection position Cap of the centroid Ca of the display 127-a, and points to the centroid of the display 127-b. The projection position of Cb is the projection direction D1p of Cbp, and the eleventh angle is the angle A1p between the projection direction D1p and the target projection direction Dtp. The smaller the angle A1p is, to some extent, the closer the projection position of the candidate electronic device 120-b is to the target projection path Ptp pointed by the target projection direction Dtp. Therefore, if the included angle A1p is an acute angle and is smaller than the critical angle Ath, the multimedia interactive module 128-a determines the relative position of the electronic device 120-b and the target direction Dt in space in the foregoing twenty-sixth embodiment. The location meets the predetermined conditions. Conversely, if the angle A1p is greater than In the twenty-sixth embodiment, the multimedia interaction module 128-a determines that the position of the candidate electronic device 120-b and the relative position of the target direction Dt in the space do not meet the predetermined condition.

In the aspect of FIG. 16, when the candidate electronic device is the electronic device 120-n, the first projection direction is based on the projection position Cap of the centroid Ca of the display 127-a, and is directed to the centroid of the display 127-n. The projection position Cn of Cn is the projection direction D2p, and the eleventh angle is the angle A2p between the projection direction D2p and the target projection direction Dtp. The smaller the angle A2p is, to some extent, the closer the projection position of the candidate electronic device 120-n is to the target projection path Ptp pointed by the target projection direction Dtp. Therefore, if the angle A2p is an acute angle and is smaller than the critical angle Ath, the multimedia interaction module 128-a determines the relative position of the electronic device 120-n and the target direction Dt in space in the foregoing twenty-sixth embodiment. The location meets the predetermined conditions. On the other hand, if the angle A2p is greater than the critical angle Ath, the multimedia interaction module 128-a determines in the foregoing twenty-sixth embodiment that the position of the candidate electronic device 120-n and the relative position of the target direction Dt in the space do not match. Predetermined conditions.

If the position of the candidate electronic device and the relative position of the target direction Dt in space meet any of the predetermined conditions of the foregoing twenty-first to twenty-sixth embodiments, the representative electronic device is located to the target direction Dt to some extent. An error tolerance range near the target path Pt pointed to. Therefore, when the multimedia interactive system 100 is to manufacture the target image object is a multimedia interactive effect transmitted from the source electronic device 120-a to the candidate electronic device, the predetermined condition setting manner in the foregoing twenty-first to twenty-sixth embodiments is adopted. The distance between the candidate electronic device and the target path Pt pointed by the target direction Dt is prevented from being too far, but the unexpected situation of the target image object can still be received.

In addition, when the multimedia interactive application performed by the multimedia interactive system 100 requires a lower accuracy of the determination of the relative position of the candidate electronic device and the target direction Dt in space, the aforementioned first predetermined value R1 or critical angle Ath may be relaxed. . On the other hand, when the multimedia interactive application requires high accuracy for determining the relative position of the candidate electronic device and the target direction Dt in space, the aforementioned first predetermined value R1 or critical angle Ath may be lowered, or the twentieth tenth may be adopted. The predetermined condition setting mode of an embodiment.

In the twenty-seventh embodiment, the predetermined condition is that a twelfth angle between the target projection direction Dtp and a second projection direction is an acute angle, and the eleventh angle is less than the twelfth angle. The second projection direction is the source projection position Cap as a starting point, and is directed to a projection position of the third electronic device of the electronic device 120-a~120-n on the reference horizontal plane (hereinafter referred to as a third projection position). .

In the aspect of FIG. 17, when the candidate electronic device is the electronic device 120-b, the multimedia interaction module 128-a selects another electronic device 120-n whose projection position is close to the target projection path Ptp as the third electronic device. . At this time, the first projection direction is also the projection direction Cap of the centroid Ca, and the projection direction D1p of the projection position Cbp of the centroid Cb, and the eleventh angle is also the projection direction D1p and the target projection direction Dtp. The angle between the angles A1p. The second projection direction is the projection direction D2p of the projection position Cn of the centroid Cn of the display 127-n starting from the projection position Cap of the centroid Ca of the display 127-a, and the twelfth angle is the projection direction D2p. An angle A2p between the target projection direction Dtp. The smaller the angle A2p is, to some extent, the closer the projection position of the third electronic device 120-n is to the target projection path Ptp. In the aspect of FIG. 17, since the included angle A1p is an acute angle and smaller than the included angle A2p, the projected position of the candidate electronic device 120-b is somewhat closer to the target projection than the projected position of the third electronic device 120-n. Path Ptp. Therefore, the multimedia interactive module 128-a is in the foregoing In the twenty-seventh embodiment, it is determined that the position of the candidate electronic device 120-b and the relative position of the target direction Dt in space satisfy a predetermined condition.

In the aspect of FIG. 17, when the candidate electronic device is the electronic device 120-n, the multimedia interaction module 128-a selects another electronic device 120-b whose projection position is close to the target projection path Ptp as the third electronic device. . At this time, the first projection direction is the projection direction D2p of the projection position Cn of the centroid Cn starting from the projection position Cap of the centroid Ca, and the eleventh angle is between the projection direction D2p and the target projection direction Dtp. The angle A2p. The second projection direction is the projection direction D1p of the projection position Cbp of the centroid C from the projection position Cap of the centroid Ca, and the twelfth angle is the angle A1p between the projection direction D1p and the target projection direction Dtp. . In the aspect of FIG. 17, since the included angle A2p is larger than the included angle A1p, the position of the third electronic device 120-b is somewhat closer to the target projected path Ptp than the candidate electronic device 120-n. Therefore, in the foregoing twenty-seventh embodiment, the multimedia interactive module 128-a determines that the position of the candidate electronic device 120-n and the relative position of the target direction Dt in the space do not meet the predetermined condition.

When the multimedia interactive system 100 is to manufacture a single candidate electronic device having a projection position closest to the target projection path Ptp, in order to receive the multimedia interactive effect of the target image object or the target command transmitted by the source electronic device 120-a, the foregoing The predetermined condition setting manner in the twenty-seventh embodiment can prevent the target image object or the target instruction transmitted by the source electronic device 120-a from being unexpectedly received by the plurality of candidate electronic devices.

In the twenty-eighth embodiment, the predetermined condition is that the projection of the source electronic device 120-a on the reference horizontal plane is a source projection area 120-ap, and the projection of the candidate electronic device on the reference horizontal plane is one. Candidate projection area, the aforementioned candidate The selected projection position is located on the target projection path Ptp, and the segment between the source projection area and the candidate projection area of the target projection path Ptp does not contact other electronic devices in the electronic devices 120-a-120-n. Refer to the projection on the horizontal plane.

In the twenty-ninth embodiment, the foregoing predetermined condition means that the distance between the candidate projection position and the target projection path Ptp is smaller than the first predetermined value R1, and the target projection path Ptp is in the source projection area 120-ap and The segments between the candidate projection regions do not touch the projection of other electronic devices in the electronic devices 120-a~120-n on the reference horizontal plane.

In the thirtieth embodiment, the foregoing predetermined condition means that the target projection path Ptp passes through a display projection area of the candidate display of the candidate electronic device on the reference horizontal plane, and the target projection path Ptp is in the source projection area 120-ap The segment between the candidate projection area does not touch the projection of other electronic devices in the electronic devices 120-a~120-n on the reference horizontal plane.

In the aspect of FIG. 18, the projection of the electronic device 120-b on the reference horizontal plane is a projection area of 120-bp. The target projection path Ptp passes through the projection position Cbp of the centroid Cb of the display 127-b, and the projection position Cbp of the electronic device 120-b is located on the target projection path Ptp, so the projection position Cbp of the electronic device 120-b and the target projection path The distance between Ptp is zero. In addition, the segment of the target projection path Ptp between the source projection area 120-ap and the projection area 120-bp of the electronic device 120-b is also not in contact with the projection of other electronic devices. This represents to some extent that the source electronic device 120-a and the electronic device 120-b are not blocked by other electronic devices.

Therefore, for the aspect of FIG. 18, when the candidate electronic device is the electronic device 120-b, the multimedia interactive module 128-a is in the foregoing twenty-eighth to thirtieth embodiments, It is determined that the position of the candidate electronic device 120-b and the relative position of the target direction Dt in space satisfy a predetermined condition.

Compared with FIG. 18, in the foregoing aspect of FIG. 13, the segment of the target projection path Ptp between the source projection region 120-ap and the projection region 120-bp of the electronic device 120-b may pass through the electronic device 120. The projection area 127-np of the display 127-n of -n. This represents to some extent the blocking of the electronic device 120-n between the source electronic device 120-a and the electronic device 120-b.

Therefore, for the aspect of FIG. 13, when the candidate electronic device is the electronic device 120-b, the multimedia interactive module 128-a determines the candidate electronic device 120 in the foregoing twenty-eighth to thirtieth embodiments. The position of the -b and the relative position of the target direction Dt in the space do not meet the predetermined condition.

If the position of the candidate electronic device and the relative position of the target direction Dt in space meet any of the predetermined conditions in the foregoing twenty-eighth to thirtieth embodiments, the projection position of the candidate electronic device is represented to some extent, at the target An error tolerance range near the target projection path Ptp pointed by the projection direction Dtp, and the candidate electronic device and the source electronic device 120-a are not blocked by other electronic devices. Therefore, when the multimedia interactive system 100 is to be manufactured, only if the candidate electronic device and the source electronic device 120-a are not blocked by other electronic devices, the target image object can be transmitted from the source electronic device 120-a to the candidate electronic device. In the multimedia interaction effect, the predetermined condition setting method in the foregoing twenty-eighthth to thirtieth embodiments can avoid that the candidate electronic device and the source electronic device 120-a are blocked by other electronic devices, but the candidate electronic device can be blocked. Unexpected situations in which the target image object can still be received.

In the thirty-first embodiment, the predetermined condition is that a thirteenth angle is formed between the first projection direction and the second projection direction, and the eleventh angle is less than half of the thirteenth angle.

In the thirty-second embodiment, the foregoing predetermined condition is that the second reference line in which the second projection direction is located cuts the reference horizontal plane into a first side area and a second side area, and the target projection direction Dtp Pointing to the first side region, and the projected position of the candidate electronic device is located within the first side region.

In the aspect of FIG. 19, when the candidate electronic device is the electronic device 120-b, the multimedia interaction module 128-a selects another electronic device 120-n whose projection position is close to the target projection path Ptp as the third electronic device. . At this time, the first projection direction is also the projection direction Cap of the centroid Ca, and the projection direction D1p of the projection position Cbp of the centroid Cb, and the eleventh angle is also the projection direction D1p and the target projection direction Dtp. The angle between the angles A1p. The second projection direction is the projection direction D2p of the projection position Cnp of the centroid Cn starting from the projection position Cap of the centroid Ca, and the thirteenth angle is the angle A3p between the projection direction D1p and the projection direction D2p. If the angle A1p is less than half of the angle A3p, the projection position Cbp of the candidate electronic device 120-b is somewhat closer to the target projection path Ptp than the projection position Cnp of the third electronic device 120-n. Further, the second reference straight line is the reference straight line L2p where the projection direction D2p is located. The reference horizontal plane cuts the reference horizontal plane into a first side area SRp and a second side area SLp. As shown in FIG. 19, the target projection direction Dtp is directed to the first side region SRp, and the projection position of the electronic device 120-b is located within the first side region SRp. Therefore, in the foregoing thirty-first and thirty-second embodiments, the multimedia interactive module 128-a determines that the relative position of the position of the candidate electronic device 120-b and the target direction Dt in space meets a predetermined condition.

When the multimedia interactive system 100 is to manufacture a single candidate electronic device having a projection position closest to the target projection path Ptp pointed by the target projection direction Dtp, the multimedia of the target image object or the target instruction transmitted by the source electronic device 120-a can be received. In the interactive effect, by using the predetermined condition setting manner in the foregoing thirty-first or thirty-second embodiment, the target image object or the target instruction transmitted by the source electronic device 120-a can be prevented from being received by the plurality of candidate electronic devices. Unexpected circumstances have occurred.

In the thirty-third embodiment, the foregoing predetermined condition means that the source of the source electronic device 120-a is directed to the projection direction of the direction Da on the reference horizontal plane (hereinafter referred to as the source pointing projection direction) Dap, and the source projection position. The Cap is directed to the source to the projection direction Dap. The rotation of the first viewing angle VA1 on both sides defines a target viewing angle region. The source points to the projection direction Dap to cut the target viewing region into a first half region and a second half region. The projection direction Dtp points to the first half side region, and the aforementioned candidate projection position is located in the first half side region.

In the thirty-fourth embodiment, the predetermined condition is that the source is directed to form a fourteenth angle between the projection direction Dap and the target projection direction Dtp, and the first projection direction and the source pointing projection direction Dap form a first The fifteenth angle, and the fourteenth angle and the fifteenth angle are smaller than the first angle of view VA1.

In the aspect of FIG. 20, the source is directed to the projection direction Dap with the projection position of the source electronic device 120-a (in this example, the projection position Cap of the centroid Ca of the display 127-a) as the axis to the source pointing to the projection direction Dap. Rotating the first viewing angle VA1 on both sides defines a target viewing angle region composed of the right half region VRp and the left half region VLp. The projection position Cbp of the centroid Cb of the display 127-b is located in the right half area VRp, and the projection position of the representative electronic device 120-b is located in the right half area VRp. As shown in FIG. 20, the target projection direction Dtp points to the right half area VRp. The fourteenth angle is the source pointing to the projection direction The angle A4p between the Dap and the target projection direction Dtp. When the angle A4p is smaller than the first angle of view VA1, the target projection direction Dtp is directed to the target viewing angle area of the source electronic device 120-a.

For the aspect of FIG. 20, when the candidate electronic device is the electronic device 120-b, the first projection direction is also the projection direction of the projection position Cap of the centroid Ca and the projection position of the projection position Cbp of the centroid Cb. D1p, and the fifteenth angle is the angle A5p between the projection direction D1p and the source pointing projection direction Dap. Since the angle A4p and the angle A5p are both smaller than the first angle of view VA1, the multimedia interaction module 128-a determines the position and target direction of the candidate electronic device 120-b in the aforementioned thirty-third and thirty-fourth embodiments. The relative position in space meets the predetermined conditions.

As shown in FIG. 20, the projection position Cnp of the centroid Cn of the display 127-n is outside the target viewing angle area, and the projection position of the representative electronic device 120-n is outside the target viewing angle area.

For the aspect of FIG. 20, when the candidate electronic device is the electronic device 120-n, the first projection direction is the projection direction D2p of the projection position Cnp of the centroid Cn starting from the projection position Cap of the centroid Ca. And the fifteenth angle is the angle A5p' between the projection direction D2p and the source pointing projection direction Dap. Since the included angle A5p' is larger than the first viewing angle VA1, and the projection position of the electronic device 120-n is outside the target viewing angle region, the multimedia interactive module 128-a is determined in the foregoing thirty-third and thirty-fourth embodiments. The position of the candidate electronic device 120-n and the relative position of the target direction Dt in space do not meet predetermined conditions.

When the multimedia interactive system 100 is to be manufactured only if the projection position of the candidate electronic device is within the target viewing angle region of the source electronic device 120-a, the candidate electronic device can receive the target image object transmitted by the source electronic device 120-a or aims When the multimedia interactive effect of the command is used, the predetermined condition setting method in the foregoing thirty-third and thirty-fourth embodiments can avoid the target image object or the target command transmitted by the source electronic device 120-a, and the projected position is located. Unexpected conditions received by other electronic devices outside the target viewing area of the source electronic device 120-a occur.

In the thirty-fifth embodiment, the predetermined condition is that a first back projection direction and a candidate pointing direction of the candidate electronic device form a projection direction on the reference horizontal plane (hereinafter referred to as a candidate pointing projection direction). The sixteenth angle, the aforementioned fourteenth angle and the fifteenth angle are smaller than the first angle of view VA1, and the sixteenth angle is smaller than the second angle of view VA2, wherein the first back projection direction is the candidate projection position The starting point and pointing to the aforementioned source projection position Cap.

In the thirty-sixth embodiment, the foregoing predetermined condition is that the candidate pointing projection direction is the axis of the candidate projection position, and rotating the second angle of view VA2 on both sides of the candidate pointing projection direction defines a candidate viewing angle region. The foregoing source projection position Cap is located in the candidate viewing angle region, the target projection direction Dtp is directed to the first half-side region, and the aforementioned candidate projection position is located in the first half-side region.

When the fifteenth angle is smaller than the first angle of view VA1, the representative candidate electronic device is located within the target viewing angle region of the source electronic device 120-a. When the sixteenth angle is smaller than the second angle of view VA2, the representative source electronic device 120-a is located within the candidate viewing area of the candidate electronic device.

In the aspect of FIG. 21, the source is directed to the projection direction Dap with the projection position of the source electronic device 120-a (in this example, the projection position Cap of the centroid Ca of the display 127-a) as the axis to the source pointing to the projection direction Dap. Rotating the first viewing angle VA1 on both sides also defines a target viewing angle region composed of the right half region VRp and the left half region VLp. display The projection position Cbp of the centroid Cb of the 127-b is located in the right half area VRp, and the projection position of the representative electronic device 120-b is located in the right half area VRp. As shown in FIG. 21, the target projection direction Dtp points to the right half area VRp. The fourteenth angle is the angle A4p between the source pointing projection direction Dap and the target projection direction Dtp. When the angle A4p is smaller than the first angle of view VA1, the target projection direction Dtp is directed to the target viewing angle area of the source electronic device 120-a. When the candidate electronic device is the electronic device 120-b, the first projection direction is also the projection direction D1p of the projection position Cbp of the centroid Cb starting from the projection position Cap of the centroid Ca. The fifteenth angle is the angle A5p between the projection direction D1p and the source pointing projection direction Dap. The multimedia interaction module 128-a can translate the projection direction D1p to the starting position of the projection position of the candidate electronic device 120-b (in this example, the projection position Cbp of the centroid Cb), and flip the projection direction D1p by 180 degrees. To define the first back projection direction D1p'. The sixteenth angle is the angle A6p between the first back projection direction D1p' and the candidate pointing projection direction Dbp of the candidate electronic device 120-b. The candidate of the candidate electronic device 120-b points to the projection direction Dbp, and the candidate projection position Cbp is taken as the axis, and the second viewing angle VA2 is rotated to the candidate pointing direction Dbp on both sides, and a candidate viewing angle region is defined. As shown in FIG. 21, since the angle A5p is smaller than the first angle of view VA1, and the angle A6p is smaller than the second angle of view VA2, the multimedia interaction module 128-a determines the candidate in the foregoing thirty-fifth and thirty-sixth embodiments. The position of the electronic device 120-b and the relative position of the target direction Dt in the space meet predetermined conditions.

In the thirty-fifth embodiment, the fifteenth angle is limited to be smaller than the first angle of view VA1, and the sixteenth angle is limited to be smaller than the second angle of view VA2, which is used to limit the source electronic device 120-a. And the projection of the candidate electronic device 120-b on the reference horizontal plane must belong to or be close to the face-to-face aspect, and the source electronic device 120-a can transmit the target instruction to the candidate electronic device 120-b to avoid strange occurrences. User experience.

In practice, the aforementioned first viewing angle VA1 may be the same as the second viewing angle VA2 or different from the second viewing angle VA2.

When the multimedia interactive system 100 is to manufacture only if the relative position of both the source electronic device 120-a and the candidate electronic device belongs to or is close to the face-to-face aspect, the candidate electronic device can receive the target transmitted by the source electronic device 120-a. When the multimedia object interaction effect of the image object or the target instruction is adopted, the predetermined condition setting manner in the foregoing thirty-fifth or thirty-sixth embodiment can avoid the candidate electronic device from being turned away from the source electronic device 120-a, but can still receive Unexpected conditions of the target image object or target command from the source electronic device 120-a occur. On the other hand, using the predetermined condition setting method in the foregoing thirty-fifth or thirty-sixth embodiment, the source electronic device 120-a can be prevented from being turned away from the candidate electronic device, and the candidate electronic device can still receive the source electronic device. Unexpected conditions of the target image object or target command from 120-a occurred.

It can be seen from the foregoing description that the source electronic device 120-a only when the three-dimensional or two-dimensional position of the candidate electronic device meets a specific condition, that is, when the target direction and the relative position of the candidate electronic device in the space meet the predetermined condition. The target instruction corresponding to the target image object is transmitted to the selected candidate electronic device, so that the candidate electronic device performs the multimedia operation corresponding to the target image object by using the corresponding candidate display according to the target instruction. If the target direction and the relative position of the candidate electronic device in the space do not meet the predetermined condition, the source electronic device 120-a will not transmit the target command to the candidate electronic device, and thus the candidate electronic device will not execute the target command. Obviously, using the multimedia interaction method in FIG. 3, it is possible to effectively reduce the occurrence of an inconsistent user between the source electronic device 120-a and other electronic devices. Experience, in the design of multimedia interactive applications should not appear, violate the rules set by interactive applications, or unintended multimedia interaction results.

In addition, by using the source electronic device 120-a to determine whether the position and directivity of other electronic devices meet the predetermined conditions, the amount of calculation required by other electronic devices can be effectively reduced, thereby prolonging the battery life of other electronic devices.

Another mode of operation of the multimedia interactive system 100 will be further described below in conjunction with FIG.

22 is a simplified flowchart 2200 of another embodiment of a multimedia interaction method for use in the multimedia interactive system 100 of the present invention.

When the multimedia interaction method in the flowchart 2200 is performed, the control circuit 121 in the electronic device 120 executes the multimedia interaction module 128 to cause the electronic device 120 to perform some or all of the processes in the corresponding fields. For convenience of understanding, the multimedia interaction in the flowchart 2200 is illustrated again by taking the source electronic device as the electronic device 120-a and the candidate electronic device may be one of the other electronic devices 120-b~120-n. How the method works.

Flows 302 and 304 in FIG. 22 are the same as flows 302 and 304 in FIG. 3 described above. Accordingly, the description of the operation, implementation, and related advantages of the processes 302 and 304 of the foregoing FIG. 3 also applies to the embodiment of FIG. For the sake of brevity, the description will not be repeated here.

In the embodiment of FIG. 22, when the user of the source electronic device 120-a operates the source electronic device 120-a, the multimedia interaction module 128-a performs a process 2206 to determine whether the user's current operation is performed. To indicate that a target image object is to be transported toward a target. If the operation is just another operation that is not related to the target image object, then control The circuit 121-a performs corresponding operations according to the user's operation.

If the user of the source electronic device 120-a performs a predetermined operation (for example, a specific touch mode, a specific mouse operation, or a specific voice control command) on the source electronic device 120-a, the source electronic device 120 is indicated. -a transmits a target image object toward a target direction, and the multimedia interaction module 128-a performs a process 2210.

In the process 2210, the multimedia interaction module 128-a transmits the target command corresponding to the target image object and the related information of the target direction to the other electronic devices 120-b~120-n by using the communication circuit 125-a. One or more candidate electronic devices. The foregoing target instructions include one or more instructions used by the source electronic device 120-a to set, control, change, or adjust the multimedia content presented by the display on the candidate electronic device (hereinafter referred to as the candidate display), and may also include Parameter values related to image attributes such as shape, size, color, position, duration, moving direction, and moving speed of one or more image objects.

For convenience of understanding, the following assumes that the source electronic device 120-a transmits the target command and related information of the target direction to the candidate electronic device 120-b of the other electronic devices 120-b~120-n in the foregoing process 2210. .

In the process 2212, the multimedia interaction module 128-b of the candidate electronic device 120-b receives the target instruction and related information of the target direction by using the communication circuit 125-b.

In the process 2213, the multimedia interaction module 128-b determines the relative position of the candidate electronic device 120-b and the target direction in space according to the latest information about the position and directivity of the candidate electronic device 120-b in space. Whether the location meets a predetermined condition. If the relative position of the candidate electronic device 120-b and the target direction in the space meets the predetermined condition, the multimedia interaction module 128-b performs the process 314; If the relative position of the candidate electronic device 120-b and the target direction in the space does not meet the predetermined condition, the multimedia interaction module 128-b performs the process 2216.

The operation of the multimedia interaction module 128-b in the process 2213 is the same as the operation of the multimedia interaction module 128-a described above in the process 308 of FIG. In addition, the flow 314 in FIG. 22 is also the same as the flow 314 in FIG. 3 described above. Accordingly, the description of the operation, implementation, and related advantages of the flows 308 and 314 of the foregoing FIG. 3 applies to the flows 2213 and 314 of FIG. 22, respectively. For the sake of brevity, the description will not be repeated here.

In flow 2216, the multimedia interaction module 128-b will refuse to execute the received target instruction.

In flow 2217, the multimedia interaction module 128-b transmits a rejection notification to the source electronic device 120-a using the communication circuit 125-b.

When the source electronic device 120-a receives the rejection notification from the candidate electronic device 120-b, flow 2218 is performed.

In the process 2218, the multimedia interaction module 128-a can present the candidate electronic device by using a display 127-a (hereinafter referred to as a source display), a speaker, a light source circuit, or a vibrator on the source electronic device 120-a. 120-b refuses to perform the corresponding multimedia effect of the target instruction. For example, the multimedia interaction module 128-a can control the display 127-a to present an animation effect in which the target image object collides with the edge of the display 127-a and then bounces back, can control the speaker to present a specific sound effect, and can control the vibrator to perform a specific mode. Vibrating, controllable light source circuits (such as LEDs or flashlights) exhibit a particular visual effect, or can be collocated with the various devices described above to present a particular multimedia effect to let the user know that the candidate electronic device 120-b is not in accordance with the target command Corresponding multimedia operation, that is, a multimedia interactive operation expected by the user undone.

It can be seen from the foregoing description that the candidate electronic device 120-b can utilize the candidate display 127 in accordance with the received target instruction only if the relative position of the candidate electronic device 120-b and the target direction in space meets the predetermined condition. b Perform multimedia operations corresponding to the target image object. If the candidate electronic device 120-b finds that its relative position in the space with the target direction does not meet the predetermined condition, the target instruction is rejected, and thus the multimedia operation corresponding to the target image object is not performed. Similarly, other individual electronic devices that receive the target instruction will refuse to execute the target instruction if they find that their relative position in the space with the target direction does not meet the predetermined condition. Therefore, the multimedia interaction method in FIG. 22 can also effectively reduce the occurrence of non-conformity between the source electronic device 120-a and other electronic devices, should not occur in the design of the multimedia interactive application, and violate the setting of the interactive application. Rules, or unintended multimedia interaction results.

In addition, by using individual candidate electronic devices to determine whether the respective positions and directivity meet the predetermined conditions, the amount of calculation required by the source electronic device 120-a can be effectively reduced, thereby extending the battery life of the source electronic device 120-a. .

Another mode of operation of the multimedia interactive system 100 will be further described below in conjunction with FIG.

FIG. 23 is a simplified flowchart 2300 of another embodiment of a multimedia interaction method for use in the multimedia interactive system 100 of the present invention. In this embodiment, the multimedia interactive system 100 can dynamically designate one of the electronic devices 120-a~120-n as a forwarding electronic device. The forwarding electronic device is used as an instruction transmission medium between the plurality of electronic devices 120-a~120-n, so that the electronic device The devices 120-a~120-n can transmit multimedia interactive commands through the forwarding electronic device without having to transmit the multimedia interactive commands via a remote central server (not shown), thereby elevating the electronic device 120-a The multimedia interactive instruction transfer efficiency and speed between ~120-n.

In flowchart 2300, the portion of the field labeled "Forwarding Electronic Device" represents the flow performed by electronic device 120 designated as the forwarding electronic device.

When the multimedia interaction method in the flowchart 2300 is performed, the control circuit 121 in the electronic device 120 executes the multimedia interaction module 128 to cause the electronic device 120 to perform some or all of the processes in the corresponding fields. For convenience of understanding, the following source electronic device is the electronic device 120-a, the forwarding electronic device is the electronic device 120-n, and the candidate electronic device may be one of the other electronic devices 120-b~120-m. To illustrate the operation of the multimedia interaction method in flowchart 2300.

The flow 302 in Fig. 23 is the same as the flow 302 in Fig. 3 described above. Accordingly, the description of the operation, implementation, and related advantages of the flow 302 of the foregoing FIG. 3 also applies to the embodiment of FIG. For the sake of brevity, the description will not be repeated here.

In the process 2304, the multimedia interaction module 128 of each electronic device 120 can dynamically receive information related to the position and directivity of the electronic device 120 in the space from the position detection circuit 110 by using the communication circuit 125 in a wireless transmission manner. And record it. In addition, the multimedia interaction module 128-n of the forwarding electronic device 120-n can also dynamically receive and electronically receive the electronic device 120 from the position detecting circuit 110 or other electronic devices 120-a~120-m by using the communication circuit 125-n. -a~120-m Information about individual locations and directivity in space and record them. The forwarding electronic device 120-n may perform the foregoing process 2304 periodically or intermittently to dynamically receive the position detecting circuit 110 or other The latest information generated by the electronic devices 120-a~120-m is used to update the relevant records of the individual locations and directivity of the electronic device in space.

In the embodiment of FIG. 23, when the user of the source electronic device 120-a operates the source electronic device 120-a, the multimedia interaction module 128-a performs a process 2306 to determine whether the user's current operation is performed. To indicate that a target image object is to be transported toward a target. If the operation is only another operation that is not related to the target image object, the control circuit 121-a performs a corresponding operation according to the user's operation.

If the user of the source electronic device 120-a performs a predetermined operation (for example, a specific touch mode, a specific mouse operation, or a specific voice control command) on the source electronic device 120-a, the source electronic device 120 is indicated. -a transmits a target image object toward a target direction, and the multimedia interaction module 128-a performs a process 2310.

In the process 2310, the multimedia interaction module 128-a transmits the target command corresponding to the target image object and the related information of the target direction to the designated forwarding electronic device 120-n by using the communication circuit 125-a. The foregoing target instructions include one or more instructions used by the source electronic device 120-a to set, control, change, or adjust the multimedia content presented by a display (hereinafter referred to as a candidate display) on other electronic devices, and may also include Parameter values related to image attributes such as shape, size, color, position, duration, moving direction, and moving speed of one or more image objects.

In the process 2312, the multimedia interaction module 128-n of the forwarding electronic device 120-n receives the target instruction and related information of the target direction by using the communication circuit 125-n.

In the process 2313, the multimedia interaction module 128-n can select other electronic devices 120-b~120-n other than the source electronic device 120-a as a candidate electronic device, and according to the candidate electronic device in space. The latest status related to location and directivity And determining whether the selected candidate electronic device and the relative position of the target direction in the space meet a predetermined condition. If the selected candidate electronic device and the relative position of the target direction in the space meet the predetermined condition, the multimedia interaction module 128-n performs the process 2314; otherwise, if the selected candidate electronic device and the target direction are in the space relative If the location does not meet the predetermined condition, the multimedia interaction module 128-n performs flow 2316.

The operation of the multimedia interaction module 128-n in the process 2313 is the same as the operation of the aforementioned multimedia interaction module 128-a in the flow 308 of FIG. Accordingly, the description of the operation, implementation, and related advantages of the flow 308 of the foregoing FIG. 3 also applies to the flow 2313 of FIG. For the sake of brevity, the description will not be repeated here.

In the process 2314, the multimedia interaction module 128-n transmits the target command corresponding to the target image object to the candidate electronic device that meets the predetermined condition by using the communication circuit 125-n.

In the process 2315, the multimedia interaction module of the candidate electronic device receives the target instruction by using the communication circuit of the candidate electronic device, and proceeds to flow 314. Flow 314 in FIG. 23 is the same as flow 314 in FIG. 3 described above. Accordingly, the description of the operation, implementation, and related advantages of the flow 314 of the foregoing FIG. 3 also applies to the flow 314 of FIG. For the sake of brevity, the description will not be repeated here.

In flow 2316, the multimedia interaction module 128-n will reject the delivery of the target command to the candidate electronic device.

In flow 2317, the multimedia interaction module 128-n transmits a rejection notification to the source electronic device 120-a using the communication circuit 125-n.

When the source electronic device 120-a receives the rejection notification from the forwarding electronic device 120-n At time, process 2218 is performed. Flow 2218 in FIG. 23 is the same as flow 2218 in FIG. 22 described above. Accordingly, the description of the operation, implementation, and related advantages of the process 2218 in FIG. 22 above applies to the process 2218 of FIG. For the sake of brevity, the description will not be repeated here.

It can be seen from the foregoing description that the forwarding electronic device 120-n will only transmit the target command from the source electronic device 120-a if the target direction and the relative position of the selected candidate electronic device in the space meet the predetermined condition. Forwarding to the selected candidate electronic device, causing the candidate electronic device to perform a multimedia operation corresponding to the target image object by using the corresponding candidate display according to the target instruction. If the target direction and the relative position of the candidate electronic device in the space do not meet the predetermined condition, the forwarding electronic device 120-n does not transmit the target instruction to the candidate electronic device, and therefore, the candidate electronic device does not execute the target instruction. . Similarly, the forwarding electronic device 120-n does not transmit the target command to other electronic devices that do not meet the predetermined condition, so as to prevent the electronic device that does not meet the predetermined condition from performing multimedia operations corresponding to the target image object. Therefore, using the multimedia interaction method in FIG. 23 can also effectively reduce the occurrence of non-conformity between the source electronic device 120-a and other electronic devices, should not occur in the design of the multimedia interactive application, and violate the setting of the interactive application. Rules, or unintended multimedia interaction results.

In addition, by using the forwarding electronic device 120-n to determine whether the position and directivity of other electronic devices meet the predetermined conditions, the amount of calculation required by other electronic devices can be effectively reduced, thereby prolonging the battery life of other electronic devices. Therefore, the multimedia interactive system 100 can designate the electronic device with the most battery power remaining or coupled to the conventional power network as the forwarding electronic device.

In practice, according to the design intention of the multimedia interactive application, in the foregoing different embodiments The content of the predetermined conditions is variously combined, so that the multimedia interactive system 100 can have a stronger judgment ability for the relative positions of different electronic devices in space to provide a richer and more diverse user experience. For example, the predetermined condition content in the aforementioned nineteenth or twentieth embodiment may be combined with the predetermined condition content in any one of the first to eighteenth embodiments into a new predetermined condition, or the foregoing The predetermined condition content in the thirty-fifth or thirty-sixth embodiment is combined with the predetermined condition content in any one of the twenty-first to thirty-fourth embodiments into a new predetermined condition, and the aforementioned seventeenth Or the predetermined condition content in the eighteenth embodiment is combined with the predetermined condition content in any one of the first to sixteenth embodiments into a new predetermined condition, and the foregoing thirty-third or thirty-fourth implementation may be performed. The predetermined condition content in the example is combined with the predetermined condition content in any of the twenty-first to thirty-second embodiments into a new predetermined condition.

The foregoing forwarding electronic device can be used not only as a transmission medium for multimedia interactive instructions between the electronic devices 120-a~120-n, but also as a transmission of position and directivity information between the electronic devices 120-a~120-n. medium. For example, in the foregoing embodiment of FIG. 3 or FIG. 22, if the multimedia interactive system 100 specifies an electronic device as the forwarding electronic device, the forwarding electronic device can be automatically received from the position detecting circuit 110 or other electronic device. Information about individual locations and directivity in space is recorded. The electronic device can dynamically receive the information of the individual locations and directivity of all the electronic devices in the space from the forwarding electronic device in the process 304, and update the related records accordingly, thereby simplifying the individual location and directivity information of the electronic device at all. The mode of propagation between electronic devices.

In addition, some of the multimedia materials required for the interactive operation of the electronic device 120, such as a background image, an initial image object, an animation, or a parameter required to generate the foregoing multimedia material, may be generated by a multimedia interaction. Means The source electronic device is provided by the source device, and may also be provided by other multimedia servers (not shown).

Moreover, each electronic device 120 can also display the relative positions of some or all of the electronic devices 120-a~120-n on a partial area of the respective display, and present the motion of the target image object in the local area. The related animations allow users to obtain more relevant multimedia information while participating in the multimedia interactive application to enhance the user's multimedia interactive experience.

In practice, the electronic device 120 participating in the multimedia interaction can use the display 127 to display related video content of the multimedia interaction, such as the multimedia interactive screen 2400 illustrated in FIG. As shown in FIG. 24, the multimedia interactive screen 2400 includes a main image frame 2410 displayed on a main area of the display 127, and a thumbnail picture 2420 displayed on a partial area of the display 127. The electronic device 120 may display the relative positions of some or all of the electronic devices 120-a 120-n in the thumbnail screen 2420, and present an animation related to the motion of the target image object 400 in the thumbnail screen 2420. For example, the relative positions of the portraits 2421, 2422, and 2423 in the thumbnail screen 2420 can be used to represent the relative positions of the three electronic devices 120 participating in the multimedia interaction or the users of the three electronic devices in space. The position of the image object 2424 in the thumbnail screen 2420 can be used to represent the location of the aforementioned target image object 400. The trajectory line 2425 in the thumbnail image 2420 can then be used to represent the predicted path of the motion trajectory or motion trajectory of the target image object 400 in space.

After all, the target image object 400 is only a computer image created by the multimedia interactive application. In the process of participating in the multimedia interaction, the user participating in the multimedia interaction cannot actually see the corresponding image object 400 in the space with the naked eye. Real object. Therefore, the user's operation of the target image object 400 in the virtual space The trajectory is not easy to have a clear feeling. At this time, by presenting the image object 2424 corresponding to the target image object 400 and its trajectory 2425 in the thumbnail screen 2420, the user can enjoy a multimedia interactive experience similar to augmented reaiity. The user of the electronic device 120 can also refer to the content of the thumbnail screen 2420 to decide whether to move the position or directivity of the user or the electronic device 120 to change the relative position between itself or the electronic device 120 and other electronic devices. Interactive apps create more fun.

In a practical application, the thumbnail screen 2420 displayed on the display 127 can also be used as a user control interface, so that the multimedia interaction module 128 can calculate the foregoing according to the user's operation on the display area of the thumbnail screen 2420. The target direction Dt. For example, when the user clicks on a certain target portrait pattern in the thumbnail screen 2420, the multimedia interaction module 128 can calculate a target direction corresponding to the target portrait pattern, and try to use a preset method by using the foregoing method. Or the target image object selected by the user is transmitted toward the target direction. Alternatively, the multimedia interaction module 128 can also calculate the starting point when the user drags a target image object from a certain starting point of the thumbnail image 2420 to a target portrait pattern in the thumbnail image 2420. And aiming at the target direction defined by the target portrait pattern, and attempting to transmit the target image object toward the target direction by using the foregoing method.

From the perspective of the foregoing, the multimedia interactive system 100 and the related multimedia interaction method can detect and judge the rationality of the relative positions of different electronic devices in space, and determine whether to transmit the multimedia interactive command according to the result of the judgment. The specific electronic device, or whether the specific electronic device can execute the received multimedia interactive instruction. In this way, the source of multimedia interactive instructions can be effectively reduced. The electronic device and other electronic devices have an uncommon user experience and The design of the mobile application should not appear, violate the rules set by the interactive application, or the unexpected multimedia interaction results.

From another perspective, the aforementioned multimedia interactive system 100 and related multimedia interaction methods may cause the multimedia interactive system 100 to appear to be inconsistent with the general user experience, should not appear in the design of the multimedia interactive application, and violate the interactive application. The set rules, or multimedia interactive instructions of unintended multimedia interaction results are filtered or blocked to ensure that the multimedia interactive behavior presented by the multimedia interactive system 100 conforms to the original design intent of the multimedia interactive application. As a result, the user experience provided by the multimedia interactive system 100 can be greatly improved.

Therefore, the architecture and related methods and computer program products of the multimedia interactive system 100 proposed in this case are substantially beneficial to the development of various multimedia interactive applications between electronic devices.

Certain terms are used throughout the description and claims to refer to particular elements. However, those of ordinary skill in the art should understand that the same elements may be referred to by different nouns. The specification and the scope of patent application do not use the difference in name as the way to distinguish the components, but the difference in function of the components as the basis for differentiation. The term "including" as used in the specification and the scope of the patent application is an open term and should be interpreted as "including but not limited to". In addition, "coupled" includes any direct and indirect means of attachment herein. Therefore, if the first element is described as being coupled to the second element, the first element can be directly connected to the second element by electrical connection or wireless transmission, optical transmission or the like, or by other elements or connections. The means is indirectly electrically or signally connected to the second component.

The description of "and/or" used herein includes one of the listed or Any combination of multiple projects. In addition, the terms of any singular are intended to include the meaning of the plural, unless otherwise specified in the specification.

The above are only the preferred embodiments of the present invention, and all changes and modifications made to the claims of the present invention are intended to be within the scope of the present invention.

Figure 3 is a flow chart

Claims (24)

A multimedia interactive system having a plurality of displays, comprising: a plurality of electronic devices, comprising a source electronic device and a candidate electronic device; a plurality of displays respectively disposed on the plurality of electronic devices and including the source electronic device a source display on the device, and a candidate display disposed on the candidate electronic device; and a position detecting circuit configured to dynamically detect individual positions and directivity of the plurality of electronic devices in space, and The information related to the detection result is transmitted to at least one of the plurality of electronic devices by wireless transmission; wherein, when a user instructs the source electronic device to transmit a target image object toward a target direction, the source electronic device Determining whether the relative position of the candidate electronic device and the target direction in space meets a predetermined condition, and only if the position of the candidate electronic device and the relative position of the target direction in space meet the predetermined condition, The source electronic device transmits a target instruction corresponding to the target image object to Candidate electronic device, so that the electronic device with which the candidate candidate multimedia display operation corresponding to the target object image according to the target instruction. The multimedia interactive system of claim 1, wherein the predetermined condition comprises at least one of the following conditions: the candidate electronic device is located in a columnar region pointed by the target direction, wherein the columnar region is in the target direction The axis and the radius are a first predetermined value; the candidate electronic device is located in a tapered region pointed by the target direction, wherein the The tapered region has the target direction as an axis, the position of the target image object as a vertex, and the vertex angle is an acute angle; the target direction is parallel to a target shifting direction, and the target shifting direction is between a first direction and a first direction a first angle is an acute angle and less than a critical angle, wherein the target shifting direction and the first direction are both starting from a position of the source electronic device, and the first direction is directed to a position of the candidate electronic device; a second angle between the target shifting direction and a second direction is an acute angle, and the first angle is smaller than the second angle, wherein the second direction starts from a position of the source electronic device, and points to the plurality of a location of a third electronic device in the electronic device; the candidate electronic device is located on a target path pointed by the target direction, and the target path is not in contact with a segment between the source electronic device and the candidate electronic device And other electronic devices in the plurality of electronic devices; a distance between a location of the candidate electronic device and the target path is less than the first predetermined value, and the target path is at the source The segment between the sub-device and the candidate electronic device does not contact other electronic devices of the plurality of electronic devices; the target path passes through the candidate display, and the target path is between the source electronic device and the candidate electronic device The segment between the plurality of electronic devices is not in contact with the other electronic device; the candidate electronic device is located on a target vertical plane where the target path is located, and the target vertical surface is at the source electronic device and the candidate electronic device The area between the devices does not contact other electronic devices of the plurality of electronic devices; the distance between the position of the candidate electronic device and the target vertical plane is less than the first predetermined value, and the target vertical plane is at the source The area between the electronic device and the candidate electronic device does not contact other electronic devices of the plurality of electronic devices; the candidate electronic device is located on the target path; The distance between the location of the candidate electronic device and the target path is less than the first predetermined value; the target path passes through the candidate display; the candidate electronic device is located on the target vertical plane; the location of the candidate electronic device and the target The distance between the vertical faces is smaller than the first predetermined value; the first direction forms a third angle with the second direction, and the first angle is less than half of the third angle; The two vertical planes cut the space into a first side space and a second side space, the target direction is directed to the first side space, and the candidate electronic device is located in the first side space; a source of the source electronic device points in a direction a vertical plane of a source, defining a target viewing angle region by rotating a first viewing angle from the position of the source electronic device to the two sides of the source pointing direction, the source vertical plane cutting the target viewing angle region into a first half a side area and a second half area, the target direction is directed to the first half area, and the candidate electronic device is located in the first half area; Forming a fourth angle between the direction and the target shifting direction, the first direction and the source pointing direction form a fifth angle, and the fourth angle and the fifth angle are smaller than the first angle of view; Forming a sixth angle between the opposite direction and a candidate pointing direction of the candidate electronic device, wherein the fourth angle and the fifth angle are smaller than the first angle of view, and the sixth angle is smaller than a second angle of view, wherein the first angle The direction starts from the position of the candidate electronic device and points to the location of the source electronic device; and a candidate vertical plane where the candidate pointing direction is located, and the position of the candidate electronic device is rotated to the sides of the candidate pointing direction The second perspective defines a candidate perspective The area, the source electronic device is located in the candidate viewing angle area, the target direction is directed to the first half side area, and the candidate electronic device is located in the first half side area. The multimedia interactive system of claim 2, wherein the position detecting circuit is located higher than the source electronic device, the candidate electronic device, and the third electronic device, and the first viewing angle is equal to the second viewing angle. The multimedia interactive system of claim 1, wherein the position detecting circuit is configured to detect individual projection positions and directivity of the plurality of electronic devices on the same reference horizontal plane, and the predetermined condition includes at least one of the following conditions : a target projection direction of the target direction on the reference horizontal plane points to a target projection path and a strip-shaped region, and a candidate projection position of the candidate electronic device on the reference horizontal plane is located in the strip-shaped region, wherein the strip shape The region is centered on the target projection path and has a width that is twice a first predetermined value; the target projection direction is directed to a triangular region, and the candidate projection position is located in the triangular region, wherein the triangular region is the target projection path a center line, a projection position of the target image object on the reference horizontal plane as a vertex, and an apex angle is an acute angle; an eleventh angle between the target projection direction and a first projection direction is an acute angle and less than one a critical angle, wherein the first projection direction is a source projection of the source electronic device on the reference horizontal plane The position is a starting point, and the first projection direction is directed to the candidate projection position; a twelfth angle between the target projection direction and a second projection direction is an acute angle, and the eleventh angle is smaller than the twelfth angle, The second projection direction starts from the source projection position and points to a third projection position of the third electronic device of the plurality of electronic devices on the reference horizontal plane; the source electronic device is at the reference horizontal plane Projection as a source projection area, the The projection of the candidate electronic device on the reference horizontal plane is a candidate projection region, the candidate projection position is located on the target projection path, and the segment of the target projection path between the source projection region and the candidate projection region does not Exposing a projection of the other of the plurality of electronic devices on the reference horizontal plane; a distance between the candidate projection location and the target projection path is less than the first predetermined value, and the target projection path is in the source projection region a segment between the candidate projection area and no projection of the other electronic device of the plurality of electronic devices on the reference horizontal plane; the target projection path passing through a display of the candidate display at the reference horizontal plane a projection area, and the section of the target projection path between the source projection area and the candidate projection area does not contact projections of other electronic devices of the plurality of electronic devices on the reference horizontal plane; the candidate projection position Located on the target projection path; the distance between the candidate projection position and the target projection path is less than the a predetermined value; the target projection path passes through the display projection area; the first projection direction forms a thirteenth angle with the second projection direction, and the eleventh angle is less than half of the thirteenth angle; a second reference line in which the second projection direction is cut to cut the reference horizontal plane into a first side area and a second side area, the target projection direction is directed to the first side space, and the candidate projection position is located in the first side area a source pointing direction of the source electronic device is directed to a projection direction on a reference horizontal plane, and a target viewing angle region is defined by rotating the first viewing angle from the source to the projection direction The source is directed to the projection direction to cut the target viewing area into a first half area and a second half area. a target projection direction is directed to the first half side region, and the candidate projection position is located in the first half side region; the source pointing direction forms a fourteenth angle between the projection direction and the target projection direction, the first projection direction and the The source points a fifteenth angle between the projection directions, and the fourteenth angle and the fifteenth angle are smaller than the first angle of view; a first back projection direction and a candidate pointing direction of the candidate electronic device are in the reference Forming a sixteenth angle between a candidate pointing direction on the horizontal plane, the fourteenth angle and the fifteenth angle are smaller than the first angle of view, and the sixteenth angle is smaller than a second angle of view, wherein the first angle a projection direction starting from the candidate projection position and pointing to the source projection position; and the candidate pointing projection direction defining a candidate viewing angle region by rotating the second perspective on both sides of the candidate pointing projection direction with the candidate projection position as an axis The source projection position is located in the candidate view area, the target projection direction is directed to the first half side area, and the candidate projection position is located at the first The side region. The multimedia interactive system of claim 4, wherein the location detecting circuit is located higher than the source electronic device, the candidate electronic device, and the third electronic device, and the first viewing angle is equal to the second viewing angle. The multimedia interactive system of claim 1, further comprising: a third electronic device, comprising a third display; wherein the position detecting circuit further detects the position and directivity of the third electronic device in space, The source electronic device displays the relative position of the source electronic device, the candidate electronic device, and the third electronic device in space on a partial area of the source display, and presents the local electronic device in the local area. An animation related to the motion of the target image object. The multimedia interactive system of claim 6, wherein the source electronic device is used according to The target direction is calculated for the operation of the local area. The multimedia interactive system of claim 1, wherein the source electronic device receives information related to the location and directivity of the candidate electronic device from at least one of the location detecting circuit and the candidate electronic device. The multimedia interactive system of claim 1, further comprising: a forwarding electronic device configured to serve as an instruction transmission medium between the plurality of electronic devices; wherein the forwarding electronic device is from the position detecting circuit and the candidate electronic device At least one of the information receiving information related to the location and directivity of the candidate electronic device is provided to the source electronic device. The multimedia interactive system of any one of claims 1 to 9, wherein the position detecting circuit detects and utilizes a centroid position of the source electronic device to represent a position of the source electronic device in space. A location of a centroid of the candidate electronic device is detected and utilized to represent the location of the candidate electronic device in space. The multimedia interactive system of any one of claims 1 to 9, wherein the position detecting circuit detects and transmits a spatial coordinate of a plurality of transmitting reference points in the source electronic device to the source electronic device, and Detecting and transmitting the spatial coordinates of the plurality of receiving reference points in the candidate electronic device to the candidate electronic device; wherein the source electronic device calculates the source electronic device according to the spatial coordinates of the plurality of transmitting reference points a position of the centroid to represent the position of the source electronic device in space, and the candidate electronic device calculates a centroid position of the candidate electronic device according to the spatial coordinates of the plurality of receiving end reference points to represent The location of the candidate electronic device in space. The multimedia interactive system of any one of claims 1 to 9, wherein the position detecting circuit detects and transmits a space seat of a plurality of transmitting reference points in the source electronic device Marking the source electronic device, and detecting and transmitting the spatial coordinates of the plurality of receiving reference points in the candidate electronic device to the candidate electronic device; wherein the source electronic device is based on the plurality of transmitting reference points The space coordinates calculate a position of a centroid of the source display to represent the position of the source electronic device in space, and the candidate electronic device calculates one of the candidate displays according to the spatial coordinates of the plurality of receiving end reference points. The position of the centroid to represent the position of the candidate electronic device in space. The multimedia interactive system of any one of claims 1 to 9, wherein the position detecting circuit detects and transmits a spatial coordinate of a plurality of transmitting reference points in the source electronic device to the source electronic device, and Detecting and transmitting a spatial coordinate of a plurality of receiving reference points in the candidate electronic device to the candidate electronic device; wherein the source electronic device calculates the spatial display based on the spatial coordinates of the plurality of transmitting reference points The position of the center point of the first multimedia interactive program window is displayed to represent the location of the source electronic device in space, and the candidate electronic device calculates the space coordinates of the plurality of receiving end reference points. The position of the center point of a second multimedia interactive program window displayed on the candidate display to represent the position of the candidate electronic device in space. A computer program product stored in a non-transitory storage device of a source electronic device, the source electronic device comprising a source display, when a control circuit of the source electronic device executes the computer program product, causing the source electronic The device performs a multimedia interactive operation, comprising: using a communication circuit of the source electronic device to dynamically receive individual locations and directivity in the space with the source electronic device and the one or more electronic devices by wireless transmission Relevant information; when a user instructs the source electronic device to target a target image object toward a target And transmitting, by the control circuit, determining whether a relative position of a candidate electronic device in the one or more electronic devices in the space meets a predetermined condition; and only the position of the candidate electronic device and the target direction When the relative position in the space meets the predetermined condition, the communication circuit is used to transmit a target instruction corresponding to the target image object to the candidate electronic device, so that the candidate electronic device utilizes the corresponding instruction according to the target instruction. A candidate display performs multimedia operations corresponding to the target image object. The computer program product of claim 14, wherein the predetermined condition comprises at least one of the following conditions: the candidate electronic device is located in a columnar region pointed by the target direction, wherein the columnar region is in the target direction The axis and the radius are a first predetermined value; the candidate electronic device is located in a tapered region pointed by the target direction, wherein the tapered region takes the target direction as an axis and the position of the target image object as a vertex. And the apex angle is an acute angle; the target direction is parallel to a target shifting direction, and a first angle between the target shifting direction and a first direction is an acute angle and less than a critical angle, wherein the target shifting direction And the first direction is a starting point of the source electronic device, and the first direction is directed to the position of the candidate electronic device; a second angle between the target shifting direction and a second direction is an acute angle, and The first angle is smaller than the second angle, wherein the second direction starts from a position of the source electronic device and points to a third electronic device of the plurality of electronic devices The candidate electronic device is located on a target path pointed by the target direction, and the segment of the target path between the source electronic device and the candidate electronic device does not contact other electronic devices of the plurality of electronic devices; ; The distance between the location of the candidate electronic device and the target path is less than the first predetermined value, and the segment of the target path between the source electronic device and the candidate electronic device does not contact the plurality of electronic devices. The other electronic device; the target path passes through the candidate display, and the segment of the target path between the source electronic device and the candidate electronic device does not contact other electronic devices of the plurality of electronic devices; The electronic device is located on a target vertical plane where the target path is located, and the target vertical plane does not contact other electronic devices in the plurality of electronic devices in an area between the source electronic device and the candidate electronic device; The distance between the position of the electronic device and the target vertical plane is less than the first predetermined value, and the area of the target vertical plane between the source electronic device and the candidate electronic device does not contact the plurality of electronic devices. a further electronic device; the candidate electronic device is located on the target path; a distance between the location of the candidate electronic device and the target path is less than a first predetermined value; the target path passes through the candidate display; the candidate electronic device is located on the target vertical plane; a distance between a position of the candidate electronic device and the target vertical plane is less than the first predetermined value; Forming a third angle between the direction and the second direction, and the first angle is less than half of the third angle; and the second vertical plane of the second direction cuts the space into a first side space and a second side a space, the target direction is directed to the first side space, and the candidate electronic device is located in the first side space; a source of the source electronic device points to a source vertical plane where the direction is located, The position of the source electronic device defines a target viewing angle region by rotating a first viewing angle to the two sides of the source pointing direction, and the source vertical surface cuts the target viewing angle region into a first half side region and a second half side region. The target direction is directed to the first half-side region, and the candidate electronic device is located in the first half-side region; the source pointing direction and the target shifting direction form a fourth angle, the first direction and the source Forming a fifth angle between the pointing directions, wherein the fourth angle and the fifth angle are smaller than the first angle of view; a first opposite direction and a candidate pointing direction of the candidate electronic device form a sixth angle, the first The four angles and the fifth angle are smaller than the first angle of view, and the sixth angle is smaller than a second angle of view, wherein the first reverse direction starts from a position of the candidate electronic device and points to a position of the source electronic device; a candidate vertical plane in which the candidate pointing direction is located, and a candidate viewing angle area is defined by rotating the second viewing angle on both sides of the candidate pointing direction with the position of the candidate electronic device as an axis. The source of the electronic device is located in the candidate zone viewing angle, the direction toward the first half of the target region, and the candidate electronic device located within the first half of region. The computer program product of claim 14, wherein the predetermined condition comprises at least one of the following conditions: a target projection direction of the target direction on the reference horizontal plane points to a target projection path and a strip region, the candidate electron A candidate projection position of the device on the reference horizontal plane is located in the strip-shaped region, wherein the strip-shaped region is centered on the target projection path and has a width that is twice a first predetermined value; the target projection direction is directed to a a triangular region, the candidate projection position is located in the triangular region, wherein the triangular region is centered on the target projection path, the projection position of the target image object on the reference horizontal plane is a vertex, and the vertex angle is an acute angle; An eleventh angle between the target projection direction and a first projection direction is an acute angle and less than a critical angle, wherein the first projection direction is a starting point of a source of the source electronic device on the reference horizontal plane. And the first projection direction is directed to the candidate projection position; a twelfth angle between the target projection direction and a second projection direction is an acute angle, and the eleventh angle is smaller than the twelfth angle, wherein the first The second projection direction starts from the source projection position and points to a third projection position of the third electronic device of the plurality of electronic devices on the reference horizontal plane; the projection of the source electronic device on the reference horizontal plane is a source projection area, the projection of the candidate electronic device on the reference horizontal plane is a candidate projection area, the candidate projection position is located on the target projection path, and the target projection path is between the source projection area and the candidate projection area a segment that does not touch a projection of the other of the plurality of electronic devices on the reference horizontal plane; the candidate projection bit The distance from the target projection path is less than the first predetermined value, and the segment of the target projection path between the source projection area and the candidate projection area does not contact other electrons in the plurality of electronic devices Projecting a projection on the reference horizontal plane; the target projection path passes through a display projection area of the candidate display on the reference horizontal plane, and the target projection path is between the source projection area and the candidate projection area, Not projecting the projection of the other electronic device of the plurality of electronic devices on the reference horizontal plane; the candidate projection position is located on the target projection path; the distance between the candidate projection position and the target projection path is less than the first a predetermined value; the target projection path passes through the projection area of the display; Forming a thirteenth angle between the first projection direction and the second projection direction, and the eleventh angle is less than half of the thirteenth angle; a second reference line of the second projection direction is the reference horizontal plane Cutting into a first side area and a second side area, the target projection direction is directed to the first side space, and the candidate projection position is located in the first side area; a source pointing direction of the source electronic device is at the reference level A source is directed to the projection direction, and a source of the first perspective is rotated from the source to the projection direction to define a target viewing angle region, and the source is directed to the projection direction to cut the target viewing region into a first a half side area and a second half side area, the target projection direction is directed to the first half side area, and the candidate projection position is located in the first half side area; the source pointing direction forms a direction between the projection direction and the target projection direction a fourteenth angle, the first projection direction forms a fifteenth angle with the source pointing projection direction, and the fourteenth angle and the fifteenth clip All being smaller than the first viewing angle; a first back projection direction and a candidate pointing direction of the candidate electronic device form a sixteenth angle between a candidate pointing projection direction of the reference horizontal plane, the fourteenth angle and the first The fifteenth angle is smaller than the first angle of view, and the sixteenth angle is smaller than a second angle of view, wherein the first back projection direction starts from the candidate projection position and points to the source projection position; and the candidate points to the projection direction The candidate projection position defines a candidate viewing angle region for each rotation of the second viewing angle to the two sides of the candidate pointing projection direction, where the source projection position is located in the candidate viewing angle region, and the target projection direction is directed to the first half region. And the candidate projection position is located in the first half side region. The computer program product of claim 14, wherein the multimedia interactive operation further comprises: receiving and pointing from a position detecting circuit to a third electronic device in space Relevant information; displaying the relative position of the source electronic device, the candidate electronic device, and the third electronic device in space on a partial area of the source display; and presenting the target in the local area Animation related to the motion of the image object. The computer program product of claim 17, wherein the multimedia interactive operation further comprises: calculating the target direction according to the operation of the local area by the user. The computer program product of claim 14, wherein the multimedia interactive operation further comprises: receiving information related to the position and directivity of the candidate electronic device from at least one of the position detecting circuit and the candidate electronic device. The computer program product of claim 14, wherein the multimedia interactive operation further comprises: receiving information related to the location and directivity of the candidate electronic device from a forwarding electronic device. The computer program product of any one of claims 14 to 20, wherein the multimedia interactive operation further comprises: receiving and utilizing a centroid location of the source electronic device to represent a location of the source electronic device in space. The computer program product of any one of claims 14 to 20, wherein the multimedia interactive operation further comprises: receiving, from a position detecting circuit, a space coordinate of a plurality of transmitting end reference points in the source electronic device; The spatial coordinates of the plurality of transmitting end reference points calculate the position of a centroid of the source electronic device to represent the position of the source electronic device in space. The computer program product of any one of claims 14 to 20, wherein the multimedia interactive operation further comprises: receiving, by a position detecting circuit, a plurality of transmitting reference points in the source electronic device a space coordinate; and calculating a position of a centroid of the source display according to a spatial coordinate of the plurality of transmitting end reference points to represent a position of the source electronic device in space. The computer program product of any one of claims 14 to 20, wherein the multimedia interactive operation further comprises: receiving, from a location detecting circuit, a spatial coordinate of a plurality of transmitting reference points in the source electronic device; The spatial coordinates of the plurality of transmitting end reference points calculate the position of the center point of a multimedia interactive program window displayed on the source display to represent the position of the source electronic device in space.