TWI482049B - Multimedia interaction system and related computer program product capable of blocking multimedia interaction commands that against interactive rules - Google Patents

Description

Multimedia interactive system and related computer program products that can block multimedia interactive instructions that violate interactive rules

The invention relates to a multimedia interactive system, in particular to a multimedia interactive system and related computer program products comprising a plurality of displays and capable of blocking multimedia interactive instructions violating interactive rules.

With the advancement of technology, multimedia interactive systems and related applications that allow multimedia interactions of different electronic devices have received increasing attention. The design of many interactive applications related to multimedia content expects that the relative positions of multiple electronic devices participating in multimedia interactions in space must meet certain conditions to allow specific multimedia interactions. However, in the traditional multimedia interactive system, the transmitting end electronic device of the multimedia interactive instruction cannot judge the relative position of itself and other electronic devices in space, nor can it restrict the transmission direction of the multimedia content or the interactive instruction. Therefore, there is often a multimedia interaction result between the electronic devices that does not conform to the general user experience, should not appear in the design of the multimedia interactive application, violates the rules set by the interactive application, or is unintended.

For example, some multimedia interactive applications are designed to expect the receiving electronic device and its user to be in front of the user of the transmitting electronic device, and the specific imaging object or command can be transmitted by the transmitting electronic device to the receiving electronic device. However, in actual operation, the receiving end electronic device and its user can receive the specific image object or instruction transmitted by the transmitting end electronic device even if it is located behind the user of the transmitting end electronic device. Such unintended interactions are not in line with the general user experience and should not occur in the design of multimedia interactive applications, but they often occur. This is because in order to enable the electronic device to achieve better signal transmission quality, the communication circuits in the electronic device are generally designed to transmit and receive signals in various directions, rather than transmitting and receiving signals in a specific direction.

One of the ways to reduce the above problem is to design the communication circuit of the electronic device to only transmit and receive signals in a specific direction, but this method will seriously affect the signal transmission capability and the receiving range of the electronic device. If the user experience presented by the multimedia interactive system cannot be ensured, and the original design intention of the multimedia interactive application can be met, the development and application range of the multimedia interactive application across the electronic device will be seriously hindered.

In view of this, how to reduce the number of electronic devices participating in multimedia interactive applications, which may not be in line with the general user experience, should not appear in the design of multimedia interactive applications, violate the rules set by interactive applications, or unintended multimedia The possibility of interactive results to improve the user experience of multimedia interactive systems is a problem that the industry has yet to resolve.

The present specification provides an embodiment of a multimedia interactive system having multiple displays, The method includes: a plurality of electronic devices; a plurality of displays respectively disposed on the plurality of electronic devices; a forwarding electronic device configured to serve as an instruction transmission medium between the plurality of electronic devices; and a position detecting circuit configured to be disposed The device can dynamically detect individual locations and directivity of the plurality of electronic devices in space, and transmit information related to the detection result to the forwarding electronic device and at least one of the plurality of electronic devices by wireless transmission One. When a user instructs a source electronic device of the plurality of electronic devices to transmit a target image object toward a target direction, the source electronic device displays a target command corresponding to the target image object and the target direction information. Transmitted to the forwarding electronic device, the forwarding electronic device determines whether a candidate electronic device of the other electronic device and the relative position of the target direction in space meet a predetermined condition, and only the location of the candidate electronic device and the If the relative position of the target direction in the space meets the predetermined condition, the forwarding electronic device transmits the target instruction to the candidate electronic device, so that the candidate electronic device utilizes the corresponding candidate display according to the target instruction. Perform multimedia operations corresponding to the target image object.

This specification provides an embodiment of a computer program product. The computer program product is stored in a non-transitory storage device of the forwarding electronic device. The forwarding electronic device includes a forwarding display. When the control circuit of the forwarding electronic device executes the computer program product, the forwarding electronic device is caused to perform a multimedia interactive operation. The multimedia interactive operation includes: using a communication circuit of the forwarding electronic device to dynamically receive information related to individual positions and directivity of a plurality of electronic devices in a space by wireless transmission; when a user indicates the plurality of electronic devices One source of electronic equipment Receiving a target image object in a target direction, using the communication circuit to receive a target command corresponding to the target image object and information about the target direction from the source electronic device; using the control circuit to determine the other electronic device Whether a candidate electronic device and the relative position of the target direction in space meet a predetermined condition; and only if the position of the candidate electronic device and the relative position of the target direction in space meet the predetermined condition The communication circuit transmits the target command to the candidate electronic device, so that the candidate electronic device performs a multimedia operation corresponding to the target image object by using a corresponding candidate display according to the target instruction.

One of the advantages of the above embodiments is that the source of the multimedia interactive instruction can be effectively reduced from the source of the electronic device and other electronic devices, which is not suitable for the general user experience, should not appear in the design of the multimedia interactive application, and violates the setting of the interactive application. Rules, or unintended multimedia interaction results.

Another advantage of the above embodiment is that it may cause the multimedia interactive system to appear to be inconsistent with the general user experience, should not appear in the design of the multimedia interactive application, violate the rules set by the interactive application, or the unintended multimedia interaction. The resulting multimedia interactive instructions are filtered or blocked to ensure that the multimedia interactions presented by the multimedia interactive system are consistent with the original design intent of the multimedia interactive application. As a result, the user experience provided by the multimedia interactive system can be greatly improved. Other advantages of the invention will be explained in more detail by the following description and drawings.

100‧‧‧Multimedia interactive system

110‧‧‧ position detection circuit

120‧‧‧Electronic devices

121‧‧‧Control circuit

123‧‧‧Storage device

125‧‧‧Communication circuit

127‧‧‧ display

128‧‧‧Multimedia interactive module

130‧‧‧Network

211, 212, 213, 214, 221, 222, 223, 224, 231, 232, 233, 234 ‧ ‧ reference points

215, 235‧‧‧ control keys

216, 226‧‧‧ browser window

225‧‧‧ brand logo

400‧‧‧ Target image objects

1300‧‧‧Projected objects of the target image object

2400‧‧‧Multimedia interactive screen

2410‧‧‧Master image screen

2420‧‧‧ thumbnail picture

2421, 2422, 2423‧‧‧ portrait

2424‧‧‧Image objects

2425‧‧‧Track line

FIG. 1 is a simplified functional block diagram of a multimedia interactive system according to an embodiment of the present invention.

FIG. 2 is a schematic diagram showing the simplified position of a portion of the electronic device in FIG. 1 in space. FIG.

FIG. 3 is a simplified flowchart of a multimedia interaction method according to an embodiment of the present invention.

4 to 12 are simplified schematic views showing different states of relative positions of the electronic devices in FIG. 1 in space.

13 to 21 are simplified schematic views showing different states of relative positions of projections of a portion of the electronic device of FIG. 1 on a reference horizontal plane.

22 to 23 are simplified flowcharts of a multimedia interaction method according to various embodiments of the present invention.

FIG. 24 is a schematic diagram of a simplified multimedia interactive screen according to an embodiment of the present invention.

Embodiments of the present invention will be described below in conjunction with the associated drawings. In the drawings, the same reference numerals are used to refer to the same or similar elements or process steps.

Please refer to FIG. 1 , which is a simplified functional block diagram of a multimedia interactive system 100 according to an embodiment of the present invention. The multimedia interactive system 100 includes a locatin detection circuit 110 and a member electronic device (120-a~120-n is taken as an example). In the multimedia interactive system 100, different users perform interactive operations related to multimedia content by using various electronic devices 120-a~120-n, such as various multimedia content sharing, multimedia content interaction, multimedia content collaborative editing, online sports. Games, card games, Role-playing Game (RPG), Action Game, Adventure Game, Strategy Game (SLG), Real Time Strategy Game (RSG) and many more.

The position detecting circuit 110 can use one or more magnetic sensing circuits, ultrasonic positioning circuits, infrared sensing circuits, image sensing and identification circuits, WiFi signal positioning circuits, motion detection circuits, indoor GPS circuits, and gesture sensing. Various existing object positioning circuits, such as circuits, are implemented. In practice, the position detecting circuit 110 can be disposed above all the electronic devices 120-a~120-n, such as the position of the ceiling, so that the position detecting circuit 110 is positioned higher than all the electronic devices 120-a~120. -n to improve the accuracy of position detection.

The lowercase English indexes a~n in the component numbers and device numbers used in the present specification and drawings are merely for convenience of referring to individual components and devices, and are not intended to limit the number of the aforementioned components and devices to a specific number. In the specification and the drawings, if an element number or device number is used to indicate the index of the component number or device number, it means that the component number or device number refers to the component group or device group that is not specified. Any component or device. For example, the component number 121-a refers to the control circuit 121-a, and the component number 121 refers to any of the control circuits 121-a to 121-b. For another example, the device number 120-b refers to the electronic device 120-b, and the device number 120 refers to any of the electronic devices 120-a to 120-n.

In the embodiment of FIG. 1 , the electronic devices 120-a 120 120-n respectively include a control circuit 121 , a storage device 123 coupled to the control circuit 121 , a communication circuit 125 , and a display 127 . In practice, the control circuit 121 can be implemented by one or more processor units, and the communication circuit 125 can be a wired network interface, a wireless network interface, or a circuit that integrates both functions. In addition, the storage device 123 A multimedia interaction module 128 is stored therein. The multimedia interaction module 128 can be composed of one or more application modules. For convenience of explanation, other elements and connection relationships in the electronic device 120 are not shown in FIG.

In operation, the electronic devices 120-a~120-n can communicate with each other via the network 130. The aforementioned network 130 may be an internet or internal network employing various communication protocols.

In use, the electronic devices 120-a-120-n may be a plurality of electronic devices having the same hardware specifications and operating systems, or a plurality of electronic devices having different hardware specifications and operating systems. In other words, the electronic devices 120-a~120-n can be various desktop computers, desktop game machines, transaction machines, and mobile electronic devices (such as mobile phones, tablets, notebook computers, small devices) having networking functions. Various combinations of notebooks, e-books, handheld game consoles, etc., or various types of home appliances (such as televisions, refrigerators, stereos, etc.).

The operation of the multimedia interactive system 100 will be further described below in conjunction with FIG.

3 is a simplified flowchart 300 of an embodiment of a multimedia interaction method for use in a multimedia interactive system 100 of the present invention.

In flowchart 300, the process located in the field to which a particular device belongs is representative of the flow performed by that particular device. For example, in flowchart 300, the portion of the field labeled "Location Detection Circuit" represents the flow performed by position detection circuit 110, in the field labeled "source electronic device". The portion of the electronic device that generates the multimedia interactive command, in the field labeled "candidate electronic device" The part represents the flow of the electronic device that may receive or execute the multimedia interactive instruction. The same orchestration logic is also used in subsequent flowcharts.

When the multimedia interaction method in the flowchart 300 is performed, the control circuit 121 in the electronic device 120 executes the multimedia interaction module 128 to cause the electronic device 120 to perform some or all of the processes in the corresponding fields.

For convenience of understanding, the operation mode of the multimedia interactive system 100 will be described below by taking the source electronic device as the electronic device 120-a and the candidate electronic device as one of the other electronic devices 120-b-120-n.

In the process 302, the position detecting circuit 110 can dynamically detect the individual positions and directivity of the electronic devices 120-a~120-n in space to generate individual devices in the space with the electronic devices 120-a~120-n. Information related to location and directivity, and wirelessly transmitting information related to the detection result to at least one of the electronic devices 120-a~120-n by wireless transmission.

In the multimedia interactive system 100, the location of the particular geometric feature of the electronic device 120, a particular logo, a particular component, a particular region, a particular geometric feature of the display 127, or a particular geometric feature of a particular display region on the display 127 in space may be utilized. To represent the location of the electronic device 120 in space.

For example, the position detecting circuit 110 can detect and utilize the position of a centroid of the electronic device 120 to represent the position of the electronic device 120 in space. Alternatively, the position detecting circuit 110 can detect and utilize the centroid position of the display 127 to represent the position of the electronic device 120 in space.

In practice, the position detecting circuit 110 and the individual electronic devices 120-a~120-n can also be utilized. The joint operation is performed to calculate the position of the individual electronic devices 120-a~120-n in space. The position detecting circuit 110 can detect and transmit the spatial coordinates of the plurality of reference points in the electronic device 120 to the electronic device 120, and the electronic device 120 uses the control circuit 121 to calculate the spatial coordinate of the received multiple reference points. The centroid position of the electronic device 120 represents the position of the electronic device 120 in space. For example, in the embodiment of FIG. 2, the position detecting circuit 110 can detect and transmit the spatial coordinates of the reference points 211 to 214 in the electronic device 120-a to the electronic device 120-a, and the detecting and transmitting electronic device 120- The spatial coordinates of the reference points 221-224 in b are given to the electronic device 120-b, and the spatial coordinates of the reference points 231-234 in the detecting and transmitting electronic device 120-n are given to the electronic device 120-n.

Since the length and width of the electronic device 120-a are given values, the electronic device 120-a can calculate the electronic device by using the control circuit 121-a according to the spatial coordinates of some or all of the reference points in the reference points 211 to 214. The position of the centroid of 120-a represents the position of the electronic device 120-a in space. Since the length and width of the electronic device 120-b are given values, the electronic device 120-b can calculate the electronic device by using the control circuit 121-b according to the spatial coordinates of some or all of the reference points 221~224. The position of the centroid of 120-b represents the position of the electronic device 120-b in space. Similarly, since the length and width of the electronic device 120-n are given values, the electronic device 120-n can be calculated by the control circuit 121-n according to the spatial coordinates of some or all of the reference points 231-234. The three-dimensional coordinates of the centroid of the electronic device 120-n are represented to represent the position of the electronic device 120-n in space.

Alternatively, the electronic device 120 can also utilize the control circuit 121 according to the received multiple references. The spatial coordinates of the point calculate the position of the centroid of the display 127 to represent the position of the electronic device 120 in space. For example, in the embodiment of FIG. 2, the position detecting circuit 110 can detect and transmit the spatial coordinates of the reference points 211 to 214 in the electronic device 120-a to the electronic device 120-a, and the detecting and transmitting electronic device 120- The spatial coordinates of the reference points 221-224 in b are given to the electronic device 120-b, and the spatial coordinates of the reference points 231-234 in the detecting and transmitting electronic device 120-n are given to the electronic device 120-n.

Since the length and width of the electronic device 120-a are given values, and the size of the display 127-a and the set position in the electronic device 120-a are also given, the electronic device 120-a can utilize the control circuit 121. -a calculates the position of the centroid Ca of the display 127-a based on the spatial coordinates of some or all of the reference points in the reference points 211 to 214 to represent the position of the electronic device 120-a in space. Since the length and width of the electronic device 120-b are given values, and the size of the display 127-b and the set position in the electronic device 120-b are also given, the electronic device 120-b can utilize the control circuit 121. -b calculates the position of the centroid Cb of the display 127-b based on the spatial coordinates of some or all of the reference points 221-224 to represent the position of the electronic device 120-b in space. Similarly, since the length and width of the electronic device 120-n are given values, and the size of the display 127-n and the set position in the electronic device 120-n are also given, the electronic device 120-n can be utilized. The control circuit 121-n calculates the three-dimensional coordinates of the centroid Cn of the display 127-n based on the spatial coordinates of some or all of the reference points 231-234 to represent the position of the electronic device 120-n in space.

Alternatively, the electronic device 120 can also use the control circuit 121 to calculate a multimedia interactive program displayed on the display 127 according to the received spatial coordinates of the plurality of reference points. The location of a particular geometric feature of a window (eg, a browser window), such as the location of a center point, represents the location of the electronic device 120 in space. For example, in the embodiment of FIG. 2, electronic device 120-a utilizes display 127-a to display a target browser window 216, and electronic device 120-b utilizes display 127-b to display a target browser window 226. Since the size of the target browser window 216 displayed on the display 127-a and the relative position in the display 127-a are both set by the control circuit 121-a, they are all known parameters. Therefore, the position detecting circuit 110 can detect and transmit the spatial coordinates of the reference points 211 to 214 in the electronic device 120-a to the electronic device 120-a, and the electronic device 120-a can use the control circuit 121-a according to the reference. The spatial coordinates of some or all of the reference points in points 211 to 214 calculate the three-dimensional coordinates of the center point Wa of the target browser window 216 to represent the position of the electronic device 120-a in space. Similarly, since the size of the target browser window 226 displayed on the display 127-b and the relative position in the display 127-b are both set by the control circuit 121-b, they are all known parameters. Therefore, the position detecting circuit 110 can detect and transmit the spatial coordinates of the reference points 221 to 224 in the electronic device 120-b to the electronic device 120-b, and the electronic device 120-b can utilize the control circuit 121-b according to the reference. The spatial coordinates of some or all of the reference points in points 221 to 224 calculate the three-dimensional coordinates of the center point Wb of the target browser window 226 to represent the position of the electronic device 120-b in space.

In addition, the position detecting circuit 110 can also identify and detect the position of one or more reference objects or signs in the electronic device 120, and compare with the positions of other reference points to determine that the electronic device 120 is in space. Orientation. For example, in the embodiment of FIG. 2, the position detecting circuit 110 can identify and detect the electronic device 120-a. The position of the control key 215 is compared with the spatial coordinates of some or all of the reference points 211 to 214 to determine the directivity of the electronic device 120-a in space. The position detecting circuit 110 can identify and detect the position of the brand mark 225 of the electronic device 120-b, and compare with the spatial coordinates of some or all of the reference points 221 to 224 to determine the electronic The directivity of device 120-b in space. The position detecting circuit 110 can identify and detect the position of the control key 235 of the electronic device 120-n, and compare with the spatial coordinates of some or all of the reference points 231-234 to determine the electronic The directivity of device 120-n in space.

Alternatively, the position detecting circuit 110 can also transmit the detection result of the position of the one or more reference objects or flags to the electronic device 120 together with the detection result of the position of the other reference points. The electronic device 120 uses the control circuit 121 to compare the position of the one or more reference objects or flags with the positions of other reference points to determine the directivity of the electronic device 120 in space to reduce the position detection. The computational burden of the circuit 110.

In the following description, the directivity of the electronic device 120-a in the space is represented by the pointing direction Da, and the directivity of the electronic device 120-b in the space is represented by the pointing direction Db, and the electronic device 120-n is The directivity in space is represented by the pointing direction Dn. It should be noted that the "directivity" and the "directing direction" referred to in the present invention are description terms regarding the manner in which the electronic device 120 is placed in the use state, and are not used to indicate the signal transmission and reception direction of the communication circuit 125 of the electronic device 120.

For convenience of explanation, it is assumed below that the multimedia interactive system 100 utilizes a display. The position of the centroid of 127 represents the position of the electronic device 120 in space.

In operation, the position and directivity of each electronic device 120 in space may change due to a change in the position of the user or a change in the posture of the operating electronic device 120. Therefore, the position detecting circuit 110 performs the foregoing process 302 continuously or intermittently, and dynamically detects the individual positions and directivity of the electronic devices 120-a-120-n in the space to generate the electronic device 120-a~ 120-n information about individual locations and directivity in space, and the generated information is transmitted wirelessly to one or more electronic devices in need.

In the process 304, the multimedia interaction module 128 of each electronic device 120 can dynamically receive information related to the position and directivity of the electronic device 120 in the space from the position detection circuit 110 by using the communication circuit 125 in a wireless transmission manner. And record it. In addition, the multimedia interaction module 128 can also use the communication circuit 125 to dynamically receive and record information related to individual positions and directivity of other electronic devices in the space from the position detection circuit 110 or other electronic devices. The electronic device 120 can perform the foregoing process 304 periodically or intermittently to dynamically receive the latest information generated by the position detecting circuit 110 or other electronic devices, and update the electronic devices 120-a~120-n in space accordingly. The individual location and directivity related records.

When the user of the source electronic device 120-a operates the source electronic device 120-a, the multimedia interaction module 128-a performs a process 306 to determine whether the user's current operation is an indication that a target image object is facing one. Target direction transfer. If the operation is only another operation that is not related to the target image object, the control circuit 121-a performs a corresponding operation according to the user's operation.

If the user of the source electronic device 120-a performs a predetermined operation (for example, a specific touch mode, a specific mouse operation, or a specific voice control command) on the source electronic device 120-a, the source electronic device 120 is indicated. -a transmits a target image object in a target direction, and the multimedia interaction module 128-a performs a process 308.

In the process 308, the multimedia interaction module 128-a can select other electronic devices 120-b~120-n one by one as a candidate electronic device, and according to the latest information about the position and directivity of the candidate electronic device in space. Information, to determine whether the selected candidate electronic device and the relative position of the target direction in space meet a predetermined condition. If the selected candidate electronic device and the relative position of the target direction in the space meet the predetermined condition, the multimedia interaction module 128-a performs the process 310; otherwise, if the selected candidate electronic device and the target direction are in space relative to each other; If the location does not meet the predetermined condition, the multimedia interaction module 128-a performs flow 316.

In the process 310, the multimedia interaction module 128-a transmits the target command corresponding to the target image object and the user's instruction to the candidate electronic device that meets the predetermined condition by using the communication circuit 125-a. The foregoing target instructions include one or more instructions used by the source electronic device 120-a to set, control, change, or adjust the multimedia content presented by the display on the candidate electronic device (hereinafter referred to as the candidate display), and may also include Parameter values related to image attributes such as shape, size, color, position, duration, moving direction, and moving speed of one or more image objects.

In the process 312, the multimedia interaction module of the candidate electronic device utilizes the communication circuit of the candidate electronic device to receive the target instruction.

In the process 314, the multimedia interaction module of the candidate electronic device will be based on the target The candidate display is used to perform multimedia operations corresponding to the target image object. For example, the multimedia interaction module of the candidate electronic device can use the control circuit to set or adjust the shape, size, color, position, duration, moving direction, and moving speed of one or more image objects corresponding to the target image object according to the target instruction. The image attributes are generated to generate one or more corresponding images, and the one or more corresponding images are displayed on the candidate display to complete a multimedia interactive operation.

In practice, the multimedia interaction module 128-a can perform the foregoing process 308 on the other electronic devices 120-b~120-n one by one to find all eligible electronic devices that meet the requirements. Alternatively, the multimedia interaction module 128-a may also find the first candidate electronic device that meets the determination condition of the process 308 from the electronic devices 120-b~120-n, and then terminate the operation of the process 308 instead of The position of the other electronic device is judged relative to the relative position of the target direction in space.

In flow 316, the multimedia interaction module 128-a will reject the delivery of the target command to the candidate electronic device.

In the process 318, the multimedia interaction module 128-a can be rendered by using a display 127-a (hereinafter referred to as a source display), a speaker, a light source circuit, or a vibrator on the source electronic device 120-a. Rejecting the target instruction to the corresponding multimedia effect of the candidate electronic device. For example, the multimedia interaction module 128-a can control the display 127-a to present an animation effect in which the target image object collides with the edge of the display 127-a and then bounces back, can control the speaker to present a specific sound effect, and can control the vibrator to perform a specific mode. Vibrating, controllable light source circuits (such as LEDs or flashlights) present a particular visual effect, or can be collocated with the various devices described above to present a particular multimedia effect In order to let the user know that the source electronic device 120-a has not transmitted the target image object or target command to the candidate electronic device.

It can be seen from the foregoing description that the source electronic device 120-a transmits the target command corresponding to the target image object to the target only if the target direction and the relative position of the selected candidate electronic device in the space meet the predetermined condition. The selected candidate electronic device causes the candidate electronic device to perform a multimedia operation corresponding to the target image object by using the corresponding candidate display according to the target instruction. If the target direction and the relative position of the candidate electronic device in the space do not meet the predetermined condition, the source electronic device 120-a does not transmit the target command to the candidate electronic device, and therefore, the candidate electronic device does not execute the target command. . Similarly, the source electronic device 120-a does not transmit the target command to other electronic devices that do not meet the predetermined condition, so as to prevent the electronic device that does not meet the predetermined condition from performing multimedia operations corresponding to the target image object. In other words, the multimedia interaction method in FIG. 3 can effectively avoid the generation of strange and unreasonable multimedia interaction results in the multimedia interactive system 100.

The manner in which the source electronic device 120-a operates in the foregoing process 308 is further described below in conjunction with FIGS. 4-12.

4 to 12 are the relative positions of a part of the electronic devices in the multimedia interactive system 100 in the space when the user of the source electronic device 120-a indicates that the source electronic device 120-a transmits a target image object 400 toward a target direction Dt. A simplified schematic of different aspects.

In practice, the multimedia interactive system 100 can determine whether the relative positions of the candidate electronic device and the target direction Dt in the space are consistent according to the three-dimensional position of the candidate electronic device. The predetermined condition referred to in the foregoing process 308.

In the first embodiment, the aforementioned predetermined condition means that the candidate electronic device must be located on a target path Pt to which the target direction Dt is directed.

In the second embodiment, the aforementioned predetermined condition means that the distance between the position of the candidate electronic device and the target path Pt is smaller than a first predetermined value R1.

In the third embodiment, the aforementioned predetermined condition means that the target path Pt passes through any position of the candidate display on the candidate electronic device.

In the fourth embodiment, the aforementioned predetermined condition means that the candidate electronic device is located on a target vertical plane (not shown) where the target path Pt is located and perpendicular to the ground.

In the fifth embodiment, the aforementioned predetermined condition means that the distance between the position of the candidate electronic device and the aforementioned target vertical plane is smaller than the first predetermined value R1.

In the aspect of FIG. 4, the target path Pt pointed by the target direction Dt passes through the centroid Cb of the display 127-b, and represents that the electronic device 120-b is located on the target path Pt, and is also located at the target vertical plane where the target path Pt is located. on. Since the electronic device 120-b is located on the target path Pt and the target vertical plane, the distance between the position of the electronic device 120-b and the target path Pt is zero, and the position of the electronic device 120-b is between the target and the target vertical plane. The distance is also zero. As shown in FIG. 4, the target path Pt passes through the display 127-n, but does not pass through the centroid Cn of the display 127-n, indicating that the electronic device 120-n is not located on the target path Pt, nor is it located at the target path Pt. Vertical plane.

Therefore, for the aspect of FIG. 4, when the candidate electronic device is the electronic device 120-b, the multimedia interactive module 128-a determines the position of the electronic device 120-b in the foregoing first to fifth embodiments. And the relative position of the target direction Dt in space conforms to the pre- Set the conditions. When the candidate electronic device is the electronic device 120-n, the multimedia interaction module 128-a determines in the foregoing third embodiment that the relative position of the position of the electronic device 120-n and the target direction Dt in the space meets a predetermined condition. However, in the foregoing first or fourth embodiment, the multimedia interaction module 128-a determines that the position of the candidate electronic device 120-n and the relative position of the target direction Dt in the space do not meet the predetermined condition.

In the aspect of FIG. 5, the target path Pt pointed by the target direction Dt passes through the area of the display 127-b, but does not pass through the centroid Cb of the display 127-b, indicating that the electronic device 120-b is not located on the target path Pt. It is not located on the target vertical plane where the target path Pt is located. The distance between the centroid Cb and the target path Pt is G1, and the distance between the position of the electronic device 120-b and the target path Pt is G1. In addition, the target path Pt passes through the peripheral area of the electronic device 120-n, but does not pass through the area of the display 127-n, and the representative electronic device 120-n is not located on the target path Pt, nor is it located at the target vertical plane where the target path Pt is located. on. As shown in FIG. 5, the distance G1 between the centroid Cb of the display 127-b and the target path Pt is smaller than the first predetermined value R1, but the distance between the centroid Cn of the display 127-n and the target path Pt is conspicuous. Greater than the first predetermined value R1.

Therefore, for the aspect of FIG. 5, when the candidate electronic device is the electronic device 120-b, the multimedia interactive module 128-a determines the electronic device 120 in the foregoing second, third, and fifth embodiments. The position of b and the relative position of the target direction Dt in space satisfy a predetermined condition, but in the foregoing first and fourth embodiments, the position of the candidate electronic device 120-b and the relative position of the target direction Dt in space are determined. Not meeting the predetermined conditions. When the candidate electronic device is the electronic device 120-n, the multimedia interactive module 128-a determines the candidate electronic device 120-n in the foregoing first to fifth embodiments. The relative position of the position and the target direction Dt in the space does not meet the predetermined condition.

In the sixth embodiment, the foregoing predetermined condition means that the candidate electronic device is located in a columnar region S1 pointed by the target direction Dt, wherein the columnar region S1 has the target direction Dt as an axis and the radius is the first predetermined value. R1.

In the aspect of FIG. 5, the centroid Cb of the display 127-b is located in the columnar region S1 to which the target direction Dt is directed, and the representative electronic device 120-b is located in the columnar region S1. The centroid Cn of the display 127-n is located outside the columnar region S1, and the representative electronic device 120-n is not located in the columnar region S1.

Therefore, for the aspect of FIG. 5, when the candidate electronic device is the electronic device 120-b, the multimedia interactive module 128-a determines the position and target of the candidate electronic device 120-b in the foregoing sixth embodiment. The relative position of the direction Dt in the space satisfies a predetermined condition. When the candidate electronic device is the electronic device 120-n, the multimedia interactive module 128-a determines in the foregoing sixth embodiment that the position of the candidate electronic device 120-n and the relative position of the target direction Dt in the space do not meet the predetermined schedule. condition.

In the seventh embodiment, the predetermined condition is that the candidate electronic device is located in a pyramidal or cone region S2 pointed by the target direction Dt, wherein the tapered region S2 is oriented with the target direction Dt as an axis. The position of the target image object 400 is a vertex and the vertex angle is an acute angle. In practice, the tapered region S2 may be a conical or pyramidal region.

In the aspect of Fig. 6, the tapered region S2 is a conical region, and the centroid Cb of the display 127-b is located in the tapered region S2, and the representative electronic device 120-b is located in the tapered region S2. The centroid Cn of the display 127-n is located outside the tapered region S2, representing the electronic device 120-n is not located in the tapered region S2.

Therefore, for the aspect of FIG. 6, when the candidate electronic device is the electronic device 120-b, the multimedia interactive module 128-a determines the position and target of the candidate electronic device 120-b in the foregoing seventh embodiment. The relative position of the direction Dt in the space satisfies a predetermined condition. When the candidate electronic device is the electronic device 120-n, the multimedia interactive module 128-a determines in the foregoing seventh embodiment that the position of the candidate electronic device 120-n and the relative position of the target direction Dt in the space do not meet the predetermined schedule. condition.

In the eighth embodiment, the predetermined condition is that the target direction Dt is parallel to a target shifting direction Dts, and a first angle between the target shifting direction Dts and a first direction is an acute angle and less than one. The critical angle Ath, wherein the target shift direction Dts and the first direction both start from the position of the source electronic device 120-a, and the first direction points to the position of the candidate electronic device.

In the aspect of FIG. 7, the multimedia interaction module 128-a can translate the target direction Dt to the position of the source electronic device 120-a (in this example, the position of the centroid Ca) as a starting point to define the target. Shift direction Dts. When the candidate electronic device is the electronic device 120-b, the first direction is the direction D1 of the centroid Cb of the display 127-b starting from the centroid Ca of the display 127-a. The line L1 pointed by the direction D1 passes through the centroid Cb of the display 127-b. The first angle is the angle A1 between the direction D1 and the target shift direction Dts. The smaller the angle A1 is, to some extent, the closer the position of the candidate electronic device 120-b is to the target path Pt pointed by the target direction Dt. Therefore, if the angle A1 is an acute angle and is smaller than the critical angle Ath, the multimedia interaction module 128-a determines the phase of the position of the electronic device 120-b and the target direction Dt in the space in the foregoing eighth embodiment. The location meets the predetermined conditions. On the other hand, if the angle A1 is greater than the critical angle Ath, the multimedia interaction module 128-a determines in the foregoing eighth embodiment that the position of the candidate electronic device 120-b and the relative position of the target direction Dt in the space do not meet the predetermined condition. .

In the aspect of FIG. 7, when the candidate electronic device is the electronic device 120-n, the first direction is the direction D2 of the centroid Cn of the display 127-n starting from the centroid Ca of the display 127-a. The line L2 pointed by the direction D2 passes through the centroid Cn of the display 127-n. The first angle is the angle A2 between the direction D2 and the target shift direction Dts. The smaller the angle A2 is, to some extent, the closer the position of the candidate electronic device 120-n is to the target path Pt pointed by the target direction Dt. Therefore, if the angle A2 is an acute angle and is smaller than the critical angle Ath, the multimedia interaction module 128-a determines in the foregoing eighth embodiment that the position of the electronic device 120-n and the relative position of the target direction Dt in the space are consistent. Predetermined conditions. On the other hand, if the angle A2 is greater than the critical angle Ath, the multimedia interaction module 128-a determines in the foregoing eighth embodiment that the position of the candidate electronic device 120-n and the relative position of the target direction Dt in the space do not meet the predetermined condition. .

In the aspect illustrated in FIG. 7 and subsequent sections, if the centroids Ca, Cb, and Cn are not in the same spatial plane, the target direction Dt, the direction D1, and the direction D2 are not in the same spatial plane. on. At this time, the target shift direction Dts, the direction D1, and the direction D2 are not in the same spatial plane.

If the position of the candidate electronic device and the relative position of the target direction Dt in space meet any of the predetermined conditions in the foregoing first to eighth embodiments, to some extent, the target electronic device is located at the target path pointed by the target direction Dt. A margin of error near Pt Tolerance within the range. Therefore, when the multimedia interactive system 100 is to manufacture the target image object is a multimedia interactive effect transmitted from the source electronic device 120-a to the candidate electronic device, the candidate condition setting manner in the foregoing first to eighth embodiments can be used to avoid the candidate. The distance between the electronic device and the target path Pt pointed by the target direction Dt is too far, but the unexpected situation of the target image object can still be received.

In addition, when the multimedia interactive application performed by the multimedia interactive system 100 requires a lower accuracy of the determination of the relative position of the candidate electronic device and the target direction Dt in space, the aforementioned first predetermined value R1 or critical angle Ath may be relaxed. . On the other hand, when the multimedia interactive application requires high accuracy for determining the relative position of the candidate electronic device and the target direction Dt in space, the first predetermined value R1 or the critical angle Ath may be lowered, or the first implementation may be adopted. The predetermined condition setting method of the example.

In the ninth embodiment, the predetermined condition is that a second angle between the target shifting direction Dts and a second direction is an acute angle, and the first angle is smaller than the second angle, wherein the second direction is The location of the source electronic device 120-a is a starting point and is directed to a location of a third one of the electronic devices 120-a-120-n.

In the aspect of FIG. 8, when the candidate electronic device is the electronic device 120-b, the multimedia interactive module 128-a selects another electronic device 120-n that is close to the target path Pt as the third electronic device. At this time, the first direction is also the direction D1 of the centroid Cb of the display 127-b, and the first angle is the direction D1 and the target shift direction Dts. The angle between the angles A1. The second direction is the direction D2 of the centroid Cn of the display 127-n starting from the centroid Ca of the display 127-a, and the second angle is the angle between the direction D2 and the target shifting direction Dts. A2. The smaller the angle A2 is, to some extent, the closer the position of the third electronic device 120-n is to the target path Pt pointed by the target direction Dt. In the aspect of FIG. 8, since the included angle A1 is an acute angle and smaller than the included angle A2, the position of the candidate electronic device 120-b is represented to some extent closer to the target direction Dt than the third electronic device 120-n. Target path Pt. Therefore, in the foregoing ninth embodiment, the multimedia interactive module 128-a determines that the position of the candidate electronic device 120-b and the relative position of the target direction Dt in the space meet predetermined conditions.

In the aspect of FIG. 8, when the candidate electronic device is the electronic device 120-n, the multimedia interactive module 128-a selects another electronic device 120-b that is close to the target path Pt as the third electronic device. At this time, the first direction is the direction D2 of the centroid Cn of the display 127-n starting from the centroid Ca of the display 127-a, and the first angle is between the direction D2 and the target shifting direction Dts. Angle A2. The second direction is the direction D1 of the centroid Cb of the display 127-b starting from the centroid Ca of the display 127-a, and the second angle is the angle A1 between the direction D1 and the target shifting direction Dts. In the aspect of FIG. 8, since the included angle A2 is larger than the included angle A1, the position of the third electronic device 120-b is represented to some extent closer to the target path Pt pointed by the target direction Dt than the candidate electronic device 120-n. Therefore, in the foregoing ninth embodiment, the multimedia interactive module 128-a determines that the position of the candidate electronic device 120-n and the relative position of the target direction Dt in the space do not meet the predetermined condition.

When the multimedia interactive system 100 is to manufacture a single candidate electronic device having only the target path Pt pointed to by the target direction Dt, the multimedia interactive effect of the target image object or the target instruction transmitted by the source electronic device 120-a can be received. , By adopting the predetermined condition setting manner in the foregoing ninth embodiment, the target image object or the target instruction transmitted by the source electronic device 120-a can be prevented from being unexpectedly received by the plurality of candidate electronic devices.

In the tenth embodiment, the foregoing predetermined condition means that the candidate electronic device is located on the target path Pt, and the segment of the target path Pt between the source electronic device 120-a and the candidate electronic device does not contact the electronic device 120. Other electronic devices in -a~120-n.

In the eleventh embodiment, the foregoing predetermined condition means that the distance between the position of the candidate electronic device and the target path Pt is smaller than the first predetermined value R1, and the target path Pt is at the source electronic device 120-a and the candidate electronic device. The segments between them do not touch other electronic devices in the electronic devices 120-a~120-n.

In the twelfth embodiment, the foregoing predetermined condition means that the target path Pt passes through the candidate display on the candidate electronic device, and the segment of the target path Pt between the source electronic device 120-a and the candidate electronic device does not Contacting other electronic devices in the electronic devices 120-a~120-n.

In the thirteenth embodiment, the foregoing predetermined condition means that the candidate electronic device is located on the target vertical plane where the target path Pt is located, and the target vertical plane is not in the region between the source electronic device 120-a and the candidate electronic device. Contacting other electronic devices in the electronic devices 120-a~120-n.

In the fourteenth embodiment, the foregoing predetermined condition means that the distance between the position of the candidate electronic device and the target vertical plane is smaller than the first predetermined value R1, and the target vertical plane is at the source electronic device 120-a and the candidate electronic device. The area between them does not touch other electronic devices in the electronic devices 120-a~120-n.

In the aspect of FIG. 9, the target path Pt pointed by the target direction Dt passes through the centroid Cb of the display 127-b, and represents that the electronic device 120-b is located on the target path Pt, and is also located at the target vertical plane where the target path Pt is located. on. Since the electronic device 120-b is located on the target path Pt and the target vertical plane, the distance between the electronic device 120-b and the target path Pt is zero, and the distance between the electronic device 120-b and the target vertical plane is also zero. . Further, the target path Pt does not contact other electronic devices in the section between the source electronic device 120-a and the electronic device 120-b. This represents to some extent between the source electronic device 120-a and the electronic device 120-b, and is not blocked by other electronic devices.

Therefore, for the aspect of FIG. 9, when the candidate electronic device is the electronic device 120-b, the multimedia interactive module 128-a determines the candidate electronic device 120-b in the foregoing tenth to fourteenth embodiments. The position and the relative position of the target direction Dt in the space meet predetermined conditions.

Compared with FIG. 9, in the foregoing aspect of FIG. 4, the segment of the target path Pt between the source electronic device 120-a and the electronic device 120-b passes through the display 127-n of the electronic device 120-n. Area. This represents to some extent the blocking of the electronic device 120-n between the source electronic device 120-a and the electronic device 120-b.

Therefore, for the aspect of FIG. 4, when the candidate electronic device is the electronic device 120-b, the multimedia interactive module 128-a determines the candidate electronic device 120-b in the foregoing tenth to fourteenth embodiments. The relative position of the position and the target direction Dt in the space does not meet the predetermined condition.

If the position of the candidate electronic device and the relative position of the target direction Dt in space meet any of the predetermined conditions in the aforementioned tenth to fourteenth embodiments, it represents to some extent The candidate electronic device is located within an error tolerance range near the target path Pt pointed by the target direction Dt, and the candidate electronic device and the source electronic device 120-a are not blocked by other electronic devices. Therefore, when the multimedia interactive system 100 is to be manufactured, only if the candidate electronic device and the source electronic device 120-a are not blocked by other electronic devices, the target image object can be transmitted from the source electronic device 120-a to the candidate electronic device. In the multimedia interaction effect, the predetermined condition setting manner in the tenth to fourteenth embodiments can prevent the candidate electronic device from being blocked by other electronic devices between the source electronic device 120-a, and the candidate electronic device can still be used. Unexpected conditions of receiving the target image object occurred.

In the fifteenth embodiment, the predetermined condition is that a first angle is formed between the first direction and the second direction, and the first angle is less than half of the third angle.

In the sixteenth embodiment, the predetermined condition is that the second vertical surface (not shown), where the second direction is located and perpendicular to the ground, cuts the space into a first side space and a second side. Space, the target direction Dt points to the first side space, and the candidate electronic device is located in the first side space.

In the aspect of FIG. 10, when the candidate electronic device is the electronic device 120-b, the multimedia interactive module 128-a selects another electronic device 120-n that is close to the target path Pt as the third electronic device. At this time, the first direction is also the direction D1 of the centroid Cb of the display 127-b, and the first angle is the direction D1 and the target shift direction Dts. The angle between the angles A1. The second direction is based on the centroid Ca of the display 127-a and points to the centroid Cn of the display 127-n. The direction D2, and the third angle is the angle A3 between the direction D1 and the direction D2. If the angle A1 is less than half of the angle A3, the position of the candidate electronic device 120-b is represented to some extent closer to the target path Pt pointed by the target direction Dt than the third electronic device 120-n. In addition, a second vertical plane, where the direction D2 is located and perpendicular to the ground, cuts the space into a first side space SR and a second side space SL. As shown in FIG. 10, the target direction Dt points to the first side space SR, and the electronic device 120-b is located in the first side space SR. Therefore, in the fifteenth and sixteenth embodiments, the multimedia interactive module 128-a determines that the position of the candidate electronic device 120-b and the relative position of the target direction Dt in space meet predetermined conditions.

When the multimedia interactive system 100 is to manufacture a single candidate electronic device having only the target path Pt pointed to by the target direction Dt, the multimedia interactive effect of the target image object or the target instruction transmitted by the source electronic device 120-a can be received. By adopting the predetermined condition setting manner in the fifteenth or sixteenth embodiment, the target image object or the target instruction transmitted by the source electronic device 120-a can be avoided, and the unexpected situation received by the plurality of candidate electronic devices can be avoided. occur.

In the seventeenth embodiment, the predetermined condition is that a source of the source electronic device 120-a is directed to the direction Da, and is perpendicular to the ground, a source vertical plane, with the position of the source electronic device 120-a as the axis. Rotating a first viewing angle VA1 to both sides of the source pointing direction Da defines a target viewing angle area, and the source vertical plane cuts the target viewing area into a first half area and a second half area, and the target direction Dt points The first half of the area, and the candidate electronic device is located within the first half of the area.

In the eighteenth embodiment, the aforementioned predetermined condition means that the source is directed to the direction Da and the mesh. A fourth angle is formed between the target displacement directions Dts, and the first direction and the source pointing direction Da form a fifth angle, and the fourth angle and the fifth angle are smaller than the first angle of view VA1.

In the aspect of FIG. 11, the source is directed to the source vertical plane (not shown) where the direction Da is located, and the position of the source electronic device 120-a (in this example, the position of the centroid Ca of the display 127-a) is Rotating the first viewing angle VA1 from the axis to the source pointing direction Da on both sides defines a target viewing angle region composed of the right half region VR and the left half region VL. The centroid Cb of the display 127-b is located in the right half area VR, and the representative electronic device 120-b is located in the right half area VR. As shown in FIG. 11, the target direction Dt points to the right half area VR. The fourth included angle is an angle A4 between the source pointing direction Da and the target shifting direction Dts. When the angle A4 is smaller than the first angle of view VA1, the representative target direction Dt is directed into the target viewing angle area of the source electronic device 120-a.

For the aspect of FIG. 11, when the candidate electronic device is the electronic device 120-b, the first direction is also the direction from the centroid Ca of the display 127-a and points to the centroid Cb of the display 127-b. D1, and the fifth angle is the angle A5 between the direction D1 and the source pointing direction Da. Since the angle A4 and the angle A5 are both smaller than the first angle of view VA1, the multimedia interaction module 128-a determines in the foregoing seventeenth and eighteenth embodiments that the position of the candidate electronic device 120-b and the target direction Dt are in space. The relative position is in accordance with the predetermined conditions.

As shown in FIG. 11, the centroid Cn of the display 127-n is located outside the target viewing angle area, and the representative electronic device 120-n is located outside the target viewing angle area.

For the aspect of FIG. 11, when the candidate electronic device is the electronic device 120-n, the first One direction is the direction D2 from the centroid Ca of the display 127-a and directed to the centroid Cn of the display 127-n, and the fifth angle is the angle A5' between the direction D2 and the source pointing direction Da. As shown in FIG. 11, the angle A5' is larger than the first angle of view VA1, and the representative electronic device 120-n is located outside the target angle of view. Therefore, the multimedia interaction module 128-a determines the candidate in the seventeenth and eighteenth embodiments. The position of the electronic device 120-n and the relative position of the target direction Dt in the space do not meet the predetermined condition.

When the multimedia interactive system 100 is to be manufactured only if the candidate electronic device is located in the target viewing area of the source electronic device 120-a, the candidate electronic device can receive the target image object or target command transmitted by the source electronic device 120-a. In the multimedia interaction effect, by using the predetermined condition setting manner in the seventeenth or eighteenth embodiment, the target image object or the target command transmitted by the source electronic device 120-a can be prevented from being located at the source electronic device 120-a. Unexpected situations received by other electronic devices outside the target viewing angle area occur.

In the nineteenth embodiment, the predetermined condition is that a first opposite direction forms a sixth angle with a candidate pointing direction of the candidate electronic device, and the fourth angle and the fifth angle are smaller than the first angle. VA1, and the sixth angle is smaller than a second angle of view VA2, wherein the first reverse direction starts from a position of the candidate electronic device and points to a position of the source electronic device 120-a.

In the twentieth embodiment, the predetermined condition is that a candidate vertical plane of the candidate electronic device is located in a direction perpendicular to the ground, and the position of the candidate electronic device is taken as an axis to the two sides of the candidate pointing direction. Rotating the second viewing angle VA2 defines a candidate viewing angle region, and the source electronic device 120-a is located in the candidate viewing angle region. The target direction Dt points to the aforementioned first half side area, and the candidate electronic device is located in the aforementioned first half side area.

When the fifth angle is smaller than the first angle of view VA1, the representative candidate electronic device is located within the target viewing angle region of the source electronic device 120-a. When the sixth angle is smaller than the second angle of view VA2, the representative source electronic device 120-a is located within the candidate viewing area of the candidate electronic device.

In the aspect of FIG. 12, the source is directed to the source vertical plane (not shown) where the direction Da is located, and the position of the source electronic device 120-a (in this example, the position of the centroid Ca of the display 127-a) is The axis rotates the first viewing angle VA1 to both sides of the source pointing direction Da, and also defines a target viewing angle region composed of the right half region VR and the left half region VL. The centroid Cb of the display 127-b is located in the right half area VR, and the representative electronic device 120-b is located in the right half area VR. As shown in FIG. 12, the target direction Dt points to the right half area VR. The fourth included angle is an angle A4 between the source pointing direction Da and the target shifting direction Dts. When the angle A4 is smaller than the first angle of view VA1, the representative target direction Dt is directed into the target viewing angle area of the source electronic device 120-a. When the candidate electronic device is the electronic device 120-b, the first direction is also the direction D1 of the centroid Cb of the display 127-b starting from the centroid Ca of the display 127-a. The fifth angle is the angle A5 between the direction D1 and the source pointing direction Da. The multimedia interaction module 128-a can translate the first direction D1 to a position starting from the position of the candidate electronic device 120-b (in this example, the position of the centroid Cb) and flipping the direction D1 by 180 degrees to define The first reverse direction D1'. The sixth angle is an angle A6 between the first reverse direction D1' and the candidate pointing direction Db of the electronic device 120-b. Candidates of the candidate electronic device 120-b in the direction of the candidate pointing direction Db Straight face (not shown), with the position of the candidate electronic device 120-b (in this example, the position of the centroid Cb of the display 127-b) as an axis, and the second viewing angle VA2 is rotated to both sides of the candidate pointing direction Db, A candidate perspective area is defined. As shown in FIG. 12, since the angle A5 is smaller than the first angle of view VA1, and the angle A6 is smaller than the second angle of view VA2, the multimedia interaction module 128-a determines the candidate electronic device in the foregoing nineteenth and twentieth embodiments. The position of the 120-b and the relative position of the target direction Dt in the space meet predetermined conditions. In the nineteenth embodiment, the fifth angle is limited to be smaller than the first angle of view VA1, and the sixth angle is limited to be smaller than the second angle of view VA2, for limiting the source electronic device 120-a and the candidate electrons. The relative position of both devices 120-b in space must be in or near face to face, and source electronic device 120-a can communicate the target command to candidate electronic device 120-b to avoid strange user experience.

In practice, the aforementioned first viewing angle VA1 may be the same as the second viewing angle VA2 or different from the second viewing angle VA2.

When the multimedia interactive system 100 is to be manufactured, only if the relative position of the source electronic device 120-a and the candidate electronic device in the space belongs to or is close to the face-to-face aspect, the candidate electronic device can receive the source electronic device 120-a. When the multimedia image interaction effect of the target image object or the target command is transmitted, the predetermined condition setting method in the above-mentioned nineteenth or twentieth embodiment can avoid the candidate electronic device facing away from the source electronic device 120-a, but still can Unexpected conditions of receiving the target image object or target command from the source electronic device 120-a occur. On the other hand, by adopting the predetermined condition setting method in the aforementioned nineteenth or twentieth embodiment, the source power can also be avoided. The sub-device 120-a faces away from the candidate electronic device, but the candidate electronic device can still receive an unexpected situation of the target image object or the target command from the source electronic device 120-a.

In practice, the multimedia interactive system 100 can also determine whether the relative position of the candidate electronic device and the target direction Dt in the space meets the predetermined condition referred to in the foregoing process 308 according to the two-dimensional position of the candidate electronic device. The multimedia interaction system 100 can utilize the position detection circuit 110 to detect individual projection positions, shapes, and directivity of the individual electronic devices 120-a-120-n on the same reference level plane parallel to the ground. The multimedia interactive system 100 can utilize the particular geometric features of the electronic device 120, particular markers, particular elements, or projected locations of particular regions on a reference horizontal plane to represent the location of the electronic device 120 in space.

For example, the position detecting circuit 110 can detect and utilize the projection position of the centroid of the electronic device 120 on the reference horizontal plane to represent the position of the electronic device 120 in the space. Alternatively, the position detecting circuit 110 can detect and utilize the projection position of the centroid of the display 127 on the reference horizontal plane to represent the position of the electronic device 120 in space.

Similarly, the position detecting circuit 110 and the individual electronic devices 120-a~120-n can be used together to calculate the position of the individual electronic devices 120-a~120-n in space. For example, in the embodiment of FIG. 2, the position detecting circuit 110 can detect and transmit the two-dimensional coordinate of the projection position of the plurality of reference points in the electronic device 120 on the reference horizontal plane to the electronic device 120, and the electronic device The control circuit 121 calculates the centroid of the electronic device 120 or the projection position of the centroid of the display 127 on the reference horizontal surface according to the coordinates of the received plurality of reference points to represent the electronic The location of device 120 in space.

Since the gyroscope is usually installed inside the electronic device 120, the control circuit 121 of the electronic device 120 can obtain the tilt angle of the electronic device 120 by using the gyroscope. Moreover, the length and width of the electronic device 120, the length and width of the display 127, and the location of the display 127 in the electronic device 120 are all given values. Therefore, the electronic device 120 can use the control circuit 121 to calculate the centroid of the electronic device 120 or the projection position of the centroid of the display 127 on the reference horizontal surface according to the coordinates of the projection position of the reference point to represent the electronic device 120. The location in space.

Alternatively, the electronic device 120 can also use the control circuit 121 to calculate a specific geometric feature (eg, a center point) of a multimedia interactive program window (eg, a browser window) displayed on the display 127 according to the received spatial coordinates of the plurality of reference points. The projection position on the reference horizontal plane represents the position of the electronic device 120 in space. For example, in the embodiment of FIG. 2, electronic device 120-a utilizes display 127-a to display target browser window 216, and electronic device 120-b utilizes display 127-b to display target browser window 226. Since the size of the target browser window 216 displayed on the display 127-a and the relative position in the display 127-a are both set by the control circuit 121-a, they are all known parameters. Therefore, the position detecting circuit 110 can detect and transmit the two-dimensional coordinates of the projection positions of the reference points 211 to 214 in the electronic device 120-a on the reference horizontal plane to the electronic device 120-a, and the electronic device 120-a The control circuit 121-a can calculate the two-dimensional coordinates of the projection position of the center point Wa of the target browser window 216 on the reference horizontal plane according to the coordinates of part or all of the reference points, to represent the electronic device 120-a in the space. s position. Similarly, because of the display 127-b The size of the target browser window 226 displayed above and the relative position in the display 127-b are all set by the control circuit 121-b and are therefore known parameters. Therefore, the position detecting circuit 110 can detect and transmit the spatial coordinates of the reference points 221 to 224 in the electronic device 120-b to the electronic device 120-b, and the electronic device 120-b can utilize the control circuit 121-b according to the reference. Calculating the two-dimensional coordinates of the projection position of the center point Wb of the target browser window 226 on the reference horizontal plane, representing the spatial coordinates of some or all of the reference points in the points 221 to 224, to represent the electronic device 120-b in space. position.

The following is a description of the source electronic device 120-a according to FIG. 13 to FIG. 21 to determine whether the relative position of the candidate electronic device and the target direction Dt in the space meets the predetermined condition in the foregoing process 308 according to the two-dimensional position of the candidate electronic device. Mode of operation.

13 to 21 are projections of a portion of the electronic devices in the multimedia interactive system 100 on the same reference level when the user of the source electronic device 120-a indicates that the source electronic device 120-a transmits the target image object 400 toward the target direction Dt. A simplified schematic of the different aspects of the relative position. In FIGS. 13 to 21, the projection area of the electronic device 120-a on the reference horizontal plane is 120-ap, the projection of the display 127-a on the reference horizontal plane is the projection area 127-ap, and the centroid Ca of the display 127-a is The projection position on the reference horizontal plane is Cap. The projection of the electronic device 120-b on the reference horizontal plane is the projection area 120-bp, the projection of the display 127-b on the reference horizontal plane is the projection area 127-bp, and the projection position of the centroid Cb of the display 127-b on the reference horizontal plane. Is Cbp. The projection of the electronic device 120-n on the reference horizontal plane is the projection area 120-np, the projection of the display 127-n on the reference horizontal plane is the projection area 127-np, and the centroid Cn of the display 127-n The projection position on the reference horizontal plane is Cnp. The projection of the target direction Dt on the reference horizontal plane is the target projection direction Dtp. The projection of the target image object 400 on the reference horizontal plane is the target projection object 1300.

For convenience of explanation, it is assumed below that the multimedia interactive system 100 utilizes the projection position of the centroid of the display 127 on the reference horizontal plane to represent the projected position of the electronic device 120 on the reference horizontal plane.

In the twenty-first embodiment, the predetermined condition in the foregoing flow 308 refers to a projection position of the candidate electronic device on a reference horizontal plane parallel to the ground (hereinafter referred to as a candidate projection position), and the target direction Dt is at a reference horizontal plane. A target projection direction Dtp is directed to a target projection path Ptp.

In the twenty-second embodiment, the aforementioned predetermined condition means that the distance between the aforementioned candidate projection position and the target projection path Ptp is smaller than the first predetermined value R1.

In the twenty-third embodiment, the aforementioned predetermined condition means that the target projection path Ptp passes through a display projection area of the candidate display of the candidate electronic device on the reference horizontal plane.

In the aspect of FIG. 13, the target direction Dt is the target projection path Ptp pointed by the target projection direction Dtp on the reference horizontal plane, and the projection position Cbp passing through the centroid Cb of the display 127-b on the reference horizontal plane represents the electronic device. The projection position of 120-b on the reference horizontal plane is located on the target projection path Ptp. Since the projection position of the electronic device 120-b is located on the target projection path Ptp, the distance between the projection position of the electronic device 120-b and the target projection path Ptp is zero. As shown in FIG. 13, the target projection path Ptp passes through the projection area 127-np of the display 127-n, but does not pass through the display 127-n. The projection position Cnp of the centroid Cn on the reference horizontal plane represents that the projection position of the electronic device 120-n is not located on the target projection path Ptp.

Therefore, for the aspect of FIG. 13, when the candidate electronic device is the electronic device 120-b, the multimedia interactive module 128-a determines the electronic device 120 in the foregoing twenty-first to twenty-third embodiments. The position of the -b and the relative position of the target direction Dt in the space meet predetermined conditions. When the candidate electronic device is the electronic device 120-n, the multimedia interactive module 128-a determines in the foregoing twenty-third embodiment that the position of the electronic device 120-n and the relative position of the target direction Dt in the space meet the predetermined schedule. Condition, but in the aforementioned twenty-first embodiment, it is determined that the position of the candidate electronic device 120-n and the relative position of the target direction Dt in space do not satisfy the predetermined condition.

In the aspect of FIG. 14, the target projection path Ptp pointed by the target projection direction Dtp passes through the projection area 127-bp of the display 127-b, but does not pass through the projection position Cbp of the centroid Cb of the display 127-b, representing the electron The projected position of the device 120-b is not located on the target projection path Ptp. The distance between the projection position Cbp of the centroid Cb and the target projection path Ptp is G1p, and the distance between the projection position of the electronic device 120-b and the target projection path Ptp is G1p. Further, the target projection path Ptp passes through the projection area 127-np of the display 127-n, but does not pass through the projection position Cnp of the centroid Cn of the display 127-n, and the projection position of the representative electronic device 120-n is not located at the target projection path Ptp. on. As shown in FIG. 14, the distance G1p between the projection position Cbp of the centroid Cb of the display 127-b and the target projection path Ptp is smaller than the first predetermined value R1, but the projection position Cnp of the centroid Cn of the display 127-n and the target The distance between the projection paths Ptp is significantly larger than the first predetermined value R1.

Therefore, for the aspect of FIG. 14, when the candidate electronic device is the electronic device 120-b, the multimedia interactive module 128-a determines the electronic device 120 in the foregoing twenty-second and twenty-third embodiments. The position of the -b and the relative position of the target direction Dt in the space satisfy a predetermined condition, but in the aforementioned twenty-first embodiment, the position of the candidate electronic device 120-b and the relative position of the target direction Dt in the space are determined. Not meeting the predetermined conditions. When the candidate electronic device is the electronic device 120-n, the multimedia interactive module 128-a determines that the position and the target direction Dt of the candidate electronic device 120-n are in the space in the foregoing twenty-first and twenty-second embodiments. The relative position in the second does not satisfy the predetermined condition, but in the aforementioned twenty-third embodiment, it is determined that the position of the candidate electronic device 120-n and the relative position of the target direction Dt in the space satisfy the predetermined condition.

In the twenty-fourth embodiment, the foregoing predetermined condition means that the target projection direction Dtp points to the target projection path Ptp and a strip-shaped region S1p, and the aforementioned candidate projection position is located in the strip-shaped region S1p, wherein the strip-shaped region S1p is The target projection path Ptp is a center line and has a width twice the first predetermined value R1.

In the aspect of FIG. 14, the projection position Cbp of the centroid Cb of the display 127-b is located in the strip-shaped region S1p to which the target projection direction Dtp is directed, and the projection position of the representative electronic device 120-b is located in the strip-shaped region S1p. The projection position Cnp of the centroid Cn of the display 127-n is located outside the strip region S1p, and the projection position of the electronic device 120-n is not located in the strip region S1p.

Therefore, for the aspect of FIG. 14, when the candidate electronic device is the electronic device 120-b, the multimedia interactive module 128-a determines the position of the candidate electronic device 120-b in the aforementioned twenty-fourth embodiment. Corresponds to the relative position of the target direction Dt in space Predetermined conditions. When the candidate electronic device is the electronic device 120-n, the multimedia interactive module 128-a determines in the foregoing twenty-fourth embodiment that the position of the candidate electronic device 120-n and the relative position of the target direction Dt in the space are not Meet the predetermined conditions.

In the twenty-fifth embodiment, the foregoing predetermined condition means that the target projection direction Dtp points to a triangular area S2p, and the aforementioned candidate projection position is located in the triangular area S2p, wherein the triangular area S2p is centered on the target projection path Ptp, The projection position of the target image object 400 on the reference horizontal plane (that is, the position of the projection object 1300) is a vertex, and the vertex angle is an acute angle.

In the aspect of Fig. 15, the projection position Cbp of the centroid Cb of the display 127-b is located in the triangular area S2p, and the projection position of the representative electronic device 120-b is located in the triangular area S2p. The projection position Cnp of the centroid Cn of the display 127-n is located outside the triangular area S2p, and the projection position of the representative electronic device 120-n is not located in the triangular area S2p.

Therefore, for the aspect of FIG. 15, when the candidate electronic device is the electronic device 120-b, the multimedia interactive module 128-a determines the location of the candidate electronic device 120-b in the foregoing twenty-fifth embodiment. The relative position in the space with the target direction Dt meets a predetermined condition. When the candidate electronic device is the electronic device 120-n, the multimedia interactive module 128-a determines in the foregoing twenty-fifth embodiment that the position of the candidate electronic device 120-n and the relative position of the target direction Dt in the space are not Meet the predetermined conditions.

In the twenty-sixth embodiment, the predetermined condition is that an eleventh angle between the target projection direction Dtp and a first projection direction is an acute angle and less than a critical angle Ath, wherein the first projection direction At the reference level with the source electronic device 120-a The projection position on the face (hereinafter referred to as the source projection position) Cap is the starting point, and the first projection direction is directed to the aforementioned candidate projection position.

In the aspect of FIG. 16, when the candidate electronic device is the electronic device 120-b, the first projection direction is based on the projection position Cap of the centroid Ca of the display 127-a, and points to the centroid of the display 127-b. The projection position of Cb is the projection direction D1p of Cbp, and the eleventh angle is the angle A1p between the projection direction D1p and the target projection direction Dtp. The smaller the angle A1p is, to some extent, the closer the projection position of the candidate electronic device 120-b is to the target projection path Ptp pointed by the target projection direction Dtp. Therefore, if the included angle A1p is an acute angle and is smaller than the critical angle Ath, the multimedia interactive module 128-a determines the relative position of the electronic device 120-b and the target direction Dt in space in the foregoing twenty-sixth embodiment. The location meets the predetermined conditions. On the other hand, if the angle A1p is greater than the critical angle Ath, the multimedia interaction module 128-a determines in the foregoing twenty-sixth embodiment that the position of the candidate electronic device 120-b and the relative position of the target direction Dt in the space do not match. Predetermined conditions.

In the aspect of FIG. 16, when the candidate electronic device is the electronic device 120-n, the first projection direction is based on the projection position Cap of the centroid Ca of the display 127-a, and is directed to the centroid of the display 127-n. The projection position Cn of Cn is the projection direction D2p, and the eleventh angle is the angle A2p between the projection direction D2p and the target projection direction Dtp. The smaller the angle A2p is, to some extent, the closer the projection position of the candidate electronic device 120-n is to the target projection path Ptp pointed by the target projection direction Dtp. Therefore, if the included angle A2p is an acute angle and is smaller than the critical angle Ath, the multimedia interactive module 128-a determines the position and target direction of the electronic device 120-n in the foregoing twenty-sixth embodiment. The relative position of Dt in space meets predetermined conditions. On the other hand, if the angle A2p is greater than the critical angle Ath, the multimedia interaction module 128-a determines in the foregoing twenty-sixth embodiment that the position of the candidate electronic device 120-n and the relative position of the target direction Dt in the space do not match. Predetermined conditions.

If the position of the candidate electronic device and the relative position of the target direction Dt in space meet any of the predetermined conditions of the foregoing twenty-first to twenty-sixth embodiments, the representative electronic device is located to the target direction Dt to some extent. An error tolerance range near the target path Pt pointed to. Therefore, when the multimedia interactive system 100 is to manufacture the target image object is a multimedia interactive effect transmitted from the source electronic device 120-a to the candidate electronic device, the predetermined condition setting manner in the foregoing twenty-first to twenty-sixth embodiments is adopted. The distance between the candidate electronic device and the target path Pt pointed by the target direction Dt is prevented from being too far, but the unexpected situation of the target image object can still be received.

In addition, when the multimedia interactive application performed by the multimedia interactive system 100 requires a lower accuracy of the determination of the relative position of the candidate electronic device and the target direction Dt in space, the aforementioned first predetermined value R1 or critical angle Ath may be relaxed. . On the other hand, when the multimedia interactive application requires high accuracy for determining the relative position of the candidate electronic device and the target direction Dt in space, the aforementioned first predetermined value R1 or critical angle Ath may be lowered, or the twentieth tenth may be adopted. The predetermined condition setting mode of an embodiment.

In the twenty-seventh embodiment, the predetermined condition is that a twelfth angle between the target projection direction Dtp and a second projection direction is an acute angle, and the eleventh angle is less than the twelfth angle. Where the second projection direction is the source projection position The Cap is a starting point and points to a projection position of the third electronic device of the electronic device 120-a~120-n on the reference horizontal plane (hereinafter referred to as a third projection position).

In the aspect of FIG. 17, when the candidate electronic device is the electronic device 120-b, the multimedia interaction module 128-a selects another electronic device 120-n whose projection position is close to the target projection path Ptp as the third electronic device. . At this time, the first projection direction is also the projection direction Cap of the centroid Ca, and the projection direction D1p of the projection position Cbp of the centroid Cb, and the eleventh angle is also the projection direction D1p and the target projection direction Dtp. The angle between the angles A1p. The second projection direction is the projection direction D2p of the projection position Cn of the centroid Cn of the display 127-n starting from the projection position Cap of the centroid Ca of the display 127-a, and the twelfth angle is the projection direction D2p. An angle A2p between the target projection direction Dtp. The smaller the angle A2p is, to some extent, the closer the projection position of the third electronic device 120-n is to the target projection path Ptp. In the aspect of FIG. 17, since the included angle A1p is an acute angle and smaller than the included angle A2p, the projected position of the candidate electronic device 120-b is somewhat closer to the target projection than the projected position of the third electronic device 120-n. Path Ptp. Therefore, in the foregoing twenty-seventh embodiment, the multimedia interactive module 128-a determines that the position of the candidate electronic device 120-b and the relative position of the target direction Dt in the space meet the predetermined condition.

In the aspect of FIG. 17, when the candidate electronic device is the electronic device 120-n, the multimedia interaction module 128-a selects another electronic device 120-b whose projection position is close to the target projection path Ptp as the third electronic device. . At this time, the first projection direction is the projection direction D2p of the projection position Cn of the centroid Cn starting from the projection position Cap of the centroid Ca, and the eleventh angle is the projection direction D2p and the target projection direction Dtp. The angle between the two is A2p. The second projection direction is the projection direction D1p of the projection position Cbp of the centroid C from the projection position Cap of the centroid Ca, and the twelfth angle is the angle A1p between the projection direction D1p and the target projection direction Dtp. . In the aspect of FIG. 17, since the included angle A2p is larger than the included angle A1p, the position of the third electronic device 120-b is somewhat closer to the target projected path Ptp than the candidate electronic device 120-n. Therefore, in the foregoing twenty-seventh embodiment, the multimedia interactive module 128-a determines that the position of the candidate electronic device 120-n and the relative position of the target direction Dt in the space do not meet the predetermined condition.

When the multimedia interactive system 100 is to manufacture a single candidate electronic device having a projection position closest to the target projection path Ptp, in order to receive the multimedia interactive effect of the target image object or the target command transmitted by the source electronic device 120-a, the foregoing The predetermined condition setting manner in the twenty-seventh embodiment can prevent the target image object or the target instruction transmitted by the source electronic device 120-a from being unexpectedly received by the plurality of candidate electronic devices.

In the twenty-eighth embodiment, the predetermined condition is that the projection of the source electronic device 120-a on the reference horizontal plane is a source projection area 120-ap, and the projection of the candidate electronic device on the reference horizontal plane is one. a candidate projection area, where the candidate projection position is located on the target projection path Ptp, and the segment between the source projection area and the candidate projection area of the target projection path Ptp does not contact the electronic device 120-a~120-n. Projection of other electronic devices on the reference level.

In the twenty-ninth embodiment, the foregoing predetermined condition means that the distance between the candidate projection position and the target projection path Ptp is smaller than the first predetermined value R1, and the target is cast. The segment of the shadow path Ptp between the source projection area 120-ap and the candidate projection area does not touch the projection of other electronic devices in the electronic devices 120-a~120-n on the reference horizontal plane.

In the thirtieth embodiment, the foregoing predetermined condition means that the target projection path Ptp passes through a display projection area of the candidate display of the candidate electronic device on the reference horizontal plane, and the target projection path Ptp is in the source projection area 120-ap The segment between the candidate projection area does not touch the projection of other electronic devices in the electronic devices 120-a~120-n on the reference horizontal plane.

In the aspect of FIG. 18, the projection of the electronic device 120-b on the reference horizontal plane is a projection area of 120-bp. The target projection path Ptp passes through the projection position Cbp of the centroid Cb of the display 127-b, and the projection position Cbp of the electronic device 120-b is located on the target projection path Ptp, so the projection position Cbp of the electronic device 120-b and the target projection path The distance between Ptp is zero. In addition, the segment of the target projection path Ptp between the source projection area 120-ap and the projection area 120-bp of the electronic device 120-b is also not in contact with the projection of other electronic devices. This represents to some extent that the source electronic device 120-a and the electronic device 120-b are not blocked by other electronic devices.

Therefore, for the aspect of FIG. 18, when the candidate electronic device is the electronic device 120-b, the multimedia interactive module 128-a determines the candidate electronic device 120 in the foregoing twenty-eighth to thirtieth embodiments. The position of the -b and the relative position of the target direction Dt in the space meet predetermined conditions.

Compared with FIG. 18, in the foregoing aspect of FIG. 13, the target projection path Ptp is between the source projection area 120-ap and the projection area 120-bp of the electronic device 120-b, The projection area 127-np of the display 127-n passing through the electronic device 120-n. This represents to some extent the blocking of the electronic device 120-n between the source electronic device 120-a and the electronic device 120-b.

Therefore, for the aspect of FIG. 13, when the candidate electronic device is the electronic device 120-b, the multimedia interactive module 128-a determines the candidate electronic device 120 in the foregoing twenty-eighth to thirtieth embodiments. The position of the -b and the relative position of the target direction Dt in the space do not meet the predetermined condition.

If the position of the candidate electronic device and the relative position of the target direction Dt in space meet any of the predetermined conditions in the foregoing twenty-eighth to thirtieth embodiments, the projection position of the candidate electronic device is represented to some extent, at the target An error tolerance range near the target projection path Ptp pointed by the projection direction Dtp, and the candidate electronic device and the source electronic device 120-a are not blocked by other electronic devices. Therefore, when the multimedia interactive system 100 is to be manufactured, only if the candidate electronic device and the source electronic device 120-a are not blocked by other electronic devices, the target image object can be transmitted from the source electronic device 120-a to the candidate electronic device. In the multimedia interaction effect, the predetermined condition setting method in the foregoing twenty-eighthth to thirtieth embodiments can avoid that the candidate electronic device and the source electronic device 120-a are blocked by other electronic devices, but the candidate electronic device can be blocked. Unexpected situations in which the target image object can still be received.

In the thirty-first embodiment, the predetermined condition is that a thirteenth angle is formed between the first projection direction and the second projection direction, and the eleventh angle is less than half of the thirteenth angle.

In the thirty-second embodiment, the foregoing predetermined condition is that the second reference line in which the second projection direction is located cuts the reference horizontal plane into a first side area and a second side area, and the target projection direction Dtp Pointing to the first side region, and the projected position of the candidate electronic device is located within the first side region.

In the aspect of FIG. 19, when the candidate electronic device is the electronic device 120-b, the multimedia interaction module 128-a selects another electronic device 120-n whose projection position is close to the target projection path Ptp as the third electronic device. . At this time, the first projection direction is also the projection direction Cap of the centroid Ca, and the projection direction D1p of the projection position Cbp of the centroid Cb, and the eleventh angle is also the projection direction D1p and the target projection direction Dtp. The angle between the angles A1p. The second projection direction is the projection direction D2p of the projection position Cnp of the centroid Cn starting from the projection position Cap of the centroid Ca, and the thirteenth angle is the angle A3p between the projection direction D1p and the projection direction D2p. If the angle A1p is less than half of the angle A3p, the projection position Cbp of the candidate electronic device 120-b is somewhat closer to the target projection path Ptp than the projection position Cnp of the third electronic device 120-n. Further, the second reference straight line is the reference straight line L2p where the projection direction D2p is located. The reference horizontal plane cuts the reference horizontal plane into a first side area SRp and a second side area SLp. As shown in FIG. 19, the target projection direction Dtp is directed to the first side region SRp, and the projection position of the electronic device 120-b is located within the first side region SRp. Therefore, in the foregoing thirty-first and thirty-second embodiments, the multimedia interactive module 128-a determines that the relative position of the position of the candidate electronic device 120-b and the target direction Dt in space meets a predetermined condition.

When the multimedia interactive system 100 is to be manufactured, only the projection position is closest to the target projection direction. When a single candidate electronic device of the target projection path Ptp pointed by Dtp can receive the multimedia interactive effect of the target image object or the target instruction transmitted by the source electronic device 120-a, the foregoing thirty-first or thirty-second is adopted. In the predetermined condition setting manner in the embodiment, the target image object or the target instruction transmitted by the source electronic device 120-a can be avoided, and an unexpected situation received by the plurality of candidate electronic devices occurs.

In the thirty-third embodiment, the foregoing predetermined condition means that the source of the source electronic device 120-a is directed to the projection direction of the direction Da on the reference horizontal plane (hereinafter referred to as the source pointing projection direction) Dap, and the source projection position. The Cap is directed to the source to the projection direction Dap. The rotation of the first viewing angle VA1 on both sides defines a target viewing angle region. The source points to the projection direction Dap to cut the target viewing region into a first half region and a second half region. The projection direction Dtp points to the first half side region, and the aforementioned candidate projection position is located in the first half side region.

In the thirty-fourth embodiment, the predetermined condition is that the source is directed to form a fourteenth angle between the projection direction Dap and the target projection direction Dtp, and the first projection direction and the source pointing projection direction Dap form a first The fifteenth angle, and the fourteenth angle and the fifteenth angle are smaller than the first angle of view VA1.

In the aspect of FIG. 20, the source is directed to the projection direction Dap with the projection position of the source electronic device 120-a (in this example, the projection position Cap of the centroid Ca of the display 127-a) as the axis to the source pointing to the projection direction Dap. Rotating the first viewing angle VA1 on both sides defines a target viewing angle region composed of the right half region VRp and the left half region VLp. The projection position Cbp of the centroid Cb of the display 127-b is located in the right half area VRp, and the projection position of the representative electronic device 120-b is located in the right half area VRp. As shown in Figure 20, The target projection direction Dtp points to the right half area VRp. The fourteenth angle is the angle A4p between the source pointing projection direction Dap and the target projection direction Dtp. When the angle A4p is smaller than the first angle of view VA1, the target projection direction Dtp is directed to the target viewing angle area of the source electronic device 120-a.

For the aspect of FIG. 20, when the candidate electronic device is the electronic device 120-b, the first projection direction is also the projection direction of the projection position Cap of the centroid Ca and the projection position of the projection position Cbp of the centroid Cb. D1p, and the fifteenth angle is the angle A5p between the projection direction D1p and the source pointing projection direction Dap. Since the angle A4p and the angle A5p are both smaller than the first angle of view VA1, the multimedia interaction module 128-a determines the position and target direction of the candidate electronic device 120-b in the aforementioned thirty-third and thirty-fourth embodiments. The relative position in space meets the predetermined conditions.

As shown in FIG. 20, the projection position Cnp of the centroid Cn of the display 127-n is outside the target viewing angle area, and the projection position of the representative electronic device 120-n is outside the target viewing angle area.

For the aspect of FIG. 20, when the candidate electronic device is the electronic device 120-n, the first projection direction is the projection direction D2p of the projection position Cnp of the centroid Cn starting from the projection position Cap of the centroid Ca. And the fifteenth angle is the angle A5p' between the projection direction D2p and the source pointing projection direction Dap. Since the included angle A5p' is larger than the first viewing angle VA1, and the projection position of the electronic device 120-n is outside the target viewing angle region, the multimedia interactive module 128-a is determined in the foregoing thirty-third and thirty-fourth embodiments. The position of the candidate electronic device 120-n and the relative position of the target direction Dt in space do not meet predetermined conditions.

When the multimedia interactive system 100 is to be manufactured only at the projection position of the candidate electronic device In the case of the target viewing area of the source electronic device 120-a, when the candidate electronic device can receive the multimedia interactive effect of the target image object or the target command transmitted by the source electronic device 120-a, the aforementioned thirty-third sum is adopted. In the predetermined condition setting manner in the thirty-fourth embodiment, the target image object or the target instruction transmitted by the source electronic device 120-a can be avoided, and the projected position is located outside the target viewing angle region of the source electronic device 120-a. Unexpected conditions received by the electronic device occur.

In the thirty-fifth embodiment, the predetermined condition is that a first back projection direction and a candidate pointing direction of the candidate electronic device form a projection direction on the reference horizontal plane (hereinafter referred to as a candidate pointing projection direction). The sixteenth angle, the aforementioned fourteenth angle and the fifteenth angle are smaller than the first angle of view VA1, and the sixteenth angle is smaller than the second angle of view VA2, wherein the first back projection direction is the candidate projection position The starting point and pointing to the aforementioned source projection position Cap.

In the thirty-sixth embodiment, the foregoing predetermined condition is that the candidate pointing projection direction is the axis of the candidate projection position, and rotating the second angle of view VA2 on both sides of the candidate pointing projection direction defines a candidate viewing angle region. The foregoing source projection position Cap is located in the candidate viewing angle region, the target projection direction Dtp is directed to the first half-side region, and the aforementioned candidate projection position is located in the first half-side region.

When the fifteenth angle is smaller than the first angle of view VA1, the representative candidate electronic device is located within the target viewing angle region of the source electronic device 120-a. When the sixteenth angle is smaller than the second angle of view VA2, the representative source electronic device 120-a is located within the candidate viewing area of the candidate electronic device.

In the aspect of FIG. 21, the source is directed to the projection direction Dap by the source electronic device 120-a. The projection position (in this example, the projection position Cap of the centroid Ca of the display 127-a) is the rotation of the first viewing angle VA1 from the axis to the source toward the projection direction Dap, and also defines the right half region VRp and left. The target viewing angle area composed of the half-side area VLp. The projection position Cbp of the centroid Cb of the display 127-b is located in the right half area VRp, and the projection position of the representative electronic device 120-b is located in the right half area VRp. As shown in FIG. 21, the target projection direction Dtp points to the right half area VRp. The fourteenth angle is the angle A4p between the source pointing projection direction Dap and the target projection direction Dtp. When the angle A4p is smaller than the first angle of view VA1, the target projection direction Dtp is directed to the target viewing angle area of the source electronic device 120-a. When the candidate electronic device is the electronic device 120-b, the first projection direction is also the projection direction D1p of the projection position Cbp of the centroid Cb starting from the projection position Cap of the centroid Ca. The fifteenth angle is the angle A5p between the projection direction D1p and the source pointing projection direction Dap. The multimedia interaction module 128-a can translate the projection direction D1p to the starting position of the projection position of the candidate electronic device 120-b (in this example, the projection position Cbp of the centroid Cb), and flip the projection direction D1p by 180 degrees. To define the first back projection direction D1p'. The sixteenth angle is the angle A6p between the first back projection direction D1p' and the candidate pointing projection direction Dbp of the candidate electronic device 120-b. The candidate of the candidate electronic device 120-b points to the projection direction Dbp, and the candidate projection position Cbp is taken as the axis, and the second viewing angle VA2 is rotated to the candidate pointing direction Dbp on both sides, and a candidate viewing angle region is defined. As shown in FIG. 21, since the angle A5p is smaller than the first angle of view VA1, and the angle A6p is smaller than the second angle of view VA2, the multimedia interaction module 128-a determines the candidate in the foregoing thirty-fifth and thirty-sixth embodiments. The position of the electronic device 120-b and the relative position of the target direction Dt in the space are in accordance with the predetermined condition.

In the thirty-fifth embodiment, the fifteenth angle is limited to be smaller than the first angle of view VA1, and the sixteenth angle is limited to be smaller than the second angle of view VA2, which is used to limit the source electronic device 120-a. And the projection of the candidate electronic device 120-b on the reference horizontal plane must belong to or be close to the face-to-face aspect, and the source electronic device 120-a can transmit the target instruction to the candidate electronic device 120-b to avoid strange use. Experience.

In practice, the aforementioned first viewing angle VA1 may be the same as the second viewing angle VA2 or different from the second viewing angle VA2.

When the multimedia interactive system 100 is to manufacture only if the relative position of both the source electronic device 120-a and the candidate electronic device belongs to or is close to the face-to-face aspect, the candidate electronic device can receive the target transmitted by the source electronic device 120-a. When the multimedia object interaction effect of the image object or the target instruction is adopted, the predetermined condition setting manner in the foregoing thirty-fifth or thirty-sixth embodiment can avoid the candidate electronic device from being turned away from the source electronic device 120-a, but can still receive Unexpected conditions of the target image object or target command from the source electronic device 120-a occur. On the other hand, using the predetermined condition setting method in the foregoing thirty-fifth or thirty-sixth embodiment, the source electronic device 120-a can be prevented from being turned away from the candidate electronic device, and the candidate electronic device can still receive the source electronic device. Unexpected conditions of the target image object or target command from 120-a occurred.

It can be seen from the foregoing description that only in the case where the three-dimensional or two-dimensional position of the candidate electronic device meets a specific condition, that is, the target direction and the phase of the candidate electronic device in space When the location meets the predetermined condition, the source electronic device 120-a transmits the target instruction corresponding to the target image object to the selected candidate electronic device, so that the candidate electronic device performs the target with the corresponding candidate display according to the target instruction. The multimedia operation corresponding to the image object. If the target direction and the relative position of the candidate electronic device in the space do not meet the predetermined condition, the source electronic device 120-a will not transmit the target command to the candidate electronic device, and thus the candidate electronic device will not execute the target command. Obviously, using the multimedia interaction method in FIG. 3, the non-conformity of the source electronic device 120-a and other electronic devices may be effectively reduced, and the interactive application may not appear in the design of the multimedia interactive application. Set rules, or unintended multimedia interaction results.

In addition, by using the source electronic device 120-a to determine whether the position and directivity of other electronic devices meet the predetermined conditions, the amount of calculation required by other electronic devices can be effectively reduced, thereby prolonging the battery life of other electronic devices.

Another mode of operation of the multimedia interactive system 100 will be further described below in conjunction with FIG.

22 is a simplified flowchart 2200 of another embodiment of a multimedia interaction method for use in the multimedia interactive system 100 of the present invention.

When the multimedia interaction method in the flowchart 2200 is performed, the control circuit 121 in the electronic device 120 executes the multimedia interaction module 128 to cause the electronic device 120 to perform some or all of the processes in the corresponding fields. For convenience of understanding, the multimedia interaction in the flowchart 2200 is illustrated again by taking the source electronic device as the electronic device 120-a and the candidate electronic device may be one of the other electronic devices 120-b~120-n. square The way the law works.

Flows 302 and 304 in FIG. 22 are the same as flows 302 and 304 in FIG. 3 described above. Accordingly, the description of the operation, implementation, and related advantages of the processes 302 and 304 of the foregoing FIG. 3 also applies to the embodiment of FIG. For the sake of brevity, the description will not be repeated here.

In the embodiment of FIG. 22, when the user of the source electronic device 120-a operates the source electronic device 120-a, the multimedia interaction module 128-a performs a process 2206 to determine whether the user's current operation is performed. To indicate that a target image object is to be transported toward a target. If the operation is only another operation that is not related to the target image object, the control circuit 121-a performs a corresponding operation according to the user's operation.

If the user of the source electronic device 120-a performs a predetermined operation (for example, a specific touch mode, a specific mouse operation, or a specific voice control command) on the source electronic device 120-a, the source electronic device 120 is indicated. -a transmits a target image object toward a target direction, and the multimedia interaction module 128-a performs a process 2210.

In the process 2210, the multimedia interaction module 128-a transmits the target command corresponding to the target image object and the related information of the target direction to the other electronic devices 120-b~120-n by using the communication circuit 125-a. One or more candidate electronic devices. The foregoing target instructions include one or more instructions used by the source electronic device 120-a to set, control, change, or adjust the multimedia content presented by the display on the candidate electronic device (hereinafter referred to as the candidate display), and may also include Parameter values related to image attributes such as shape, size, color, position, duration, moving direction, and moving speed of one or more image objects.

For convenience of understanding, the following assumes that the source electronic device 120-a transmits the target command and related information of the target direction to the candidate electronic device 120-b of the other electronic devices 120-b~120-n in the foregoing process 2210. .

In the process 2212, the multimedia interaction module 128-b of the candidate electronic device 120-b receives the target instruction and related information of the target direction by using the communication circuit 125-b.

In the process 2213, the multimedia interaction module 128-b determines the relative position of the candidate electronic device 120-b and the target direction in space according to the latest information about the position and directivity of the candidate electronic device 120-b in space. Whether the location meets a predetermined condition. If the relative position of the candidate electronic device 120-b and the target direction in space meets the predetermined condition, the multimedia interaction module 128-b performs the flow 314; otherwise, if the candidate electronic device 120-b and the target direction are in space, the relative If the location does not meet the predetermined condition, the multimedia interaction module 128-b performs flow 2216.

The operation of the multimedia interaction module 128-b in the process 2213 is the same as the operation of the multimedia interaction module 128-a described above in the process 308 of FIG. In addition, the flow 314 in FIG. 22 is also the same as the flow 314 in FIG. 3 described above. Accordingly, the description of the operation, implementation, and related advantages of the flows 308 and 314 of the foregoing FIG. 3 applies to the flows 2213 and 314 of FIG. 22, respectively. For the sake of brevity, the description will not be repeated here.

In flow 2216, the multimedia interaction module 128-b will refuse to execute the received target instruction.

In flow 2217, the multimedia interaction module 128-b transmits a rejection notification to the source electronic device 120-a using the communication circuit 125-b.

When the source electronic device 120-a receives the rejection notification from the candidate electronic device 120-b At time, process 2218 is performed.

In the process 2218, the multimedia interaction module 128-a can present the candidate electronic device by using a display 127-a (hereinafter referred to as a source display), a speaker, a light source circuit, or a vibrator on the source electronic device 120-a. 120-b refuses to perform the corresponding multimedia effect of the target instruction. For example, the multimedia interaction module 128-a can control the display 127-a to present an animation effect in which the target image object collides with the edge of the display 127-a and then bounces back, can control the speaker to present a specific sound effect, and can control the vibrator to perform a specific mode. Vibrating, controllable light source circuits (such as LEDs or flashlights) exhibit a particular visual effect, or can be collocated with the various devices described above to present a particular multimedia effect to let the user know that the candidate electronic device 120-b is not in accordance with the target command The corresponding multimedia operation, that is, a multimedia interactive operation expected by the user is not completed.

It can be seen from the foregoing description that the candidate electronic device 120-b can utilize the candidate display 127 in accordance with the received target instruction only if the relative position of the candidate electronic device 120-b and the target direction in space meets the predetermined condition. b Perform multimedia operations corresponding to the target image object. If the candidate electronic device 120-b finds that its relative position in the space with the target direction does not meet the predetermined condition, the target instruction is rejected, and thus the multimedia operation corresponding to the target image object is not performed. Similarly, other individual electronic devices that receive the target instruction will refuse to execute the target instruction if they find that their relative position in the space with the target direction does not meet the predetermined condition. Therefore, using the multimedia interaction method in FIG. 22, the non-conformity between the source electronic device 120-a and other electronic devices can also be effectively reduced. Experience, in the design of multimedia interactive applications should not appear, violate the rules set by interactive applications, or unintended multimedia interaction results.

In addition, by using individual candidate electronic devices to determine whether the respective positions and directivity meet the predetermined conditions, the amount of calculation required by the source electronic device 120-a can be effectively reduced, thereby extending the battery life of the source electronic device 120-a. .

Another mode of operation of the multimedia interactive system 100 will be further described below in conjunction with FIG.

FIG. 23 is a simplified flowchart 2300 of another embodiment of a multimedia interaction method for use in the multimedia interactive system 100 of the present invention. In this embodiment, the multimedia interactive system 100 can dynamically designate one of the electronic devices 120-a~120-n as a forwarding electronic device. The forwarding electronic device is used as an instruction transmission medium between the plurality of electronic devices 120-a~120-n, so that the electronic devices 120-a~120-n can transmit multimedia interactive instructions through the forwarding electronic device without A remote central server (not shown) transmits multimedia interactive commands, thereby improving the efficiency and speed of multimedia interactive command transmission between the electronic devices 120-a~120-n.

In flowchart 2300, the portion of the field labeled "Forwarding Electronic Device" represents the flow performed by electronic device 120 designated as the forwarding electronic device.

When the multimedia interaction method in the flowchart 2300 is performed, the control circuit 121 in the electronic device 120 executes the multimedia interaction module 128 to cause the electronic device 120 to perform some or all of the processes in the corresponding fields. For convenience of understanding, the following source electronic device is the electronic device 120-a, and the forwarding electronic device is the electronic device 120-n, and the candidate electronic device The setting may be one of the other electronic devices 120-b~120-m as an example to illustrate the operation mode of the multimedia interaction method in the flowchart 2300.

The flow 302 in Fig. 23 is the same as the flow 302 in Fig. 3 described above. Accordingly, the description of the operation, implementation, and related advantages of the flow 302 of the foregoing FIG. 3 also applies to the embodiment of FIG. For the sake of brevity, the description will not be repeated here.

In the process 2304, the multimedia interaction module 128 of each electronic device 120 can dynamically receive information related to the position and directivity of the electronic device 120 in the space from the position detection circuit 110 by using the communication circuit 125 in a wireless transmission manner. And record it. In addition, the multimedia interaction module 128-n of the forwarding electronic device 120-n can also dynamically receive and electronically receive the electronic device 120 from the position detecting circuit 110 or other electronic devices 120-a~120-m by using the communication circuit 125-n. -a~120-m Information about individual locations and directivity in space and record them. The forwarding electronic device 120-n may periodically or intermittently perform the foregoing process 2304 to dynamically receive the latest information generated by the location detecting circuit 110 or other electronic devices 120-a~120-m, and update the electronic device accordingly. Relevant records of individual locations and directivity in space.

In the embodiment of FIG. 23, when the user of the source electronic device 120-a operates the source electronic device 120-a, the multimedia interaction module 128-a performs a process 2306 to determine whether the user's current operation is performed. To indicate that a target image object is to be transported toward a target. If the operation is only another operation that is not related to the target image object, the control circuit 121-a performs a corresponding operation according to the user's operation.

If the user of the source electronic device 120-a performs a predetermined operation on the source electronic device 120-a (eg, a specific touch mode, a specific mouse operation, or a specific one is issued) The voice control command is configured to instruct the source electronic device 120-a to transmit a target image object toward a target direction, and the multimedia interaction module 128-a performs the process 2310.

In the process 2310, the multimedia interaction module 128-a transmits the target command corresponding to the target image object and the related information of the target direction to the designated forwarding electronic device 120-n by using the communication circuit 125-a. The foregoing target instructions include one or more instructions used by the source electronic device 120-a to set, control, change, or adjust the multimedia content presented by a display (hereinafter referred to as a candidate display) on other electronic devices, and may also include Parameter values related to image attributes such as shape, size, color, position, duration, moving direction, and moving speed of one or more image objects.

In the process 2312, the multimedia interaction module 128-n of the forwarding electronic device 120-n receives the target instruction and related information of the target direction by using the communication circuit 125-n.

In the process 2313, the multimedia interaction module 128-n can select other electronic devices 120-b~120-n other than the source electronic device 120-a as a candidate electronic device, and according to the candidate electronic device in space. The latest information about the location and directivity is used to determine whether the relative position of the selected candidate electronic device and the target direction in space meets a predetermined condition. If the selected candidate electronic device and the relative position of the target direction in the space meet the predetermined condition, the multimedia interaction module 128-n performs the process 2314; otherwise, if the selected candidate electronic device and the target direction are in the space relative If the location does not meet the predetermined condition, the multimedia interaction module 128-n performs flow 2316.

The operation of the multimedia interaction module 128-n in the process 2313 is the same as the operation of the aforementioned multimedia interaction module 128-a in the flow 308 of FIG. Therefore, regarding the aforementioned Figure 3 The description of the operation, implementation, and related advantages of the process 308 also applies to the process 2313 in FIG. For the sake of brevity, the description will not be repeated here.

In the process 2314, the multimedia interaction module 128-n transmits the target command corresponding to the target image object to the candidate electronic device that meets the predetermined condition by using the communication circuit 125-n.

In the process 2315, the multimedia interaction module of the candidate electronic device receives the target instruction by using the communication circuit of the candidate electronic device, and proceeds to flow 314. Flow 314 in FIG. 23 is the same as flow 314 in FIG. 3 described above. Accordingly, the description of the operation, implementation, and related advantages of the flow 314 of the foregoing FIG. 3 also applies to the flow 314 of FIG. For the sake of brevity, the description will not be repeated here.

In flow 2316, the multimedia interaction module 128-n will reject the delivery of the target command to the candidate electronic device.

In flow 2317, the multimedia interaction module 128-n transmits a rejection notification to the source electronic device 120-a using the communication circuit 125-n.

When the source electronic device 120-a receives the rejection notification from the forwarding electronic device 120-n, flow 2218 is performed. Flow 2218 in FIG. 23 is the same as flow 2218 in FIG. 22 described above. Accordingly, the description of the operation, implementation, and related advantages of the process 2218 in FIG. 22 above applies to the process 2218 of FIG. For the sake of brevity, the description will not be repeated here.

It can be seen from the foregoing description that the forwarding electronic device 120-n will only transmit the target command from the source electronic device 120-a if the target direction and the relative position of the selected candidate electronic device in the space meet the predetermined condition. Forward to the selected candidate The electronic device causes the candidate electronic device to perform a multimedia operation corresponding to the target image object by using the corresponding candidate display according to the target instruction. If the target direction and the relative position of the candidate electronic device in the space do not meet the predetermined condition, the forwarding electronic device 120-n does not transmit the target instruction to the candidate electronic device, and therefore, the candidate electronic device does not execute the target instruction. . Similarly, the forwarding electronic device 120-n does not transmit the target command to other electronic devices that do not meet the predetermined condition, so as to prevent the electronic device that does not meet the predetermined condition from performing multimedia operations corresponding to the target image object. Therefore, using the multimedia interaction method in FIG. 23 can also effectively reduce the occurrence of non-conformity between the source electronic device 120-a and other electronic devices, should not occur in the design of the multimedia interactive application, and violate the setting of the interactive application. Rules, or unintended multimedia interaction results.

In addition, by using the forwarding electronic device 120-n to determine whether the position and directivity of other electronic devices meet the predetermined conditions, the amount of calculation required by other electronic devices can be effectively reduced, thereby prolonging the battery life of other electronic devices. Therefore, the multimedia interactive system 100 can designate the electronic device with the most battery power remaining or coupled to the conventional power network as the forwarding electronic device.

In practice, according to the design intention of the multimedia interactive application, the contents of the predetermined conditions in the foregoing different embodiments are variously combined, so that the multimedia interactive system 100 can have more powerful judgment ability for the relative positions of different electronic devices in space. To provide a richer and more diverse user experience. For example, the predetermined condition content in the aforementioned nineteenth or twentieth embodiment may be combined with the predetermined condition content in any one of the first to eighteenth embodiments into a new predetermined condition, or the foregoing Thirty-five or The predetermined condition content in the thirty-sixth embodiment is combined with the predetermined condition content in any one of the twenty-first to thirty-fourth embodiments into a new predetermined condition, and the aforementioned seventeenth or eighteenth implementation may be performed The predetermined condition content in the example is combined with the predetermined condition content in any of the first to sixteenth embodiments into a new predetermined condition, and the predetermined condition in the aforementioned thirty-third or thirty-fourth embodiment may also be used. The content is combined with the predetermined conditional content in any of the twenty-first to thirty-second embodiments into a new predetermined condition.

The foregoing forwarding electronic device can be used not only as a transmission medium for multimedia interactive instructions between the electronic devices 120-a~120-n, but also as a transmission of position and directivity information between the electronic devices 120-a~120-n. medium. For example, in the foregoing embodiment of FIG. 3 or FIG. 22, if the multimedia interactive system 100 specifies an electronic device as the forwarding electronic device, the forwarding electronic device can be automatically received from the position detecting circuit 110 or other electronic device. Information about individual locations and directivity in space is recorded. The electronic device can dynamically receive the information of the individual locations and directivity of all the electronic devices in the space from the forwarding electronic device in the process 304, and update the related records accordingly, thereby simplifying the individual location and directivity information of the electronic device at all. The mode of propagation between electronic devices.

In addition, some of the multimedia materials required for the interactive operation of the electronic device 120, such as a background image, an initial image object, an animation, or a parameter required to generate the foregoing multimedia material, may be generated by a multimedia interaction. The source of the instruction is provided by the electronic device, and may also be provided by other multimedia servers (not shown).

Moreover, each electronic device 120 can also have some or all of the electronic devices 120-a~120-n The relative position is displayed on a partial area of the respective display, and an animation related to the movement of the target image object is presented in the partial area, so that the user can obtain more related multimedia in the process of participating in the multimedia interactive application. Information to enhance the user's multimedia interactive experience.

In practice, the electronic device 120 participating in the multimedia interaction can use the display 127 to display related video content of the multimedia interaction, such as the multimedia interactive screen 2400 illustrated in FIG. As shown in FIG. 24, the multimedia interactive screen 2400 includes a main image frame 2410 displayed on a main area of the display 127, and a thumbnail picture 2420 displayed on a partial area of the display 127. The electronic device 120 may display the relative positions of some or all of the electronic devices 120-a 120-n in the thumbnail screen 2420, and present an animation related to the motion of the target image object 400 in the thumbnail screen 2420. For example, the relative positions of the portraits 2421, 2422, and 2423 in the thumbnail screen 2420 can be used to represent the relative positions of the three electronic devices 120 participating in the multimedia interaction or the users of the three electronic devices in space. The position of the image object 2424 in the thumbnail screen 2420 can be used to represent the location of the aforementioned target image object 400. The trajectory line 2425 in the thumbnail image 2420 can then be used to represent the predicted path of the motion trajectory or motion trajectory of the target image object 400 in space.

After all, the target image object 400 is only a computer image created by the multimedia interactive application. In the process of participating in the multimedia interaction, the user participating in the multimedia interaction cannot actually see the corresponding image object 400 in the space with the naked eye. Real object. Therefore, the user does not have a clear feeling of the trajectory of the target image object 400 in the virtual space. At this time, by being displayed in the thumbnail screen 2420 The image object 2424 corresponding to the target image object 400 and its trajectory 2425 can provide a user-like multimedia interactive experience similar to augmented reality. The user of the electronic device 120 can also refer to the content of the thumbnail screen 2420 to decide whether to move the position or directivity of the user or the electronic device 120 to change the relative position between itself or the electronic device 120 and other electronic devices. Interactive apps create more fun.

In a practical application, the thumbnail screen 2420 displayed on the display 127 can also be used as a user control interface, so that the multimedia interaction module 128 can calculate the foregoing according to the user's operation on the display area of the thumbnail screen 2420. The target direction Dt. For example, when the user clicks on a certain target portrait pattern in the thumbnail screen 2420, the multimedia interaction module 128 can calculate a target direction corresponding to the target portrait pattern, and try to use a preset method by using the foregoing method. Or the target image object selected by the user is transmitted toward the target direction. Alternatively, the multimedia interaction module 128 can also calculate the starting point when the user drags a target image object from a certain starting point of the thumbnail image 2420 to a target portrait pattern in the thumbnail image 2420. And aiming at the target direction defined by the target portrait pattern, and attempting to transmit the target image object toward the target direction by using the foregoing method.

From the perspective of the foregoing, the multimedia interactive system 100 and the related multimedia interaction method can detect and judge the rationality of the relative positions of different electronic devices in space, and determine whether to transmit the multimedia interactive command according to the result of the judgment. The specific electronic device, or whether the specific electronic device can execute the received multimedia interactive instruction. In this way, the source electronic of multimedia interactive instructions can be effectively reduced. There is no general user experience between the device and other electronic devices, should not appear in the design of multimedia interactive applications, violate the rules set by the interactive application, or unintended multimedia interaction results.

From another perspective, the aforementioned multimedia interactive system 100 and related multimedia interaction methods may cause the multimedia interactive system 100 to appear to be inconsistent with the general user experience, should not appear in the design of the multimedia interactive application, and violate the interactive application. The set rules, or multimedia interactive instructions of unintended multimedia interaction results are filtered or blocked to ensure that the multimedia interactive behavior presented by the multimedia interactive system 100 conforms to the original design intent of the multimedia interactive application. As a result, the user experience provided by the multimedia interactive system 100 can be greatly improved.

Therefore, the architecture and related methods and computer program products of the multimedia interactive system 100 proposed in this case are substantially beneficial to the development of various multimedia interactive applications between electronic devices.

Certain terms are used throughout the description and claims to refer to particular elements. However, those of ordinary skill in the art should understand that the same elements may be referred to by different nouns. The specification and the scope of patent application do not use the difference in name as the way to distinguish the components, but the difference in function of the components as the basis for differentiation. The term "including" as used in the specification and the scope of the patent application is an open term and should be interpreted as "including but not limited to". In addition, "coupled" includes any direct and indirect means of attachment herein. Therefore, if the first element is described as being coupled to the second element, the first element may be directly connected to the second element by electrical connection or wireless transmission, optical transmission or the like, or by other means. The component or connection means is indirectly electrically or signally connected to the second component.

The description of "and/or" as used herein includes any combination of one or more of the listed items. In addition, the terms of any singular are intended to include the meaning of the plural, unless otherwise specified in the specification.

The above are only the preferred embodiments of the present invention, and all changes and modifications made to the claims of the present invention are intended to be within the scope of the present invention.

Figure 23 is a flow chart

Claims (21)

A multimedia interactive system having a plurality of displays, comprising: a plurality of electronic devices, comprising a source electronic device and a candidate electronic device; a plurality of displays respectively disposed on the plurality of electronic devices and including the source electronic device a source display on the device, and a candidate display disposed on the candidate electronic device; a forwarding electronic device configured to serve as an instruction transmission medium between the plurality of electronic devices; and a position detecting circuit configured to dynamically detect Measure the individual position and directivity of the plurality of electronic devices in space, and transmit information related to the detection result to at least one of the forwarding electronic device and the plurality of electronic devices by wireless transmission; When a user instructs the source electronic device to transmit a target image object toward a target direction, the source electronic device transmits a target command corresponding to the target image object and information of the target direction to the forwarding electronic device. The forwarding electronic device determines that the candidate electronic device is in space with the target direction Whether the location meets a predetermined condition, and only if the location of the candidate electronic device and the relative position of the target direction in space meet the predetermined condition, the forwarding electronic device transmits the target instruction to the candidate The electronic device causes the candidate electronic device to perform a multimedia operation corresponding to the target image object by using the candidate display according to the target instruction. The multimedia interactive system of claim 1, wherein the predetermined condition includes the following conditions At least one of the candidate electronic devices is located in a columnar region pointed by the target direction, wherein the columnar region is oriented with the target direction as a axis and the radius is a first predetermined value; the candidate electronic device is located at the a cone-shaped region pointed by the target direction, wherein the tapered region has the target direction as an axis, the position of the target image object as a vertex, and the vertex angle is an acute angle; the target direction is parallel to a target shifting direction, And a first angle between the target shifting direction and a first direction is an acute angle and less than a critical angle, wherein the target shifting direction and the first direction start from a position of the source electronic device, and The first direction is directed to the position of the candidate electronic device; a second angle between the target shifting direction and a second direction is an acute angle, and the first angle is smaller than the second angle, wherein the second direction is The location of the source electronic device is a starting point and is directed to a location of a third one of the plurality of electronic devices; the candidate electronic device is located on a target path pointed by the target direction, The segment of the target path between the source electronic device and the candidate electronic device does not contact other electronic devices of the plurality of electronic devices; the distance between the location of the candidate electronic device and the target path is less than the first a predetermined value, and the segment of the target path between the source electronic device and the candidate electronic device does not contact other electronic devices of the plurality of electronic devices; the target path passes through the candidate display, and the target a section of the path between the source electronic device and the candidate electronic device does not contact the plurality of electronic devices The other electronic device; the candidate electronic device is located on a target vertical plane where the target path is located, and the target vertical plane does not contact the plurality of electronic devices in an area between the source electronic device and the candidate electronic device The other electronic device; the distance between the position of the candidate electronic device and the target vertical plane is less than the first predetermined value, and the target vertical plane is not in contact with the area between the source electronic device and the candidate electronic device The other of the plurality of electronic devices; the candidate electronic device is located on the target path; the distance between the location of the candidate electronic device and the target path is less than the first predetermined value; the target path passes through the candidate display The candidate electronic device is located on the target vertical plane; the distance between the position of the candidate electronic device and the target vertical plane is less than the first predetermined value; and the first direction forms a third angle with the second direction. And the first angle is less than half of the third angle; a second vertical surface of the second direction cuts the space into a first side space a second side space, the target direction is directed to the first side space, and the candidate electronic device is located in the first side space; a source of the source electronic device is directed to a source vertical direction of the source, and the source electronic device The position is defined by the axis to the first direction of the direction of the source pointing to define a target viewing angle region, the source vertical plane is the target viewing angle region The field is cut into a first half side region and a second half side region, the target direction is directed to the first half side region, and the candidate electronic device is located in the first half side region; the source pointing direction is shifted with the target Forming a fourth angle between the directions, the first direction and the source pointing direction form a fifth angle, and the fourth angle and the fifth angle are smaller than the first angle of view; a first reverse direction and the candidate electron Forming a sixth angle between a candidate pointing direction of the device, the fourth angle and the fifth angle are smaller than the first angle of view, and the sixth angle is smaller than a second angle of view, wherein the first reverse direction is the candidate electronic device a position is a starting point and a position of the source electronic device; and a candidate vertical plane where the candidate pointing direction is located, and the second viewing angle is defined by rotating the second viewing angle on both sides of the candidate pointing direction with the position of the candidate electronic device as an axis a candidate viewing area, the source electronic device is located in the candidate viewing area, the target direction is directed to the first half area, and the candidate electronic device is located in the first half area . The multimedia interactive system of claim 2, wherein the position detecting circuit is located higher than the source electronic device, the candidate electronic device, and the third electronic device, and the first viewing angle is equal to the second viewing angle. The multimedia interactive system of claim 1, wherein the position detecting circuit is configured to detect individual projection positions and directivity of the plurality of electronic devices on the same reference horizontal plane, and the predetermined condition includes at least one of the following conditions : the target direction points to a target projection in a target projection direction on the reference horizontal plane a path and a strip region, wherein a candidate projection position of the candidate electronic device on the reference horizontal plane is located in the strip region, wherein the strip region is centered on the target projection path and has a width of a first predetermined value The target projection direction is directed to a triangular region, and the candidate projection position is located in the triangular region, wherein the triangular region is centered on the target projection path, and the projection position of the target image object on the reference horizontal plane is a vertex, and an apex angle is an acute angle; an eleventh angle between the target projection direction and a first projection direction is an acute angle and less than a critical angle, wherein the first projection direction is at the reference horizontal plane of the source electronic device a source projection position is a starting point, and the first projection direction is directed to the candidate projection position; a twelfth angle between the target projection direction and a second projection direction is an acute angle, and the eleventh angle is smaller than the a twelfth angle, wherein the second projection direction starts from the source projection position and points to a third of the plurality of electronic devices a third projection position of the sub-device on the reference horizontal plane; the projection of the source electronic device on the reference horizontal plane is a source projection area, and the projection of the candidate electronic device on the reference horizontal plane is a candidate projection area, the candidate a projection position is located on the target projection path, and a section of the target projection path between the source projection area and the candidate projection area does not contact other electronic devices of the plurality of electronic devices on the reference horizontal plane Projection; a distance between the candidate projection position and the target projection path is less than the first predetermined value And the segment of the target projection path between the source projection area and the candidate projection area does not touch the projection of the other electronic device of the plurality of electronic devices on the reference horizontal plane; the target projection path passes through The candidate display is in a display projection area on the reference horizontal plane, and the segment of the target projection path between the source projection area and the candidate projection area does not contact other electronic devices in the plurality of electronic devices. a projection on the reference horizontal plane; the candidate projection position is located on the target projection path; a distance between the candidate projection position and the target projection path is less than the first predetermined value; the target projection path passes through the display projection area; Forming a thirteenth angle between the first projection direction and the second projection direction, and the eleventh angle is less than half of the thirteenth angle; a second reference line of the second projection direction cutting the reference plane Forming a first side area and a second side area, the target projection direction is directed to the first side space, and the candidate projection position is In the first side region, a source of the source electronic device has a source pointing direction on the reference horizontal plane pointing to the projection direction, and the source projection position is the axis to the source to the projection direction. a target viewing angle region, the source is directed to the projection direction to cut the target viewing angle region into a first half side region and a second half side region, the target projection direction is directed to the first half side region, and the candidate projection position is located at the target Within the first half of the area; The source is directed to form a fourteenth angle between the projection direction and the target projection direction, and the first projection direction forms a fifteenth angle with the source pointing projection direction, and the fourteenth angle and the fifteenth angle are both Less than the first viewing angle; a first back projection direction and a candidate pointing direction of the candidate electronic device form a sixteenth angle between a candidate pointing projection direction of the reference horizontal plane, the fourteenth angle and the tenth The five angles are smaller than the first angle of view, and the sixteenth angle is smaller than a second angle of view, wherein the first back projection direction starts from the candidate projection position and points to the source projection position; and the candidate points to the projection direction The candidate projection position defines a candidate viewing angle region for each rotation of the second viewing angle to the two sides of the candidate pointing projection direction, where the source projection position is located in the candidate viewing angle region, and the target projection direction is directed to the first half region, and The candidate projection location is located within the first half-side region. The multimedia interactive system of claim 4, wherein the location detecting circuit is located higher than the source electronic device, the candidate electronic device, and the third electronic device, and the first viewing angle is equal to the second viewing angle. The multimedia interactive system of claim 1, wherein the forwarding electronic device comprises: a forwarding display; wherein the position detecting circuit further detects the position and directivity of the forwarding electronic device in space, and the forwarding electronic device Displaying the relative position of the source electronic device, the candidate electronic device, and the forwarding electronic device in space on a partial area of the forwarding display, and presenting in the local area related to the motion of the target image object Animation. The multimedia interactive system of claim 1, wherein the forwarding electronic device receives information related to the position and directivity of the candidate electronic device from at least one of the position detecting circuit and the candidate electronic device. The multimedia interactive system of any one of claims 1 to 7, wherein the position detecting circuit detects and utilizes a centroid position of the source electronic device to represent a position of the source electronic device in space. A location of a centroid of the candidate electronic device is detected and utilized to represent the location of the candidate electronic device in space. The multimedia interactive system of any one of claims 1 to 7, wherein the position detecting circuit detects and transmits a spatial coordinate of a plurality of transmitting reference points in the source electronic device to the source electronic device, and Detecting and transmitting a spatial coordinate of a plurality of receiving reference points in the candidate electronic device to the candidate electronic device; wherein the source electronic device calculates one of the source electronic devices according to a spatial coordinate of the plurality of transmitting reference points Position of the centroid to represent the position of the source electronic device in space, and the candidate electronic device calculates a centroid position of the candidate electronic device according to the spatial coordinates of the plurality of receiving end reference points to represent the The location of the candidate electronic device in space. The multimedia interactive system of any one of claims 1 to 7, wherein the position detecting circuit detects and transmits a spatial coordinate of a plurality of transmitting reference points in the source electronic device to the source electronic device, and Detecting and transmitting a spatial coordinate of a plurality of receiving reference points in the candidate electronic device to the candidate electronic device; wherein the source electronic device calculates one of the source displays according to a spatial coordinate of the plurality of transmitting reference points The location of the centroid to represent the source electronic device The position in the space, and the candidate electronic device calculates a position of a centroid of the candidate display according to the spatial coordinates of the plurality of receiving end reference points to represent the position of the candidate electronic device in space. The multimedia interactive system of any one of claims 1 to 7, wherein the position detecting circuit detects and transmits a spatial coordinate of a plurality of transmitting reference points in the source electronic device to the source electronic device, and Detecting and transmitting a spatial coordinate of a plurality of receiving reference points in the candidate electronic device to the candidate electronic device; wherein the source electronic device calculates the spatial display based on the spatial coordinates of the plurality of transmitting reference points The position of the center point of the first multimedia interactive program window is displayed to represent the location of the source electronic device in space, and the candidate electronic device calculates the space coordinates of the plurality of receiving end reference points. The position of the center point of a second multimedia interactive program window displayed on the candidate display to represent the position of the candidate electronic device in space. A computer program product stored in a non-transitory storage device of a forwarding electronic device, the forwarding electronic device comprising a forwarding display, when the control circuit of the forwarding electronic device executes the computer program product, causing the forwarding electronic The device performs a multimedia interactive operation, and the multimedia interactive operation comprises: using a communication circuit of the forwarding electronic device to dynamically receive information related to individual locations and directivity of the plurality of electronic devices in the space by wireless transmission; When the one of the plurality of electronic devices instructs the source electronic device to transmit a target image object toward a target direction, the communication circuit obtains a target command corresponding to the target image object from the source electronic device and Information of the target direction; determining, by the control circuit, whether a candidate electronic device of the other electronic device and the relative position of the target direction in space meet a predetermined condition; and only the position of the candidate electronic device and the target direction are in space When the relative position of the device meets the predetermined condition, the communication circuit is used to transmit the target command to the candidate electronic device, so that the candidate electronic device performs the target image object with the corresponding candidate display according to the target command. Corresponding multimedia operations. The computer program product of claim 12, wherein the predetermined condition comprises at least one of the following conditions: the candidate electronic device is located in a columnar region pointed by the target direction, wherein the columnar region is in the target direction The axis and the radius are a first predetermined value; the candidate electronic device is located in a tapered region pointed by the target direction, wherein the tapered region takes the target direction as an axis and the position of the target image object as a vertex. And the apex angle is an acute angle; the target direction is parallel to a target shifting direction, and a first angle between the target shifting direction and a first direction is an acute angle and less than a critical angle, wherein the target shifting direction And the first direction is a starting point of the source electronic device, and the first direction is directed to the position of the candidate electronic device; a second angle between the target shifting direction and a second direction is an acute angle, and The first angle is smaller than the second angle, wherein the second direction starts from the position of the source electronic device and points to a third electronic device of the plurality of electronic devices The candidate electronic device is located on a target path pointed by the target direction, and the segment of the target path between the source electronic device and the candidate electronic device does not contact other ones of the plurality of electronic devices An electronic device; a distance between the location of the candidate electronic device and the target path is less than the first predetermined value, and a segment of the target path between the source electronic device and the candidate electronic device does not contact the plurality of The other electronic device in the electronic device; the target path passes through the candidate display, and the segment of the target path between the source electronic device and the candidate electronic device does not contact other electronic devices of the plurality of electronic devices The candidate electronic device is located on a target vertical plane where the target path is located, and the target vertical plane does not contact other electronic devices in the plurality of electronic devices in an area between the source electronic device and the candidate electronic device. The distance between the position of the candidate electronic device and the target vertical plane is less than the first predetermined value, and the target vertical plane is at the source The area between the child device and the candidate electronic device does not contact other electronic devices of the plurality of electronic devices; the candidate electronic device is located on the target path; the distance between the position of the candidate electronic device and the target path Less than the first predetermined value; the target path passes through the candidate display; the candidate electronic device is located on the target vertical plane; the distance between the position of the candidate electronic device and the target vertical plane is smaller than the first pre- a third angle formed between the first direction and the second direction, and the first angle is less than half of the third angle; a second vertical plane of the second direction cuts the space into a first side a space and a second side space, the target direction is directed to the first side space, and the candidate electronic device is located in the first side space; a source of the source electronic device points to a source vertical direction of the source, the source The position of the electronic device defines a target viewing angle region by rotating a first viewing angle to the two sides of the source pointing direction, and the source vertical surface cuts the target viewing angle region into a first half side region and a second half side region. The target direction is directed to the first half-side region, and the candidate electronic device is located in the first half-side region; the source pointing direction and the target shifting direction form a fourth angle, the first direction and the source pointing Forming a fifth angle between the directions, wherein the fourth angle and the fifth angle are smaller than the first angle of view; a first reverse direction and a candidate pointing direction of the candidate electronic device form a a six-angle, the fourth angle and the fifth angle are smaller than the first angle of view, and the sixth angle is smaller than a second angle of view, wherein the first reverse direction starts from a position of the candidate electronic device, and points to the source electron a position of the device; and a candidate vertical plane in which the candidate pointing direction is located, and a candidate viewing angle region is defined by rotating the second viewing angle on both sides of the candidate pointing direction with the position of the candidate electronic device as an axis, and the source electronic device is located In the candidate viewing area, the target The direction is directed to the first half side region and the candidate electronic device is located within the first half side region. The computer program product of claim 12, wherein the predetermined condition comprises at least one of the following conditions: a target projection direction of the target direction on the reference horizontal plane points to a target projection path and a strip region, the candidate electron A candidate projection position of the device on the reference horizontal plane is located in the strip-shaped region, wherein the strip-shaped region is centered on the target projection path and has a width that is twice a first predetermined value; the target projection direction is directed to a a triangular region, the candidate projection position is located in the triangular region, wherein the triangular region is centered on the target projection path, the projection position of the target image object on the reference horizontal plane is a vertex, and the vertex angle is an acute angle; An eleventh angle between the projection direction and a first projection direction is an acute angle and less than a critical angle, wherein the first projection direction is a starting point of a source of the source electronic device on the reference horizontal plane, and The first projection direction is directed to the candidate projection position; between the target projection direction and a second projection direction a twelfth angle is an acute angle, and the eleventh angle is smaller than the twelfth angle, wherein the second projection direction starts from the source projection position and points to a third electronic device of the plurality of electronic devices a third projection position on the reference horizontal plane; the projection of the source electronic device on the reference horizontal plane is a source projection area, and the projection of the candidate electronic device on the reference horizontal plane is a candidate projection area, The candidate projection position is located on the target projection path, and the segment of the target projection path between the source projection area and the candidate projection area does not contact other electronic devices in the plurality of electronic devices at the reference horizontal plane. Projection; the distance between the candidate projection position and the target projection path is less than the first predetermined value, and the segment of the target projection path between the source projection area and the candidate projection area does not touch the a projection of the other of the plurality of electronic devices on the reference horizontal plane; the target projection path passes through a display projection area of the candidate display on the reference horizontal plane, and the target projection path is at the source projection area and the candidate a segment between the projection regions that does not touch a projection of the other of the plurality of electronic devices on the reference horizontal plane; the candidate projection location is located on the target projection path; the candidate projection location and the target projection path The distance between the two is less than the first predetermined value; the target projection path passes through the projection area of the display, the first Forming a thirteenth angle between the projection direction and the second projection direction, and the eleventh angle is less than half of the thirteenth angle; a second reference line of the second projection direction cutting the reference plane into a first a side area and a second side area, the target projection direction is directed to the first side space, and the candidate projection position is located in the first side area; a source of the source electronic device is directed to a direction on the reference horizontal plane Source In the projection direction, a target viewing angle region is defined by rotating the first viewing angle from the source to the projection direction on the both sides of the source projection position, and the source is directed to the projection direction to cut the target viewing angle region into a first half region and a second half side region, the target projection direction is directed to the first half side region, and the candidate projection position is located in the first half side region; the source pointing direction forms a fourteenth angle between the projection direction and the target projection direction Forming a fifteenth angle between the first projection direction and the source pointing projection direction, and the fourteenth angle and the fifteenth angle are smaller than the first angle of view; a first back projection direction and the candidate electronic device a candidate pointing direction forms a sixteenth angle between a candidate pointing projection direction on the reference horizontal plane, the fourteenth angle and the fifteenth angle are smaller than the first angle of view, and the sixteenth angle is less than one a second viewing angle, wherein the first back projection direction starts from the candidate projection position and points to the source projection position; and the candidate points to the projection direction to select the candidate Positioning the axis to the candidate pointing direction of the projection direction to rotate the second view defines a candidate view area, the source projection position is located in the candidate view area, the target projection direction is directed to the first half area, and the candidate The projection position is located within the first half-side region. The computer program product of claim 12, wherein the multimedia interactive operation further comprises: receiving, from a location detecting circuit, information related to location and directivity of the forwarding electronic device in space; the source electronic device, the candidate The electronic device, and the relative position of the forwarding electronic device in space, are displayed on a partial area of the forwarding display; An animation related to the motion of the target image object is presented in the local area. The computer program product of claim 12, wherein the multimedia interactive operation further comprises: receiving information related to the location and directivity of the source electronic device from at least one of a location detection circuit and the source electronic device. The computer program product of claim 12, wherein the multimedia interactive operation further comprises: receiving information related to the position and directivity of the candidate electronic device from at least one of the position detecting circuit and the candidate electronic device. The computer program product of any one of claims 12 to 17, wherein the multimedia interactive operation further comprises: receiving and utilizing a centroid location of the source electronic device to represent a location of the source electronic device in space; And receiving and utilizing a location of a centroid of the candidate electronic device to represent the location of the candidate electronic device in space. The computer program product of any one of claims 12 to 17, wherein the multimedia interactive operation further comprises: receiving a spatial coordinate of the plurality of reference points in the forwarding electronic device from a position detecting circuit; The spatial coordinates of the reference point calculate the position of a centroid of the forwarding electronic device to represent the position of the forwarding electronic device in space. The computer program product of any one of claims 12 to 17, wherein the multimedia interactive operation further comprises: receiving a space seat of the plurality of reference points in the forwarding electronic device from a position detecting circuit And calculating a position of the centroid of the forwarding display based on the spatial coordinates of the plurality of reference points to represent the position of the forwarding electronic device in space. The computer program product of any one of claims 12 to 17, wherein the multimedia interactive operation further comprises: receiving a spatial coordinate of the plurality of reference points in the forwarding electronic device from a position detecting circuit; The spatial coordinates of the reference point calculate the position of the center point of a multimedia interactive program window displayed on the forwarding display to represent the position of the forwarding electronic device in space.