TWI482502B - Image interaction device, interactive image operating system, and interactive image operating method thereof - Google Patents

Description

Image interactive device, interactive image operating system, and related interactive image manipulation method

The present invention discloses an image interaction device, an interactive image operating system, and related interactive image manipulation methods, and more particularly, a method of encoding a data vector in a digital image to transmit information related to the digital image for remote image interaction device Interactive image interaction device, interactive image operating system, and related interactive image manipulation methods.

Please refer to FIG. 1 , which is a schematic diagram of a general interactive game system 100 . The interactive game system 100 includes a first image interaction device 110 and a second image interaction device 120 . In FIG. 1 , a user 130 uses a first image interaction device 110 and a second image interaction device 120 used by a remote user 140 to perform a connection game, wherein the first image interaction device 110 and the first image interaction device 110 The two image interaction devices 120 have a network 150 for transmitting messages or images between the first image interaction device 110 and the second image interaction device 120. The network 150 can be an internal network or an external network.

The first image interaction device 110 can detect the outline and motion of the user 130 by using a motion detector 112 to correspondingly generate and display a digital image 114. The second image interaction device 120 can also detect the user 140 through a motion detector 122 to generate a digital image 116 and transmit the digital image 116 to the first image interaction device 110 through the network 150. The first image interaction device 110 can simultaneously display the digital image 116; similarly, the second image interaction device 140 can simultaneously display the digital images 114 and 116. An operation instruction issued by the user 130 to the digital image 114 or an operation instruction issued by the user 140 to the digital image 116 may be additionally transmitted between the first image interaction device 110 and the second image interaction device 120 to perform an interactive game.

However, in the middle of the interactive game, a large number of digital images and operation instructions need to be transmitted through the network 150, so that the first image interaction device 110 and the second image interaction device 120 can synchronize the interactive game. Will bring considerable data transmission. If the network 150 cannot afford such data transmission, the interactive game between the first image interaction device 110 and the second image interaction device 120 will be delayed and cannot be synchronized, thereby affecting the progress and quality of the interactive game.

The invention discloses an image interaction device, an interactive image operating system, and a related interactive image operation method, which are used for effectively reducing the amount of data transmission between remote image interaction devices, and thereby overcoming the prior art remote There is a problem that the interactive video game is delayed due to the excessive amount of data transmission between the interactive devices.

The image interactive device disclosed in the present invention comprises an image capturing device, an image processing module, and an image transmitter. The image capturing device is used to capture a digital image of an object. The image processing module is configured to generate a data vector according to the physical feature information of the object included in the digital image, and encode the data vector into the digital image to generate a digital encoded image. The image transmitter is configured to output the digitally encoded image to a network such that a device connected to the network can display the digital image according to the data vector included in the digitally encoded image.

The interactive image operating system disclosed in the present invention comprises a first image interaction device and a second image interaction device. The first image interaction device comprises an image capture device, a first image processing module, and an image transmitter. The image capturing device is used to capture a digital image of an object. The first image processing module is configured to generate a data vector according to the physical feature information of the object included in the digital image, and encode the data vector into the digital image to generate a digital encoded image. The image transmitter is used to output the digitally encoded image. The second image interaction device includes a receiver, a second image processing module, and a display device. The receiver is configured to receive the digitally encoded image by the first image interaction device. The second image processing module is configured to decode the digitally encoded image to restore the data vector and the digital image. The display device is configured to display the digital image according to physical characteristic information of the object included in the data vector.

The interactive image manipulation method disclosed in the present invention comprises: a first image interaction device generating a data vector according to physical feature information of the object included in a digital image of an object. The first image interaction device encodes the data vector into the digital image to generate a digitally encoded image. A second image interaction device decodes the digitally encoded image to restore the data vector and the digital image. The second image interaction device displays the digital image according to the physical feature information of the object included in the data vector.

Please refer to FIG. 2, which is a schematic diagram of an interactive image operating system 200 according to an embodiment of the invention. In FIG. 2, the user 130 uses the first image interaction device 210 and the second image interaction device 220 used by the remote user 140 to perform a connection game, wherein the first image interaction device 210 and the second image The interactive device 220 also has a network 150, wherein the network 150 can be an internal network or an external network. The interactive image operating system 200 shown in FIG. 2 is different from the interactive game system 100 shown in FIG. 1 mainly in that the first image interaction device 210 and the second image interaction device 220 are passed between The data vector of the message is encoded in the digitally encoded image produced in the digital image.

Please refer to FIG. 3 , which is a functional block diagram of the interactive image operating system 200 shown in FIG. 2 , for detailing the components and detailed operation modes of the interactive image operating system 200 . As shown in FIG. 3, the first image interaction device 210 includes an image capture device 212, an image processing module 214, an input/output interface 215, a display device 216, an image transmitter 218, and a receiver. 219, the second image interaction device 220 includes an image capture device 222, an image processing module 224, an input/output interface 225, a display device 226, an image transmitter 228, and a receiver 229, wherein The connection relationship and operation mode between the components and the components included in each of the image interaction device 210 and the second image interaction device 220 are substantially the same. Next, there is a description about FIG. 3, which mainly discloses that a first digitally encoded image is generated by the first image interaction device 210 and transmitted to the second image interaction device 220, so that the second image interaction device 220 can be displayed on the display device. The first digital image restored by the first digitally encoded image decoding and the second digital image generated by the second image interactive device 220 are simultaneously displayed on the 226, and are used to display the first digital image and the second digital image. Details of various interactive features. However, the second image interactive device 220 can also generate a second digitally encoded image and transmit it to the first image interactive device 210, so that the display device 216 simultaneously displays the second digital image and the first digital image. The various interaction functions with the first digital image and the second digital image are merely for simplifying the description, and the partial details are not shown in FIG.

When the first image interaction device 210 interacts with the second image interaction device 220, for example, an interactive network game, the image capture device 212 first captures the first digital image associated with the user 130 and transmits the image to the first digital image. Image processing module 214. The image processing module 214 analyzes the physical feature information related to the user 130 in the first digital image to generate a data vector, and the image processing module 214 directly encodes the data vector into the first digital image to generate A first digitally encoded image is transmitted to the image transmitter 218, wherein the image processing module 214 can be implemented by software, hardware, or a combination of software and hardware. The image transmitter 218 will then forward the first digitally encoded image to the second image interactive device 220 via the network 150.

After the second image interaction device 220 receives the first digitally encoded image through the receiver 229, the receiver 229 transfers the first digitally encoded image to the image processing module 224. The image processing module 224 is configured to decode the first digitally encoded image to restore the data vector originally encoded in the first digitally encoded image and the first digital image, and the first digital image and the data The information contained in the vector is transmitted to the display device 226, wherein the image processing module 224 can be implemented by software, hardware, or a combination of software and hardware; in addition, the image capturing device 222 can also capture the user. The second digital image associated with the image is transmitted to the display device 226 by the processing of the second digital image captured by the image processing module 224. Finally, the display device 226 displays the first digital image according to the physical feature information of the user 130 included in the data vector, and simultaneously displays the second image received by the image capturing device 222 and the image processing module 224. The digital image is displayed on the display device 226 in such a manner that the first digital image and the second digital image can interact with each other. Similarly, the display device 216 can simultaneously use the first digital image and the second digital image to each other. The first digital image and the second digital image are displayed in an interactive manner, so that the user 130 and the user 140 can pass through the first image interaction device 210 and the second image included in the interactive image operating system 200. The interaction device 220 interacts.

In some embodiments of the present invention, the image processing module 214 may include an image of an object that can be analyzed, such as a motion detector, an object detector, or an object tracker. The device 130 related physical feature information obtained by the image processing module 214 by analyzing the first digital image may include the amount of movement associated with the user 130 (eg, the moving distance of the hand, the foot, or the body, and the moving speed). Or the direction of movement), the depth map (Depthmap) of the user 130 in the first digital image, the Skeleton outline of the user 130, and/or the user 130 used to operate the first digital image. Gestures, etc., are used as game controls for interactive games.

In some embodiments of the present invention, the image capturing devices 212 and 222 can be implemented using a device capable of capturing an image of an object such as a two-dimensional camera, a three-dimensional camera, or a network camera (IP Camara). In this embodiment, the first digital image may be a real digital motion image of the user 130, and the second digital image may also be a real digital motion image of the user 140. .

In some embodiments of the present invention, the data vector encoded in the first encoded digital image may additionally include external commands and/or image parameters for setting a display manner of the first digital image, wherein the user 130 can transmit The input/output interface 215 installed on the first image interaction device 210 is connected to a keyboard, a mouse, a remote controller, or other controller operable by the user 130, and inputs the external command to the first image interaction device 210. Image parameters. The external command may be used by the user 130 to issue a part of the operation command to the first image, so that the display device 226 can update the display mode of the first image corresponding to the operation command; for example, when the first image represents a virtual character The first image can be commanded by the user 130 to replace a particular garment, and the display device 226 can display an operation command to display the first image to replace the particular garment. The image parameter may include setting parameters such as brightness and color gradation of the first image. The image processing module 224 can update the display mode of the first digital image by the display device 226 according to the external command and/or the image parameter.

In some embodiments of the present invention, the manner in which the image processing module 214 encodes the data vector in the first digital image may include hiding the data vector at a specific position of the first digital image, and replacing the data vector with the data vector. The image data of the specific location, plus the header (Header) to indicate the hidden position. For example, the data vector may be hidden in any form of data hiding manner such as a front end, a back end, an image high frequency area, a low image area or a combination of the above positions of the first digital image sequence. Since the replaced image data is located at a position that is less likely to be observed by the user, it does not affect the user's viewing of the first digital image quality. However, the present invention is not limited to hiding the data vector in the front end, the back end, the image high frequency area, and the image low level area of the first digital image sequence. In other embodiments, it may also be hidden in other places that are not easily perceived by the user. Data vector.

In various embodiments of the present invention, the user 130 and the user 140 may also be replaced with objects other than humans, such as robots that can generate motion.

With the interactive image operating system 200 disclosed in the second and third embodiments of the present invention, when the first image interaction device 210 and the second image interaction device 220 transmit a digitally encoded image encoded with a data vector, When a digital image is not added to the prior art, only the same amount of data transmission as the digital image is obtained, and there is no additional transmission amount caused by the message. In this way, the delay caused by the excessive amount of data transmission during the connection interaction between the image interactive devices can be greatly reduced, and the problems in the prior art are solved.

Please refer to FIG. 4, which is a flowchart of an interactive image manipulation method for the interactive image operating system 200 shown in FIGS. 2 and 3, according to an embodiment of the present invention. As shown in Figure 4, the interactive image manipulation method includes the following steps:

Step 402: The first image interaction device 210 generates a data vector according to the physical feature information of the object included in the first digital image of the user 130.

Step 404: The first image interaction device 210 encodes the data vector in the first digital image to generate a first digitally encoded image.

Step 406: The second image interaction device 220 decodes the first digitally encoded image to restore the data vector and the first digital image;

Step 408: The second image interaction device 220 displays the first digital image according to the physical feature information of the user 130 included in the data vector.

It should be noted that the embodiments derived from the steps shown in FIG. 4 by adding the various limitations described above, or the embodiments derived from the reasonable arrangement of the steps in FIG. 4, should still be regarded as the implementation of the present invention. example.

The invention discloses an image interaction device, an interactive image operating system using the image interaction device, and an interactive image manipulation method used by the interactive image operating system. According to the disclosure of the present invention, when a large amount of information or information needs to be transmitted between the image interaction devices, the information or the message can be encoded into the digital image to reduce the amount of data transmission between the image interaction devices, and thereby reduce the image. The transmission delay between the interactive devices to achieve instant interaction between the image interaction devices.

The above are only the preferred embodiments of the present invention, and all changes and modifications made to the scope of the present invention should be within the scope of the present invention.

100. . . Interactive game system

110, 210. . . First image interactive device

112, 122. . . Motion detector

114, 116. . . Digital image

120, 220. . . Second image interactive device

130, 140. . . user

150. . . network

200. . . Interactive image operating system

212, 222. . . Image capture device

214, 224. . . Image processing module

215, 225. . . Input/output interface

216, 226. . . Display device

218, 228. . . Image transmitter

219, 229. . . receiver

402, 404, 406, 408. . . step

Figure 1 is a schematic diagram of a general interactive game system.

2 is a schematic diagram of an interactive image operating system disclosed in accordance with an embodiment of the present invention.

Figure 3 is a functional block diagram of the interactive image operating system shown in Figure 2.

4 is a flow chart of an interactive image manipulation method for the interactive image operating system shown in FIGS. 2 and 3 according to an embodiment of the present invention.

130, 140. . . user

150. . . network

200. . . Interactive image operating system

210. . . First image interactive device

215, 225. . . Input/output interface

220. . . Second image interactive device

212, 222. . . Image capture device

214, 224. . . Image processing module

216, 226. . . Display device

218, 228. . . Image transmitter

219, 229. . . receiver

Claims (23)

An image interaction device includes: an image capturing device for capturing a digital image of an object; and an image processing module for generating a data vector according to physical characteristic information of the object included in the digital image And encoding the data vector to the digital image to generate a digitally encoded image; and an image transmitter for outputting the digitally encoded image to a network such that a device connected to the network can be The data vector included in the digitally encoded image is used to display the digital image. The image interaction device of claim 1, wherein the physical feature information of the object includes a moving distance, a moving speed, a moving direction, a depth map, a skeleton contour, and/or a gesture of the object. The image interaction device of claim 1, wherein the image processing module encodes the data vector into the digital image, and the method for generating the digitally encoded image comprises replacing the data vector with a specific position of the digital image. Data and add a header to indicate the specific location. The image interaction device of claim 3, wherein the specific location comprises a front end, a back end, an image high frequency area, an image low level area or a combination of the above positions of the digital image. The image interaction device of claim 1, wherein the image capture device is a two-dimensional camera, a three-dimensional camera, or a network camera. The image interaction device of claim 1, further comprising: a display device for displaying the digital image. The image interaction device of claim 1, wherein the data vector further comprises an external command and/or an image parameter for setting a display mode of the digital image. An interactive image operating system includes: a first image interaction device, comprising: an image capture device for capturing a digital image of an object; and a first image processing module for using the digital image The physical characteristic information of the object is included to generate a data vector, and the data vector is encoded in the digital image to generate a digitally encoded image; and an image transmitter is configured to output the digitally encoded image; a second image The interactive device includes: a receiver for receiving the digitally encoded image by the first image interaction device; and a second image processing module for decoding the digitally encoded image to restore the data vector and the a digital image; and a display device for displaying the digital image according to the physical characteristic information of the object included in the data vector. The interactive image operating system of claim 8, wherein the physical feature information of the object comprises a moving distance, a moving speed, a moving direction, a depth map, a skeleton contour, and/or a gesture of the object. The interactive image operating system of claim 8, wherein the first image processing module encodes the data vector in the digital image to generate the digital encoded image, the method comprising: replacing the data vector with one of the digital images Image data at a specific location, plus a header to indicate the specific location. The interactive image operating system of claim 10, wherein the specific location comprises a front end, a back end, an image high frequency area, an image low level area or a combination of the above positions of the digital image. The interactive image operating system of claim 8, wherein the image capturing device is a two-dimensional camera, a three-dimensional camera, or a web camera. The interactive image operating system of claim 8, wherein the data vector further comprises an external command and/or an image parameter for setting a display mode of the digital image, and the display device is based on the external command or the Image parameters to update how the digital image is displayed. An interactive image manipulation method comprising: A first image interaction device generates a data vector according to physical feature information of the object included in one of the digital images of the object; the first image interaction device encodes the data vector into the digital image to generate a digitally encoded image a second image interactive device decodes the digitally encoded image to restore the data vector and the digital image; and the second image interactive device displays the digital image according to the physical feature information of the object included in the data vector . The interactive image manipulation method of claim 14, further comprising: the first image interaction device capturing the digital image. The interactive image manipulation method of claim 14, further comprising: the first image interaction device outputting the digitally encoded image to the second image interaction device. The interactive image manipulation method of claim 14, wherein the physical feature information of the object includes a moving distance, a moving speed, a moving direction, a depth map, a skeleton contour, and/or a gesture of the object. The interactive image manipulation method of claim 14, further comprising: the second image interaction device setting the display mode of the digital image according to an external command or an image parameter for operating the digital image. The interactive image manipulation method of claim 14, wherein the first image interaction device encodes the data vector in the digital image to generate the digitally encoded image system: the first image interaction device replaces the data vector Image data of a specific position of the digital image, and a header is added to mark the specific position to generate the digitally encoded image. The interactive image manipulation method of claim 19, wherein the specific location comprises a front end, a back end, an image high frequency area, an image low level area or a combination of the above positions of the digital image. An image interaction device includes: an image capturing device for capturing a digital image of an object; and an image processing module for generating a data vector according to physical characteristic information of the object included in the digital image Substituting the data vector for image data at a specific position of the digital image, and adding a header to mark the specific position to generate a digitally encoded image, wherein the specific position includes a front end, a back end, and an image of the digital image a combination of a high frequency region, an image low bit region or a plurality of locations; and an image transmitter for outputting the digitally encoded image to a network such that a device connected to the network can be included in the digitally encoded image The data vector displays the digital image. An interactive image operating system includes: a first image interaction device, comprising: an image capture device for capturing a digital image of an object; and a first image processing module for using the digital image The physical characteristic information of the object is included to generate a data vector, the data vector is replaced by the image data of a specific position of the digital image, and a header is added to mark the specific position to generate a digitally encoded image, wherein the data is generated. The specific location includes a combination of a front end, a back end, an image high frequency area, an image low bit area or a combination of the digital image; and an image transmitter for outputting the digitally encoded image; and a second image interactive device comprising: a receiver for receiving the digitally encoded image by the first image interaction device; a second image processing module for decoding the digitally encoded image to restore the data vector and the digital image; The display device is configured to display the digital image according to the physical characteristic information of the object included in the data vector. An interactive image manipulation method includes: a first image interaction device generates a data vector according to physical feature information of the object included in one of the digital images; the first image interaction device replaces the data vector with the data Image data at a specific location of the image, plus a header to indicate the specific location to generate a number a bit-coded image, wherein the specific location includes a front end, a back end, an image high-frequency area, an image low-level area, or a combination of the above positions; and a second image interactive device decodes the digitally encoded image to restore The data vector and the digital image; and the second image interactive device displays the digital image according to the physical feature information of the object included in the data vector.