TW200526043A - Video analyzer - Google Patents

Abstract

A multiplexed motion picture stream (e.g., video) is demultiplexed. The motion picture stream contains one or more images from each of a plurality of camera sources. The process of demultiplexing the stream is automated and does not require user intervention. The stream is demultiplexed by identifying images within the image stream and comparing the images to representative images from camera sources. During comparison a mismatch value is determined and is compared to a mismatch threshold. If the mismatch value is below the mismatch threshold, the image is assigned to a channel associated with the camera. In some embodiments after demultiplexing, stored motion picture images of different channels can be viewed simultaneously at the same image by advancing to a given image of only one stored channel.

Description

200526043 A7 B7 V. Description of the invention 5 ο 11 5 11 Printed by the Consumer Cooperative of the Intellectual Property Bureau of the Ministry of Economic Affairs 2Θ The technical field to which the invention belongs This invention relates to image analysis. Prior Art In summary, the analog camera surveillance system generates more time to be stored in the video tape and outputs it. Photography_hezhi-camera_camera_for multi-tool. This type of system has a first camera that outputs images at 0 o'clock and a second camera that outputs images at n. In this way, the Lost Belt has images from each camera in sequence. Time-sharing town guards allow storage of large amounts of information. However, in the event of a videotape-like event, finding specific situations and multiplexing videotape are difficult and time-consuming tasks. Even if a digital camera is used and a digital output is generated, to identify an event, multiplexed digital streaming still requires a lot of manual intervention. Therefore, an automatic system is needed to demultiplex the image stream. SUMMARY OF THE INVENTION According to one aspect of the present invention, an image recognition technology is used to instantly demultiplex a multiplexed moving picture stream (such as an image). In some embodiments, it is possible to move to a given image of only one stored channel, while viewing the stored moving picture image of a different channel in the same image. A moving picture stream contains one or more images from multiple camera sources. The illustrative embodiment of the present invention is achieved with a computer program product having a computer-usable medium having a computer-readable program code on the medium. It can be read and used by computer system according to conventional methods. This paper size applies the Chinese National Standard (CNS) A4 specification (210x297 mm) 200526043 A7 B7 V. Description of the invention (2) The method includes receiving at least part of an image stream composed of a plurality of image images in a processor . From this image, we analyze the first shirt image and the first image. Determine the amount of misalignment between the first and second images. Any of a variety of comparison techniques can be used to achieve the amount of misalignment determination. Can be compared pixel by pixel (pixe | by pixel). Or it can be compared by region by region (region by region). If the misalignment is below a misalignment threshold, the first and second test images are assigned to the first channel. The first channel may be a memory storage location associated with the first camera. If the misalignment 10 15 is printed by the Consumer Cooperatives of the Intellectual Property Bureau of the Ministry of Economic Affairs 20 above the misalignment threshold, the first video image is assigned to the first channel and the second video image is assigned to the second channel. The second channel is a second memory storage location related to the second camera. Continuing the process, a current image is analyzed from the video stream and compared with each image of the channel given to the channel. After multiple images, each camera in the system has an image associated with it. The closest image related to a channel (camera) is the reference image. The reference map is used for all subsequent comparisons of the current image of the video streamer. After all channels have been assigned images, the misalignment level of each channel has been determined ^. If any misalignment value is below the misalignment threshold, the current image is assigned to the channel with the lowest misalignment. If all misalignment values are higher than the misalignment threshold, then the misalignment value is compared with the —discard threshold value # 乂 ☆ All misalignment values are higher than the · discard threshold, the current image is discarded. "Yu Bubutiantian" When the term is used here, the term “discarded image” is not associated with the video / channel, but the paper size can be adapted to 4-200526043, invention description 10 15 20 When all channels have related image maps ΐ If all channels / cameras do not have η -a ^ ", then the discard threshold is not used. The system automatically sets the number and when to start using the disposal threshold. The system camera is the reference image of the machine, and the system will recognize the value when the special line camera (such as a predetermined number of images). If the machine sentence has been considered and can then use the disposal threshold, this method is applicable to the processor Computer system, and the processor operates on the image stream without user intervention. In special cases, the user can interact with the graphical user interface to change various parameters. For example, the user can decide to change : Set the threshold or change the threshold for discard. The user can also discard the picture: reference the image and make the system restart to obtain the second image from the video stream and assign the image to each channel. The user can also specify- Any image can be read as' Even if the image exceeds the channel's misalignment threshold, after Qian Duowei passes through the time or solution process, the user can re-call the image through the channel and pass through the series of predicates. In addition, Taxi 'can be moved through all the other camera images in sequence by only moving between the images related to the single-camera.' Six methods can be used in real time to serially receive from memory or receive from a multiplexer. The image for analysis and operation. Can be sub-sampled (s.Sa_e) times the reference image and the current image Tarshish profile case 'to select the video display, and then compare 3 can be printed with -5-200526043 Ministry of Economic Affairs Intellectual Property Office staff Η consumer cooperatives

This paper scale applies the Chinese National Standard (CNS) A4 specification (21: 0: A7 B7 image in the second section of the image and the current image. In this method, the data used for comparison is less than the complete image image. Implementation -The term "digital image" as used in the following tissues refers to the digital representation of the attributable device temporarily, otherwise-a digital representation of the image. A typical digital image contains a plurality of messages I, each of which represents a face image. Divide the miscellaneous times so that the message box is composed of a series of pixels. Terms used in the following description

Single point of the image ° The larger the number of pixels in the image, the more the county image resolution I resolution- is generally expressed by the length and width measurement of the number of pixels, such as 8 coffee _ resolution, silk along the length direction _ transcription Up to 600 pixels in the image direction. The "channel" here is defined as the physical or virtual information that can be stored in or retrieved from memory. For example, a channel can be associated with a specific photography, and it can be used to mark the age position of a clock. Miscellaneous,-the frequency list is information related to drawing, such as the camera name or number. S 't of the present invention-the implementation of the wealth, will be a number of images from the stream into a stream of side-by-side image demultiplexing, can be collected , Analysis and View 2 Image from a given source. Figure 1 shows the environment in which the present invention-an embodiment is implemented. Figure ^ shows a complex number with rhyme (Photogram A, PhotoB Lin Zhic): = The video camera generates an image signal with image information. The image is "and digitally bribed to the scale 2Q Youshe Jizhi, or stored in the video tape 25 in bit or analog format. Many times, the source header information is used to identify the shell. Zada, but the present invention does not require header information to convert -6- 297 mm)

V. Description of the invention (5) Zhenm Xie Xigong. In the case of the poor news, then the current day and month will turn Jiang F's information into information and only process the image constituting the image == 5 _Multiple. If the image information is in an analog format, it will be cooked first. Those at this age are familiar with _Bai Lai Zhuan _ Lihua. After the shadow «bribe position, —bit dragon ^ to = ^ picture ^ is compressed and uncompressed, or it can be in the format of viewing or frame. : If the poor information is compressed, the processor will first shrink the video stream before decompressing the video stream. Similarly, the 'digital image may be any one of the color space representations including rgb and Y ^. Virtual 10 = __ :: OK; = = ::::: == ’can first store the information stream in the relay processor and execute the operation as described in the flowchart of Figure 1A to stream the video image 15 silly. ·: The video image string is controlled by the processor without the user's intervention. In a specific embodiment, the user can change the settings, or in a manual embodiment, the system can still automatically process the image stream. In this disclosure, the term “frame” refers to the 20-shirt image displayed during the calibration time period. The display of the image produced by the coffee-coffee lung device is also applicable as a whole. ~ ^ As shown in Figure 1A, '110 identifies the first image in the video stream. If the money' has been multiplexed from the camera, the video stream can come directly from multiple cameras, or video_stream can From the memory of ㈣t. Analyze the image _ image detail image of the Φ stream towel and store it with the processor-7- I paper size applicable national national standard (CNS) A4 specification (210x297 public love) 200526043 A7 B7 V. Description of the invention (6) ~-2 = in the memory location. The Gamma processor connects the first video image with the first camera and marks the image as the reference image of the first camera. As a The reference image of the camera. This image is for comparison with the image in the video stream below. 5 "3Q identifies sub-images in the video stream (" current image "). The image f is analyzed and stored in the processor-related memory. 14〇 Then process all the reference images and current images of αα, and compare the image data. In this comparison, the misalignment value is calculated occasionally. The misalignment value can be the percentage error of the pixels between the reference image and the current image. The misalignment value can be calculated in any way as long as it is a comparison of the amount of shared information between the reference image and the dependent image. For example, the difference ratio between the current image of a recognition source (camera) and each reference image can be calculated. Calculate the sum of the absolute value of the difference between the pixels of the current image and the reference image, and divide it by the sum of the intensity values of the pixels of the target image. This ratio represents the difference between the current image and a reference image for a given camera. 15 Calculate individual misalignment values for each reference image and the current image. In this flow chart, since only one camera is identified at this stage, there is only a single reference image, but as more images are recognized from different reference cameras, the reference frame will be related to each camera. Printed by the Consumer Cooperatives of the Intellectual Property Bureau of the Ministry of Economic Affairs 145 The processor then automatically recognizes if any of the judged misalignment values are below the 20 misalignment threshold. Although the term "below" is used, it may be equal to or lower than that without departing from the scope of the present invention. In addition, the comparison process assumes that the dislocation value is on a lower value scale, indicating that compared with the higher dislocation value, the representative image shares more information with the current image. It should be understood that the opposite scale can be implemented, and the larger the dislocation value, the more information is currently shared between the image and the representative image. In this case, the paper size applies to the Chinese National Standard (CNS) A4 (210 x 297 mm) 200526043 A7 B7

5 10 15 20 V. Description of Invention (7) In the case of all comparisons, the comparison will be reversed. 157 If the misalignment value is below the misalignment threshold, the current image is related to the camera (reference image) with the lowest misalignment value. Then use the current image as the reference image for the camera and replace the previous reference image. 147 If the misalignment value is lower than the misalignment value, the reason is that the misregistration and discard threshold are too low. As long as the -image has been compared with the video projector, the threshold is only for comparison purposes. If the JI50 records wrongly, it will be wrong; ϊ; higher than the value of the discarded controller, the current image will be given to the new camera. For example, the current image will be the camera M of the number 2 as the first reference image for the professional photography. In the process of assigning the current image to the new camera, the current image may have a header indicating that the current image is from the second camera. The processor may also store the image to a memory location related to the second image. The memory location can be shared with other cameras, or it can be an individual memory dedicated to camera 2. If the memory is shared memory, the processor will construct a linked image table (LUT aQQk_up_table) to obtain and display the camera image. 155 If all the misplaced values are discarded, the system can automatically discard the current image. Images can be stored and saved in individual reading positions for further steps. In others, the image is discarded and not stored. 160 If the current image is entrusted to the new camera, the processor will treat the current image as the reference image of the new camera. The 165 processor then checks for more money, and if not, handles the social bundle. If there are others, Ma De-the new edition and follow the rationale. With the success of processing -9- This paper standard applies ^ National Standard (CNS) A4 ^^ 1 () 乂 297 --.__ 200526043 • A7 B7 V. Description of the invention (8) '~ 一 --- Continued , Assign more current images to the new camera, until the cameras in the system all have-related reference images. The processor can be stylized, or the processor can automatically determine the total number of cameras. In the surveillance industry, multiplexed images are multiplexed so that one or multiple images from each camera are stored in the image stream in a 5-sequence manner (camera 1, camera 2, etc.). For example, if there are three cameras, one image from each camera can be stored in the grabber '. The first image is obtained at T0, the second image is obtained at T1, and the third is 7th. In other implementations, a particular camera may add more than one image to the video stream before adding images to other cameras. For example, camera 10, 1 can provide 3 images from D0, D1, and D2 to the video stream, and then camera 2 provides an image at T3 and camera 3 at T4. As a result, after the processor demultiplexes the image stream, the first few images are processed by the above method, and all cameras are recognized normally. If a camera, such as the first camera, has a predetermined number of images associated with it, such as 10 15 ® images, the total number of cameras with the specified image can be calculated. Since multiple images are already associated with the —camera (the —camera), the images of all the cameras are likely to have been overridden, and the multiplexed image stream has been looped around a camera. Printed by the Consumer Cooperative of the Intellectual Property Bureau of the Ministry of Economic Affairs To increase the processing speed of image streaming, the image can be sub-sampled. You can subsample images horizontally and vertically before comparing 20 images. In the embodiment, the image of the NTSC frame can be reduced in size, for example, it is 1/8 of the original size before storage. Image reduction can be done simply by removing pixels. For example, to reduce the number of pixels in a 800 × 600 pixel image by 4 times, every other pixel can be removed to make it 400 × 300 pixels. In another example, Fu can be used

This paper size applies to China National Standard (CNS) A4 (210 X -10- 200526043)

Inverter transforms and encodes the image, and then samples it in the frequency domain. In the example, the data can be reduced by averaging. For example, every eight pixels of eight pixels can be averaged, and 64 pixels per pixel are converted into one pixel. These two samples are not shown in Figure 1B. 125B and 135b will be sub-sampled with reference to Figure 5 and the current image before comparison. The entire image image and all its pixel assets can be stored for display 'but the image is sub-sampled to increase the comparison processing speed. In addition-Figure 1C125C, 135C display-image paragraph data can be used for comparison processing, rather than the display image: miscellaneous. System users can pre-select or pre-select the " " segment map for comparison. When using it at this time, the technique 1〇 # 日 日 守, is the image data displayed on the display device, and select a box or other appearance, so that it is less than all the image data. If the paragraph is predetermined, the image data need not be displayed on the display device. The image data will be selected according to the address position related to the paragraph on the display device that the user wants to compare. Those skilled in the art should know that the sub-sampling and sub-segment selection of images can be used in combination to further increase the speed of image comparison and image multiplexing. Printed by the Consumer Cooperative of the Intellectual Property Bureau of the Ministry of Economic Affairs In a specific embodiment, before comparing the reference image with the current image, the selected image area is normalized and any brightness / intensity changes are removed from the comparison. For example, calculate the average intensity value in the user-selected area of the reference image and the same area in the current image. Subtract the average intensity value from each pixel intensity value. This step takes into account all changes in brightness, such as sudden flashes, to normalize the values. Therefore, only the absolute values of changes close to the intermediate values of the two images are compared. For example, if a camera is monitoring an automatic teller machine and a car is approaching the cash dispenser and the car's headlights suddenly illuminate the observation area, then this lighting change is taken into consideration. This regularization can also be implemented in any of a number of ways known in this technology, including the use of a standard paper size that applies the Chinese National Standard (CNS) A4 (210x297 mm) 200526043 A7 B7

10 15 Printed by the Consumer Cooperatives of the Intellectual Property Bureau of the Ministry of Economic Affairs. 20 RMS value for the average intensity of the user selection area. During image multiplexing, the display can be displayed on the display. Images related to a camera are displayed on individual windows 810. After 1D, the tea test image is displayed in the window of each camera. ^ Display and re-save the similarity of the cameras, you can not transfer "money: take, for example, each of the four cameras through the time-sharing surveillance system to capture 3 images before taking 彳 Π image, tilting each image ' Each i channel related to the camera will have 6 stored images. The camera will have images at τ〇, Ή = not visible, and then the T2 map will cover another 3 times. Video frequency 2, = 3 blank images' Next is the image at T3, which will: have 4 blank images stored, then the image at T4: Second, people, camera 4 will have 5 blank images, and then consider this The first cycle of each camera. In subsequent cycles, repeat until the new current frame related to the camera and the reference picture i. In this way, all channels of all camera modes will be stored on the display. The same amount of images, so you can come to the right image, the system users during the demultiplexing process or after all the images are demultiplexed, they will enter the time point, and then in the second section of this paragraph Check all the images captured by all cameras. For example, you can use ^ to select rotation or pass forward—specific For a single set of images of the camera, the system receiver can display the noise-related close-up images that occurred during the clearing. The system and method of the above boundary will work to demultiplex the image stream without multiplexing.

Specifications for this paper size (210 X 297 public love)

200526043 A7 B7 V. Description of the invention (Η 10 15 Printed by the Consumer Cooperatives of the Intellectual Property Bureau of the Ministry of Economic Affairs 20 User intervention. However, the user can ignore the system and change the settings in the system. For example, the user can change the disposal threshold or The misalignment threshold is shown in Figure 1D. The user can assign an image to a camera, even if the system indicates that the image should be discarded or assigned to another—camera camera. In this way—the system and method That is to provide the user's personal interface to control and change the parameters of the system and to cancel the system. Since the effects of changes such as daylight changes and camera panning are minimized, the current image replaces the reference image The processing facilitates source identification. In one embodiment of the present invention, the camera shoots an area by scanning over it. The image captured by the multiplexed scanning camera is then demultiplexed as shown in the figure. As shown in Figure 3. In this practice, #set the threshold of misalignment to connect = Image and -Camera 'to consider the temporary change between image and image as the camera scans. For example, Figure 3 shows The three cameras (camera 彳, camera 2 and camera 3) produce—the shape image 32Q, in which the goalkeeper images from each camera are added to the sequence at any time. After the image is stored in the sequence, the process is repeated. In FIG. 3A, the image from camera 1 occurs at T0 and T3. As shown in FIG. 3B, if the camera movement between D0 and T3 can be considered, it will be from D0. The images are offset by three pixels, and the images overlap. Most of the pixels of the image when riding TQ will overlap the images at 3 o'clock. Replace the reference image with the current image and use the comparison period. When updating the reference image, the amount of movement between the reference image and the current image is minimized, that is, no more complicated tracking and comparison techniques are needed. Compared with the time between miscellaneous stored images, the camera moves slowly. Then you can adjust the threshold to adapt to the movement. -13- This paper size is applicable to Chinese national standard cars (CNSU4 specifications ί2 ν ΊΟΊ \

200526043 A7 B7 V. Description of the invention (12) In other embodiments, in order to consider the camera scan, it is more beautiful than the current image, that is, offsets the pixel position of the reference image. In addition, in this comparison process, the current image may be shifted several times in several directions to calculate a difference ratio and compare the ratio with a threshold value. In addition, the direction of miscellaneous movement can be analyzed by the trend. 5 The movement direction of the towel is based on the previous movement of the same plane. Therefore, by tracking the moving direction, the data position offset and comparison number can be reduced. In another embodiment, after all the cameras in the surveillance system have an associated image in the system, the processor has sufficient data to identify the sequence, and the radio images are associated with the camera. As long as the order is known, the system or 10 can increase the misalignment threshold and assign individual-individual misalignment thresholds to each camera, and only recognize significant changes in the image. For example, if there is a qualitative change in movement or lighting, the system can recognize these images and assign a label to the digital data 'so that the user can find the image when reviewing the image subsequently. In another embodiment, in order to save memory space, only the moving image 15 can be recorded and stored in a channel related to the camera. Printed by the Consumer Cooperatives of the Intellectual Property Bureau of the Ministry of Economic Affairs. Under certain circumstances, the images can be separated by time and / or date. In certain multiplexed systems where the camera is a digital camera, such as a CCD (Charge Coupled Device), the digital data stream with the digital image can include the date and time stamp before the digital image image. In this case, you can store and separate images in time according to date = 20 times. In other multiplexed systems, the camera generates an analog # with overprinted date and time, or the date and time of the digital camera included in the digital image, then the image can be sub-divided by time and date. In this embodiment, after the image signal is digitized, the display area or date is used to select the user-selected area. If the images are separated by time, the user's selection area can be changed. 14- • · This paper is a small-scale standard (CNS) A4 specification (210 × 297 is clear — ---- ^ 200526043 Λ7 V. Description of the invention (π ) 10 15 Printed by the Consumer Cooperatives of the Intellectual Property Bureau of the Ministry of Economic Affairs 20 22! · Time Γ ° Α 'Not as shown in Figure 4A, and any time in the area of the image image can be saved to and from The difference between the hour and the month-the date of the month injury is to select the user-defined zone G B. The system can hold the change in the data definition of the observed financial value _ exceeded-the threshold value, and identify the changes from different dates in the month Figure 5 is another embodiment of the present invention, in which the formula 50,000 of the present invention. The device 500 may be an electronic device such as a programmable FPGA module. A chip 5G is included to recover or receive digital images. Data recovery module 501 of data 550. The digital image data includes images from multiple sources of poor image data. The recovery module 5Q1 recovers the first digital image data representing the first image, and recovers the current digital image— Group of current digital video materials. Recovery module 501 transmits the first group The digital data to the bribe module 502. The storage 2 module 502 stores the first set of digital image data in the memory 56. The memory location is related to the first source 561. This data is also considered as a representative of the first source Sexual image data. The recovery module 5Q1 sends the first set of digital image data and the current digital image data to the computing module 503. The first setting and digital image data of the digital image data of the different calculation module 503 described above The current setting is to calculate the difference ratio. If more than one source has been identified, the digital image data of each representative image of a source is restored, and the difference ratio is calculated separately. The difference ratio ("misplace value") is transmitted to the query module 50. The query module 504 compares the difference ratio with a misalignment threshold. If the difference ratio of a representative image from a camera source is lower than the threshold value, the current image is linked to the camera. Order-15- This paper size applies to China National Standard (CNS) A4 (210 X 297 mm) 200526043

5 ο 11 5 11 Member of the Intellectual Property Bureau of the Ministry of Economic Affairs, Consumer Co-operation, Printed by the Society 20 Note: == ^ Camera 562 related Tozaki, the current digital image will be: _ 结 === False, the image will become the fourth camera Representative image. The body with the camera can be co-drought memory, where the identification code and the image data = identify the image data related to the camera, or the memory can be an individual or a memory. If you remember, the drive will send the relevant image to the memory of the new button. If the RAM memory is segmented, then each button will be related to a specific camera. The domain controller will have a LUT «specify the number The image starves the memory section associated with the camera. If all the difference ratios are higher than the misalignment threshold, the query module 504 compares the misalignment value with the -discard sickle value. If the wrong recordings are all higher than the discard threshold, the system can automatically discard the images without user intervention. If the misalignment value is not negotiated for the discard threshold, the query module will automatically assign image data to a new camera source. In other embodiments, the user receives the message on the display device 51, and the current image of the image data is not easily linked to a specific source because the misalignment value is higher than a threshold value. The user can then couple to the indicator A through a link. The input device 511, such as a keyboard or mouse, from a device of the first source or another previously identified source sends a response that should be related to a new source or discarded. The query module 504 receives this information and instructs the storage and storage module 502 to store the current digital image data of the current image of the image in a memory with an identified source. The system user has the display of the current image and representative images of each camera. Allows the user to perform a visual comparison to assist identification 16- This paper size applies the Chinese National Standard (CNS) A4 specification (210 X 297 mm) 200526043 A7 V. Description of the invention (15 treatment. 10 15 Ministry of Economic Affairs 20 It should be noted that the right user recognizes that the current digital image data is from a new source! The monthly digital image data will be linked to the memory location related to the new camera source. The normalized module 505 can also be incorporated into the device. The normalization loss group normalizes the digital image data of the image of the moon and the moon, and compares it with the representative image image. As mentioned above, the normalization of the digital image data can be considered such as daylight and night light. Normalization Department Occurs before calculating the difference ratio.-It should be noted that the miscellaneous things described here are all aspects of the invention, and should not be considered as limiting the invention to any specific logical flow or logical implementation. = Without changing the overall view As a result, the logic is divided into different logical blocks (such as programs, modules, functions, or subroutines) under the actual shooting of the present invention. According to the tradition, logic units are added, improved, ignored, and implemented in different orders, or different logics are used to build the invention. The present invention may take many different forms, including but not limited to the same processing. Crying (such as microprocessors, microcontrollers, digital signal processors, or general-purpose electronic devices); programmable logic (such as placeholders (FPGA) or other PLDs); programmable logic; Integrated circuits (such as special application integrated circuits (AS or any other combination of any other means.), == The computer logic of the foregoing functions can be in various forms-secret code form, computer executable form and various Form (for example, a combiner, compiler, linker, or locator, 200526043 A7

5 ο 11 5 ΙΑ Consumer Co-operation of the Intellectual Property Bureau of the Ministry of Economic Affairs, Social E 20 System). The source code can include and be used with various programming, operating systems, or operating environments in a variety of programming languages (such as object code, combined language; or a high-level mindset such as Fortran, ◦, C ++, JAVA, or HTML) —any of these can be used. -Series computer L order. The source code can define various fresh materials and communication information for money. The source code may be in a computer-executable form (for example, via a translator) or the source code may be converted into a computer-executable form (for example, via a translator, combiner, or compiler). 〇 A computer program can be specified in any form (such as source code form, computer executable form, or intermediate form), whether permanently or temporarily in a tangible storage medium such as a semiconductor memory device (such as RAM, ROM, PR0M, EEPR〇M, or Flash Programmable RAM); magnetic memory devices (such as m or fixed disk); optical memory devices (such as CD_ROM); pC cards (such as PCMCIA cards) or other memory devices. A computer program can be fixed in any form to a signal that can be transmitted to a computer using any of different communication technologies. Communication technologies include, but are not limited to, analog technology, digital technology, optical technology, wireless technology, network technology, and Internet technology. The computer program can be in any form on a removable storage medium with accompanying printed or electronic documents (such as envelope software or magnetic tape); pre-loaded with a computer system (such as on a system ROM or fixed disk), or via communication From a server or electronic bulletin board of a system (such as the Internet or the World Wide Web). The hardware logic that performs all or part of the functions described above (including programmable logic used with programmable logic devices) can be designed using traditional manual methods or using various tools such as computer-aided design (CAD), hardware description languages (such as VHDL or AHDL) or PLD programming language (such as PALASM, abel -18-this paper size applies to China National Standard (CNS) A4 specifications (χ 297 mm)

200526043 A7 B7 V. Description of the Invention (17). Or CUPL) Design, capture, simulation or electronic files. The invention may be embodied in other specific forms without departing from the scope of the invention. The described embodiments are comprehensive and are intended for illustration only and without limitation. Brief description of the drawings 5 With reference to the above detailed description and the accompanying drawings below, it is easier to understand the features of the present invention, wherein: FIG. 1 shows the environment of the first embodiment for performing image and image demultiplexing; FIG. 1A shows A flowchart of demultiplexing a 10-image image in a series of image images from a plurality of cameras; Figure 1B shows a flowchart of another aspect of demultiplexing an image image, in which the image is sub-sampled; Figure 1C shows a flowchart of another aspect of image multiplexing, in which the secondary segment of the comparison image is compared; 15 Figure 1D is a glorious lens showing the graphic display from multiple cameras; Figure 2A represents the display on The reference image on the display device, where the wireframe refers to the user-defined area; printed by the Consumer Cooperative of the Intellectual Property Bureau of the Ministry of Economic Affairs, Figure 2B represents the current image displayed on the display device, and displays the same user as in Figure 2A The restricted area is used for comparison; 20 Figure 3 shows that three cameras (camera 1, camera 2 and camera 3) generate a series of multiplexed image images, in which images from each camera are added to the sequence over time; Figure 4 shows The area the user wants to select, where the area contains the date and time displayed; and, -19- This paper size applies the Chinese National Standard (CNS) A4 specification (210x297 mm) 200526043 A7 A7 B7 V. Description of the invention ( 18), FIG. 5 is an embodiment of the present invention, in which the module is structured in hardware to perform the functions of the disclosed method. Description of the drawing code 20 processor 25 video tape Intellectual Property Bureau of the Ministry of Economic Affairs employee consumer cooperative printing 400 user-defined area 410 image display 500 device 501 recovery module 502 storage module 503 calculation module 504 query module 505 normalization Module 510 display device 511 input device 550 digital image data 560 memory 561 first source 562 identification camera 800 display device '810 window-20- This paper size applies to China National Standard (CNS) A4 specification (210 x 297 mm)

Claims (1)

Sixth, the scope of the patent application is clear. ^ A method for demultiplexing the image image + image stream / image image axis complex frequency generation, the financial method includes: The image t: "分 由-processing Analysis of the composition of a plurality of video images in the device-the first video image from the video stream; points =-the second video image from the video stream; determining the first video image disk-(mismatch ) *;… The dislocation between the second image and the image 10 15 20 If the dislocation is lower than the -dislocation threshold and the second image image to the first channel—the daughter-in-law ’s shirt looks like the image 2. Method of applying for the scope of the patent, item g—the memory storage location for storing the image and picture. 3. Doubao 3. If the scope of the scope of applying for the patent is the first item • The first camera has the i method, where the first channel and 4 · If the application scope of the patent item No.1 is misplaced, the position will be determined by the township, and the misplacement is higher than that of the second video image to a second channel. ◎ 1-channel, and refer to 5. One of the scope of the patent is related to the second camera. Go, /, the second channel is related to 6. Each channel related to the party in item 4 of the patent scope has been designated-after the video image is at least one new from the video stream with the camera-judging that the new video image and the at least one from each channel Image map-21-200526043 6. The amount of dislocation between images in the scope of patent application; and designate the new image side image to-the channel with the lowest dislocation. 7. If you request the method of the 6th patent, please: Discard the shaft image instead of the new one. For example, the method of claim 4 of the patent scope, the further steps include: iiZ-Zheyi this / You Xiang from 4. Like to compare ...., not smoke Cut-off image / Judgment-first-and-second misalignment; and 10 15 Consumers' cooperation of Intellectual Property Bureau of the Ministry of Economic Affairs, printed by the society 20. Ke Meng came up with a misalignment threshold to set the second image image to a Channel 3. 9. If the method according to item 4 of the patent application is applied, the further steps include: comparing the third image noise with the first image image and the second image to determine a first and a The second misalignment; and-if the first-misalignment and the second misalignment are lower than the misalignment sickness value, the second image image and Channels related to low misalignment. Day 10. If the method of claim 4 is applied, the steps further include: comparing a third image image with the first image image and the second image to determine a First and first dislocations; and if the first-dislocation and the second dislocation exceed a discard threshold, the third image image is discarded. Then 11. If you want to ask for a bribe, Each of these cameras is related .. 〃 12. If the method in the scope of patent application for item 彳 is applied, the further steps include: providing multiple cameras to the processor. 'Image map h' means 4 image maps J -22-& The paper size applies the Chinese National Standard (CNS) A4 specification (210x297 Public Love 200526043) 6. Patent application scope 10 15 13 · — • A method for streaming video images with complex side images, the method includes: Compare each new image in the image stream with a camera-related representative image to determine a misalignment value; and you ~ ^ all such misalignment values exceed a misalignment threshold, Associate the new image with a new camera. 14. If the method of claim 13 is applied, if any of these misalignment values are lower than the misalignment threshold, select the $ max ^ bit value to record the camera that depends on the most healthy money Associated. 15. If the method of item 14 of the scope of patent application is applied, if the misalignment values are all higher than-disposing of scales, then Lai Yinglai will be discarded. —16 · If the method of item 14 of the scope of patent application, in which a predetermined number of video images are assigned to a specific camera, the total number of pictures of the camera can be determined. 17 · If the method of item 1 of the patent application, The channel designation is implemented immediately. 18. The method according to the scope of patent application, wherein the digital video stream is analyzed and the video images are assigned to a channel in real time. Chi 20-19. The method according to item [Scope of Patent Application], wherein the first image image and the second image image are sub-sampled (su | > sam_) before comparison. 2. The method according to item 1 of the scope of patent application, wherein if the video stream contains header information, the header Wei is discarded. 21. The method according to item (1) of the scope of patent application, further comprising: -23 public paper issued by the Chinese Government ^ Standard (CNS) A4 X 297; 200526043 A8 B8 C8 meter 200526043 VI. The scope of the patent application image is produced and produced by multiple cameras. The computer code includes: the computer code composed of the gamma image in the image; • used to analyze a first-image image from the image stream The code used to analyze—the computer used to analyze—the second image image from the image stream—the computer code of Guanhuai— # 彡 side Lai Liner image 1; and certificate 10 15 20 if the misalignment is lower than— Mistakes are reduced, and the green code—the video ^ The second video image—the computer code for the channel. Order ^ 30. If the electronic hemp type product in the fourth item of the patent application scope, wherein the computer is used for ^, the code designates the first image and the first shirt image to a memory storage location . 31. If the computer program product with the scope of patent application No. 29, channel 1 in 1 is related to a first camera. '〆 ° 〆32. If the computer program product of the 29th scope of the patent application is applied, further baggage ★ If the misalignment is higher than the-misalignment threshold, specify the first image image channel and the channel Two video images for the second channel of the computer 33. For example, the computer program product of the scope of application for item 32, wherein the second channel is related to a second camera. Λ 34. If the computer program product of item & in the scope of patent application, _-25-This paper size fine towel _ home standard (CNS) A4 specification (2⑺χ 297). 6. The scope of patent application, in each-related to the camera After each channel is assigned a video image, it is used to compare the new video image from the video stream with the computer code of at least one video image from each channel; it is used to determine the new video image from each channel. Computer code for the amount of misalignment between the at least one image and five images of the channel; and computer code for deducting the image image to a channel with the lowest misalignment. 35. For example, a computer in the scope of patent application No. 34 The program product further includes a computer code of 10 that the minimum misalignment exceeds a discard threshold and is used to discard the new image Θ image instead of assigning the new image image to the _ channel. 36 · 如The computer program product under the scope of patent application No. 32, further includes: comparing a third image image with the first image image and the second image image 15 to determine a first and-second misalignment. Computer code; and ^ if A misalignment and the second misalignment exceed a misalignment threshold, which means that the second image image is given to the computer code of a third channel. 37. If the computer program product of item 32 of the patent application scope further includes: 2 〇 compare a third image with the first image and the second image to determine a first and a second misaligned computer code; and ^ if the first misalignment and the second If the misalignment is lower than a misalignment threshold, the third image is assigned to the computer code of the channel related to the lower misalignment. If the computer program product of the 32nd item of the scope of patent application is applied, further include -26-200526043 A8 B8 C8 5 ο IX 5 11 Intellectual Property Bureau, Ministry of Economic Affairs, Consumer Consumption Cooperative, Printed by the Society 20 Compare the image of the younger brother's shirt with the first image and the π image to determine the image of g ~ and the image of the first shirt The computer codes of the first and second brothers are misaligned; and if the === bit exceeds the -abandonment threshold, the Tao and the Pinpin are included, each of which includes: 40 • If the 29th item of the scope of patent application The computer program product further includes a user interface to input the computer code of the number of cameras. -An electronic post-type product with a computer code on it to stream an image with a recurring image. The computer code is for use by a computer. The code includes: Cong Zhi j in Each image in the pin stream and a camera related to the camera are compared to determine the computer code of a misalignment value; and shot one = every, misalignment values such as Hai are beyond a misalignment threshold, The computer code associated with the new image /, a new camera. = · If the computer program product of item 41 of the scope of patent application, any of these misalignment values on the right is below the misalignment threshold, then select the lowest misalignment value and make The computer code associated with the camera. ^ • 43 · If the computer program product under the scope of patent application No. 42 is further included, if these misalignment values are higher than a discard level, the new image image -27-200526043 A8 B8 Discarded computer code. 44 · If you apply for a computer program product with the scope of patent No. 42, Tian "will assign the" Silhouette of Shadows "to a specific camera, and then 1. The computer code of the total number of cameras. 45. If the patent, please apply for the fourth Item of the computer program product, of which only the real-time implementation is implemented. For example, the computer program product of item 29 of the patent scope, where the electronic device analyzes Wei image streaming and assigns the image images to — Channel. Ο 47. If the computer program product with the scope of patent application No. 29 is applied, further include the first image > brain code before comparison. Younger one image image sub-sampling electricity 5 IX Intellectual Property Bureau employee, Ministry of Economic Affairs Printed by Consumer Cooperatives 20 48. If you apply for a computer program product with the scope of item 29 of the patent application, further include the computer code used to identify the header information related to the image and the image. ~ 49. If you apply The computer program product of item 29 of the patent scope further includes computer code for providing-setting the misalignment level user interface; and computer code for receiving the misalignment level user input. 5 0. The electric presentation product according to item 29 of the patent application scope further includes: · a computer code for providing-a user interface for setting the disposal level; and a user input for receiving the disposal level The computer code of a person. 51. If the computer program product of the 43rd scope of the patent application, further includes: -28-This paper size applies the Chinese National Standard (CNS) A4 specification (21 × 297 mm) 200526043 A8 B8 C8