CN1825934B - Method and system for processing multimedia information - Google Patents
Method and system for processing multimedia information Download PDFInfo
- Publication number
- CN1825934B CN1825934B CN2006100088249A CN200610008824A CN1825934B CN 1825934 B CN1825934 B CN 1825934B CN 2006100088249 A CN2006100088249 A CN 2006100088249A CN 200610008824 A CN200610008824 A CN 200610008824A CN 1825934 B CN1825934 B CN 1825934B
- Authority
- CN
- China
- Prior art keywords
- image
- module
- mobile multimedia
- view data
- integrated
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 238000000034 method Methods 0.000 title claims abstract description 52
- 238000012545 processing Methods 0.000 title description 32
- 238000003860 storage Methods 0.000 claims abstract description 19
- 230000000007 visual effect Effects 0.000 claims abstract description 8
- 238000006386 neutralization reaction Methods 0.000 claims description 4
- 230000014759 maintenance of location Effects 0.000 claims description 3
- 230000015654 memory Effects 0.000 description 79
- 230000006870 function Effects 0.000 description 28
- 230000000694 effects Effects 0.000 description 16
- 230000006835 compression Effects 0.000 description 7
- 238000007906 compression Methods 0.000 description 7
- 238000005516 engineering process Methods 0.000 description 7
- 230000005055 memory storage Effects 0.000 description 7
- 230000008569 process Effects 0.000 description 7
- 238000010586 diagram Methods 0.000 description 6
- 238000004590 computer program Methods 0.000 description 5
- 230000002093 peripheral effect Effects 0.000 description 5
- 208000024754 bloodshot eye Diseases 0.000 description 4
- 230000006837 decompression Effects 0.000 description 4
- 238000013461 design Methods 0.000 description 4
- 238000010295 mobile communication Methods 0.000 description 4
- 201000005111 ocular hyperemia Diseases 0.000 description 4
- 238000012360 testing method Methods 0.000 description 4
- 238000006243 chemical reaction Methods 0.000 description 3
- 238000005520 cutting process Methods 0.000 description 3
- 241000209149 Zea Species 0.000 description 2
- 235000005824 Zea mays ssp. parviglumis Nutrition 0.000 description 2
- 235000002017 Zea mays subsp mays Nutrition 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 235000005822 corn Nutrition 0.000 description 2
- 238000013478 data encryption standard Methods 0.000 description 2
- 238000009826 distribution Methods 0.000 description 2
- 230000010365 information processing Effects 0.000 description 2
- 238000007726 management method Methods 0.000 description 2
- 239000000463 material Substances 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 1
- 230000000712 assembly Effects 0.000 description 1
- 238000000429 assembly Methods 0.000 description 1
- 239000003990 capacitor Substances 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 230000005059 dormancy Effects 0.000 description 1
- 230000008030 elimination Effects 0.000 description 1
- 238000003379 elimination reaction Methods 0.000 description 1
- 239000004744 fabric Substances 0.000 description 1
- 238000009415 formwork Methods 0.000 description 1
- 238000013467 fragmentation Methods 0.000 description 1
- 238000006062 fragmentation reaction Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 230000000737 periodic effect Effects 0.000 description 1
- 230000002265 prevention Effects 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
- 238000011946 reduction process Methods 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000010977 unit operation Methods 0.000 description 1
Images
Abstract
Certain embodiments of the invention may be found in a method and system for image editing in a mobile multimedia processor and may include editing image data within a mobile multimedia chip comprising an integrated image editor. At least a portion of the image data may be acquired for the editing from at least one of a plurality of storage devices. The at least one of the plurality of storage devices may be integrated within the mobile multimedia chip, and/or may be located external to the mobile multimedia chip. The mobile multimedia chip may be integrated within a mobile device with a visual display that displays at least a portion of the edited image data. The image data may be edited within the mobile multimedia chip independent of a file format associated within the image data.
Description
Technical field
The present invention relates to mobile multimedia communication, more specifically, the present invention relates in mobile multimedia processor, carry out picture editting's method and system.
Background technology
Mobile communication has changed the mode of people's communications, and mobile phone also changes the element of people's daily life into from a kind of luxury goods.Social condition is depended in the use of mobile phone, and is not subjected to place and technology limitation.Current, voice connect the basic need that has satisfied periodic traffic, and mobile voice connects the every aspect of just constantly dissolving in daily life, and next step integrated mobile multimedia that will be to use mobile Internet to get of mobile communication revolution is used.
The third generation (3G) cellular network of multiple high-speed access technology can be provided, and special design uses the mobile phone of these technology, satisfied people to integrated multimedia demands of applications such as the TV that supports to use the advanced compression standard and voice applications, high-resolution recreation application, music interface, peripheral interface supports.Transmit more information along with the chip designer uses the bandwidth of compress technique and Geng Gao, processing requirements also improves thereupon.To between the 2M/s, this allows the chip designer to provide multimedia performance, higher quality, lower interference and bigger overlay area for wireless system to the bit rate that the 3G wireless application is supported at 384k/s.
Along with mobile multimedia service is more and more universal, factors such as power consumption, network performance cost performance optimization and service quality concerning telecom operators with even more important.The raising of the improvement of the careful network planning and deployment, transmission means, receiver technology and chip Integrated Solution just can make above-mentioned target be achieved.In this, operator needs a kind of technology to make can to use for mobile multimedia higher downlink throughput capacity is provided, and coming with this is that the consumer of mobile multimedia application service provides more outstanding QoS performance and speed.
Current, mobile multimedia processor is not also fully developed the integrated effect of monolithic system (SOC), and coming provides more outstanding overall system solution for the mobile handset of today.For example, existing mobile processor can use a plurality of hardware accelerators to support multiple multimedia application, and this will increase power consumption, implementation complexity significantly, mobile processor takes up space and the final volume of portable terminal.However, can provide the new technology of more outstanding downlink capacity constantly to release, further quicken the demand of people multimedia application of new generation.The primary goal of these multimedia application of new generation provides and the similar application of application type commonly used in personal computer (PC).
Compare the follow-up system that will introduce in conjunction with the accompanying drawings of the present invention, other limitation of prior art and drawback are conspicuous for the person of ordinary skill of the art.
Summary of the invention
The invention provides a kind of system and/or method of in mobile multimedia processor, carrying out the picture editting, be illustrated in conjunction with at least one width of cloth accompanying drawing, and carried out complete description in the claims.
According to an aspect of the present invention, provide a kind of method of handling multimedia messages, described method comprises: by obtaining view data to edit at least one from a plurality of memory devices of image editor that is integrated in the mobile multimedia chip;
By described integrated image editor at least a portion of described view data is converted to described mobile multimedia chip from the original image form and edits suitable picture format;
Use the band method in described integrated image editor, to edit described view data based on the form of described view data, wherein said band method comprises: read next band from input image data, handle this band, and the band after will handling writes in the output image.
Preferably, during described a plurality of storage is established described at least one be positioned at one of following: be integrated in the outside that described mobile multimedia chip neutralization is positioned at described mobile multimedia chip.
Preferably, described mobile multimedia chip is integrated in the mobile device that includes the visual display unit that is used for showing the view data behind the described editor of at least a portion.
Preferably, described method also comprises: be independent of the file format relevant with described view data, in the described view data of mobile multimedia chip inediting.
Preferably, described method also comprises: be independent of the source position relevant with described view data, in the described view data of described mobile multimedia chip inediting.
Preferably, described method also comprises: in the described view data raw pixel data of described mobile multimedia chip inediting.
Preferably, described method also comprises: use at least one plug-in unit that is connected on the described mobile multimedia chip to edit described view data in described mobile multimedia chip.
Preferably, described view data comprises video data.
According to an aspect of the present invention, provide a kind of system that handles multimedia messages, described system comprises: be integrated in the image editor in the mobile multimedia chip, obtain view data at least one from a plurality of memory devices to edit; Described integrated image editor is converted at least a portion of described view data with described mobile multimedia chip from the original image form and edits suitable picture format, and use the band method based on the described view data of the format editing of described view data, wherein said band method comprises: read next band from input image data, handle this band, and the band after will handling writes in the output image.
Preferably, be integrated at least one from a plurality of memory devices of described image editor in the described mobile multimedia chip and obtain at least a portion of described view data to carry out described editor.
Preferably, during described a plurality of storage is established described at least one be positioned at one of following: be integrated in the outside that described mobile multimedia chip neutralization is positioned at described mobile multimedia chip.
Preferably, be integrated in described image editor in the described mobile multimedia chip and be integrated in the mobile device that includes the visual display unit that is used for showing the view data behind the described editor of at least a portion.
Preferably, the described image editor that is integrated in the described mobile multimedia chip is independent of the file format editor described view data relevant with described view data.
Preferably, being integrated in described image editor in the described mobile multimedia chip is independent of the source position relevant with described view data and edits described view data.
Preferably, be integrated in the raw pixel data of the described view data of described image editor editor in the described mobile multimedia chip.
Preferably, the described image editor that is integrated in the described mobile multimedia chip uses the described view data of at least one plug-in unit editor that is connected to described mobile multimedia chip.
Preferably, being integrated in described image editor in the described mobile multimedia chip is converted to the described view data of at least a portion with described mobile multimedia chip from the original image form of described view data and edits suitable picture format.
Preferably, the described image editor that is integrated in the described mobile multimedia chip uses the band method based on the described view data of the format editing of described view data.
These and other advantages of the present invention, purpose and character of innovation, and the details of described embodiment will comprehensively be understood after in conjunction with the following description and drawings.
Description of drawings
Figure 1A is the structural representation of the mobile device of the mobile multimedia chip that has integrated image editor of the use according to one embodiment of the invention;
Figure 1B is the structural representation of mobile multi-medium system according to having of one embodiment of the invention of integrated image editor;
Fig. 2 A is the block diagram according to the image editor of one embodiment of the invention;
Fig. 2 B is the block diagram according to the image editor of one embodiment of the invention;
Fig. 3 is the flow chart according to use bar tape handling (striping) the method processing video data of one embodiment of the invention;
Fig. 4 is the block diagram according to the image manipulation of the image editor shown in Fig. 2 B of one embodiment of the invention;
Fig. 5 be according to the processing multi-medium data of one embodiment of the invention flow chart.
Embodiment
The invention provides a kind of method and system that in mobile multimedia processor, carries out the picture editting, be included in mobile multimedia chip inediting video data.Described mobile multimedia chip can obtain video data to edit from on-chip memory and/or chip external memory.Described mobile multimedia chip is integrated in the mobile device, and described mobile device comprises visual display unit, the video data behind demonstration at least a portion editor.Described mobile multimedia chip has nothing to do to the editor of video data and the source position of file format and/or video data.In addition, but the raw pixel data of described mobile multimedia chip editing video data, also can with video data from its original image format conversion for and the suitable picture format of editing of described mobile multimedia chip.In one embodiment of the invention, on described mobile multimedia chip, be connected with one or more plug-in units,, for example eliminate " blood-shot eye illness " function so that additional image processing function to be provided.
Figure 1A is the structural representation of the mobile device of the mobile multimedia chip that has integrated image editor of the use according to one embodiment of the invention.As shown in Figure 1A, mobile device 102a comprises display 107a, host-processor 108a, mainframe memory 110a, antenna 104a and mobile multimedia chip 114a.Mobile multimedia chip 114a is used for handling audio frequency and/or the video data of mobile device 102a.Mobile multimedia chip 114a comprises image editor 116a and on-chip memory 122a.
According to one embodiment of the present of invention, image editor 116a can be mobile device 102a PC is provided applied editting function.For example, image editor 116a realizes for example Photoshop of PC application program
TMEditting function.Image editor 116a can comprise suitable circuit, logic and/or code, provide multiple image editing function edit a plurality of image 118a ..., 120a.Mobile multimedia chip 114a among the mobile device 102a and/or host-processor 108a can use this image editing function in the process of processing video data.Image editor 116a can carry out multiple image editing function at least a portion of a pictures at every turn, uses and/or handle bandwidth with this memory of optimizing in the mobile device 102a.Some characteristic features of image editor 116a comprise that the very color complete clear picture frame of generation, the CamPlus effect that can be applicable to offline condition and picture merge (part-shot combining).Other features of some of image editor 116a comprise by shielding padding (masked fill operation) adds literal on image, use plug-in unit to carry out senior or self-defined picture operation, for example, adjusts brightness/contrast/color balance etc.
In the video editing process, image file format and image file position are transparent or hide mobile multimedia chip 114a and/or host-processor 108a, this makes that manageable file format is more, and can handle the compressed image that is loaded among the on-chip memory 122a.In this, for realizing handling, the physical location of image file format and video data is isolated.In addition, the memory buffer of the video data that storage will be handled can use for example user-defined ID of identifier to identify, rather than absolute storage address.Mobile multimedia chip 114a can pass through antenna 114a from the external video data source, or receives the video data that will handle from external memory storage 106a by connecting 105a.
In another embodiment of the present invention, image editor 116a can under offline condition, handle any size image 118a ..., 120a, and the raw pixel data of permission mobile multimedia chip 114a and/or host-processor 108a visit arbitrary image, and with its part as graphic user interface (GUI).According to another embodiment of the present invention, image editor 116a can allow third party (3
Rd) write the plug-in unit 112a that is used to realize user-defined function or effect, with to image (for example any one image 118a ..., 120a) operate.For example, image editor 116a can allow third party (3
Rd) write plug-in unit 112a, be used on video display 107a, showing when handling the rear video data, in mobile device 102a, realize eliminating the blood-shot eye illness function.
The picture format that image editor 116a is supported comprises JPEG (joint photographic experts group) (JPEG) form, BIIF (GIF) and transplantable network representation file format (PNG).JPG is a kind of compress technique, is used for compressed color and gray scale continuous-tone image.Jpeg image can be supported 1,600 ten thousand pixels, and can be applicable to photo and complex figure.GIF is a kind of compress technique of supporting 256 looks, can be used for line style, black and white image and the high small text of several pixel.The GIF form also can be supported transparent form, and background colour is set to transparent, and the color of the webpage below making can display.The PNG form uses the compression ratio higher than GIF form, also can use opacity, or the control of transparency.
According to one embodiment of the present of invention, image editor 116a can support PNG and GIF form.If image editor 116a uses the PNG form, when the editing video data, can use the form of every pixel 24 (bpp) so, and use Alpha's (alpha) channel and need not interlock.If image editor 116a uses the GIF form, video data editing just can be realized need not to adopt under the situation of staggered, local color map and/or cartoon making so.However, the present invention is not limited to this.PNG decoding, PNG coding and GIF coding can be set to default option.This can be by to be PNG CODEC and/or GIF CODEC at compiling image editor 116a be provided with sign when realizing PNG coding/decoding and GIF coding or parameter realizes.
Figure 1B is the structured flowchart of mobile multi-medium system according to having of one embodiment of the invention of integrated image editor.As shown in Figure 1B, mobile multi-medium system 100 comprises core processor 102, audio-frequency module 108, memory stick module 110, SanDisk (SD) card module 112, test module 114, TV module 116, PC module 118 and a plurality of camera module, i.e. camera 1120 and camera 2 120.System 100 also can further comprise base band flash memory module 124, baseband module 126, Keysheet module 128, RF module 130, antenna 132, main LCD module 134, inferior LCD module 136, optional flash memory module 138 and optional SDRAM module 140.Core processor 102 can comprise RAM module 104, image editor 103 and analog module 106.
Core processor 102 can be 150MHz double arithmetic logic units (ALU) VideoCore that for example has 128K bit instruction and data high-speed buffer memory
The ll processor.Core processor 102 can be the digital rights manager (DRM) that for example has unique chip id code.Core processor 102 have for multiple product and algorithm for example SD card, Advanced Encryption Standard (AES), 3 data encryption standards (3DES) and Rivest-Shamir-Adleman (RSA) but the function that provides the recording medium content protecting to encrypt.Core processor 102 can comprise the encryption post code that has the key of freely programming.H.263 or H.264 core processor 102 can be used for carrying out video compression, for example moves video CODEC such as MPEG-4.Core processor 102 can be used for Video processing, for example imageing sensor front-end processing, blur prevention or noise reduction process, or be used for video analysis, for example cutting operation, target identification or intelligence sensor.Core processor 102 can comprise for example 52 general purpose I/O (GPIO) pin.This GPIO pin can be used for user-defined I/O or is connected with inner peripheral equipment.
Core processor 102 comprises image editor 103, RAM module 104 and analog module 106.Image editor 103 comprises suitable circuit, logic and/or code, realizes the video data editing function of mobile multi-medium system 100.For example, image editor 103 can provide with Figure 1A in the same image editing function of image editor 116a.RAM module 106 comprises suitable circuit, logic and/or code, is used for data on the memory feature, for example data on the sheet of 10Mb.Analog module 106 can comprise for example Switching Power Supply (SMPS) module and phase-locked loop (PLL) module.
Audio-frequency module 108 can comprise suitable logic, circuit and/or code, is used for by built-in IC audio frequency (I
2S), pulse code modulation (pcm) or audio coding decoding (AC ' 97) interface is communicated by letter with core processor 102.AC ' 97/I
2The S controller can provide AC ' 97/I in holotype or under pattern
2The output of S audio frequency.But pcm interface input and output speech or high-quality stereo audio.The PCM controller comprises and independently transmits and receives first-in first-out (FIFO) buffer memory, and can use DMA further to reduce the processor expense.Audio-frequency module 108 also can comprise audio frequency input, audio output port and loud speaker/microphone port.Memory stick module 110 can comprise suitable logic, circuit and/or code, is used for communicating by letter with core processor 102 by the memory stick supporting interface.SD card module 112 can comprise suitable logic, circuit and/or code, is used for communicating by letter with core processor 102 by SD I/O (I/O) interface.Multimedia card (MMC) also can be used for communicating by letter with core processor 102 by SD I/O (I/O) interface.
Base band flash memory module 124 can comprise suitable logic, circuit and/or code, receives data by 8/16 parallel-by-bit host interface from core processor 102.Host interface can provide two channels with absolute address and data register, and the memory space of core processor 102 can directly be read and/or write to host-processor thus.Baseband module 126 can comprise suitable logic, circuit and/or code, is used for by communicating by letter with core processor 102 as 8/16 parallel-by-bit host interface.Keysheet module 128 and RF module 130 can comprise suitable logic, circuit and/or code, are connected with baseband module 126.Antenna 132 can be connected to RF module 130.Core processor 102 can comprise baseband interface, concerning the main frame that has 3 bit address and 8/16 bit data bus, with the form work of memory mapped ancillary equipment.This baseband interface can comprise the two software channels that possess power supply effective bypass pattern.
Optional flash memory module 138 can comprise suitable logic, circuit and/or code, is used for communicating by letter with core processor 102 by external memory interface.Optional SDRAM module 140 can comprise suitable logic, circuit and/or code, is used for receiving data by external memory interface from core processor 102.Core processor 102 can comprise the high-speed memory interface, is connected to SDRAM, SRAM, flash memory and external peripheral.The control and the clocking information of SDRAM and other asynchronous devices can be configured by core processor 102.Core processor 102 can further comprise the additional storage interface, is connected to memory mapped LCD and external peripheral.This additional storage interface can be used for connecting low-speed device, but can not influence the access speed of external memory storage.This additional storage interface can provide 16 data lines and 6 chip selection/address lines, and the employed programmable bus timing of setting, visit and retention time.Core processor 102 can be supported the NAND/NR flash memory, comprises that NAND starts and high speed direct memory visit (DMA).
Core processor 102 can be used for the multiple application in the mobile video field, and has minimum power consumption.The programmable features of core processor 102 provides flexibility and adaptability, makes it can move existing and new CODEC, can make mobile device 102a possess the applied editting function of PC.For example, image editor 116a can realize PC application program such as Photoshop
TMThe same editting function.Core processor 102 can move high-quality 3D recreation, and performance can compare favourably with family's control desk.The parallel characteristics of vector processing unit makes the game developer can develop usually the painted and volume light source high-end features such as (volumetric lighting) of pixel by the desktop game of hardware supports, and consumes power seldom.For example, core processor 102 can use image editor 103 to realize the image editing function of handheld mobile communication device such as mobile phone.
Fig. 2 A is the block diagram according to the image editor of one embodiment of the invention.In Fig. 2 A, image editor 200a comprises main frame 202a, memory 203a, disk 204a, cache manager 206a, resource module 208a, processing module 210a, CODEC module 212a, card module 226a and picture editting's corn module (IECFB) 228a.Resource module 208a, processing module 210a among the image editor 200a, CODEC module 212a, card module 226a and IECFB 228a can be realized by software and/or firmware in mobile multimedia chip (as the mobile multimedia chip 114a among Figure 1A).
Image processor corn module (IECFB) 228a can comprise suitable logic, circuit and/or code, is used to the multiple image effect of one or more image applications of handling the image manipulation request and/or processing module 210a being handled.For example, IECFB 228a can handle cutting, adjustment size, rotation, transparent filling, mask filling (mask fill) and/or CamPlus
TM Effect.Card module 226a can comprise suitable logic, circuit and/or code, is used for one or more plug-in units of leading subscriber definition.
In operating process, video data can mail to processing module 210a from main frame 202a, memory 203a and/or disk 204a by cache manager 206a.Processor module 210a can use software and/or firmware to realize, uses CODEC module 212a and resource module 208a to come the video data of receiving is handled and decoded.Processor module 210a processed video data will mail to IECFB 228a further to be handled.For example, IECFB228a is the video data after the editing and processing further, and/or uses one or more visual effects by card module 226a.
Fig. 2 B is the block diagram according to the image editor of one embodiment of the invention.Main frame 202, memory 203, disk 204, cache manager 206, resource module 208, band module 210, CODEC manager module 212, plug-in unit effects module 224 and plugin manager module 226 have been shown in Fig. 2 B.Also show a plurality of CODEC among the figure, comprise RAW CODEC module 214, PNG CODEC module 216, JPEG CODEC module 218, GIF CODEC module 220 and be used for the image C ODEC of video module 222.Fig. 2 D also comprises image manipulation request module 228, image effect module 230, CAMPLUS module 236, image editor functional module 232, image editor command module 234 and image editor message processing module 238.
Resource module 208 can comprise suitable logic, circuit and/or code, is used to main frame 202, memory 203, disk 204 and/or cache manager 206 to handle the allocation and deallocation of resource.The resource that resource module 208 is handled can comprise uses for example memory buffer that identifies of user definition ID rather than absolute storage address of identifier.In addition, image file information is transparent or hiding as image file format and/or image file position for main frame 202, and this makes that manageable file format is more, and can handle the compressed image that is loaded in the memory 203.Image editor 200 can use the unified resource notion, so just can use one or more processing commands to the image that is stored on the different physical medias.In this, this resource can comprise the view data that is stored in a certain position, and it can be certain position in physical file, the memory, certain position, null resource and/or the transmission buffer of mainframe memory.But the position of file resource identification document comprises pathname, is used in reference to place, prescribed paper position.Except the file of sign storage inside, file resource also can identify the file of exterior storage.Memory resource can be used for storing original image.This has reduced the data access time significantly.For the data that are stored on the host computer system, can use host resource to visit these data by host address.Null resource can be used for creating new images, also can be used as input.File format can separate with the physical location of data, and this is beneficial to the processing of video data, as is stored in the JPED file in the memory, or adds new CODEC and handle new images/video format.Each resource can comprise the band interface, and as band module 210, resource module 208 can use them to handle the video data of input.
Band module or band interface 210 can comprise suitable logic, circuit and/or code, are used to handle an input picture.Each resource can send image manipulation request module 228 to by band module 210.If there is next base band, then band module 210 can be returned next band from input picture, this next band is carried out the rake formula scan and it is stored in the corresponding output image.This band interface also is used between original image form and the operation picture format and changes.Most of image manipulations are based on that band carries out, and comprise from input picture and read next band, handle this band, and this band is write output image.Because the restriction of memory, image will be that handle on the basis with every.In this, can read, handle a band and be written into memory such as memory 203 in.
Plug-in unit effects module 224 can comprise suitable logic, circuit and/or code, the multiple plug-in unit effect of process user definition.For example, can create elimination " blood-shot eye illness " plug-in unit, be applied on the image editor 200 handled images as third party application.
Image manipulation request module 228 can comprise suitable logic, circuit and/or code, can handle the image manipulation request.Image effect module 230 can comprise suitable logic, circuit and/or code, can handle various image effects, fills and/or CamPlus as cutting, adjustment size, rotation, transparent filling, mask
TMDeng." transparent filling " operation is used in pastes Target Photo on the original image, wherein the color of Target Photo is not the Transparent color of definition.CAMPLUS module 236 can comprise suitable logic, circuit and/or code, can handle CamPlus
TMImage effect.Image editing function module 232 can comprise suitable logic, circuit and/or code, can realize the plurality of picture editting function of operation on the main frame 202.Image editor command module 234 can comprise suitable logic, circuit and/or code, can generate the operation requests relevant with image editor command.
Image editor message processing module 238 can comprise suitable logic, circuit and/or code, can handle the management of image editor message.For example, picture editting's message processing module 238 can be realized indicating its process of commands that stops, ending, finish, starts processing, and send notice when finishing dealing with.For example, starting the order of handling causes making it to begin to handle the next band of input picture.
In one embodiment of the invention, cache manager 206, resource module 208, band module 210, CODEC manager module 212, plug-in unit effects module 224, plugin manager module 226, CODEC module 212 ..., 222, image manipulation request module 228, image effect module 230, CAMPLUS module 236, image editor functional module 232, image editor command module 234 and image editor message processing module 238 can be realized in the mobile multimedia chip by software and/or firmware, the mobile multimedia chip 114a among Figure 1A for example.
In operating process, the cache manager 206 in the image editor 200 can use user-defined identifier to come view data in the diode-capacitor storage 203.Based on a kind of picture format, the CODEC manager can be loaded into appropriate C ODEC in the memory 203.For the image of JPEG or PNG form, will distinguish and dynamically load JPEG CODE218 or PNG CODEC216.Based on the order of receiving, image editor command module 234 can be set up correct request, is applied in subsequently on the band of the indicated view data of band module 210.According to one embodiment of the present of invention, image editor 200 can be handled the view data as one or more rest images.But the present invention is not limited only to this, and image editor 200 can be handled the view data such as video data of Tathagata from video flowing equally.
If image editor 200 can use external memory storage, externally create the memory resource that is used for stored video data in the memory.If externally there are not enough memory spaces in the memory, image editor 200 will generate an error message.In one embodiment of the invention, memory buffer is pressed reverse sequence and is discharged, and such distribution method is reduced to memory fragmentation minimum.In addition, allow the maximum quantity of the memory buffer of use can be fixed as particular value, and can change to implement more flexible.Memory resource also can be used as temporary file and stores initial data, to quicken image manipulation.
If external memory storage is unavailable, image editor 200 can the slow memory mode operation, during this period, will not support the original image and the PNG of 24/pixel (bpp).To replace with 16bpp at the image manipulation of internal operation with 24bpp.But the color parameter in these orders still is appointed as the value of 24bpp.Some image manipulation for example shows non-jpeg image or rotation jpeg image, will be slow when using external memory storage, because image editor will use temporary file.
Be used for being described in detail at the U.S. Patent application No.__ of the application same period (act on behalf of case number be No.17063US02) in the structure of the image editor of mobile communication equipment inediting image, the application quotes in full the disclosed content of this patent application at this.
In one embodiment of the invention, except main application thread is the message handling device, image editor 200 can comprise worker thread.In this, a worker thread will be specifically designed to carries out all uncompleted image manipulations, and other worker threads will be specifically designed to display, and as the display on the mobile device, the rear video data are handled in output.
In another embodiment of the present invention, image editor command module 234 can be set up and the relevant operation requests of a plurality of image editor orders.Each order of image editor 200 can be used as input resource string and mails to the image editor command module, and corresponding order output will be mail to image manipulation request module 228 as output resource string.Some image editor order that image editor command module 234 is handled can be used for returning the state of image editor 200, for image manipulation current and/or subsequently is set up input picture, return the size of images of editing by integrated image editor 200, and the image manipulation that stops to move.Other image editor orders that image editor command module 234 is handled can be used for setting up the display window that uses the specific program that image editor 200 distributes to, refresh or the conversion displaying contents, and duplicate choosing partly of shown image and further handle.
Other image editor orders that image editor command module 234 is handled can be used for using the image feature image rotating, this function is optional, after rotation, use is by a zone of the definite color blank map picture of for example 24bpp value, second image pasted open filling on the color or transparent first image of editing, opening Fill Color on the part of image, to opening image applications CamPlus effect.Other image editor orders that image editor command module 234 is handled can be used for image is adjusted to the new size of appointment, and image is cropped to fixed new region.Use relevant image editor command to handle with memory, be used to remove or delete memory resource or memory buffer, list all buffer memorys in the memory 203, delete all memory resources by image editor command module 234.Use relevant image editor command to handle with plug-in unit by image editor command module 234, be used to add the input picture that plug-in unit will use, for plug-in unit is provided with output image, list one or more resource strings to be used for test, replacement resource string, the operation plug-in unit, and/or from plug-in unit, obtain the visual effect tabulation.
Fig. 3 is the flow chart according to the use band method processing video data of one embodiment of the invention.In an embodiment of this operation, when in mobile multimedia processor, carrying out the picture editting, can use the band processing method.As Fig. 2 B and shown in Figure 3, the most of image manipulations in the image editor 200 all carry out based on band.Band interface 210 also is used between the video data original image form received from main frame 202, memory 203 and/or disk 204 and the operation picture format and changes.In this, the band module 210 in the image editor 200 can be used for reading next band from input picture, handles this band, and this band is write in the output image.Because the restriction of memory, image will be that handle on the basis with every.In this, can read, handle a band and be written into memory such as memory 203 in.In step 302, the band module 210 in the image editor 200 can read next band from the input picture that is received from disk 204 or memory 203.In step 304, the band that obtains can be handled in image editor 200.In step 306, processed video data band can write in the output image.Output image after the processing can be stored in the memory 203, and picture editting's request will be mail to image manipulation request module 228.Image-editing operations can be applied on the image after the processing by image effect module 230.In addition, can be by plugin manager 226 with on the image of one or more plug-in unit effects applications after handle.
Fig. 4 is the schematic diagram that carries out image manipulation according to image editor shown in Fig. 2 B of one embodiment of the invention.In Fig. 4, show image manipulation module 402, unified resource module 404a, 404b, 404c and 404d, band cache module 406a and 406b. Unified resource module 404b, 404c and 404d are input unified resource modules, and unified resource module 404a is the output resource module.Among input unified resource module 404b, 404c and the 404d each can be handled one or more input resources, and output unified resource module can be handled an output resource. Unified resource module 404b, 404c and 404d can comprise the view data that is stored in a certain position, as the view data of a position in the view data in the physical file, the memory, the view data of a position in the mainframe memory and/or the view data of null resource.
The input resource can comprise and mails to the data that image editor 200 is edited.The output resource can comprise the processed video data, and these data are handled by image editor 200.Null resource can be used for creating new images, also can be used as input.Picture format will separate with the physical location of data, is beneficial to video data as being stored in the processing of the jpeg file in the memory, or adds new CODEC and handle new images/video format.Each resource all can comprise a band interface, and image manipulation module 402 will use this interface to handle the video data of input.
In an operation, use band cache module 406b to handle from the one or more unified output resource of unified resource module 404b, and mail to image manipulation module 402.Image manipulation module 402 receives and is used for input parameter that the output that band buffer memory 406 generates is handled.Band buffer memory 406a is mail in the output that image manipulation module 402 generates, and offers unified resource module 404a.Unified resource module 404a can comprise the output resource.In this, image editor 200 editors' video data can mail to and be stored in memory 203, disk 204 or image editor 200 external memory storages such as the chip external memory.
Fig. 5 is the flow chart according to the processing multi-medium data of one embodiment of the invention.As Figure 1A and shown in Figure 5,, be integrated in and obtain video data in image editor 116a at least one memory device from a plurality of among the mobile multimedia chip 114a and edit in step 502.For example, integrated image editor 116a can obtain data from remote storage device by wireless mode by antenna 104a.In addition, integrated image editor 116a can obtain video data from external memory storage 106a by connecting 105a.In step 504, the video data that integrated image editor 116a obtains at least a portion from the initial image format conversion of video data for the picture format of mobile multimedia chip compatibility to edit.In step 506, integrated image editor 116a can use collection band method based on the form of video data the data of obtaining to be edited.In addition, integrated image editor 116a can use the plug-in unit 112a that is connected to mobile multimedia chip 114a and/or integrated image editor 116a.For example, in editor's video data process in the past, plug-in unit 112a can be used to provide anti-" blood-shot eye illness " function.
Therefore, the present invention can be realized by the combination of hardware, software or hardware and software.The present invention can realize at least one computer system in a concentrated manner, perhaps realizes with the distributed way of distribution of different parts in the computer system of several mutual connections.The computer system of any kind of or other equipment that can realize method of the present invention all are suitable for.A typical combination of hardware, software and firmware is the general-purpose computing system with computer program, when this computer program is uploaded and carried out, controls this computer system so that realize method of the present invention.
One embodiment of the present of invention can be used as independent chip, application specific integrated circuit (ASIC) is embodied as the circuit board level product, or are integrated on the independent chip as different assemblies other parts with system.The degree of the system integration is mainly by speed and cost factor decision.Because modern handle complicated specific can be used commercial available processors, realize the outside that this processor can be realized at the ASIC of native system.As selection, if processor can be used as ASIC core or logic module, the part that so commercial available processors can be used as the ASIC equipment that has multiple function of form of firmware realizes.
The present invention also can embed in the computer program that includes the various features that can realize described method, can realize the described method of the application when this program is loaded in the computer system.Described herein computer program is meant, for example, one group of instruction with any language, code or symbolic representation, can directly make system carry out specific function, perhaps through making system carry out specific function after the following a kind of or various processing: a) convert another kind of language, code or symbol to information processing capability with information processing capability; B) duplicate with different materials.But the implementation method of those of ordinary skill in the art's other computer programs as can be known also can be used for the present invention.
Below invention has been described in conjunction with certain embodiment, and those of ordinary skill in the art can carry out various changes or be equal to replacing and not departing from the scope of the present invention as can be known to the present invention.In addition, the various modifications of carrying out according to instruction of the present invention to adapt to particular environment or material do not depart from the scope of the present invention yet.Therefore, the present invention is not limited to disclosed specific embodiment, the present invention includes all embodiment that fall in the claim scope.
The application quote in full and require the applying date be February 12 in 2005 day, be called the U.S. Provisional Patent Application No.60/652 of " mobile multimedia processor in picture editting method and system ", the priority of 481 (act on behalf of case number be No.16436US01).
The application also quotes in full following patent application:
U.S. Patent application No.____ (act on behalf of case number for No.16430US02), the applying date is 2006 years _ month _ days;
U.S. Patent application No.____ (act on behalf of case number for No.16431US02), the applying date is 2006 years _ month _ days;
U.S. Patent application No.____ (act on behalf of case number for No.16432US02), the applying date is 2006 years _ month _ days;
U.S. Patent application No.____ (act on behalf of case number for No.16433US02), the applying date is on December 14th, 2005;
U.S. Patent application No.____ (act on behalf of case number for No.16434US02), the applying date is 2006 years _ month _ days;
U.S. Patent application No.____ (act on behalf of case number for No.16435US02), the applying date is on December 14th, 2005;
U.S. Patent application No.____ (act on behalf of case number for No.16437US02), the applying date is 2006 years _ month _ days;
U.S. Patent application No.____ (act on behalf of case number for No.17063US02), the applying date is 2006 years _ month _ days;
U.S. Patent application No.____ (act on behalf of case number for No.17064US02), the applying date is 2006 years _ month _ days.
Claims (10)
1. a method of handling multimedia messages is characterized in that, described method comprises:
By obtaining view data to edit at least one from a plurality of memory devices of image editor that is integrated in the mobile multimedia chip;
By described integrated image editor at least a portion of described view data is converted to described mobile multimedia chip from the original image form and edits suitable picture format;
Use the band method in described integrated image editor, to edit described view data based on the form of described view data, wherein said band method comprises: read next band from input image data, handle this band, and the band after will handling writes in the output image.
2. method according to claim 1 is characterized in that, described method also comprises: use at least one plug-in unit that is connected on the described mobile multimedia chip to edit described view data in described integrated image editor.
3. method according to claim 2 is characterized in that, during described a plurality of storages are established described at least one be positioned at one of following: be integrated in the outside that described mobile multimedia chip neutralization is positioned at described mobile multimedia chip.
4. method according to claim 1 is characterized in that, described mobile multimedia chip is integrated in the mobile device that includes the visual display unit that is used for showing the view data behind the described editor of at least a portion.
5. method according to claim 1 is characterized in that, described method also comprises: be independent of the file format relevant with described view data, in the described view data of mobile multimedia chip inediting.
6. method according to claim 1 is characterized in that, described method also comprises: be independent of the source position relevant with described view data, in the described view data of described mobile multimedia chip inediting.
7. a system that handles multimedia messages is characterized in that, described system comprises: be integrated in the image editor in the mobile multimedia chip, obtain view data at least one from a plurality of memory devices to edit; Described integrated image editor is converted at least a portion of described view data with described mobile multimedia chip from the original image form and edits suitable picture format, and use the band method based on the described view data of the format editing of described view data, wherein said band method comprises: read next band from input image data, handle this band, and the band after will handling writes in the output image.
8. system according to claim 7 is characterized in that, the described image editor that is integrated in the described mobile multimedia chip uses the described view data of at least one plug-in unit editor that is connected on the described mobile multimedia chip.
9. system according to claim 8 is characterized in that, during described a plurality of storages are established described at least one be positioned at one of following: be integrated in the outside that described mobile multimedia chip neutralization is positioned at described mobile multimedia chip.
10. system according to claim 7 is characterized in that, is integrated in described image editor in the described mobile multimedia chip and is integrated in the mobile device that includes the visual display unit that is used for showing the view data behind the described editor of at least a portion.
Applications Claiming Priority (4)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US65248105P | 2005-02-12 | 2005-02-12 | |
| US60/652,481 | 2005-02-12 | ||
| US11/332,892 | 2006-01-17 | ||
| US11/332,892 US20060181547A1 (en) | 2005-02-12 | 2006-01-17 | Method and system for image editing in a mobile multimedia processor |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN1825934A CN1825934A (en) | 2006-08-30 |
| CN1825934B true CN1825934B (en) | 2010-12-01 |
Family
ID=36936334
Family Applications (3)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2006100044700A Expired - Fee Related CN1828665B (en) | 2005-02-12 | 2006-02-10 | Method and system for information processing in a communication apparatus |
| CN 200610004469 Pending CN1828664A (en) | 2005-02-12 | 2006-02-10 | Method and system for image editing in a communication apparatus |
| CN2006100088249A Expired - Fee Related CN1825934B (en) | 2005-02-12 | 2006-02-13 | Method and system for processing multimedia information |
Family Applications Before (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2006100044700A Expired - Fee Related CN1828665B (en) | 2005-02-12 | 2006-02-10 | Method and system for information processing in a communication apparatus |
| CN 200610004469 Pending CN1828664A (en) | 2005-02-12 | 2006-02-10 | Method and system for image editing in a communication apparatus |
Country Status (1)
| Country | Link |
|---|---|
| CN (3) | CN1828665B (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2013149374A1 (en) * | 2012-04-01 | 2013-10-10 | 华为技术有限公司 | Medium processing system and method for processing medium service |
| CN104639950A (en) * | 2015-02-06 | 2015-05-20 | 北京量子伟业信息技术股份有限公司 | Image processing system and method based on fragmentation technique |
| CN106034210A (en) * | 2015-03-09 | 2016-10-19 | 华为技术有限公司 | Image editing method and image editing device |
| CN108370414A (en) * | 2016-10-29 | 2018-08-03 | 华为技术有限公司 | A kind of image pickup method and terminal |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2004066615A1 (en) * | 2003-01-22 | 2004-08-05 | Nokia Corporation | Image control |
| US20040240845A1 (en) * | 2003-05-30 | 2004-12-02 | Casio Computer Co., Ltd. | Apparatus and method for editing motion picture, and recording medium in which computer executable program is recorded |
| US20050010568A1 (en) * | 2002-11-29 | 2005-01-13 | Casio Computer Co., Ltd. | Portable wireless communication terminal, picked-up image editing apparatus, and picked-up image editing method |
-
2006
- 2006-02-10 CN CN2006100044700A patent/CN1828665B/en not_active Expired - Fee Related
- 2006-02-10 CN CN 200610004469 patent/CN1828664A/en active Pending
- 2006-02-13 CN CN2006100088249A patent/CN1825934B/en not_active Expired - Fee Related
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050010568A1 (en) * | 2002-11-29 | 2005-01-13 | Casio Computer Co., Ltd. | Portable wireless communication terminal, picked-up image editing apparatus, and picked-up image editing method |
| WO2004066615A1 (en) * | 2003-01-22 | 2004-08-05 | Nokia Corporation | Image control |
| US20040240845A1 (en) * | 2003-05-30 | 2004-12-02 | Casio Computer Co., Ltd. | Apparatus and method for editing motion picture, and recording medium in which computer executable program is recorded |
Also Published As
| Publication number | Publication date |
|---|---|
| CN1828664A (en) | 2006-09-06 |
| CN1828665A (en) | 2006-09-06 |
| CN1828665B (en) | 2011-11-30 |
| CN1825934A (en) | 2006-08-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP1691549A1 (en) | Method and system for image editing in a mobile multimedia processor | |
| US20060182411A1 (en) | Architecture for an image editor used for editing images in a mobile communication device | |
| CN1831928B (en) | Method for processing video data, and mobile multimedia processor for processing video data | |
| CN107092684B (en) | Image processing method and device, storage medium | |
| WO2022042285A1 (en) | Method for displaying interface of application program and electronic device | |
| DE112013001305T5 (en) | A method, apparatus, and system for preprocessing touch data and display area control | |
| US20060181540A1 (en) | Image editor with plug-in capability for editing images in a mobile communication device | |
| CN105074549B (en) | Content-adaptive LCD backlight controls | |
| US20200227010A1 (en) | Electronic display partial image frame update systems and methods | |
| CN109196865A (en) | A kind of data processing method and terminal | |
| CN101472062A (en) | Mobile terminal apparatus and method for implementing pick-up head function | |
| CN1825934B (en) | Method and system for processing multimedia information | |
| US8798386B2 (en) | Method and system for processing image data on a per tile basis in an image sensor pipeline | |
| WO2023065812A1 (en) | Page display method, electronic device, and computer-readable storage medium | |
| US20060184803A1 (en) | Method and system for digital rights management in a mobile multimedia processor | |
| US6466204B1 (en) | Color LCD interface circuit in a portable radio terminal | |
| WO2023125273A1 (en) | Image display method of electronic equipment, image processing circuit and electronic equipment | |
| JP2003233366A (en) | Display composing circuit and portable electronic equipment | |
| US20110157199A1 (en) | Method and Device for Processing Digital Images | |
| CN105072342B (en) | Image synthesizer and method | |
| US20050068336A1 (en) | Image overlay apparatus and method for operating the same | |
| US7505073B2 (en) | Apparatus and method for displaying a video on a portion of a display without requiring a display buffer | |
| KR100438283B1 (en) | Mobile station and face detection method for mobile station | |
| CN101399891A (en) | Digital photo frame and image reinforcement method thereof | |
| CN105472106A (en) | Background display method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20180508 Address after: Singapore Singapore Patentee after: Avago Technologies General IP (Singapore) Pte. Ltd. Address before: california Patentee before: BROADCOM Corp. |
|
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20190829 Address after: Singapore Singapore Patentee after: Avago Technologies General IP (Singapore) Pte. Ltd. Address before: Singapore Singapore Patentee before: Avago Technologies General IP (Singapore) Pte. Ltd. |
|
| TR01 | Transfer of patent right | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20101201 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |