CN1816090A - Physiognomy image treatment system and method based on multi-media message service - Google Patents
Physiognomy image treatment system and method based on multi-media message service Download PDFInfo
- Publication number
- CN1816090A CN1816090A CN 200510023686 CN200510023686A CN1816090A CN 1816090 A CN1816090 A CN 1816090A CN 200510023686 CN200510023686 CN 200510023686 CN 200510023686 A CN200510023686 A CN 200510023686A CN 1816090 A CN1816090 A CN 1816090A
- Authority
- CN
- China
- Prior art keywords
- user
- image processing
- image
- facial
- facies
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 49
- 238000012545 processing Methods 0.000 claims abstract description 223
- 238000004891 communication Methods 0.000 claims abstract description 13
- 230000006854 communication Effects 0.000 claims abstract description 13
- 230000005540 biological transmission Effects 0.000 claims abstract description 10
- 230000001815 facial effect Effects 0.000 claims description 128
- 208000035126 Facies Diseases 0.000 claims description 61
- 238000001514 detection method Methods 0.000 claims description 26
- 239000000284 extract Substances 0.000 claims description 13
- 230000015572 biosynthetic process Effects 0.000 claims description 11
- 238000010295 mobile communication Methods 0.000 claims description 11
- 238000003786 synthesis reaction Methods 0.000 claims description 11
- 230000002194 synthesizing effect Effects 0.000 claims description 10
- 238000012217 deletion Methods 0.000 claims description 6
- 230000037430 deletion Effects 0.000 claims description 6
- 238000000605 extraction Methods 0.000 claims description 6
- 238000003672 processing method Methods 0.000 claims description 5
- 238000012790 confirmation Methods 0.000 claims description 3
- 238000012958 reprocessing Methods 0.000 claims description 3
- 230000006855 networking Effects 0.000 claims 1
- 229920001690 polydopamine Polymers 0.000 claims 1
- 238000010586 diagram Methods 0.000 description 10
- 238000005516 engineering process Methods 0.000 description 9
- 230000009286 beneficial effect Effects 0.000 description 2
- 238000009434 installation Methods 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 1
- 230000007175 bidirectional communication Effects 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 238000009795 derivation Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 210000001061 forehead Anatomy 0.000 description 1
- 210000003128 head Anatomy 0.000 description 1
- 238000005286 illumination Methods 0.000 description 1
- 238000012805 post-processing Methods 0.000 description 1
- 238000007781 pre-processing Methods 0.000 description 1
- 230000011218 segmentation Effects 0.000 description 1
- 238000013179 statistical model Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 238000012795 verification Methods 0.000 description 1
Images
Landscapes
- Information Transfer Between Computers (AREA)
- Mobile Radio Communication Systems (AREA)
Abstract
Based on techniques of CDMA, GPRS, EDGE or 3G communication protocols, through Multimedia Messaging Service (MMS), the invention transmits pictures of physiognomy, voice and text information. Moreover, combining with network transmission and information edit technique, and using dedicated system for processing and managing images, the method can carry out fast physiognomy image processes for pictures of physiognomy including recognition, deformation, composition, adding information of voice and text into physiognomy image, and creating new physiognomy image from picked up features. The method also cam manage physiognomy images.
Description
Technical Field
The present invention relates to a mobile communication technology and an image processing technology, and more particularly, to a system and a method for processing an image of a Multimedia Messaging Service (MMS) based front-end image.
Background
In real life, more and more people want to distribute pictures taken with digital cameras or camera-enabled cell phones to family or friends as soon as possible to share with them. It is common practice to post the photo to the other party after the photo is developed in a traditional developing shop or send the digital photo to a computer and send the digital photo to the electronic mailbox of the other party by e-mail. However, on the one hand, it takes much time to do so, and on the other hand, it is difficult to make people perform image processing on partial images in the photos, such as background and facies, so as to achieve special effects, and thus it is difficult to meet the needs that people want to process the pictures at any time during movement.
Disclosure of Invention
The invention aims to provide a rapid and convenient facial image processing method which is convenient to use, can realize bidirectional communication and is low in price.
Another object of the present invention is to provide a mobile communication network and multimedia messaging service-based facies image processing system that has low cost, convenient use, and wide application range and can perform image processing such as facies detection, facies recognition, facies deformation, facies synthesis, adding text and sound information to facies images, extracting facies features, creating new facies images, and the like quickly.
According to an aspect of the present invention, there is provided a method for processing a facies image based on a multimedia messaging service, comprising the steps of:
a user registration step;
a facial image processing request step, in which the registered user can request the facial image processing;
a facial image uploading step, wherein the registered user uploads a facial image to be processed;
a face image processing/managing step of performing processing and management confirmed by a user by an image processing/managing device;
and sending, namely sending the processed facial image to a mobile terminal or an electronic mailbox of a user through a gateway, and receiving after the user confirms.
The method can be directly finished through a Web webpage or a WAP webpage on line or by using a mobile terminal, wherein the user side comprises the following steps:
the user logs in, the image processing/management device opens up a permanent MMS storage management space for the user who logs in for the first time;
the user transmits the facial image to the image processing/managing apparatus;
the user transmits information elements required for performing the face image processing to the image processing/managing apparatus;
a user selects an image processing/managing operation to be performed by the image processing/managing apparatus;
the user can select whether to perform reprocessing;
and previewing and confirming the processed facial image by the user, receiving the processed facial image through the user confirmation, and returning the processed facial image if the processed facial image is not confirmed by the user.
The network side in the method can comprise the following steps:
the image processing/management device receives a facies image processing request transmitted from a Web site, a WAP site, a PC client or a gateway;
the image processing/management device places the received surface image processing request in a receiving queue;
the image processing/management device selects a facies image processing request from the receiving queue and determines an image processing module to be called;
the image processing/management device calls a corresponding image processing module to perform image processing required by a user;
the image processing/management device sends the generated result to a sending queue;
the image processing/management apparatus takes the data from the transmission queue and transmits the data to the gateway.
In the method, the step of transmitting the information element required for the planar image processing by the user comprises the following steps:
editing an MMS message;
sending the MMS message to a specific identification number;
a user receives help information of the facial image processing;
filling reply contents by a user according to the received help information, wherein the reply contents represent the processing required to be carried out on the image;
the user receives the facial image after the required processing.
Wherein composing an MMS message comprises:
selecting and determining a facial image needing to be processed by a user;
selecting and determining the type and category of the facies image processing by a user;
the user edits a character for selecting and determining the type of the photographic image processing to be performed.
The surface image processing/managing step in the method comprises the following steps:
detecting one or more facial phases in the facial phase image;
identifying one or more facies in the facies image;
surface phase deformation in the surface phase image;
synthesizing the facies in the facies image;
synthesizing a face in the face image and information elements required to be used for face image processing;
generating a new facial image;
and managing the facial image.
According to another aspect of the present invention, there is provided a multimedia message service-based facies image processing system comprising a plurality of personal mobile communication devices and a plurality of network terminal computers, a WAP site, a Web site, an MMS service center device, wherein the WAP site, Web site, MMS service center device are connected through the internet, gateway, lan and dedicated data link,
the system also comprises an image processing/managing device which is connected with other equipment in the system through the internet, a gateway and a local area network; wherein,
the Web site or the WAP site is connected with the image processing management device through the Internet; the user registration is completed when the user accesses a Web site or a WAP site for the first time; then the user logs in the Web site or WAP site and transmits the facial image to the image processing management device;
the image processing management device can perform image processing on the facial image transmitted by a user, and comprises facial detection, facial deformation, facial recognition, facial synthesis, addition of character and sound information in the facial image, extraction of facial features to create a new facial image, and deletion and storage of the facial image;
the image processing management device is connected with the gateway through a local area network, and the gateway is connected with the MMS service center device through the special data link. The MMS center device can send the processed facial image to the user; the gateway is also connected with an internet, and can forward the facial image to an electronic mail system appointed by the user or directly send the facial image to the user through a WAP PUSH according to the requirement of the user, wherein the WAP PUSH is a communication mode directly reaching the mobile terminal of the user through the internet.
Wherein the image processing/managing apparatus in the system comprises:
the detection device is used for detecting one or more facial phases in the facial phase image;
the recognition device is used for recognizing one or more facial facies in the facial facies image;
a deforming means for deforming the facies in the facies image;
a synthesizing device for synthesizing the facial phases in the facial phase images;
the element synthesis device synthesizes the facial phase in the facial phase image and the information element required for processing the facial phase image;
generating means for generating a new face image;
and a management device for managing the face image.
By adopting the technical scheme, the invention has the beneficial effects that people can conveniently carry out complicated special image processing such as surface phase detection, surface phase identification, surface phase synthesis, surface phase restoration and the like on the surface phase image, and the processed surface phase image can be timely and conveniently sent and received in a mobile terminal mode, so that the traditional time-consuming and labor-consuming image distribution process is omitted, and the function is obviously improved. Another advantage of this patent is that it can provide a plurality of novel and unique facial image processing methods for users.
Drawings
The above and other features, nature, and advantages of the present invention will become more apparent from the following description of the embodiments taken in conjunction with the accompanying drawings in which like reference characters identify correspondingly throughout and wherein,
FIG. 1 is a block diagram of a system for transmitting, receiving, processing and managing facial images by a user using a Web site, a Wap site or a PC client;
FIG. 2 is a system diagram of a user directly using a mobile terminal to transmit, receive, process and manage facial images;
FIG. 3 shows a system block diagram of the software portion of the image processing management apparatus;
FIG. 4 is a flowchart showing a thread transmission/reception process by the image processing management apparatus;
FIG. 5 is a flowchart of an image processing engine routine of the image processing management device;
FIG. 6 is a block diagram illustrating the process of uploading, processing, and transmitting/receiving facial images using a Web site, a WAP site, and a PC client in accordance with an embodiment of the present invention;
fig. 7 is a block diagram of a process of uploading, processing, and transmitting/receiving a facies image by a mobile terminal device in an embodiment of the present invention;
FIG. 8 is a block diagram illustrating a process of transmitting a facial image and receiving a user with a mobile terminal according to an embodiment of the present invention;
fig. 9 is a block diagram illustrating a process for managing an existing photo image by a user through a Web site, a WAP site, or a PC client according to an embodiment of the present invention.
Detailed Description
The technical scheme of the invention is further explained by combining the drawings and the embodiment.
Referring first to fig. 1, fig. 1 is a system block diagram showing a user performing transmission, reception, image processing, and management of a facies image with a Web site, a Wap site, or with a PC client. A block diagram of a system 100 according to one embodiment of the invention is shown in fig. 1, which includes a plurality of personal mobile communication devices 102 and a plurality of network terminal computers 104, a WAP site 106, a Web site 108, an MMS service center 110, and an image processing management apparatus 112. Wherein the WAP site 106, the Web site 108, the MMS service center apparatus 110 and the image processing/management apparatus 112 are connected to each other through the internet 114, a gateway 116, a local area network and a dedicated data link (these two components are not shown in the figure).
In the system shown in fig. 1, the Web site 108 or WAP site 106 is connected to the image processing/management apparatus 112 via the internet 114. The user must log onto the Web site 108 or WAP site 106 and transfer the facial image to the image processing/management device 112 in order to process and use the facial image. The user must fill in necessary information to complete the user registration when the user initially accesses the Web site 108 or the WAP site 106, and can log in according to the registration information afterwards. In addition, the user can also use special software to complete the tasks by downloading special PC client software or special mobile terminal software.
The personal mobile communication device 102 may be a mobile phone, a PDA, or a wireless internet appliance. As shown in fig. 2, the user may also send a facies image processing request using the personal mobile communications device 102.
The image processing/management apparatus 112 is a Web server, is connected to the gateway 116 via a local area network, and performs image processing by receiving a request from a Web or WAP site user or a request from a mobile terminal user. The image processing/management apparatus 112 may be divided into five modules: the system comprises a receiving and sending module, a task scheduling module, an image processing module, a face detection engine module and an image management module. The receiving and sending module consists of a receiving and sending thread and a receiving and sending queue and is used for carrying out concurrent interaction with a site user or a mobile terminal user; the task scheduling module is responsible for taking out tasks from the receiving queue, distributing the tasks to the image processing module according to types required to be customized by a user, and putting results returned by the image processing module into the sending queue; the image processing module is composed of a plurality of extensible sub-modules, can respectively realize image processing such as face detection, face recognition, face deformation, face synthesis, addition of character and sound information in a face image, extraction of face features and creation of a new face image and the like, and can be quickly customized and deployed by developers according to requirements; the face detection engine module is used for detecting the face with high detection rate; the image management module is used for respectively managing the processed facial image data according to different affiliated users, and has the functions of checking, editing, deleting and forwarding the processed facial image to an email address designated by the user and the like.
The gateway 116 is connected to the MMS service center apparatus 112 through a dedicated data link. The MMS center device can send the processed image to the terminal user, wherein the communication protocol is CDMA, GPRS, EDGE or 3G communication protocol.
The gateway is also directly connected with the internet, and can forward the facial image to an e-mail address designated by a user or directly send the facial image to a mobile terminal user through a WAP PUSH according to the requirements of a website user or the mobile terminal user, wherein the WAP PUSH is a communication mode directly reaching the mobile terminal of the user through the internet.
An important feature of the present invention is the unique face-phase detection and face-phase identification technology, and the processed face-phase image is carried in the form of MMS (Multimedia Messaging Service), i.e. the carried information is the combination of image, sound, video and text. The mobile communication technology adopted by the invention is CDMA, GPRS, EDGE or 3G communication protocol technology. The surface image processing technology of the invention can realize the following functions:
1) the method can carry out rapid ground facies detection, facies identification, facies deformation, facies synthesis, addition of character and sound information in the facies image, extraction of facies characteristics, creation of new facies image, facies correction and other facies image processing on the existing facies image;
2) after being processed by the patent, the traditional face image can be transmitted to a mobile terminal of a user in a combination of image, sound, video and text modes;
3) in the image processing/managing device, image processing of a large number of facial images of a user can be performed;
4) in the image processing/managing apparatus, one storage space can be opened up for each user. The user can correspondingly manage a large number of facial images, including viewing, editing, deleting and the like of the facial images;
7) the photo image can be sent to an electronic mailbox designated by a user;
8) the photo image can be expanded to a photo album.
The invention provides an MMS (Multimedia Messaging Service) -based face-to-face image processing management system.
The system can transmit the information of face image, sound, text and the like through multimedia message service on the basis of CDMA, GPRS, EDGE or 3G communication protocol technology, and combines network transmission and information editing technology, can perform image processing such as face detection, face identification, face synthesis, face deformation and the like on the face image, can also perform quick transmission on new image information generated by combining the processed face image with character information and sound information, and can perform management of a network or a mobile user terminal, including image viewing, editing, deleting and the like on the face image.
The user can also edit the MMS message containing the facial image by using personal mobile communication equipment such as mobile phone, PDA, wireless internet equipment, send to a special service number, and make an image processing request to the image processing management device through the MMS service center device. At this time, the system 200 is shown in fig. 2, and includes an image processing/managing apparatus 112, a gateway 116, an MMS service center apparatus 110, and a plurality of mobile communication terminals 102. Wherein the image processing/managing apparatus 112 is connected to the gateway 116 through a local area network, performs image processing by receiving a request from a Web or WAP site user or a request from a mobile terminal user, and can transmit the processed image to the gateway.
The block diagram of the image processing/managing device 112 is shown in fig. 3, and the image processing/managing device can be divided into five modules, i.e., a transceiver module, a task scheduling module, an image processing module, a face detection engine module, and an image management module, in consideration of the requirements of concurrent processing and expandability. Shown in fig. 3, the transceiver module includes a receive thread 302, a receive message queue 304, a send message queue 306, and a send thread 308; a task scheduling module 310; the image processing module 312 may be further divided into image sub-modules 312a, 312b, 312c, and so on; a face detection engine module 314; the image management module 316 further includes a storage space 318. The image processing management device allocates a permanent storage space for each user, so that the user can conveniently manage the face image.
The transceiving module is composed of transceiving threads (302, 308) and transceiving queues (304, 306) for ensuring possible massive concurrent requests and concurrent transmissions from site users and mobile terminal users. Each individual receive and send thread runs in the background in the form of a Dameon ("daemon thread"), and thread-safe receive and send message queues may buffer temporarily unhandled requests. The receive queue and the transmit queue are both thread-safe FIFO (first-in first-out) queues, and the size of the queues can be customized according to the size of concurrency.
The request instructions from the Web site, WAP site, PC client and mobile terminal user include: image processing instructions, uploading instructions, viewing instructions, editing instructions, deleting instructions, forwarding instructions, and the like. The uploading instruction is used for uploading the facial image by a user, the viewing instruction is used for viewing the existing facial image of the user, the editing instruction is used for selectively editing the existing facial image of the user, the deleting instruction is used for deleting the specified facial image by the user, and the forwarding instruction is used for forwarding the MMS facial image data of the user to the E-mail address specified by the user. The received message queue can be classified according to different request instructions, the image processing instruction and the uploading request are directly sent to the task scheduling module, the corresponding image processing sub-modules are called by the task scheduling module according to the image processing instruction and multimedia resources such as pictures, characters and music uploaded by users for processing, and other types of user requests are sent to the image management module for processing. The message sending queue can transmit the processed image data to the gateway for transmission.
The workflow of the receive and transmit threads (302, 308) in the transceiver module is shown in fig. 4. After the receiving and sending threads are started, the receiving thread receives the request of the user, namely the request of the user is put into a receiving queue for subsequent processing. And if the sending thread finds that the user request exists in the sending queue, the sending thread performs related processing according to the sending request type (sent to a site, sent to an electronic mailbox, sent to a mobile terminal and the like) of the user.
The task scheduling module 310, the image processing module 312 and the face detection engine module 314 together form an image processing engine of the image processing management apparatus.
The face detection engine module 314 is a core module of the image processing engine. In order to improve the speed and accuracy of face detection, the face detection engine uses the following detection method: the method comprises the steps of carrying out skin color detection, illumination compensation and skin color segmentation in an image preprocessing stage to carry out face pre-extraction, sending the processed image into a sub-classifier based on a statistical model, carrying out multi-pose face detection by adopting subspace-based algorithms such as Boosting, local feature analysis and the like, carrying out data post-processing on the detected result, carrying out face verification by utilizing the forehead closure of the face, the closure of the core area of the face and the feature distribution of the core area of the face, and obtaining the final result which can achieve the high face detection rate aiming at various pose head images of the face with different light backgrounds and different sizes in a gray image and a color image.
The image processing module 312 is made up of several scalable sub-modules 312a, 312b, 312c, etc. On the basis of the output result of the face detection engine module 314, each sub-module can respectively realize the image processing functions of face phase deformation, face phase synthesis, addition of character and sound information in the face phase image, extraction of face phase characteristics, creation of a new face phase image and the like. The output result of the image processing module can be called by the task scheduling module. The number and the functions of the image processing modules can be customized and deployed rapidly by developers according to actual requirements.
The task scheduling module 310 is configured to take out a task from the receiving queue, distribute the task to different image processing sub-modules according to types customized by a user, and put a processing result returned by the image processing sub-module into the sending queue.
The workflow of the image processing engine is shown in fig. 5.
The image management module 316 is composed of two functional sub-modules, a storage sub-module and a message processing sub-module. The storage submodule is used for storing a face image processing result generated by a user. The submodule can monitor and filter the sending message queue, extract image data and user data from the sending message queue and store the image data and the user data in a background database. The message processing sub-module can filter various requests needing to be processed by the image management module from the receiving queue, such as viewing requests, editing requests, deleting requests, forwarding requests and the like, and correspondingly process different requests. If the user request is an image viewing request, the message processing submodule extracts user information from the receiving queue and then extracts picture data from the permanent storage space, the user information is packaged and then sent into the sending queue, and the sending queue is directly returned to a Web site, a WAP (wireless application protocol) site, a PC (personal computer) client or a mobile terminal user through a gateway; if the user request is an image editing request, the message processing sub-module extracts user information from the receiving queue, extracts a picture to be edited by the user from the permanent storage space, packages the picture and then sends the picture to the receiving queue, and the request information at the moment is not different from the request format of the picture uploaded by the user, so that the request information is processed by the task scheduling module and a final result is sent to the sending queue; if the user request is an image deletion request, the message processing submodule extracts user information from the receiving queue, then finds corresponding user data in the permanent storage space, and returns user prompt information to the user through the sending queue after deletion operation is performed; if the user request is a forwarding request, the image processing sub-module extracts user data from the receiving queue, then finds corresponding user data in the permanent storage space, packages the user data together with the electronic mail address specified by the user, sends the information into the sending queue, sends the information to the gateway by the sending thread at the moment, and generates an electronic mail format aiming at the information by a port connected with the internet by the gateway and sends the electronic mail format to the corresponding address. Of course, the storage submodule can also be separated as an independent storage space 318 as shown in fig. 3.
The gateway 116 is connected to the MMS service center apparatus 110 through a dedicated data link. The MMS center device can send the processed image to the terminal user (such as mobile phone, PDA, wireless internet device, etc.), and the communication protocol used in the interaction process between the MMS center device and the mobile terminal device is CDMA, GPRS, EDGE or 3G communication protocol. In addition, the gateway is also directly connected with the internet, and the facial image can be forwarded to an e-mail address designated by a user or directly sent to a mobile terminal user through a WAP PUSH according to the requirements of a website user or the mobile terminal user, wherein the WAP PUSH is a communication mode directly reaching the mobile terminal of the user through the internet.
The present invention also provides a multimedia message service-based facies image processing method, which includes the following steps, referring to fig. 6:
s11, a user registration step;
s12, a step of requesting surface image processing, wherein the registered user can request the surface image processing; the step of processing the image of the face phase requests can be completed online through a Web webpage, online through special software on a user PC, online through a WAP webpage, or through the operation of a mobile terminal of a user.
S13, uploading a facial image, wherein the registered user uploads the facial image to be processed; the step of uploading the photo image can be uploaded on line through a Web webpage, uploaded on line on a user PC through special software, uploaded on line through a WAP webpage or operated and sent through a mobile terminal of a user.
S14, a surface image processing/managing step, wherein the surface image is processed and managed through user confirmation through an image processing/managing device; the following processing can be performed on the face image:
detecting one or more facial phases in the facial phase image;
identifying one or more facies in the facies image;
surface phase deformation in the surface phase image;
synthesizing the facies in the facies image;
synthesizing a face in the face image and information elements required to be used for face image processing;
generating a new facial image;
and managing the facial image.
And S15, a sending step, wherein the processed facial image is sent to a mobile terminal or an electronic mailbox of a user through a gateway and the user receives the processed facial image after confirming the processed facial image.
The method of the invention can be completed on line through a Web webpage or a WAP webpage, wherein a user side comprises the following steps:
s21, a user logs in, and the image processing/management device opens up a permanent MMS storage management space for the user who logs in for the first time;
s22, the user transmits the area image to an image processing/management device; the user may use a network that may transmit the image to the image processing/managing apparatus through a wired network (e.g., the Internet) or a wireless network;
s23, the user transmits information elements required for performing the area image processing to an image processing/management device; also, the user may transmit the information element to the image processing/managing apparatus through a wired network (e.g., the Internet) or a wireless network; the information element carrier described herein supports the following types:
text: unicode;
video: ITU-T H.263, MPEG 4;
image: JPEG, GIF89a, WBMP;
audio: MP3, MIDI, WAV, AMR/EPR (for speech).
These information elements can be expressed in various forms such as images, sounds, texts, animation, videos, and the like formed by digital cameras, mobile phones, general photographing apparatuses and scanning devices, computer terminals, and the like.
S24, selecting image processing/management operation required to be performed by the image processing/management device by a user;
s25, the user can select whether to perform reprocessing or not;
s26, the user previews and confirms the processed facial image, the processed facial image is received after the user confirms the processed facial image, and otherwise, the facial image is returned.
According to one embodiment of the invention, the user can use MMS messages to transmit the information elements required for the facies image processing, where this step comprises:
s31, editing an MMS message, comprising:
selecting and determining a facial image needing to be processed by a user;
selecting and determining the type and category of the facies image processing by a user;
the user edits a character for selecting and determining the type of the photographic image processing to be performed.
S32, sending the MMS message to a specific identification number;
s33, receiving help information of the face image processing by a user;
s34, filling reply contents by the user according to the received help information, wherein the reply contents indicate that the image is required to be processed;
s35, the user receives the face image after the required processing.
Correspondingly, on the network side, the method correspondingly comprises the following steps:
s41, the image processing/management device receives a face image processing request transmitted from a Web site, a WAP site, a PC client or a gateway;
s42, the image processing/management device places the received surface image processing request in a receiving queue;
s43, the image processing/management device selects a face image processing request from the receiving queue and determines an image processing module to be called;
s44, the image processing/management device calls a corresponding image processing module to perform image processing required by a user;
s45, the image processing/management device sends the generated result into a sending queue;
and S46, the image processing/management device takes the data from the sending queue and sends the data to the gateway.
According to an embodiment of the present invention, the steps of the above method are further embodied and may include the steps of:
s51, the image processing/management device stores the area image into a storage space allocated to each user according to user data;
s52, the image processing/management device receives a user request instruction from a Web site, a WAP site, a PC client or a mobile terminal, if the request instruction is a viewing instruction, the image processing/management device extracts the existing facial image data of the user from the storage space according to the selection of the user, sends the facial image data into a message sending queue and returns the facial image data to the Web site, the WAP site, the PC client or the mobile terminal;
s53, the image processing/management device receives a user request instruction from a Web site, a WAP site, a PC client or a mobile terminal, if the request instruction is an editing instruction, the image processing/management device extracts the existing image data of the user from the storage space according to the selection of the user, sends the image data to a message receiving queue to wait for the processing of a task scheduler, and sends the processed result to a message sending queue to return to the Web site, the WAP site, the PC client or the mobile terminal;
s54, the image processing/management device receives a user request instruction from a Web site, a WAP site, a PC client or a mobile terminal, if the request instruction is a deletion instruction, the existing facial image data of the user is deleted from the storage space according to the selection of the user, and a prompt message is generated and sent to a message sending queue to be returned to the Web site, the WAP site, the PC client or the mobile terminal;
s55, the image processing/management device receives a user request instruction from a Web site, a WAP site, a PC client or a mobile terminal, if the request instruction is a forwarding instruction, the image processing/management device extracts the existing image data of the user from the storage space according to the selection of the user, sends the image data into a message sending queue, and sends the image data to a specified e-mail address by a gateway or directly sends the image data to the mobile terminal user through a WAP PUSH.
For the above system and method, for the sake of more clear description, the following is classified into three operation modes, i.e. a site, a PC client, and a mobile user terminal, and the operation procedures are described as the transmission/reception operation procedures of a facies image and the image management operation procedures:
first, the operation process of sending the photo image and receiving by the user is performed by using the Web site, WAP site or PC client, as shown in fig. 7,
A. operating at Web site, WAP site
S701, registering and logging in by using a user terminal number, wherein the system automatically creates a storage space for a user to store user information
S702, selecting the type of facial image to be processed
S703. the user uploads the own facial image
S704, characters added on the facial image to be processed are selected, or characters needed by a user are added
S705, selecting music or uploading the music of the user
S706, image processing customized by the user is carried out by the image processing management device
S707, the user selects whether to preview the image to be processed
S708, if the user needs to preview, the thumbnail of the preview can be received
S709, the user selects whether to send the processed facies image
S710, inputting a mobile terminal number or an electronic mailbox of a receiving face image by a user
S711, the user confirms the sending
S712, the user opens the mobile terminal device or the email box to receive the facies imagery
S713, the user receives the information of the received surface phase image sent by the system
S714, the user confirms to receive
S715, the user receives the processed face image
B. Operating on a PC client
Downloading PC client dedicated software provided by the photo image processing service provider, and operating according to S701-S715 described in part A after installation
Secondly, the operation process of sending the facial image and receiving by the user by the mobile terminal is as shown in fig. 8:
s801, opening user mobile terminal equipment
S802, the user edits MMS information containing face image
S803. the user selects the type of the surface image processing or the characters for the surface image processing
S804, sending the edited MMS information to the special service number
S805. user confirms sending
S806. the user opens the mobile terminal device or the electronic mailbox to receive the facies image
S807, the user receives the information of the received area image sent by the system
S808. the user confirms to receive
S809, the user receives the processed facial image
All of the above multimedia information can be represented in various forms of images, sounds, texts, animations, videos, etc. formed by digital cameras, mobile phones, general photographing devices and scanning apparatuses, computer terminals, etc.
Third, the user manages the existing photo images through the Web site, WAP site, or PC client, as shown in fig. 9:
A. operating at a Web or WAP site
S901, logging in by using user terminal number
S902. enter management image interface
S903. the user selects whether to check the image operation, and if not, the user selects whether to edit the image operation
S904, the user selects an image to be viewed
S905. the user views the image
S906, the user selects whether to edit the image or not, and if not, whether to delete the image or not is selected
S907, selecting the image needing to be edited and reprocessed by the user
S908, the image processing management device edits and reprocesses the selected image
S909, the user selects whether to delete the image, and if not, selects whether to forward the image to quit the processing
S910, selecting the image to be deleted by the user
S911, the user confirms the user who deletes the operation
S912, the user selects whether to forward the image, if not, quit processing is carried out
S913, the user selects the image to be forwarded
S914. the user selects which kind of forwarding is needed to the selected image, whether the selected image is forwarded to a station, an electronic mailbox or a mobile terminal
S915, according to the selection type of the a14, filling corresponding information by the user
S916, the user confirms the forwarding operation, and the system forwards the data by itself
S917. Exit processing
B. Operating on a PC client
And downloading PC client-side special software provided by the photo image processing service provider, and operating according to the steps S701-S717 described in the part A after installation.
The above description is given for the purpose of illustration and not limitation, and since the present system has been described in detail with reference to preferred embodiments, it will be apparent to those skilled in the art that various changes and substitutions can be made, functional extensions and derivations can be made, without departing from the spirit and scope of the present system, which is intended to be covered by the appended claims. Such as:
electronic photo album based on MMS: by taking MMS service as a platform, the digital surface phase images are integrated into an electronic photo album which integrates multimedia forms such as voice, characters, animation and the like, and the electronic photo album can be checked, managed and the like through a mobile terminal;
identification based on MMS: and the MMS serves as a platform, and the identity authentication is carried out through the mobile terminal by utilizing the face detection and face identification technology.
By adopting the technical scheme, the invention has the beneficial effects that people can conveniently carry out complicated special image processing such as surface phase detection, surface phase identification, surface phase synthesis, surface phase restoration and the like on the surface phase image, and the processed surface phase image can be timely and conveniently sent and received in a mobile terminal mode, so that the traditional time-consuming and labor-consuming image distribution process is omitted, and the function is obviously improved. Another advantage of this patent is that it can provide a plurality of novel and unique facial image processing methods for users.
Claims (20)
1. A multimedia message service-based facial image processing method comprises the following steps:
a user registration step;
a facial image processing request step, in which the registered user can request the facial image processing;
a facial image uploading step, wherein the registered user uploads a facial image to be processed;
a face image processing/managing step of performing processing and management confirmed by a user by an image processing/managing device;
and sending, namely sending the processed facial image to a mobile terminal or an electronic mailbox of a user through a gateway, and receiving after the user confirms.
2. The method of claim 1, wherein the step of requesting the photographic image processing is accomplished online via a Web page, online via dedicated software on a user's PC, online via a WAP page, or via a user's mobile terminal operation.
3. The method of claim 1, wherein the facial image uploading step may be through Web page online upload, through dedicated software online upload on user PC, through WAP Web page online upload, or through user mobile terminal operation.
4. The method of claim 1, wherein the method is performed online via a Web page or a WAP page, and wherein the user side comprises the steps of:
the user logs in, the image processing/management device opens up a permanent MMS storage management space for the user who logs in for the first time;
the user transmits the facial image to the image processing/managing apparatus;
the user transmits information elements required for performing the face image processing to the image processing/managing apparatus;
a user selects an image processing/managing operation to be performed by the image processing/managing apparatus;
the user can select whether to perform reprocessing;
and previewing and confirming the processed facial image by the user, receiving the processed facial image through the user confirmation, and returning the processed facial image if the processed facial image is not confirmed by the user.
5. The method according to claim 4, wherein the user can transmit the photographic image and the information element subjected to the photographic image processing to the image processing/management apparatus through a wired network or a wireless network.
6. The method of claim 4, wherein the types of information element carrier support required for the facies image processing include the following:
text: unicode;
video: ITU-T H.263, MPEG 4;
image: JPEG, GIF89a, WBMP;
audio: MP3, MIDI, WAV, AMR/EPR (for speech).
7. The method of claim 6, wherein the information element is represented in various forms of images, sounds, texts, animations, videos, etc. formed by digital cameras, mobile phones, general photography equipment and scanning devices, computer terminals, etc.
8. The method of claim 5, wherein the step of transmitting the facies image and the information elements required for facies image processing by the user using the mobile terminal over the wireless network comprises:
editing an MMS message;
sending the MMS message to a specific identification number;
a user receives help information of the facial image processing;
filling reply contents by a user according to the received help information, wherein the reply contents represent the processing required to be carried out on the image;
the user receives the facial image after the required processing.
9. The method of claim 8, wherein said composing an MMS message comprises:
selecting and determining a facial image needing to be processed by a user;
selecting and determining the type and category of the facies image processing by a user;
the user edits a character for selecting and determining the type of the photographic image processing to be performed.
10. The method of claim 1, wherein the method is performed online via a Web page or a WAP page, and wherein the network comprises the steps of:
the image processing/management device receives a facies image processing request transmitted from a Web site, a WAP site, a PC client or a gateway;
the image processing/management device places the received surface image processing request in a receiving queue;
the image processing/management device selects a facies image processing request from the receiving queue and determines an image processing module to be called;
the image processing/management device calls a corresponding image processing module to perform image processing required by a user;
the image processing/management device sends the generated result to a sending queue;
the image processing/management apparatus takes the data from the transmission queue and transmits the data to the gateway.
11. The method according to claim 10, wherein the network side specifically comprises the steps of:
the image processing/management device stores the face image into a storage space allocated to each user according to the user data;
the image processing/management device receives a user request instruction from a Web site, a WAP site, a PC client or a mobile terminal, if the request instruction is a viewing instruction, the image processing/management device extracts the existing face image data of the user from the storage space according to the selection of the user, sends the face image data into a message sending queue and returns the face image data to the Web site, the WAP site, the PC client or the mobile terminal;
the image processing/management device receives a user request instruction from a Web site, a WAP site, a PC client or a mobile terminal, if the request instruction is an editing instruction, the image processing/management device extracts the existing face image data of the user from the storage space according to the selection of the user, sends the face image data to a received message queue to wait for the processing of a task scheduler, and sends the processed result to a sent message queue to return to the Web site, the WAP site, the PC client or the mobile terminal;
the image processing/management device receives a user request instruction from a Web site, a WAP site, a PC client or a mobile terminal, if the request instruction is a deletion instruction, the image processing/management device deletes the existing face image data of the user from the storage space according to the selection of the user, generates a prompt message, sends the prompt message into a message sending queue and returns the prompt message to the Web site, the WAP site, the PC client or the mobile terminal;
the image processing/managing device receives a user request instruction from a Web site, a WAP site, a PC client or a mobile terminal, if the request instruction is a forwarding instruction, the image processing/managing device extracts the existing face image data of the user from the storage space according to the selection of the user, sends the face image data into a message sending queue and sends the face image data to a designated e-mail address by the gateway.
12. The method of claim 1, wherein the facies image processing/managing step comprises:
detecting one or more facial phases in the facial phase image;
identifying one or more facies in the facies image;
surface phase deformation in the surface phase image;
synthesizing the facies in the facies image;
synthesizing a face in the face image and information elements required to be used for face image processing;
generating a new facial image;
and managing the facial image.
13. A multimedia message service-based facial image processing system comprises a plurality of personal mobile communication devices, a plurality of network terminal computers, a WAP site, a Web site, an MMS service center device and an image processing/management device, wherein the WAP site, the Web site and the MMS service center device are connected through the Internet, a gateway, a local area network and a special data link,
the image processing/managing device is connected with other equipment in the system through the Internet, a gateway and a local area network; wherein,
the Web site or the WAP site is connected with the image processing management device through the Internet; the user registration is completed when the user accesses a Web site or a WAP site for the first time; then the user logs in the Web site or WAP site and transmits the facial image to the image processing management device;
the image processing management device can perform image processing on the facial image transmitted by a user, and comprises facial detection, facial deformation, facial recognition, facial synthesis, addition of character and sound information in the facial image, extraction of facial features to create a new facial image, and deletion and storage of the facial image;
the image processing management device is connected with the gateway through a local area network, and the gateway is connected with the MMS service center device through the special data link. The MMS center device can send the processed facial image to the user; the gateway is also connected with an internet, and can forward the facial image to an electronic mail system appointed by the user or directly send the facial image to the user through a WAP PUSH according to the requirement of the user, wherein the WAP PUSH is a communication mode directly reaching the mobile terminal of the user through the internet.
14. A system according to claim 13, characterized in that said users comprise network users, such as Web users, WAP users, or end users, such as mobile phones, PDAs, wireless internet device users.
15. The system of claim 13, wherein the communication protocol used by the MMS service center device to send the processed phase image to the user is CDMA, GPRS, EDGE, or 3G communication protocol.
16. The system of claim 13, wherein the Personal mobile communication device is a mobile phone or a Personal Digital Assistant (PDA) or a wireless networking device.
17. The system of claim 13, wherein the image processing/management device is a web server.
18. The system of claim 13, wherein the gateway is a web server.
19. The system of claim 13, wherein the dedicated data link is a TCP/IP data link.
20. The system of claim 13, wherein the image processing/management means comprises:
the detection device is used for detecting one or more facial phases in the facial phase image;
the recognition device is used for recognizing one or more facial facies in the facial facies image;
a deforming means for deforming the facies in the facies image;
a synthesizing device for synthesizing the facial phases in the facial phase images;
the element synthesis device synthesizes the facial phase in the facial phase image and the information element required for processing the facial phase image;
generating means for generating a new face image;
and a management device for managing the face image.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB2005100236867A CN100493128C (en) | 2005-01-31 | 2005-01-31 | Physiognomy image treatment system and method based on multi-media message service |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB2005100236867A CN100493128C (en) | 2005-01-31 | 2005-01-31 | Physiognomy image treatment system and method based on multi-media message service |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN1816090A true CN1816090A (en) | 2006-08-09 |
| CN100493128C CN100493128C (en) | 2009-05-27 |
Family
ID=36908029
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNB2005100236867A Expired - Fee Related CN100493128C (en) | 2005-01-31 | 2005-01-31 | Physiognomy image treatment system and method based on multi-media message service |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN100493128C (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102291409A (en) * | 2011-08-17 | 2011-12-21 | 韩智纲 | House information display system |
| CN102841792A (en) * | 2012-09-07 | 2012-12-26 | 腾讯科技（深圳）有限公司 | Information editing method and terminal in SNS (social network service) application |
| CN105159634A (en) * | 2015-07-10 | 2015-12-16 | 深圳市美贝壳科技有限公司 | Photo splicing and projection method and apparatus |
| CN105264516A (en) * | 2013-03-14 | 2016-01-20 | 微软技术许可有限责任公司 | Document collaboration and notification of changes |
| CN108174237A (en) * | 2017-12-28 | 2018-06-15 | 北京奇虎科技有限公司 | Image combining method and device |
| CN111512599A (en) * | 2017-12-28 | 2020-08-07 | 电子湾有限公司 | Adding images to draft documents via MMS |
-
2005
- 2005-01-31 CN CNB2005100236867A patent/CN100493128C/en not_active Expired - Fee Related
Cited By (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102291409A (en) * | 2011-08-17 | 2011-12-21 | 韩智纲 | House information display system |
| CN102841792B (en) * | 2012-09-07 | 2016-02-17 | 腾讯科技（深圳）有限公司 | Information edit method in SNS application and device |
| US9300700B2 (en) | 2012-09-07 | 2016-03-29 | Tencent Technology (Shenzhen) Company Limited | Method and terminal for editing information in social network service applications |
| KR20140133598A (en) * | 2012-09-07 | 2014-11-19 | 텐센트 테크놀로지(센젠) 컴퍼니 리미티드 | Method and terminal for editing information in social network service applications |
| KR101651766B1 (en) | 2012-09-07 | 2016-08-26 | 텐센트 테크놀로지(센젠) 컴퍼니 리미티드 | Method and terminal for editing information in social network service applications |
| WO2014036961A1 (en) * | 2012-09-07 | 2014-03-13 | Tencent Technology (Shenzhen) Company Limited | Method and terminal for editing information in social network service applications |
| CN102841792A (en) * | 2012-09-07 | 2012-12-26 | 腾讯科技（深圳）有限公司 | Information editing method and terminal in SNS (social network service) application |
| CN105264516A (en) * | 2013-03-14 | 2016-01-20 | 微软技术许可有限责任公司 | Document collaboration and notification of changes |
| CN105159634A (en) * | 2015-07-10 | 2015-12-16 | 深圳市美贝壳科技有限公司 | Photo splicing and projection method and apparatus |
| CN105159634B (en) * | 2015-07-10 | 2018-07-06 | 深圳市美贝壳科技有限公司 | A kind of method and device of photo splicing projection |
| CN108174237A (en) * | 2017-12-28 | 2018-06-15 | 北京奇虎科技有限公司 | Image combining method and device |
| CN111512599A (en) * | 2017-12-28 | 2020-08-07 | 电子湾有限公司 | Adding images to draft documents via MMS |
| US11349791B2 (en) | 2017-12-28 | 2022-05-31 | Ebay Inc. | Adding images via MMS to a draft document |
| US11743217B2 (en) | 2017-12-28 | 2023-08-29 | Ebay Inc. | Adding images via MMS to a draft document |
| US11888799B2 (en) | 2017-12-28 | 2024-01-30 | Ebay Inc. | Adding images via MMS to a draft document |
Also Published As
| Publication number | Publication date |
|---|---|
| CN100493128C (en) | 2009-05-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN1278557C (en) | Information delivery system, method, information processing apparatus, and method | |
| CN1198478C (en) | Electronic equipment and program | |
| CN1661598A (en) | Collaboration server, collaboration system, and method and program for collaboration server and system | |
| CN1235389C (en) | Image information distributing method and system, central and terminal equipment and scanistor | |
| CN1822643A (en) | Information processing apparatus, information processing method, and information processing system | |
| CN100346325C (en) | Communications device and control method for transmitting an image by electronic mail | |
| CN1867142A (en) | Method and system for mobile terminal device obtaining computer information | |
| CN100343835C (en) | Program, information processing method and device | |
| CN1835569A (en) | Time-shift image distribution system, time-shift image distribution method, time-shift image requesting apparatus, and image server | |
| CN1742480A (en) | Information processing device, information processing method, and computer program | |
| CN1685434A (en) | Portable wireless communication terminal for picked-up image editing | |
| CN1716922A (en) | Method and system for mobile device messaging | |
| CN1925536A (en) | Imaging system and system control method | |
| CN1701347A (en) | Information processor, sensor network system, information processing program, computer-readable storage medium on which information processing program is recorded, and information processing method | |
| CN1816090A (en) | Physiognomy image treatment system and method based on multi-media message service | |
| CN1589570A (en) | Network information processing system and information processing method | |
| CN1209895C (en) | Information processing device and information processing method | |
| CN1479513A (en) | Data communication device, data communication system and data communication method | |
| CN1402176A (en) | Data allocation method and system | |
| CN1519753A (en) | Program, character inputting and editing method, device and recording medium | |
| CN1705367A (en) | Information processing apparatus and information processing method | |
| CN1823492A (en) | System and method for services provision in a peer-to-peer environment | |
| CN1297130C (en) | Communications terminal | |
| CN1532744A (en) | Service processor, service processing system and metadata storage method of service processing system | |
| CN1574830A (en) | Server device having electronic bulletin board function |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| C41 | Transfer of patent application or patent right or utility model | ||
| PB01 | Publication | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20060609 Address after: Room 140, No. 155, Lane 201, liming Road, Shanghai Applicant after: Fan Xiaobo Co-applicant after: Zhang Yingfeng Address before: Room 140, No. 155, Lane 201, liming Road, Shanghai Applicant before: Fan Xiaobo Co-applicant before: Zhang Yingfeng Co-applicant before: Zhao Songlin |
|
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| C17 | Cessation of patent right | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20090527 Termination date: 20120131 |