KR20140070906A - Mobile emotion provides methods and systems - Google Patents

Abstract

The present invention relates to a method and a system for providing a mobile photo-book, capable of achieving capturing, editing, creating, and ordering at a time in a mobile environment. The method for providing a photo-book through a mobile device including at least a camera, an image display unit and a wireless data communication unit provides a photo-book creating process by one-stop and comprises the steps of: capturing an image through the camera; displaying the captured image on the display unit and performing editing; creating a photo-book by using the edited image; and transmitting the created photo-book through the wireless data communication unit to order printing of the photo-book.

Description

[0001] Mobile emotion providing methods and systems [

The present invention relates to a method of providing a photobook, and more particularly, to a method and system for providing a mobile photobook in which photographing, editing, production, and ordering are performed at once in a mobile environment.

The development and dissemination of digital imaging devices are leading to the mass production of digital data. Accordingly, a variety of techniques have been developed to enable the creation and ordering of photobooks online using a PC.

Korean Patent Registration No. 10-0312843 (registered on October 12, 2001, Prior Art 1) relates to a digital image online printing method. When a customer uploads a digital image for ordering prints online, And provides a digital image online printing method for delivering printed photographs according to a customer's desired delivery method.

Korean Unexamined Patent Application Publication No. 10-2002-5345 (published on Jan. 17, 2002, Prior Art 2) relates to a digital image processing system, which is capable of maintaining the functions of a conventional photo vending machine or a sticker vending machine, Digital Photo System (DPS), which transmits pictures or images to a web server, and Internet Photo Album Site, which stores and manages photos and images transmitted by a general PC user or DPS connected to the Internet, and provides various services do.

The above-mentioned prior arts have been able to make electronic albums only on-line using a digital camera, a PC or a digital photo system. That is, a variety of photo transmission devices such as a mobile phone and a personal digital assistant (PDA) can not be used, a wired or wireless network other than online can not be used, and an image captured by an internal or external camera mounted on a mobile phone has a low resolution .

Accordingly, as disclosed in Korean Patent Laid-Open Publication No. 10-2003-88583 (published on November 20, 2003, Prior Art 3), various digital image data of a user is modified variously using various photo transmission devices, / Off-line integrated digital image service providing a mobile / on-line / off-line service of digital image by using an off-line integrated network.

Therefore, Prior Art 3 is a form in which mobile services are added to prior arts 1 and 2, so that the digital image is still concentrated on the online photo portal site, and the problem that the utilization rate of the popularized smart phone can not be increased have.

The number of smartphone subscribers surpassed 24 million by early 2012, and the era of popularization of smartphones was launched in earnest, which means that most of the 25 million adults are using smartphones. The number of smartphone subscribers is on the rise, and it is expected to reach about 25 million by the end of 2012 due to the increasing trend.

Also, according to the result of analysis of the usage behavior of users of mobile devices, the usage ratio of the 30s is highest at 49.6%, and the occupation rate including office work and technical work is highest.

In 2011, the domestic digital printing market is estimated to be 10% (around 850 billion won) in the world. According to a survey by the UK market research company (PIRA), the domestic analog printing market will be 19.6 While the digital printing market is expected to increase 77.3%.

In addition, according to the Fuji Photo Report, which shows the results of US photo products end-user research, in 2011, photo products sales exceeded sales in the printing field, and Photo Books showed a 26% share in the photo market . In addition, photobooks have a 25% purchase rate and a potential consumption rate of 75%.

According to Statistics Korea's birth and death statistics in 2011, the average age of childbirth in Korea is increasing year by year, and it is 31.45 years old in 2011 (30.25 years old for the first child). In the age of mobile phone settlement through the mobilians, The highest. The 30 working mothers who are raising infants from 1 year to 6 years old (married women with economic activity and housework / child raising) are familiar with smartphones and are able to use their smartphones to make the most pictures And consumes smartphones.

Regarding the current environment of the photo market mentioned above, various materials and prices are formed in the suppliers' perspective and the supply of various applications is expanding due to the openness of the APP market. On the other hand, buyers are interested in children, but their use of PCs is so inexcusable that they are easy to use, and the preference of products related to children is highlighted.

Therefore, as mentioned above, although market demands are rapidly increasing and potential customers are thick, and there are a variety of applications to edit photographs and provide photo albums in supply, most of the services are now fixed in the production environment of the PC environment And application services still have the inconvenience of becoming familiar with limited editing and new professional techniques.

Korean Patent Registration No. 10-0312843 (Oct. 12, 2001) Korean Patent Publication No. 10- 2002-5345 (2002.01.17) Korean Patent Publication No. 10-2002-75966 (October, 2002) Korean Patent Publication No. 10-2003-88583 (November 20, 2003) Korean Patent Publication No. 10-2009-40485 (Apr. 27, 2009)

Accordingly, an object of the present invention is to provide a method and system for providing a mobile photo book in which photographing, editing, production, and ordering are performed in a smart phone by one-stop.

Another object of the present invention is to provide a method and apparatus for capturing and editing an image by using a camera of a mobile device in a one-stop manner, And a method and system for providing a mobile photo book.

It is another object of the present invention to provide a method and system for providing a mobile photo book that can be easily edited anytime and anywhere by knowing only touch and drag.

Another object of the present invention is to provide a method and system for providing a mobile photo book in which a basic photo editing function is performed simultaneously with photographing by automatically matching filters matching the emotions of a person illuminated through a camera .

According to another aspect of the present invention, there is provided a method of providing a photobook through a mobile device having at least a camera, an image display means, and a wireless data communication means, The process of shooting; Displaying the photographed image on the display means and editing the photographed image; Creating a photobook with the edited image; And a step of transmitting the created photo book through the wireless data communication means to order printing of the photo book, wherein the photo book manufacturing step is one-stop.

The step of photographing the image in the method of providing a mobile photo book according to the present invention includes the steps of: detecting a face part in an image recognized by the camera; detecting a facial expression in the detected face part; Determining an emotion corresponding to the detected facial expression, and applying the emotion filter corresponding to the determined emotion to the recognized image, and photographing.

The step of detecting the facial expression in the step of photographing the image of the mobile photobook providing method according to the present invention may further include a step of discriminating the facial feature ratio and the skin color from the detected facial feature, Is detected.

Here, the emotion filter of the step of detecting the facial expression in the process of photographing the image of the mobile photo book according to the present invention is applied according to the detected facial expression and the skin color, respectively.

In addition, the emotional filter is characterized in that it is applied according to the expressions of laughter, love, anguish, sadness, frustration and fear.

According to another aspect of the present invention, there is provided a system for providing a photobook through a mobile device having at least a camera, an image display means, and a wireless data communication means, A camera control unit for photographing the camera; A camera filter unit for applying a filter corresponding to image information coming in through the camera when the camera controller captures the image; A clip art unit for displaying a virtual image on the photographed image; An image editing unit for providing editing means for at least one of cutting, enlarging and reducing, rotating, color changing, and distortion of the photographed image; A photobook production unit for producing photobooks from the image edited by the image editing unit; A data transfer unit for transferring the prepared photo book through the wireless data communication unit to order printing of the photo book; And a mobile settlement unit for paying for the requested photo book printing cost, wherein the photo book production process is provided as one-stop.

In this case, the mobile photobook providing system according to the present invention further comprises a QR code recognizing unit for recognizing a QR code for reproducing the photobook transferred to the data transmitting unit as a moving image on the display means.

In addition, the camera filter unit of the mobile photobook providing system according to the present invention may be configured such that the camera filter unit detects a face part in image information coming in through the camera, detects a facial expression in the detected facial part, And the emotion filter corresponding to the determined emotion is applied.

At this time, the camera filter section distinguishes the eye shadow ratio and the skin color from the detected face part, and judges whether or not any of the six facial expressions of laughter, love, angry, sadness, frustration, Is detected.

As described above, the present invention provides a one-stop photobook service from photographing, editing, ordering, and settlement with a smart phone without going through a PC or photograph shop, which was not provided in an existing smartphone application (APP) There are advantages to be able to.

Accordingly, the present invention has the advantage of allowing a married woman (working mam) who is engaged in economic activity, housework and child rearing to quickly and easily leave memories of their child, thereby alleviating the burden of housework and nurture.

In addition, the present invention can help family memories through photobooks and photo albums in a more convenient way and to deepen family affection.

In addition, since the present invention can easily use a photobook service using a popularized smart phone, it is possible to activate a digital printing market by inducing a potential consumer to an actual consumer, and accordingly, Can be activated.

Meanwhile, the present invention is advantageous in that it can be used as a toy (toy) for reading emotions of a child by using a function of automatically matching a matching filter by classifying emotions of a subject (person) illuminated through a camera.

1 is a conceptual diagram of a one-stop mobile photobook service of a method of providing a mobile photo book according to the present invention,
FIG. 2 is a flowchart of a method of providing a mobile photo book according to the present invention.
3A to 3C are photographs showing a process of applying a sensory filter in a method of providing a mobile photo book according to the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, a detailed description of preferred embodiments of the present invention will be given with reference to the accompanying drawings. It should be noted that the same configurations of the drawings denote the same reference numerals as possible whenever possible. Specific details are set forth in the following description, which is provided to provide a more thorough understanding of the present invention. In the following description of the present invention, detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear.

FIG. 1 is a conceptual diagram of a one-stop mobile photobook service according to the present invention. The mobile photo book providing method according to the present invention provides shooting, editing, Show.

FIG. 2 is a flowchart illustrating a method of providing a mobile photo book according to the present invention. Referring to FIGS. 1 and 2, a mobile photo book providing method and system according to the present invention will be described in detail.

A user of a method and system for providing a mobile photo book according to the present invention is a user of a mobile device having at least a camera, an image display means and a wireless data communication means such as a smart phone, , And it can become a main user of 30 working mothers who drive consumption through mobile devices and raise infants from 1 year to 6 years old who have high purchasing power for photo products such as photobook service.

The user may take a picture through a camera provided in the mobile device, and the photographing may be a general photographing, a filter photographing, and an emotional filter applying photographing. At this time, the mobile photobook providing system according to the present invention controls the camera through the camera control unit (1). As an example of the camera control, the background preview function of the surface view of the Android camera application program interface (API) is used to display a camera preview at a rate of several tens of frames per second, and the getSupportedColorEffects () function of the parameter class of the camera API is used And can be exposed by applying a real-time filter when previewing the camera.

The camera filter used in the camera filter unit 2 may be an image filter such as a sepia filter, an aqua filter, a mono filter, a miniature filter, a retro filter ), A bineting filter, and the like can be used. Since these filters are already known, detailed description thereof is omitted here.

Meanwhile, the emotional filter used in the mobile photobook providing method and system according to the present invention is a technology for recognizing human emotions through face detection using object extraction and matching filters corresponding to emotions, and includes face detection and emotion recognition There are two methods: knowledge-based and feature-based. The knowledge-based method is a detection method using the geometric position convention of the human eye using a histogram, and the feature-based method is a method of utilizing a complex feature such as a human face color shape size.

The emotional filter matching technique according to the present invention will be described in more detail with reference to FIGS. 3A to 3C. FIGS. 3A to 3C are photographs showing a process of applying the emotional filter in the method of providing a mobile photo book according to the present invention. In the emotional filter according to the present invention, emotions of a subject (person) The state is a specialized technology.

First, referring to FIG. 3A, a step of detecting a face part in an image input to a camera is a step of dividing a face part on a screen by using a pixel level, a blob level, and an object level detection method. The pixel level is a method of giving a change to a color value of a background region, the bubble level is a method of restoring a defect to a noise pixel, and the object level is a method of distinguishing faces by using a bubble level detection result value.

Next, referring to FIG. 3B, the step of discriminating emotions by detecting facial expressions in the detected facial part distinguishes facial features and skin colors in the detected facial area, and distinguishes facial expressions by using complex features of faces. The method of distinguishing facial expressions is based on knowledge - based method using positional relationship of feature points, feature - based method using skin color, texture, threshold, and contour based method using learned model.

Finally, referring to FIG. 3C, a step of applying a filter matching a corresponding emotion with a facial expression detected in a photograph can be classified into facial expressions such as anger, sadness, love, laughter, frustration, and fear.

As described above, the method and system for providing a mobile photobook according to the present invention apply a sensory filter matching technique to a photographed image or a photographed image so that a basic photographic editing function is performed simultaneously with photographing. Therefore, And a filter suitable for the atmosphere of the image can be easily applied.

The clip art unit 3 may be a photo frame, an emoticon image, or the like, showing a virtual image attached to image information input through a camera.

The QR code recognition unit 4 recognizes a QR code provided in the photobook transmitted through the data transfer unit 7 to be described below, and performs a function of reproducing the QR code as a moving image on the display means of the mobile device. For example, you can use the Zebra Crossing library to decode and analyze the QR code with autofocusing, and then call Android's WebView to connect and play back video streaming in WebView.

Then, the user edits the image of the image photographed by the mobile device on the mobile device. The image editing unit 5 can perform editing such as cropping, enlargement / reduction, rotation, and filter application.

The cropping is to crop the image by copying it from the specific coordinates of the image by applying the specified width and height, and the zooming enlarges and shrinks the image by copying a specific area of the image and drawing it down again, Uses the Android Matrix class and calls the postRotate () function to rotate the image at the desired angle.

In particular, the image editing unit 5 of the present invention can be easily edited by only touching and dragging.

The application of the filter may be performed by applying various effects of the image by changing color or distortion of the image, or may be applied at the same time as the photographing, as described above, or may be applied after the photographing.

When the user finishes editing the image, the user configures the photo book. The photobook configuration is carried out through the photobook production unit 6, and the user manually constructs the photobooks of the photobooks actually printed and delivered to the album upon ordering. On the other hand, in the photo book configuration, a proxy mode, an easy mode, an advanced mode, and the like can be selected to request a proxy to an expert, or the user himself can configure the port book.

The user orders the photo book printing when the configuration of the photo book is completed. To this end, the user wirelessly transmits the photobook prepared in the previous step to the server 9 at the remote site, and the mobile settlement unit 8 charges the cost. The detailed functions and operations of the mobile settlement unit 8 are well known and will not be described here. In general, the mobile payment unit 8 provides means for confirming order and delivery in addition to the means for payment, and returns an invoice number or the like to the user. As an example of wireless data transmission, HttpClien's HttpPost method can be used to image-compress data between a web server and a client, and then transmit and receive data.

As described above, the method and system for providing a mobile photobook according to the present invention include photographing an image through a camera, displaying the photographed image on a display means and editing the photographed image, creating a photobook with the edited image, And a series of photobook production processes for ordering the printing of the photobook by transmitting the book through the wireless data communication means are provided as one-stop. Thereafter, the ordered photo book is automatically or administratively ordered and confirmed by the server 9, and is delivered to the user after printing. The server 9 manages customer and order information.

While the present invention has been described in connection with what is presently considered to be the most practical and preferred embodiment, it is to be understood that the invention is not limited to the disclosed embodiments, but is capable of various modifications within the scope of the invention. Therefore, the scope of the present invention should not be limited by the described embodiments, but should be determined by the scope of the appended claims and equivalents thereof.

Claims (9)

A method for providing a photobook through a mobile device having at least a camera, an image display means, and a wireless data communication means,
Capturing an image through the camera;
Displaying the photographed image on the display means and editing the photographed image;
Creating a photobook with the edited image; And
And a step of transmitting the created photo book through the wireless data communication means and ordering the printing of the photo book, wherein the photo book manufacturing step is one-stop. Delivery method.
The method according to claim 1,
Detecting a face portion in an image recognized through the camera;
Detecting a facial expression in the detected face portion;
Determining an emotion corresponding to the detected facial expression and
And applying the emotion filter corresponding to the determined emotion to the recognized image, and photographing the emotion filter.
3. The method of claim 2, wherein detecting the facial expression comprises:
Wherein the facial feature detecting unit detects an facial feature from the detected face portion and detects facial expression from the positional relationship of the divided facial feature.
The method according to claim 3,
Wherein the determination step is performed according to the detected facial expression and the skin color, respectively.
5. The method according to claim 4,
Laughing, love, angry, sad, frustrated, and frightened, respectively.
A photobook providing system through a mobile device having at least a camera, an image display means, and a wireless data communication means,
A camera controller for capturing an image by controlling the camera;
A camera filter unit for applying a filter corresponding to image information coming in through the camera when the camera controller captures the image;
A clip art unit for displaying a virtual image on the photographed image;
An image editing unit for providing editing means for at least one of cutting, enlarging and reducing, rotating, color changing, and distortion of the photographed image;
A photobook production unit for producing photobooks from the image edited by the image editing unit;
A data transfer unit for transferring the prepared photo book through the wireless data communication unit to order printing of the photo book; And
And a mobile settlement unit for paying for the photo book printing cost, wherein the photo book production process is one-stop.
The method according to claim 6,
And a QR code recognizing unit for recognizing a QR code for reproducing the photobook transferred to the data transmitting unit as a moving picture on the display means.
7. The camera of claim 6,
Detecting facial parts in the image information coming in through the camera, detecting faces in the detected facial parts, determining emotions corresponding to the detected facial expressions, and applying emotional filters corresponding to the determined emotions A mobile photo book providing system with features.
9. The camera of claim 8,
The method according to any one of claims 1 to 3, wherein the face image includes a face image and a face image. The method according to claim 1, Book delivery system.

Images