CA2594133A1 - System for automated generation of layout color schemes - Google Patents

System for automated generation of layout color schemes Download PDF

Info

Publication number
CA2594133A1
CA2594133A1 CA002594133A CA2594133A CA2594133A1 CA 2594133 A1 CA2594133 A1 CA 2594133A1 CA 002594133 A CA002594133 A CA 002594133A CA 2594133 A CA2594133 A CA 2594133A CA 2594133 A1 CA2594133 A1 CA 2594133A1
Authority
CA
Canada
Prior art keywords
color
layout
colors
hue
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
CA002594133A
Other languages
French (fr)
Inventor
Edythe P. Lefeuvre
Rodney D. Hale
John A. Guzzwell
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
LEFEUVRE EDYTH P
Original Assignee
LEFEUVRE EDYTH P
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by LEFEUVRE EDYTH P filed Critical LEFEUVRE EDYTH P
Priority to CA002594133A priority Critical patent/CA2594133A1/en
Publication of CA2594133A1 publication Critical patent/CA2594133A1/en
Abandoned legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/002D [Two Dimensional] image generation
    • G06T11/001Texturing; Colouring; Generation of texture or colour
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/90Determination of colour characteristics

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Image Processing (AREA)

Description

Patent Application System for Automated Generation of Layout Color Schemes INTRODUCTION

Scrapbooking involves the creative enhancement and grouping of photos and memorabilia. Digital scrapbooking involves the use of a computer and software to assist with scrapbooking activities. Digital scrapbooking can be accomplished via platforms that include:

= photo kiosks = consumer software programs on personal computers = websites that provide layouts for digital photo images, various editing functions as well as "how to" advice and instructions A scrapbooking layout typically consists of a colored border or background for one or more photo images, with locations for inserting the one or more images.
The layout typically has a theme, incorporating various graphics and colors to portray the theme. Examples of themes include holidays (Christmas, Easter), special occasions (birthdays, births, christenings, weddings, anniversaries, graduations), sports, vacations (beach, skiing, camping) and seasons (summer, fall, winter, spring).

The various digital scrapbooking platforms provide a wide range of layout templates in various colors and configurations from which consumers must choose. Given a particular theme, even though there are many layout templates to choose from, in some cases the colors in the layouts do not match the colors in the one or more photo images, so the resulting scrapbook page is unsatisfactory. Due to the large number of scrapbook layouts available, the selection of a layout with a satisfactory color scheme can be a daunting task.
Even with a range of layouts, it may difficult to find a layout with a satisfactory color scheme. As a result the present automated scrapbook layout selection system (AutoLayout) was invented. AutoLayout is a computer algorithm that analyzes the colors in one or more images and based on the analysis, automatically selects an appropriate color or number of colors for a scrapbook layout to suit the one or more images. The AutoLayout can also be used to select one or more of the most suitable (based on color) layouts from an existing library/database of layouts.

DESCRIPTION
This invention is AutoLayout, an automated algorithm to generate scrapbook layout color schemes. The algorithm determines the dominant colors in an image or images and outputs one or more colors that match the dominant colors of the image or images for the purpose of producing colored scrapbook layouts. The description below uses the hue, saturation, intensity (HSI) color space as the basis for determining the dominant colors of one or more images, and then uses the red, green, blue (RGB) color space to convert to conventional colors. The dominant colors are used to produce a color scheme for a scrapbook layout for the image or images. The dominant colors may also be analyzed to determine whether they match each other. A scrapbook layout color scheme with colors that match is preferable to a color scheme with colors that do not match. In one embodiment, the determination of whether colors match is based on complementary and analogous colors based on the color wheel (see the Definitions section for definitions of complementary, analogous and color wheel).
It should be noted, however, that any color space, including but not limited to the list below could be used to determine the dominant colors in an image:

= red, green, blue (RGB) color space = hue, saturation, brightness (HSB) color space = tristimulus color space = CIE XYZ color space = cyan, magenta, yellow (CMY) color space Once the dominant colors of one or images are identified, they can be used to = provide color suggestions for the production of a layout color scheme, or = select a layout with colors that match the one or more images from an existing database/library of layouts The steps for one embodiment for an automated scrapbook layout color scheme generation algorithm are described below. A flowchart is also provided to illustrate an example of an embodiment of the algorithm.

Steps for AutoLayout Proaram A. For each image i of the one or more images:
1. Load the image.
2. Sub-sample the image for speed if necessary.
3. Create a histogram of the hues in the image.
4. Choose the most frequently occurring hue in the entire image (i.e. the hue that characterizes the most pixels in the image) as first Hue Suggestion, Hue (i,1):
a. Where the hue may be within a range of hue values, i.e. a bin;
b. Where the continuous range of hues is characterized by a number of ranges or bins.
5. Create a histogram of the central region of the image (at least one layer of pixels around the border is omitted from the central region)
6. Select the most frequently occurring hue in the central region that is different from Hue (i,1). This is designated the second Hue Suggestion, Hue (i,2). If no such hue exists in the central region then a) choose the most frequently occurring hue that is analogous to Hue (i,1); b) if no such analogous hue exists in the image choose an analogous hue to Hue (i,1) that is not in the image.
7. Choose the most frequently occurring hue in the entire image that is different from Hue (i,1) and Hue (i,2). This is Hue (i,3).
8. If there is no such Hue (i,3) (because, for example, the image has only one color, or because all hues other than Hue (i,1) and Hue (i,2) are equally frequent), then a) choose the most frequently occurring hue that is analogous hue to Hue (i,1) and different from Hue (i,2); b) if no such analogous hue exists in the image choose the most frequently occurring hue that is different from Hue (i,2) and complementary to Hue (i,1). If no such complementary hue exists choose a hue that is not in the image but that is analogous to Hue (i,1) and different from Hue (i,2). If no such analogous hue exists in the image choose a hue that that is not in the image but that is complementary to Hue (i,1) and different from Hue 2.
9. The order of the selection of Hue (i,1), Hue (i,2) and Hue (i,3) as described above could be altered.
10. The number of Hue Suggestions should at least be equal to the m, the number of colors required in the scrapbook layout. The number of Hue Suggestions can be increased by applying Steps 4 to 8 repeatedly. This is shown in the Flow Chart below. There can be as many Hue Suggestions as there are colors. The number of hues possible is infinite, but for digital applications, the 24-bit color range provides over 16 million colors.
11.The number of Hue Suggestions could also be increased by repeatedly changing the size of the central region and then applying Step 6.
12. For each Hue Suggestion a. select only the regions of that hue in the image and b. calculate the average saturation of those regions.
13. Calculate the image average intensity over the entire image.
14. For each Hue Suggestion, use the hue, the average saturation from Step 12b for that hue, plus the average intensity from Step 13 and convert from the HSI (hue saturation intensity) color space to the RGB (red green blue) color space to produce a layout Color Suggestion, where Color Suggestion (i,1) is based on Hue (i,1), ( Color Suggestion (i,2) is based on Hue (i,2) and so on... where i is the number identifying the image.

B. Once each image of the one or more images to be included in the scrapbook layout has been analyzed as described in steps 1 to 14 above to determine the dominant colors in the image, the following steps are taken:
15.The Color Suggestions from the one or more images are compiled into a Master Array. The number of top ranked Color Suggestions possible is infinite, as described in Step 10, but for simplicity, only the number of colors m required for the scrapbook layout would be chosen for each image. As an illustration, if there were three images with three Color Suggestions each, the Master Array would include nine Color Suggestions.
16. Each Color Suggestion for each image is weighted using a micro weighting factor, kmicro. For each image i, km;cro is highest for Color Suggestion (i,1), second highest for Color Suggestion (i,2) and so on...
17.A second weighting factor, the macro weighting factor, km.ro is applied to each Color Suggestion based on the frequency of the occurrence of that Color Suggestion in the Master Array; kn,a,,o is highest for the most frequently occurring Color Suggestion, second highest for the second most frequently occurring Color Suggestion, third highest for the third most frequently occurring Color Suggestion and so on...
18. For each unique Color Suggestion in the Master Array, the micro weighting factors of each occurrence of the Color Suggestion are added together and then the total is multiplied by the macro weighting factor to produce the decision score.
19. The color with the highest decision score is designated as Layout Color 1, the color with the second highest decision score is designated Layout Color 2, the color with the third highest decision score is designated Layout Color 3 and so on...
20. The number of Layout Colors provided in Step 19 will depend on the number of colors m required by the scrapbooking layout. If the layout requires three colors, then only three Layout Colors are determined in Step 19.
21.Output the Layout Colors as Layout Suggestion 1.
22. Optionally check to make sure the Layout Colors match each other. There are many means to determine if colors match, but for the purpose of illustration the Red-Yellow Blue color wheel system (originally developed by Isaac Newton) is used. Other color systems include but are not limited to Goethe's Triangle, James Maxwell's Triangle and Runge's Sphere and Munsell's color solid and the CIE Chromaticity Chart. The color wheel is used to determine whether the Layout Colors are either analogous or complementary to each other. If the colors are either analogous or complementary then they are considered to match. See the definitions of color wheel, analogous and complementary colors below.
23. If the Layout Colors do not match, optionally provide a Layout Suggestion with matching colors as described below. This process can also be used to provide additional Layout Suggestions:
a. Take Layout Color 1 plus any Layout Colors from Step 18 that have the highest decision score and that are analogous to Layout Color 1 until sufficient colors are selected to provide the number of colors required for the scrapbook layout. Output the Colors as Layout Suggestion 1.
b. If further colors are required then select the Layout Color from Step 18 that has the highest decision score and that is complementary to Layout Color 1.
c. If further colors are required select any colors from the color wheel that have not been chosen and that are analogous to Layout Color 1.
d. If further colors are required select any colors from the color wheel that have not been chosen and that are complementary to Layout Color 1.
e. If further colors are required select any colors from the color wheel that have not been chosen and that are analogous to an analogous color of Layout Color 1.

f. Continue to search for Analogous Colors of Analogous Colors of Analogous Colors of Analogous Colors .... of Layout Color 1 until sufficient colors are selected to provide the number of colors required for the scrapbook layout.
24. To provide additional Layout Suggestions, start with a Layout Color other than Layout Color 1 and follow Step 23.
25. The Colors in any Layout Suggestion can be used to provide as many permutations as are possible; e.g. if three colors are required, the number of permutations possible is 3! (three factorial) = 3x2x1 = 6.
26.The first permutation to be suggested is with Layout Color 1 as the Primary Layout Color, Layout Color 2 as the Secondary Layout Color, Layout Color 3 as the Third Layout Color and so on. The Primary Layout Color is the most frequently occurring color in the scrapbook layout, the Secondary Layout Color is the second most frequently occurring color in the scrapbook layout and so on.
27. Each resulting Layout Suggestion can be output as colors to a. produce a Scrapbook layout, b. select an existing scrapbook layout or c. edit an existing Scrapbook layout (or number of layouts) DEFINITIONS

Color Wheel: The Color Wheel is the basic tool for combining colors. The most common version is a wheel of twelve colors based on the red-yellow-blue color model. The twelve colors in this wheel include the primary colors, the secondary colors and the tertiary colors. In traditional color theory, red, yellow and blue are known as the primary colors. These are the three pigment colors that cannot be formed by mixing or combination of any colors. The secondary colors, green, orange and purple are created by mixing two primary colors. The tertiary colors are formed by mixing a primary and a secondary color, producing yellow-orange, red-orange, red-purple, blue-purple, blue-green and yellow-green. The location of the colors around the twelve-color color wheel are, clockwise, starting arbitrarily with red: red, red-purple, purple, blue purple, blue, blue-green, green, yellow-green, yellow, yellow-orange, orange and red-orange. The range of colors is a continuum so an infinite number of further colors can be added to the color wheel by continually combining adjacent colors to produce intermediate colors. As an illustration, a further 12 colors could be added by combining red and red-purple, red purple and blue purple, blue purple and blue and so on. It is noted that other color wheel models and other color models could be used to select colors that match a particular color.

Analogous Color: Analogous colors of a specific color are located adjacent to that color on the color wheel. Analogous color combinations are harmonious and pleasing to the eye. The analogous colors adjacent to a particular color will depend on the number of colors contained in the color wheel. For example, for a color wheel with twelve colors, the analogous colors of red are red-purple and red-orange. It is noted that the color wheel used to select the analogous colors could be any possible color wheel, ranging from the three primary colors to six, twelve, twenty-four and so on to infinity.
Complementary Color: Complementary colors are opposite each other on the color wheel. Complementary colors provide high contrast. Complementary pairs from the twelve color wheel are red and green, blue and orange, purple and yellow, red-purple and yellow-green, blue purple and yellow-orange, and blue-green and red-orange. It is noted that the color wheel used to select the analogous colors could be any possible color wheel, ranging from six to twelve, twenty-four and so on to infinity.

AutoLayout Flowchart for Main Algorithm Load n Images Where n = no. of images For each image i where i= 1 to n Subsample image for speed if necessary For x= 1 to m, in steps of 3 Create histogram of hues in the entire image I Select as Hue (i,x) the most frequently occurring hue in entire image that has not been previously chosen for image i Create histogram of hues in central region the image Select as Hue (i,x+1) the most frequently occurring unchosen (for image i) hue of central region Select as Hue (i,x+1) the most frequently occurring Does Hue (i,x+1) unchosen (for image i) hue in N~ exist in image i?
image i that is analogous to Hue (i,x). If no such hue exists in image i then select an YES
unchosen (for image i) hue that is not in image i but that is analogous to Hue (i,x).
Select as Hue (i,x+2) the most frequently occurring unchosen (for image i) hue in entire image Does Hue (i,x+2) exist in image i ?

I
NO
YES
Select as Hue (i,x+2) the most frequently occurring unchosen Next x (for image i) hue that is analogous to Hue (i,x). If no such hue exists in image i then select the most frequently occurring unchosen For each Hue (i, j) (for image i) hue that is where j= 1 to m complementary to Hue (i,x). If no such hue exists in image i then select an unchosen (for image i) hue that is not in image i but that Select all pixels in the image is analogous to Hue (i,x). If no that have hue value = Hue (ij) such hue exists in image i then select an unchosen (for image i) hue that is not in image i but that is complementary to Hue (i,x).
Calculate the average saturation Saõe of all the pixels with hue value of Hue (ij) Calculate the average intensity lave of all pixels in the image Convert Hue (i,j), Sa.e and lave from HSI format to RGB format to produce RGB Color Suggestion (ij) Assign a micro weighting factor k,,,;cro(;,;) for Color Suggestion (i,j); the highest k,,,;,,o is for j =1, the second highest k,,,,cro for j=2, the third highest k,,,;ro for j=3 and so on.....

Next j Next i Compile n x m Master Array of Color Suggestions Assign a macro weighting factor k,õ,,,o (i,;) for each Color Suggestion (i,j) in the Master Array based on frequency of occurrence in Master Array; the highest kacro is for the most frequently occurring Color Suggestion, the second highest k,n,cro is for the second most frequently occurring Color Suggestion, the third highest k,na,r, is for the third most frequently occurring Color Suggestion and so on...
For each unique Color Suggestion in the Master Array, sum the k;,, values from each occurrence of the Color Suggestion in the Master Array and then multiply the total by k,,,., to produce the Decision Score Select the Color Suggestion with the highest Decision Score as Layout Color 1, select the Color Suggestion with the second highest Decision Score as Layout Color 2, select the Color Suggestion with the third highest Decision Score as Layout Color 3 and so on until sufflcient Layout Colors are provided to satisfy the number of colors required for the scrapbook layout Where: m = number of colors required for the scrapbook layout Do Layout Colors match based on Color Wheel?
See Subroutine 1 NO

YES
Output Layout Suggestion I
noting unmatched colors. Output the Layout Colors as Layout Suggestion I
Produce Layout Suggestion 2 using Subroutine 2 and output Layout Suggestion 2.
Use the Layout Colors from Layout Suggestion I to produce m! (m factor!al) permutations of the scrapbook layout (where m = number of colors required for the scrapbook layout).
The first permutation to be suggested is with Layout Color I as the Primary Layout Color, Layout Color 2 as the Secondary Layout Color, Layout Color 3 as the Third Layout Color and so on, where the Primary Layout Color is the most frequently occurring color in the scrapbook layout, the Secondary Layout Color is the second most frequently occurring color in the scrapbook layout and so on. Repeat for Layout Suggestion 2 if necessary.

C END
D

Subroutine 1 q=2 Is Layout Color q NO Analogous to Layout Color 1?

YES q = q+1 Is Layout Color q Complementary to NO Layout Color 1? q= m? NO
YES
YES

Layout Colors match q = m? NO

YES
Continue to check to see if Layout Color q corresponds to Analogous Colors of Layout Analogous Colors of Analogous Colors of Colors match Analogous Colors .... of Layout Color I until the number of colors checked is at least equal to m = number of colors required for the scrapbook layout.
Is Layout Color q Analogous to an NO
Analogous Color of Layout Color 1?
Does Layout Color q correspond to an YES NO Analogous Color?

YES
YES q=m? NO Layout Colors DO
NOT match q = m? NO
Layout Colors match YES
Layout Colors match Subroutine 2 to Produce Layout Suggestion 2 Start with Layout Color I

k=2 Is there a Color Suggestion that has not previously been NO chosen and that is also Analogous to Layout Color 1?
YES

Select Color Suggestion as Layout Color k k=k+1 k = m? NO

YES
Output Layout Suggestion 2 Is there a Color Suggestion that has not previously been NO chosen and that is also Complementary to Layout Color I?

YES

Select Color Suggestion as Layout Color k k=k+1 k = m? NO

YES
Output Layout Suggestion 2 Is there a color that has not previously been chosen and NO that is also Analogous to Layout Color 1?
YES
Select color as Layout Color k k=m? NO k=k+1 YES

Output Layout Suggestion 2 Is there a color that has not previously been chosen and that is also Complementary NO
to Layout Color 1?

YES

Select color as Layout Color k k= Ic*1 k=m? NO

YES
Output Layout Suggestion 2 Is there a color that has not previously been chosen and NO that is also Analogous to an Analogous color of Layout Color 1?

YES
k = k+1 Select color as Layout Color k k = m? NO
YES

Output Layout Suggestion 2 Is there a color that has not previously been chosen and that is also Analogous to an NO
Analogous color of an Analogous color of Layout Color 1?

YES
k=k+1 Select color as Layout Color k NO k = m?

YES
Output Layout Suggestion 2 Contlnue to search for Analogous Colors of Analogous Colors of Analogous Colors of Analogous Colors .... of Layout Color 1 until k=m Output Layout Suggestion 2

Claims

CA002594133A 2007-07-30 2007-07-30 System for automated generation of layout color schemes Abandoned CA2594133A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CA002594133A CA2594133A1 (en) 2007-07-30 2007-07-30 System for automated generation of layout color schemes

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CA002594133A CA2594133A1 (en) 2007-07-30 2007-07-30 System for automated generation of layout color schemes

Publications (1)

Publication Number Publication Date
CA2594133A1 true CA2594133A1 (en) 2009-01-30

Family

ID=40299541

Family Applications (1)

Application Number Title Priority Date Filing Date
CA002594133A Abandoned CA2594133A1 (en) 2007-07-30 2007-07-30 System for automated generation of layout color schemes

Country Status (1)

Country Link
CA (1) CA2594133A1 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2284799A1 (en) * 2009-07-15 2011-02-16 Cabot Communications Limited The method for colour picking over an image data to be used in graphical user interface
CN107844358A (en) * 2017-11-22 2018-03-27 北京酷我科技有限公司 A kind of iOS interfaces fast layout strategy
EP3618000A4 (en) * 2017-04-24 2020-04-15 Beijing Kingsoft Office Software, Inc. Method and apparatus for generating file colour matching solution
CN112954429A (en) * 2020-12-14 2021-06-11 海看网络科技(山东)股份有限公司 Method for dynamically generating background in IPTV

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2284799A1 (en) * 2009-07-15 2011-02-16 Cabot Communications Limited The method for colour picking over an image data to be used in graphical user interface
EP3618000A4 (en) * 2017-04-24 2020-04-15 Beijing Kingsoft Office Software, Inc. Method and apparatus for generating file colour matching solution
US11361475B2 (en) 2017-04-24 2022-06-14 Beijing Kingsoft Office Software, Inc. Method and apparatus for generating file color scheme
CN107844358A (en) * 2017-11-22 2018-03-27 北京酷我科技有限公司 A kind of iOS interfaces fast layout strategy
CN112954429A (en) * 2020-12-14 2021-06-11 海看网络科技(山东)股份有限公司 Method for dynamically generating background in IPTV

Similar Documents

Publication Publication Date Title
US6697079B2 (en) Color palette providing cross-platform consistency
US8456694B2 (en) System and method for proofing a page for color discriminability problems based on color names
Houser et al. Tutorial: color rendering and its applications in lighting
CN102761766B (en) Method for depth map generation
US20180018937A1 (en) Method and apparatus for changing background color of toolbar with dominant color of picture
US20140089781A1 (en) Color-based designs
CN105096286B (en) The fusion method and device of remote sensing images
US20100110100A1 (en) Method and System For Extracting and Applying Colour Schemes Across Domains
CN101122999B (en) Method for automatically extracting stamp image from Chinese painting and calligraphy
US7990574B2 (en) Method and system for converting a document
CA2594133A1 (en) System for automated generation of layout color schemes
US20090021524A1 (en) Color Selection System and Method
Christophe et al. Colours harmony in cartography
Tuzikas et al. Artwork visualization using a solid-state lighting engine with controlled photochemical safety
Quintero et al. Color rendering map: a graphical metric for assessment of illumination
US20150039994A1 (en) Color-based designs
Žukauskas et al. Color-dulling solid-state sources of light
CN100468416C (en) Generation of changeable colour and displaying method and apparatus thereof
KR101216578B1 (en) Method and apparatus for correcting color
CA2581022A1 (en) System for selecting matte colors
Huo et al. An improved method for color harmonization
Park Histogram-based colour image analysis on tourism photography
ŽUKAUSKAS et al. LEDs in lighting with tailored color quality
Falomir et al. A model for qualitative colour description and comparison
TWI811080B (en) Optimal harmonic color assignment system and method thereof

Legal Events

Date Code Title Description
FZDE Dead