Fast Semi Causal Nonparametric Markov Random Field Texture Synthesis on a Gaussian Pyramid

My Home Page

Original Version

Fast Version

Fast Version on a Gaussian Pyramid with K Nearest Search

This algorithm is a cut down version of the algorithm published in IEEE Transactions on Image Processing 1998. In this version, it has been rewritten for a single cpu machine. To maintain speed of synthesis, the update function pUpdateFn() has been set to return the maximum value. If this was modified to return a portion of the maximum value, then the synthesis would take longer, but there would be a gain in quality. If you do decide to modify the code, be careful, as I have not put in any safeguard checks. Best to fully understand the whole code, before modifying it.

This gaussian version implements the previous fast version on a Gaussian pyramid of the input image (instead of a decimated quadtree as in the fast version). As can be seen in the results, there is not a great improvement. But just a reduction in speed of synthesis, as about 1/3 more pixels need to be synthesised. However there does appear to be also a reduction in the speckle noise that was apparent in the images synthesised by the fast version.

Recently there has been quite an influx of nonparametric sampling techniques for texture synthesis (,here is a brief list). This is because it has been the nonparametric models that have had the greatest success at synthesising arbitrary textures. This technique uses a multiscale approach, which has the advantage that only a small neighbourhood is required.

• R. Paget and I. D. Longstaff, ``Texture synthesis via a noncausal nonparametric multiscale Markov random field,'' IEEE Transactions on Image Processing, vol. 7, n 6, pp. 925-931, June 1998. - Paget_IP_1998.pdf - Paget_IP_1998.ps.gz - Paget_IP_1998.ppt

However the basis of the algorithm first appeared in:

• R. Paget and I. D. Longstaff, ``A nonparametric multiscale Markov random field model for synthesising natural textures,'' in Fourth International Symposium on Signal Processing and its Applications, vol. 2, (Gold Coast, Australia), pp. 744-747, ISSPA 96, August 1996. - Paget_ISSPA_1996.pdf - Paget_ISSPA_1996.ps.gz

• R. Paget and I. D. Longstaff, ``Texture synthesis via a nonparametric Markov random field,'' in Proceedings of DICTA-95, Digital Image Computing: Techniques and Applications (A. Maeder and B. Lovell, eds.), vol. 1, (Brisbane, Australia), pp. 547-552, Australian Pattern Recognition Society, December 1995. - Paget_DICTA_1995.pdf - Paget_DICTA_1995.ps.gz

Source Code

The source code requires ImageMagick to be preinstalled. To compile the code, run gmake in the parent directory. There are two makefiles, one in parent directory, and in the src directory. If the code does not compile, both makefiles will need to be edited. I have written one for a sun (default) and one for an sgi machine, but I give no guarantees that they will work.

The program is executed with the following command

nonparaMRF_gaussian [-l levels] [-n neighOrder] [-s] [-t treeMax] [-c] [-x cols] [-y rows] [-m maskfile] [-h] texturefile

where

levels =

number of gray levels the image will be compacted to. Reducing the number from 255, will probably not improve the synthesis, and will most likely increase the run time.

neighOrder =

number to signify neighbourhood size. See neighbourhoods for schematics of the neighbourhoods used in the texture synthesis algorithm.

s =

if set, the neighbourhood becomes a square neighbourhood.

treeMax =

maximum quadtree height. The algorithm will not allow the quadtree height to be set to a value that will allow either the input image or output image to be reduced to less than a 2x2 pixel image.

c =

if set, the output image is defined to be toroidal (ie cyclic) where each border matches with its opposite border.

cols =

number of columns in the output image. If undefined, number columns in the output image will equal number columns in the input image.

rows =

number of rows in the output image. If undefined, number rows in the output image will equal number rows in the input image.

maskfile =

is a mask image that must be the same size as the input texture image. Only where the mask image is non zero is the input image used.

h =

if set, will mean that just usage and default values will be displayed. This will also occur if no input values are given.

texturefile =

is the input texture image that is to be synthesised.

Default values are : levels = 256, neighOrder = 1, square = false, treeMax = 6, cyclic = false

Schematic of the neighbourhoods used in the texture synthesis algorithm

Synthesis run times for various input parameters

These times were compiled on a distributed system of mainly SunBlades 100: 500 MHz, 256 MBytes RAM. The input textures were 128x128 pixel images, and the output synthesised textures were 256x256 pixel images. The run times are basically dependent on output image size and the type of input texture. This is due to the nearest neighbour search algorithm used in the code. If the input texture is fairly uniform in colour, then the search algorithm will be more of an exhaustive search, and therefore more dependent on input image size. Time stamps are in "Days Hours:Minutes:Seconds".

Limitations

• This algorithm works well for natural textures which have a pixelwise noise distribution. However for input textures that contain "structure" or are not truely homogeneous, then (due to the nearest neighbour search algorithm) phase discontinuities, or visible texture seams appear.

Additional Information

• To compare this algorithm with other algorithms, it is necessary to use the same neighbourhood for each.

For More Information

Email Rupert Paget at: dr@rupertpaget.com