Next Article in Journal
Video Summarization Based on Mutual Information and Entropy Sliding Window Method
Next Article in Special Issue
A Computational Model of Tonal Tension Profile of Chord Progressions in the Tonal Interval Space
Previous Article in Journal
Bell-Type Correlation at Quantum Phase Transitions in Spin-1 Chain
Previous Article in Special Issue
On-The-Fly Syntheziser Programming with Fuzzy Rule Learning
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Generative Art with Swarm Landscapes

by
Diogo de Andrade
1,
Nuno Fachada
1,2,3,*,
Carlos M. Fernandes
3 and
Agostinho C. Rosa
3
1
School of Communication, Arts and Information Technology, Lusófona University, 1749-024 Lisboa, Portugal
2
HEI-Lab—Digital Human-Environment Interactions Lab, Lusófona University, 1749-024 Lisboa, Portugal
3
LARSyS: Laboratory for Robotics and Systems in Engineering and Science, Instituto Superior Técnico, University of Lisbon, 1049-001 Lisboa, Portugal
*
Author to whom correspondence should be addressed.
Entropy 2020, 22(11), 1284; https://doi.org/10.3390/e22111284
Submission received: 5 October 2020 / Revised: 2 November 2020 / Accepted: 6 November 2020 / Published: 12 November 2020

Abstract

:
We present a generative swarm art project that creates 3D animations by running a Particle Swarm Optimization algorithm over synthetic landscapes produced by an objective function. Different kinds of functions are explored, including mathematical expressions, Perlin noise-based terrain, and several image-based procedures. A method for displaying the particle swarm exploring the search space in aesthetically pleasing ways is described. Several experiments are detailed and analyzed and a number of interesting visual artifacts are highlighted.

1. Introduction

Particle Swarm Optimization (PSO) is a social intelligence model for learning and optimization that uses a population of particles to represent candidate solutions for a given problem [1,2]. The particle’s initial positions—i.e., the initial solutions—are typically randomized within the search space. PSO works iteratively, with particles moving through the problem landscape in search of better solutions. More specifically, at each step t, particles are informed of the best known position in the search space (or in the particle’s local network), using this information, together with the particle’s best known position, to guide how their velocity and position are updated, as shown in Equation (1) and Equation (2), respectively. When a particle’s position is updated, the solution it represents is evaluated according to a measure of fitness. This process is repeated until a “good enough” solution is found or a predefined maximum number of steps or evaluations is reached. The velocity and position of particle i for step t are updated according to [3]:
v i ( t ) = ω v i ( t 1 ) + c p r p ( p i best x i ( t 1 ) ) + c g r g ( g i best x i ( t 1 ) )
x i ( t ) = x i ( t 1 ) + v i ( t )
where ω is the inertia weight parameter, which, together with the acceleration coefficients c p and c g , allows the fine-tuning of the relative influence of the particle’s and the global (or local network) knowledge. The r p and r g parameters are random numbers taken from the uniform distribution in the interval [ 0 , 1 ] at each step t. Finally, p i best is the particle’s best known position, and g i best is the best position in the search space or in the particle’s local network. The second term in Equation (1) reflects the cognition aspect of PSO, i.e., a particle’s own thinking. The third term represents the social component, namely the collaboration between particles.
The value of the g i best parameter depends on the topology of the swarm, i.e., the group of particles with which any given particle i exchanges information. A global topology connects all particles to one another, while a local topology restricts communication of a particle to a subset of other particles. Common neighborhoods include a ring structure, in which particles are arranged in a ring, as well as 2D square lattices with von Neumann and Moore neighborhoods [2]. Topologies define the social interactions within a swarm and can have a considerable impact on its performance.
In this paper, we present a generative swarm art project capable of generating aesthetically engaging 3D animations by running a PSO algorithm over artificial landscapes. These landscapes are created by the same function being optimized by PSO, in the form f ( x , y ) . For a given input ( x , y ) , the function returns the height of the landscape and the fitness criterion at that point. Therefore, in the context of this paper, the velocity and position of a particle i are given by 2D vectors, i.e.,
v i = ( v i , x , v i , y )
x i = ( x i , y i )
Functions used for producing the artificial landscapes include well-known test functions for optimization, functions for procedural content generation (PCG), and images with pixel features such as brightness and saturation representing height/fitness. Particles move around in these landscapes in search of minima (and optionally, in the case of images, maxima), sometimes being trapped in local optima, offering interesting insights on the swarm’s social behavior. Furthermore, by manipulating parameters of the PSO algorithm, the generated visualizations allow for a deeper understanding of how PSO works in practice.
Landscape visualization can be configured in several ways. For example, landscapes can be rendered with height/fitness as a continuum along the visible electromagnetic spectrum. Height/fitness can be initially flat, and only rendered as the underlying function is explored by particles. Particle size is adjustable and particle communication lines can optionally be displayed. In summary, the swarm art project presented here provides a framework for visually exploring landscape-generating functions and a demonstration of how various PSO parametrizations self-organize in search of optimal points.
The paper is organized as follows: in Section 2, we review related work concerning the use of algorithms for generating artistic artifacts, with a special focus on swarm art. In Section 3, we describe the methods and software developed for creating the 3D animations, namely with respect to landscape aesthetics. Several experiments designed to highlight the proposed methodology are presented in Section 4; particular attention is given to their parameterization, as well as to interesting generated features. Section 5 includes a discussion on how these experiments were evaluated and selected for presentation. Section 6 closes the paper, offering some conclusions and suggesting alternative and/or complementary approaches.

2. Background

The term generative art refers to artistic objects that are partially or entirely created by autonomous systems, while computer-generated art, as defined by Boden and Edmonds [4], “results from some computer program being left to run by itself, with minimal or zero interference from a human being”. Accordingly, swarm art [5] can be defined as generative computer art that is created by artificial intelligence models with swarming behavior, requiring minimal or no interference from the artist. This is possible because swarm intelligence algorithms, which are basically populations of simple interacting entities that follow a set of rules to produce global patterns, have a considerable degree of autonomy and adaptability. Particle Swarm and Ant Colony Optimization [6] are examples of well-established swarm algorithms.
Swarm art is closely related to evolutionary art [7], but it has some specific characteristics that distinguish it from evolutionary and other types of generative or computer-generated art. One of the major differences between swarm and evolutionary art is that the former does not necessarily require an objective function. For swarm intelligence concur instead concepts like self-organization, emergency and stigmergy (indirect coordination through the environment) [8]. Their dynamic behavior and outcome are characterized by global complex patterns, rather than explicit goals imposed by objective functions. Swarm art systems have been used in several artistic conceptual spaces, like music [9] and multi-disciplinary installations [10], but they are best known for their applications in visual arts. In the remainder of this section, we will discuss visual swarm art that bears some relationship, either conceptual or aesthetic, with the proposed work.
Just like traditional painting, pictorial swarm art can be figurative and abstract. The swarm drawings by Semet et al. [11] are an example of a figurative approach. The authors use an artificial ant colony to make monochromatic drawings from black-and-white photographs. Photogrowth [12] is a similar approach, but in this case, the authors use artificial ants to produce non-photorealistic rendering of a given base-image, with a fitness function guiding image formation. Fernandes [13] used a swarm art system called pherographia to create artwork, which is in some aspects similar to those in [11,12].
Although figurative swarm art holds interesting aesthetic properties, abstract approaches can be more much exciting, both from conceptual and aesthetical points of view. From the conceptual perspective, it seems much more intuitive that swarms handle non-representational forms. The geometrical and life-like patterns generated by abstract-oriented swarms are more in harmony with their own properties. As for aesthetics, abstract styles allow for open-ended and informed exploration of search spaces, bringing novelty, surprise and an organic feel that somehow mirrors the essence of the medium. As seen in Section 4, the swarm visual forms presented in this work can be classified as abstract. The following are some examples of previous work on abstract swarm drawings and paintings.
Monmarché [14,15] was one of the first researchers to investigate the aesthetical possibilities of artificial ant colonies. Examples of Monmarché’s creations with swarms can be seen at the EA2013 Art&Science in Evolutionary Computation side-event catalogue [15]. Greenfield’s [16] first swarm art project also generated abstract images characterized by near-regular color patches. Later, Greenfield’s artwork evolved towards regularity and symmetry [17,18]. Urbano’s [19] ant paintings mimic circular sand wall building by the Temnothorax albipennis species. The images have an organic quality that is similar to other natural phenomena, like circular waves or microscopic organisms in fluids. Sand-bubbler crabs were the inspiration for Richter [20] to generate swarm paintings. The algorithm models the species collective behavior and generates colored images that recreate its feeding patterns and structures. Jacob et al. [21] proposed SwarmArt, an interactive swarm-based framework inspired by flocking birds. The interaction of the artist with the swarm is accomplished with video. However, the swarm is essentially autonomous and its dynamics can only be influenced to a certain degree. Finally, Fernandes et al. [22] used an ant clustering algorithm to design a swarm art system that was used to recreate famous abstract paintings.

3. Materials and Methods

3.1. Software

The swarm art project presented here is brought to life by the Visual PSO framework (https://github.com/DiogoDeAndrade/VisualPSO). Visual PSO was created with the Unity game engine [23], although its PSO capabilities are implemented in a separate library, OpenPSO.NET (https://github.com/fakenmc/openpso.net). This library is a C# reimplementation of OpenPSO, software originally written in C [2]. It includes a number of optimization benchmark functions, such as the Ackley [24], Griewank [25] or Rastrigin [26] functions, as well as a Perlin noise function [27], commonly used for PCG. The library allows users to easily create and use custom functions, a functionality used by Visual PSO, which adds several functions to handle images as an input for an optimization problem. Both tools are made available as open source software.
The application can be configured when running the executable binary on the command line. Running the application binary without any arguments will generate a random visualization. The available command line arguments are shown in Table 1. Alternatively, the source project can be opened in Unity and configured within the Unity editor.

3.2. Visualization

A function is visualized as a terrain, using a custom shader that displays the contour lines as glowing lines, as well as using a Fresnel-like effect to make the outlines of the search space more visible. The rendering also makes use of a post-process bloom effect to enhance the contoured nature of the generated landscapes and to create a more digital mood to the generated image.
Particles are represented as a sphere that leaves a trail, to make it easier to see the direction and speed of the particle. Particles are colored based on their current tendency: reddish while their fitness worsens, greener when it improves. Particle connectivity, i.e., the swarm topology, can optionally be shown by joining particles with a line, ignoring the z-buffer in order to avoid occlusion of the connection lines.
Visualizations can display the complete function topography from the start (the default), or only the explored search space, by activating the fog of function option. In this mode, the search space is initially displayed as flat terrain, and has the particles move, the underlying nearby terrain (i.e., fitness) is set to its correct height. This type of visualization allows the user to see where the particles have searched at any given moment. This is merely an aesthetic option, having no effect on how the PSO algorithm operates.
The camera movements are also generated procedurally. The camera can choose a random target or a particle (best, worst or random) to follow, and the movement itself is also generated considering the extents of the generated terrain. If the algorithm selects a particle to follow, a ray is cast onto the scene to check for occlusion; if an occlusion exists, a new position and target are selected. The camera also favors looking down into the scene, to avoid situations where it might be looking towards the sky. Every few seconds, the view changes to a new one.

3.3. PCG Landscapes

Most of our experiments focus on PCG landscapes. These are generated using an additive multi-layer Perlin noise [27] described by the following equation:
f ( x , y ) = i = 1 N A i P ( f x i x + o x , f y i y + o y )
where P ( x , y ) is the Perlin noise function, A i is the amplitude for layer i, f x i and f y i are the frequency for layer i, in the x and y axis, respectively; o x and o y are offsets for the terrain. On all our experiments involving the PCG terrain, o x = o y = 0 , f x i = f y i , f x i = 2 i f 0 and A i = 1 2 i A 0 , where f 0 is the start frequency, and A 0 is the start amplitude.
There were alternative possible noise functions, such as Simplex [28] or Wavelet [29]. Perlin noise was chosen because of the low computational and implementation cost and lack of patents. Other techniques for terrain generation exist, such as erosion or fault-line algorithms [30], but most of these techniques require the whole terrain to be generated beforehand, which can be memory intensive and defeats the purpose of performing PSO.

3.4. Image Landscapes

Several image-based functions were also created, using the OpenPSO.NET custom function system. These functions accept an image and return a fitness value for a specific pixel. The first two functions are Saturation and Value. For these, the color at the desired pixel position is fetched, converted from RGB to HSV and then, either the Saturation or Value are used as fitness. Hue was discarded as a fitness function because in the case of minimization, for example, the swarm would just be searching for red or the closest color to red, which is not very interesting.
A function inspired on Ralph’s bell curve [31] was also designed and implemented. The premise is that many works of art consistently exhibit functions over color gradients that conform to a bell curve distribution. This allows parameters for a bell curve distribution to be computed to measure the response of a user to an image. Since a fitness value for a specific pixel is required, the concept of local response was introduced, in which the response is calculated in a customizable neighborhood of the pixel being evaluated instead of the whole image. The mean or the variance of the bell curve is then used as the fitness value. Although the PSO results are interesting, the function has a tendency to create spiky landscapes, which are not visually appealing when exaggerated for effect, and are too small to appreciate when not.
Currently, OpenPSO.NET only supports minimization problems, but in the case of images it is more interesting to search for local and global maxima. To circumvent this, the image functions can be inverted. Coupled with a negative scale in the landscape, the visual aspects do not change, but now the swarm is searching for the maximum.

4. Results

Our focus with this work was mainly in producing an appealing visualization for the algorithmic exploration. For this, PSO parameters were chosen that would lead to more interesting visualizations instead of those that would ensure faster convergence to a problem’s solution. As such, the particles’ maximum velocity and acceleration coefficients were limited, so that the viewer could follow the particles’ movements during the experiments. For all experiments, ω was set to 0.5, and, to ensure reproducibility, the random seed was set to 12345. The remaining parameters used on the different experiments are presented in Table 2.

4.1. Benchmark Functions

PSO algorithms are usually tested with benchmark functions such as the ones proposed by Ackley (Figure 1) or Rastrigin (Figure 2). Although these functions are typically too regular from a visual perspective, some of them are interesting for our goal of generating swarm art, as is the case of the Rastrigin function, used for Experiment 1 (Figure 2, Video S1). In this experiment, it is possible to observe that particles follow the function’s smooth yet pronounced curves towards convergence at the center position. Since this function is very regular, the choice of maximum velocity does not affect convergence quality too much, and as such, a very small one was used, enabling the viewer to appreciate the movement of the particles. A large scale factor for the particle representation was also employed, to draw the attention of the audience to the particle flow. For the color scheme, a purple/blue gradient was chosen, reinforcing the connection with the mathematical aspect of these functions with cold colors.

4.2. PCG Functions

The Perlin noise function, originally developed for PCG of natural-looking surfaces and textures, is at the core of this work, arguably creating more interesting landscapes, combining a smooth terrain with deep groves and mountains. Besides curiosity to see how a particle swarm would work over a procedurally generated landscape, these experiments were also designed to demonstrate how varying several of the PSO parameters influences the behaviors of the particles working on an easier-to-interpret landscape. All experiments in this section use a start amplitude, A 0 , of 20, and a start frequency, f 0 , set to 0.04 .
In Experiment 2 (Figure 3, Video S2), an archetypical PCG landscape, created with eight layers of Perlin noise, is explored by a swarm of 49 particles. Using the fog of function option, it is clearly visible what areas the particles explore. In this experiment, a reasonable amount of the search space was visited. After a couple of seconds of simulation, the particles tend to reach local minima, although they do not stop searching for an improvement, balancing their own knowledge with the information provided by their Von Neumann neighborhood. For this experiment, the spectrum color palette was used, which maps the visible spectrum to the height of the function landscape, covering all the gamut of possibility.
In Experiment 3 (Figure 4, Video S3), the maximum speed of the particles was increased, which also enables more “risk taking”. The c g parameter was also increased, expanding the influence of the particle’s neighborhood on its behavior. As expected, there were less individual clusters, converging to one or two positions. The terrain is less detailed than in the previous experiment, with four layers of Perlin noise, becoming visible only when particles travel over it, due to the fog of function being enabled. This results in what seems as an island surrounded by high cliffs, all the more striking due to the direct association of color frequency with height.
For contrast, Experiment 4 (Figure 5, Video S4) maintains the level of detail ( N = 4 ), but switches the influences, increasing the pressure of the particle’s own experience versus the information provided by its topological neighbors. In this experiment, it can clearly be seen that there is less exploration of the space, since the particles tend to settle more in their own separate, individual regions, ignoring much of the information provided by their neighborhood. The color scheme was switched to a red/yellow gradient. With this aggressive palette, the ideas of conflict and isolation between the particles are reinforced. Regardless of color, the generated landscape is considerably different from the previous experiment, looking less like an island and more like a hole-ridden scene, with narrow, steep paths unfolding from its central area.

4.3. Image Functions

Another type of experiments created were based on a source image, from which a per-pixel fitness value is extracted. Two classical paintings (Figure 6) and different evaluation functions were used in our experiments.
In Experiment 5 (Figure 7, Video S5), the viewer can experience Juan Miró’s Ciphers and Constellations in Love with a Woman painting (Figure 6a) as an alien landscape. This extraterrestrial terrain fits well with Miró’s different perspective. The Value of the HSV representation of the color was used as the evaluation function. The Value was inverted—as well as the the scale of the terrain height—forcing the swarm to perform a maximization operation, instead of the default minimization. The reason for this is that the HSV color space is a cone and when Value is equal to zero, Saturation is irrelevant, so the particles would just search for the color black, while maximum brightness can be any color. The particle behavior in this experiment is not as interesting as in others, since searching for points of maximum brightness is not a difficult challenge in a bright painting such as this one.
In Experiment 6, Leonardo da Vinci’s Mona Lisa (Figure 6b) was selected as the source image. For the fitness value, the ideas behind Ralph’s bell curve were used, but, for aesthetic reasons, the stimulus instead of the response is used, computed in a local neighborhood with a radius of five pixels around the evaluated pixel. An interesting result of this experiment is that the particles tend to move towards the face of the Mona Lisa, as the stimulus value there was highest. Results from this experiment are shown in Figure 8 and Video S6.
In both of these experiences, the original colors of the painting were used for the contour lines. Using one of the color schemes would make the fitness more obvious (Figure 9), but it would make the painting harder to recognize.

4.4. Connectivity Experiments

From an aesthetic perspective, the connectivity display is not the most appealing, but it provides compelling insights into the social component of PSO. For this, we performed four experiments (Figure 10) using the Perlin landscape function ( N = 8 , A 0 = 20 , f 0 = 0.04 ), changing only the c p and c g parameters, as well as the topology: Experiments 7, 8, and 9 use a 7 × 7 Von Neumann grid (total of 49 particles), while Experiment 10 uses a global topology with 25 particles. The green/blue color scheme was chosen on these experiments to provide contrast with the connection colors.
In Experiment 7 (Figure 10a, Video S7), c p is equal to c g , i.e., the influence of the neighborhood knowledge and of the particles own experience is equally balanced. Besides the visual connections between particles, activated for this set of experiments, it is possible to observe a number of particle clusters forming around local minima, as well as a few isolated particles—some of which are perfectly static in deep, concentric minima. This experiment provides an instructive visualization, but its main raison d’etre is as a baseline for the next two experiments.
In Experiment 8 (Figure 10b, Video S8), the neighbors’ influence is five times that of the particles’ first-hand information. Looking at the generated visualization, this influence becomes quite clear when compared with the previous experiment: fewer and larger clusters form in valleys, with particles rarely seen wandering alone. The power of the crowds is obvious. Although this is an expected outcome, observing it as a swarm art process provides an excellent intuition of how PSO is working in general, and the influence of topology in particular.
Conversely, c g is set to zero in Experiment 9 (Figure 10c, Video S9). This means that the neighborhood has no influence at all on a particle’s decisions. It converts PSO into a multiple trials stochastic hill climber with a momentum term [30], where each particle acts on its own to find the optimum. Once again, the generated visualization confirms one’s reasoning, showing that particles essentially ignore each other, mostly hovering around minima near their spawn location.
Experiment 10 (Figure 10d, Video S10) is a very enlightening one. Parameters are the same as Experiment 7, except for the topology, which is now set to global, with a total of 25 particles. Thus, the whole swarm in considered as a particle’s neighborhood, which means that all particles are informed of the swarm’s best location at every step of the algorithm. A known issue with this approach is that it may lead the swarm to be trapped into local optima [32]. The intuition for this is strong: since all particles are biased towards the same point, the possibilities for exploration are reduced, and, with this, the chance of finding better locations. The visualization confirms our expectations, as a single large cluster of particles forms around a small region of the landscape; sometimes, a few particles wander off a bit, but never leaving the general area where the swarm is located.

5. Discussion

The swarm art project presented here is, in essence, a framework for exploring and experimenting with a parameterizable PSO algorithm working over landscape functions. The ten experiments presented in the previous section are primarily a showcase for what is possible to do with this framework. These experiments were selected by the authors based on their subjective aesthetical impact, similarly to [9,10,22], for example, and/or their didactic value, namely in how they highlight the influence of different PSO parameters on the optimization process. In this regard, the proposed VisualPSO framework can be viewed as an interactive art tool, where the main concern is not to objectively evaluate the aesthetics of a specific visualization, but instead to allow for user-controlled experiences [4] with a potentially educational facet.

6. Conclusions

In this paper, we have presented a method—and an associated software implementation—for generating swarm art in the form of expressive 3D animations. This was accomplished through the direct visualization of a parameterizable PSO algorithm running over a number of function-based artificial landscapes. The method was experimented on functions commonly used for benchmarking PSO variants, functions typically used for PCG and image-based functions. Besides the artistic side of the generated animations, the approach also presented an enlightening, didactic facet, where visualizations were able to confirm one’s intuition about the effects a given parameterization may have on the algorithm’s behavior. Taking this idea further, the generated swarm art could also potentially refute incorrect assumptions that the experimenter believes.
There are many potential avenues of research within or based on this work. For example, swarm algorithms such Ant Colony Optimization [6], Artificial Bee Colony Optimization [33] and others [34], could potentially produce visually appealing results of a different nature. Nonetheless, some care is required, since many of these bio-inspired swarm algorithms are in essence specific PSO setups [35]. Another interesting way of building upon this project would be to use some component of the PSO state to feed other generational components, such as the background or audio. A separate direction would be to create different types of aesthetics, rooted in the same concept; for example, instead of the landscape looking like a digital world, a more natural environment could be generated, creating photorealistic islands, and using particles to plant trees or carve rivers. One more possibility would be to add post-processing effects that give the whole visualization a completely different look.
A much different take would be to add an interactive component to the swarm landscapes, for example, by connecting the viewer to sensors and having these influence the function. This could be especially interesting by using a VR headset for full immersion, creating synergy between the art and the viewer, or even to expand this concept into games based on bio-feedback [36].

Supplementary Materials

Author Contributions

Conceptualization, D.d.A. and N.F.; methodology, D.d.A. and N.F.; software, D.d.A. and N.F.; validation, N.F. and C.M.F.; investigation, D.d.A. and C.M.F.; resources, A.C.R.; writing—original draft preparation, D.d.A., N.F., and C.M.F.; writing—review and editing, D.d.A., N.F., C.M.F., and A.C.R.; visualization, D.d.A.; supervision, N.F. and A.C.R.; All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by Fundação para a Ciência e Tecnologia projects UIDB/05380/2020 (HEI-Lab) and UIDB/50009/2020 (LARSyS).

Acknowledgments

The authors would like to thank André Fachada for proof-reading the text. The authors would also like to thank the anonymous referees for their valuable comments and helpful suggestions.

Conflicts of Interest

The authors declare no conflict of interest. The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript, or in the decision to publish the results.

Abbreviations

The following abbreviations are used in this manuscript:
PSOParticle Swarm Optimization
PCGProcedural Content Generation

References

  1. Kennedy, J.; Eberhart, R. Particle swarm optimization. In Proceedings of the ICNN’95—International Conference on Neural Networks, Perth, Australia, 27 November–1 December 1995; Volume 4, pp. 1942–1948. [Google Scholar] [CrossRef]
  2. Fernandes, C.M.; Fachada, N.; Merelo, J.J.; Rosa, A.C. Steady state particle swarm. PeerJ Comput. Sci. 2019, 5, e202. [Google Scholar] [CrossRef] [Green Version]
  3. Shi, Y.; Eberhart, R. A modified particle swarm optimizer. In Proceedings of the 1998 IEEE International Conference on Evolutionary Computation Proceedings, IEEE World Congress on Computational Intelligence (Cat. No. 98TH8360), Anchorage, AK, USA, 4–9 May 1998; pp. 69–73. [Google Scholar] [CrossRef]
  4. Boden, M.A.; Edmonds, E.A. What is generative art? Digit. Creat. 2009, 20, 21–46. [Google Scholar] [CrossRef]
  5. Greenfield, G.; Machado, P. Swarm art. Leonardo 2014, 47, 5–7. [Google Scholar] [CrossRef]
  6. Dorigo, M. Optimization, Learning and Natural Algorithms. Ph.D. Thesis, Politecnico di Milano, Milan, Italy, 1992. [Google Scholar]
  7. Todd, S.; Latham, W. Evolutionary Art and Computers; Academic Press Inc.: Cambridge, MA, USA, 1994. [Google Scholar]
  8. Grassé, P.P. La reconstrucion du nid et les coordinations interindividuelles chez Bellicositermes natalensis et Cubitermes sp. La théorie de la stigmergie: Essai d’interpretation du comportement des termites constructeurs. Insectes Sociaux 1959, 6, 41–80. [Google Scholar] [CrossRef]
  9. Blackwell, T.M. Swarm music: Improvised music with multi-swarms. In Proceedings of the 2003 AISB Symposium on Artificial Intelligence and Creativity in Arts and Science, University of Wales, Aberystwyth, UK, 7–11 April 2003; pp. 41–49. [Google Scholar]
  10. Correll, N.; Farrow, N.; Sugawara, K.; Theodore, M. The Swarm-Wall: Toward Life’s Uncanny Valley. In Proceedings of the IEEE International Conference on Robotics and Automation, Karlsruhe, Germany, 6–10 May 2013. [Google Scholar]
  11. Semet, Y.; O’Reilly, U.M.; Durand, F. An interactive artificial ant approach to non-photorealistic rendering. In Genetic and Evolutionary Computation Conference—GECCO 2004; Lecture Notes in Computer Science; Deb, K., Ed.; Springer: Berlin/Heidelberg, Germany, 2004; pp. 188–200. [Google Scholar] [CrossRef]
  12. Machado, P.; Pereira, L. Photogrowth: Non-photorealistic renderings through ant paintings. In Proceedings of the 14th Annual Conference on Genetic and Evolutionary Computation; ACM: New York, NY, USA, 2012; pp. 233–240. [Google Scholar] [CrossRef]
  13. Fernandes, C.M. Pherographia: Drawing by ants. Leonardo 2010, 43, 107–112. [Google Scholar] [CrossRef]
  14. Aupetit, S.; Bordeau, V.; Monmarché, N.; Slimane, M.; Venturini, G. Interactive evolution of ant paintings. In Proceedings of the 2003 Congress on Evolutionary Computation, Canberra, Australia, 8–12 December 2003; Volume 2, pp. 1376–1383. [Google Scholar] [CrossRef] [Green Version]
  15. Lutton, E.; Monmarché, N. Art&Science in Evolutionary Computation. Catalogue Side Event. 2013. Available online: http://ea2013.inria.fr/EA2013-catalogue_side-event_A3.pdf (accessed on 7 November 2020).
  16. Greenfield, G. Evolutionary methods for ant colony paintings. In Applications of Evolutionary Computing; Lecture Notes in Computer Science; Rothlauf, F., Branke, J., Cagnoni, S., Corne, D.W., Drechsler, R., Jin, Y., Machado, P., Marchiori, E., Romero, J., Smith, G.D., et al., Eds.; Springer: Berlin/Heidelberg, Germany, 2005; pp. 478–487. [Google Scholar] [CrossRef]
  17. Greenfield, G. On variation within swarm paintings. In Proceedings of the 8th Inter­disciplinary Conference of International Society of the Arts, Mathematics, and Architecture, University at Albany, Albany, NY, USA, 22–25 June 2009; pp. 5–12. [Google Scholar]
  18. Greenfield, G. Stigmmetry prints from patterns of circles. In Proceedings of the Bridges 2012: Mathematics, Music, Art, Architecture, Culture, Towson, MD, USA, 25–29 July 2012; pp. 291–298. [Google Scholar]
  19. Urbano, P. The T. albipennis sand painting artists. In Applications of Evolutionary Computation; Lecture Notes in Computer Science; Di Chio, C., Brabazon, A., Di Caro, G.A., Drechsler, R., Farooq, M., Grahl, J., Greenfield, G., Prins, C., Romero, J., Squillero, G., et al., Eds.; Springer: Berlin/Heidelberg, Germany, 2011; Volume 6625, pp. 414–423. [Google Scholar] [CrossRef]
  20. Richter, H. Visual art inspired by the collective feeding behavior of sand-bubbler crabs. In Computational Intelligence in Music, Sound, Art and Design; Lecture Notes in Computer Science; Liapis, A., Romero Cardalda, J.J., Ekárt, A., Eds.; Springer: Berlin/Heidelberg, Germany, 2018; Volume 10783, pp. 1–17. [Google Scholar] [CrossRef] [Green Version]
  21. Jacob, C.J.; Hushlak, G.; Boyd, J.E.; Nuytten, P.; Sayles, M.; Pilat, M. SwarmArt: Interactive art from swarm intelligence. Leonardo 2007, 40, 248–254. [Google Scholar] [CrossRef]
  22. Fernandes, C.M.; Mora, A.M.; Merelo, J.J.; Rosa, A.C. KANTS: A stigmergic ant algorithm for cluster analysis and swarm art. IEEE Trans. Cybern. 2013, 44, 843–856. [Google Scholar] [CrossRef] [PubMed]
  23. Unity Technologies. Unity® (San Francisco, CA, USA). 2020. Available online: https://unity.com/ (accessed on 7 November 2020).
  24. Ackley, D. A Connectionist Machine for Genetic Hillclimbing; SECS; Kluwer Academic Publishers: Amsterdam, The Netherlands, 1987; Volume 28. [Google Scholar]
  25. Griewank, A.O. Generalized descent for global optimization. J. Optim. Theory Appl. 1981, 34, 11–39. [Google Scholar] [CrossRef]
  26. Hoffmeister, F.; Bäck, T. Genetic algorithms and evolution strategies: Similarities and differences. In Parallel Problem Solving from Nature; Schwefel, H.P., Ed.; Springer: Berlin/Heidelberg, Germany, 1991; pp. 455–469. [Google Scholar] [CrossRef]
  27. Perlin, K. An Image Synthesizer. In Proceedings of the 12th Annual Conference on Computer Graphics and Interactive Techniques; ACM: New York, NY, USA, 1985; pp. 287–296. [Google Scholar] [CrossRef]
  28. Perlin, K. Noise hardware. In SIGGRAPH 2002 Course 36 Notes: Real-Time Shading Languages; University of Maryland: Baltimore, MD, USA, 2002; Chapter 2. [Google Scholar]
  29. Cook, R.L.; DeRose, T. Wavelet noise. Acm Trans. Graph. (TOG) 2005, 24, 803–811. [Google Scholar] [CrossRef]
  30. Millington, I. AI for Games, 3rd ed.; CRC Press: Boca Raton, FL, USA, 2019. [Google Scholar] [CrossRef]
  31. Ross, B.J.; Ralph, W.; Zong, H. Evolutionary image synthesis using a model of aesthetics. In Proceedings of the 2006 IEEE International Conference on Evolutionary Computation, Vancouver, BC, Canada, 16–21 July 2006; pp. 1087–1094. [Google Scholar] [CrossRef] [Green Version]
  32. Fernandes, C.M.; Fachada, N.; Laredo, J.L.J.; Merelo, J.J.; Castillo, P.A.; Rosa, A. Revisiting Population Structure and Particle Swarm Performance. In Proceedings of the 10th International Joint Conference on Computational Intelligence IJCCI’18, Seville, Spain, 18–20 September 2018; INSTICC, SciTePress: Setúbal, Portugal; Volume 1, pp. 248–254. [CrossRef]
  33. Karaboga, D. An Idea Based on Honey Bee Swarm for Numerical Optimization; Technical Report tr06; Erciyes University: Kayseri, Turkey, 2005. [Google Scholar]
  34. Del Ser, J.; Osaba, E.; Molina, D.; Yang, X.S.; Salcedo-Sanz, S.; Camacho, D.; Das, S.; Suganthan, P.N.; Coello, C.A.C.; Herrera, F. Bio-inspired computation: Where we stand and what’s next. Swarm Evol. Comput. 2019, 48, 220–250. [Google Scholar] [CrossRef]
  35. Villalón, C.L.C.; Stützle, T.; Dorigo, M. Grey Wolf, Firefly and Bat Algorithms: Three Widespread Algorithms that Do Not Contain Any Novelty. In ANTS 2020: Swarm Intelligence; Dorigo, M., Stützle, T., Blesa, M.J., Blum, C., Hamann, H., Heinrich, M.K., Strobel, V., Eds.; Springer: Berlin/Heidelberg, Germany, 2020; pp. 121–133. [Google Scholar] [CrossRef]
  36. Luz, F.; Fachada, N.; Junior, R. Biofeedback Game Design. In Proceedings of the Play2Learn 2018, Lisbon, Portugal, 19 April 2018; p. 350. [Google Scholar]
Figure 1. A visualization using the Ackley benchmark function.
Figure 1. A visualization using the Ackley benchmark function.
Entropy 22 01284 g001
Figure 2. Experiment 1. Particles converging towards the center position of the Rastrigin benchmark function. See also Video S1.
Figure 2. Experiment 1. Particles converging towards the center position of the Rastrigin benchmark function. See also Video S1.
Entropy 22 01284 g002
Figure 3. Experiment 2. Explored area of a Perlin landscape function ( N = 8 , A 0 = 20 , f 0 = 0.04 ). Regions with zero height were not explored by the particles. See also Video S2.
Figure 3. Experiment 2. Explored area of a Perlin landscape function ( N = 8 , A 0 = 20 , f 0 = 0.04 ). Regions with zero height were not explored by the particles. See also Video S2.
Entropy 22 01284 g003
Figure 4. Experiment 3. Explored area of a Perlin landscape function. ( N = 4 , A 0 = 20 , f 0 = 0.04 ). Regions with zero height were not explored by the particles. In this experiment, the influence of the information provided by the particles’ topological neighbors is higher than that of the particle’s own experiences. See also Video S3.
Figure 4. Experiment 3. Explored area of a Perlin landscape function. ( N = 4 , A 0 = 20 , f 0 = 0.04 ). Regions with zero height were not explored by the particles. In this experiment, the influence of the information provided by the particles’ topological neighbors is higher than that of the particle’s own experiences. See also Video S3.
Entropy 22 01284 g004
Figure 5. Experiment 4. Explored area of a Perlin landscape function ( N = 4 , A 0 = 20 , f 0 = 0.04 ). Regions with zero height were not explored by the particles. In this experience, the particles are highly individualistic, with low consideration for the information provided by their neighbors. See also Video S4.
Figure 5. Experiment 4. Explored area of a Perlin landscape function ( N = 4 , A 0 = 20 , f 0 = 0.04 ). Regions with zero height were not explored by the particles. In this experience, the particles are highly individualistic, with low consideration for the information provided by their neighbors. See also Video S4.
Entropy 22 01284 g005
Figure 6. Paintings used in the image functions experiments.
Figure 6. Paintings used in the image functions experiments.
Entropy 22 01284 g006
Figure 7. Experiment 5: Juan Miró’s Ciphers and Constellations in Love with a Woman. The fitness value is computed by converting the color to HSV space and taking the Value component (i.e., the brightness). See also Video S5.
Figure 7. Experiment 5: Juan Miró’s Ciphers and Constellations in Love with a Woman. The fitness value is computed by converting the color to HSV space and taking the Value component (i.e., the brightness). See also Video S5.
Entropy 22 01284 g007
Figure 8. Experiment 6. Leonardo da Vinci’s Mona Lisa. The fitness value is measured by taking the mean of Ralph’s bell curve computed in the local neighborhood of the evaluated pixel. See also Video S6.
Figure 8. Experiment 6. Leonardo da Vinci’s Mona Lisa. The fitness value is measured by taking the mean of Ralph’s bell curve computed in the local neighborhood of the evaluated pixel. See also Video S6.
Entropy 22 01284 g008
Figure 9. Alternative visualization of Experiment 6, where the color is derived from the fitness value on that point. The spectrum color palette was used in this case.
Figure 9. Alternative visualization of Experiment 6, where the color is derived from the fitness value on that point. The spectrum color palette was used in this case.
Entropy 22 01284 g009
Figure 10. Connectivity experiments using Perlin noise ( N = 8 , A 0 = 20 , f 0 = 0.04 ) and a blue/green color scheme.
Figure 10. Connectivity experiments using Perlin noise ( N = 8 , A 0 = 20 , f 0 = 0.04 ) and a blue/green color scheme.
Entropy 22 01284 g010
Table 1. Command line arguments for the VisualPSO application.
Table 1. Command line arguments for the VisualPSO application.
ArgumentDescription
-preset<number>Select one of the builtin presets. Number must be an integer in the range [ 0 , 13 ] .
-experiment<number>Select one of the builtin experiments, as represented in this article. Number must be na integer in the range [ 1 , 10 ] .
-randomGenerate a random visualization. Same as not passing any parameter.
-rngseedSeed for random number generator.
Perlin noise PCG options
-landscapeGenerate a Perlin-based function.
-octaves<number>Number of octaves for the Perlin landscape.
-amplitude<value>Initial amplitude for the Perlin landscape.
-frequency<value>Initial frequency for the Perlin landscape.
Image options
-imagesaturationUse an image’s HSV Saturation as a function.
-imagevalueUse an image’s HSV Value (brightness) as a function.
-ralphmeanUse Ralph’s bell curve mean as function.
-ralphvarUse Ralph’s bell curve variance as function.
-sampleradius<radius>Define the radius to use as the neighborhood for computing Ralph’s bell curve. Note that this is a O ( n 2 ) operation, so large radius will take some time to compute.
-usestimulusUse the stimulus value, instead of the more traditional response value for computing Ralph’s bell curve.
-useresponseUse the response value for computing Ralph’s bell curve. This is the default.
-image<index>Select a predefined image as the source image. Index must be na integer in the range [ 0 , 3 ] .
-image<filename>Load an image from the given path and uses it as source image. Only JPG and PNG are valid.
Benchmark functions
-sphereUse the sphere function.
-quadricUse the quadric function.
-hyperellipsoidUse the hyperellipsoid function.
-rastriginUse the Rastrigin function.
-griewankUse the Griewank function.
-schafferUse the Schaffer function.
-ackleyUse the Ackley function.
-weierstrassUse the Weierstrass function.
PSO parameters
-w<value>Specify ω .
-c<value>Specify c p and c g with the same value.
-c1<value>Specify the c p value.
-c2<value>Specify the c g value.
-vmax<value>Specify the maximum speed for the particles.
Visual parameters
-scale<value>Allow to scale the Y values of function.
-material<index>Select the material to use for the visualization. Index must be an integer in the range [ 0 , 5 ] .
-fofEnable the fog of function option.
-connectivityDisplay the particle connectivity.
-speed<number>Define the speed of the simulation. Default is 1, 2 is twice the speed, 0.5 is half-speed.
Table 2. Parameters for the different experiments. “Exp.” is the experiment, “Scl.” is the scale, “PS” is the particle scale, “FoF” is the fog of function, “Conn.” indicates whether the connectivity/topology display is activated and “VN” means Von Neumann topology.
Table 2. Parameters for the different experiments. “Exp.” is the experiment, “Scl.” is the scale, “PS” is the particle scale, “FoF” is the fog of function, “Conn.” indicates whether the connectivity/topology display is activated and “VN” means Von Neumann topology.
Exp.FunctionxMaxvMax c p c g Topology,
Swarm Size
Scl.PSFoFConn.Material
1Rastrigin100.151.51.5VN, 7 × 7 0.14nonoPurple/Blue
2Perlin Lands.1000.511VN, 7 × 7 11yesnoSpectrum
3Perlin Lands.1001014VN, 7 × 7 11yesnoSpectrum
4Perlin Lands.1000.520.5VN, 5 × 5 11yesnoRed/Yellow
5HSV Value100111VN, 7 × 7 −201nonoTextured
6Ralph’s Bell
Curve Mean
100111VN, 7 × 7 −11nonoTextured
7Perlin Lands.100511VN, 7 × 7 11noyesBlue/Green
8Perlin Lands.1005210VN, 7 × 7 11noyesBlue/Green
9Perlin Lands.100550VN, 7 × 7 11noyesBlue/Green
10Perlin Lands.100511Global, 2511noyesBlue/Green
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

de Andrade, D.; Fachada, N.; Fernandes, C.M.; Rosa, A.C. Generative Art with Swarm Landscapes. Entropy 2020, 22, 1284. https://doi.org/10.3390/e22111284

AMA Style

de Andrade D, Fachada N, Fernandes CM, Rosa AC. Generative Art with Swarm Landscapes. Entropy. 2020; 22(11):1284. https://doi.org/10.3390/e22111284

Chicago/Turabian Style

de Andrade, Diogo, Nuno Fachada, Carlos M. Fernandes, and Agostinho C. Rosa. 2020. "Generative Art with Swarm Landscapes" Entropy 22, no. 11: 1284. https://doi.org/10.3390/e22111284

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop