Next Article in Journal
Biomimetic Surface Engineering to Modulate the Coffee-Ring Effect for Amyloid-β Detection in Rat Brains
Next Article in Special Issue
Running Gait and Control of Quadruped Robot Based on SLIP Model
Previous Article in Journal
Effect of Hindwings on the Aerodynamics and Passive Dynamic Stability of a Hovering Hawkmoth
Previous Article in Special Issue
Derivation of Ultra-High Gain Hybrid Converter Families for HASEL Actuators Used in Soft Mobile Robots
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Translating Virtual Prey-Predator Interaction to Real-World Robotic Environments: Enabling Multimodal Sensing and Evolutionary Dynamics

1
Machine Life and Intelligence Research Center, Guangzhou University, Guangzhou 510006, China
2
School of Mathematics and Information Science, Guangzhou University, Guangzhou 510006, China
3
School of Mechanical and Electrical Engineering, Guangzhou University, Guangzhou 510006, China
4
MLTOR Numerical Control Technology Co., Ltd., Zhongshan 528400, China
5
School of Computing and Mathematical Sciences, University of Leicester, Leicester LE1 7RH, UK
*
Authors to whom correspondence should be addressed.
These authors contributed equally to this work.
Biomimetics 2023, 8(8), 580; https://doi.org/10.3390/biomimetics8080580
Submission received: 18 September 2023 / Revised: 18 October 2023 / Accepted: 29 November 2023 / Published: 1 December 2023
(This article belongs to the Special Issue Biology for Robotics and Robotics for Biology)

Abstract

:
Prey-predator interactions play a pivotal role in elucidating the evolution and adaptation of various organism’s traits. Numerous approaches have been employed to study the dynamics of prey-predator interaction systems, with agent-based methodologies gaining popularity. However, existing agent-based models are limited in their ability to handle multi-modal interactions, which are believed to be crucial for understanding living organisms. Conversely, prevailing prey-predator integration studies often rely on mathematical models and computer simulations, neglecting real-world constraints and noise. These elusive attributes, challenging to model, can lead to emergent behaviors and embodied intelligence. To bridge these gaps, our study designs and implements a prey-predator interaction scenario that incorporates visual and olfactory sensory cues not only in computer simulations but also in a real multi-robot system. Observed emergent spatial-temporal dynamics demonstrate successful transitioning of investigating prey-predator interactions from virtual simulations to the tangible world. It highlights the potential of multi-robotics approaches for studying prey-predator interactions and lays the groundwork for future investigations involving multi-modal sensory processing while considering real-world constraints.

1. Introduction

Prey-predator interaction have long captivated researchers due to their crucial role in driving organism’s evolution and shaping functional ecosystems [1,2,3,4]. Previous studies investigating predator-prey dynamics have utilized various approaches, including observational studies [5], experimental manipulations [6,7,8], and mathematical modeling [9,10,11,12,13], with recent advancements in agent-based simulations using virtual agents [14,15] or real robots [16]. While previous studies have examined population dynamics in prey-predator interactions using mathematical models, there has been limited exploration of multi-modal interactions within populations. Animals rely on multiple sensory signals for survival, particularly vision [17] and olfactory [18,19]. In some cases, vision and olfactory work in tandem to aid decision-making [20,21]. However, implementing interaction mechanisms involving multi-modal sensory interaction is challenging due to its complexity and the difficulties of being accurate. Therefore, almost no research has been conducted on this, resulting in the vagueness of its characteristics in prey-predator interaction systems.
The recent development of agent-based simulation [22,23] and the robotics technology [24,25,26,27,28,29] provides an opportunity to devise a system that could conduct real-time and real-world experiments of prey-predator interaction scenarios with multi-modal sensory and evolutionary processing involved. We highlight that bringing the multi-modal prey-predator interaction studies from virtual computer to real physical world matters at least in the following aspects: (1) Robots, designed to navigate complex environments, offer a more precise depiction of interactions than any other simulations [30,31,32,33]. (2) real-world interactions with physical constrains often lead to emergent behaviors [34,35]; (3) Robots can embody various predator and prey types, enabling exploration of how diversity shapes interactions through adaptable sensory processing and control mechanisms, exemplifying the embodiment intelligence [29,36,37]; (4) Robots equipped with sensors, replicate the sensory capabilities of real organisms, such as detecting prey movement or tracing scent trails; (5) Robotics approach fosters collaboration among biologists, engineers, and computer scientists. This multidisciplinary approach may yield innovative solutions and deeper insights into interactions.
To harness the full potential of robotics technology for investigating multi-modal prey-predator interactions, this paper employs a swarm robotics platform to conduct targeted experiments. Our focus is on validating the capability of the proposed system to facilitate multi-modal and evolutionary prey-predator studies. To achieve this, we devised a dedicated prey-predator interaction system wherein prey possess evolutionary attributes and the ability to sense both visual and olfactory cues in their environment. This tailored system was implemented both in computer simulations and the real physical realm.
We initially employed computer simulations to systematically explore the influence of environmental factors and predator hunting traits on prey dynamics and the overall prey-predator interaction system. Subsequently, to affirm the viability of swarm robotics in studying prey-predator interactions, we replicated select simulation outcomes using mobile robots in real-world scenarios. The findings, encompassing emergent behaviors, consistent preferences, and identifiable patterns in response to specific environmental factors, validate the effectiveness of our proposed robotics system in enabling multi-modal and evolutionary prey-predator interaction studies.
In summary, this paper introduces a specialized multi-agent robotics system designed for investigating prey-predator interactions. This approach integrates multi-modal sensory input and evolutionary processing, effectively bridging the gap between computer simulations and real-world prey-predator dynamics. The results demonstrate the potential of this methodology to provide a valuable complement to traditional approaches, enhancing the study of complex dynamics within prey-predator systems.

2. The Devised Prey-Predator Interaction with Multi-Modal and Evolutionary Processing

This section establishes fundamental agent and world definitions, outlining the interactions between prey and predator agents. The introduced metrics for evaluating the dynamic system’s performance are also presented. For more comprehensive details and mathematical descriptions, refer to Appendix A.

2.1. Computer Simulation

The agent population consists of two categories: prey and predator. Preys are represented as cyan cylinders with a radius of 10 and height of 5, while predators are denoted by red cylinders of the same dimensions (as depicted in Figure 1). A yellow bar positioned atop the cylinder signifies the agent’s current heading direction. Notably, the simulation does not incorporate any physical constraints, allowing agents to potentially collide without exerting forces upon each other. Consequently, an agent’s motion is entirely dictated by the control strategy implemented.
Each member of the prey population is equipped with multi-modal sensory inputs—visual and olfactory (as depicted in Figure 2A)—that dictate their motion behavior. Specifically, visual cues steer task-driven aggregation, while olfactory cues, emitted by predators, trigger escape responses (as shown in Figure 2C,D). In instances where sensory inputs lack sufficient strength, preys adopt a wandering behavior within the arena, changing their heading direction randomly at each time step. The highest priority is accorded to the escape behavior (when  m p r e y ( t ) = 2 ). This signifies that once the prey’s perception of odor strength surpasses the threshold ( f e , also known as the escaping preference factor), the escape behavior is activated. The agent then abruptly alters its heading if the temporal change in the combined value of the left and right odor sensors is positive. Otherwise, the agent retains its previous course. Conversely, vision-based intra-specific gathering behavior ensues in the absence of detected odor but in the presence of a visually recognized color (associated with the body color of mates) within its visual field. Activation of this behavior is determined by a threshold ( f g , or gathering preference factor), representing the percentage of pixels with the chosen color relative to the entire visual image. Gathering movements prompt preys to converge on their mates, and the agent halts its movement when a target mate appears sufficiently large in their field of view (dictated by the threshold  T h s ). Energy generation and consumption are intrinsically tied to the prey’s motion state. To introduce selective pressure against the escape behavior and stimulate evolutionary processes, energy consumption is proportionate to the escape speed. For other instances (wandering and gathering), energy consumption remains constant ( 0.2 τ ). Following cessation of movement, the prey’s energy is replenished at a rate of  1.2 τ  (refer to red and green text in Figure 2C for energy consumption and generation details, respectively). This framework introduces a trade-off: gathering behavior replenishes energy while evading predators consumes it. The resulting conflict in selective pressures may guide the evolution of distinct behavioral directions.
The predator’s behavior outlined in this study is relatively straightforward compared to that of the prey, mainly due to the absence of egocentric sensory information. Predators move freely within the arena, aiming to capture preys, unless their energy surpasses the threshold  T h s e . During hunting, the predator’s motion direction aligns with the vector pointing from its present position  p ( t )  to the geometrical center of the cluster containing the largest number of preys (represented by the blue point marker in Figure 3). While cluster and prey positions are manually provided in this study, in realistic contexts, the predator could obtain such information via its own sensory system. Energy expenditure in the predator is linked to odor emission (at a constant rate of  3.3 τ ) and is replenished through digestion of preys within the range of its odor field ( e p  in Figure 3, for detailed information, refer to Appendix A.2.1).

2.2. Real Robot Implementation

To realize the prey-predator interaction scenario delineated in this study within the physical realm, a robotics platform equipped with odor field rendering, localization, and visual sensing capabilities is essential. Among available swarm robotics platforms, the recently developed VColCOS Φ  platform [25,26] aligns better with these requirements. This platform was meticulously designed for conducting swarm robotics research, equipped with the capability to construct and detect multi-modal information. This includes rendering optic-simulated pheromone/odor fields and visual scenes. The mobile robot involved, referred to as Colias-IV [28], is adept at sensing optic-simulated odors through color sensors and capturing visual cues with its embedded camera. As demonstrated in Figure 4, the predator robot, adorned with a red shell, can be dynamically localized to render the odor field, providing the sensory stimuli required for preys’ olfactory escaping task. Prey robots, encased in cyan shells, serve as color targets for their visual gathering task.
The host computer, where the VColCOS Φ  GUI operates, facilitates message exchange with all robots via the wireless communication channel, enabling real-time command transmission and inner state monitoring. This capability facilitates the efficient execution of complex experiments involving multiple robots. As exemplified in this study, the information flow within the system is illustrated in Figure 5, which can be distilled into four key components: (1) localization system precisely determines the real-time positions of the robots; (2) odor fields are dynamically rendered based on the predator’s current location via the odor rendering system; (3) two-way communication system enables the host computer to both monitor the agents’ states and convey real-time data and commands; (4) mobile robots endowed with visual and optic-simulated odor sensing capabilities, fulfill the roles of both prey and predators in the designed experiments. For an in-depth understanding of the control strategies employed by both prey and predator robots, see Figure 6.
Note that there are several distinctions exist between the computer simulation and the real robot experiments: (1) In the computer simulation, predators can track prey clusters. However, in real robot experiments, transmitting position information via wireless communication incurs time delays that hinder robust control algorithms. Consequently, real robot predators behave by running randomly within the arena (see Figure 6); (2) In real robot experiments, the death of a prey robot is simulated, involving a message with evolved behavioral factors (gathering and escaping preference factors) sent from the host computer to the “dead” prey robot. The robot is then reborn and resumes its designated task (see Figure 6); (3) In real robot experiments, arena boundaries are indicated by white bordered rectangles, detected by robots’ color sensors to trigger sharp turns and avoid collisions; (4) Due to bandwidth and communication delay, real robot experiments involve limited robot numbers and potentially delayed data on the host computer, compared to the simulation; (5) Real robot cameras have a resolution of  99 × 72  and a horizontal field of view of  70 , differing from the  200 × 300  resolution and  120  field of view in simulations; (6) In contrast to simulations, real robot collisions occur. Bumpers are added to mitigate this, although the peripheral wheel placement on the Colias robots occasionally results in entanglements; (7) The message exchange interval between robots and host computer in real experiments is 1 s, considerably lower than the simulation’s 30 ms. However, robot sensor updates and motion control remain at the millisecond level.

3. Results of Computer Simulation

Figure 7 presents an overview of the outcomes from a simulation conducted using the specified agents, environment, and parameters listed in Table A1, with an arena length of  L = 200  and odor injection width  Φ w = 20 . For an animated example of the simulation process, refer to Video S1 in the supplementary materials. Results of another simulation conducted in a larger arena ( L = 280 ) is shown in Figure 8 T s y T s d E T s  and  Δ E d  are defined metrics to evaluate the dynamics of population energy and they are formulated as follows:
(1) The initial time step when the energy of prey and predator attains  E t h = 20  and  T h s e = 100  respectively,
T s y = i n f { t | e p r e y ( t ) E t h } T s d = i n f { t | e p r e d a t o r ( t ) T h s e }
(2) The average energy of the prey population at time step  T s d :
E T s = e p r e y ( T s d )
(3) The difference between the lowest and highest energy of the predator during the whole simulation:
Δ E d = max e p r e d a t o r ( t ) min e p r e d a t o r ( t )
The distribution of the escaping and gathering preference factors of the prey agents is presented through histogram plots in the lower right panel of both Figure 7 and Figure 8. We divided the data into 20 bins and the bin width for escaping and gathering factor is  10 / 20 = 0.5  and  0.3 / 20 = 0.015  respectively.
The initial values of the escaping and gathering preference factors are sampled from a uniform distribution, but they converge after the evolution process. This convergence highlights the effectiveness of the evolutionary mechanism driven by the selective pressure imposed by the prey-predator interactions. It is evident that the preys exhibit a tendency to gather around the odor field released by the predator, giving rise to distinct spatial patterns formed through the prey-predator interactions (as observed in the upper four subplots of Figure 7 and Figure 8). The temporal evolution of both the prey population’s energy and the predator’s energy also reveals intriguing tendencies that merit further investigation. For instance, a comparison between the simulation results with an arena size of  L = 280  (Figure 8) and a smaller arena size of  L = 200  demonstrates that the mean energy of the prey population  e ¯ p r e y ( t )  at the time when the predator’s energy  e p r e d a t o r ( t )  reaches 100 is lower in the smaller arena. This observation suggests that a smaller arena, which imposes stronger environmental constraints, hampers the development of the prey population. However, it’s noteworthy that the time it takes for the prey population to surpass the energy threshold ( e ¯ p r e y ( t ) 20 ) is earlier in the smaller arena. This discrepancy might be attributed to the predator’s behavior, as the predator’s energy exceeds its stopping threshold ( T h s e ) sooner in the smaller arena.

3.1. Temporal Dynamics of Population Energy

To further investigate the dynamics of population energy observed in the simulations, we conducted systematical experiments by varying the arena length (L) and the odor injection width ( Φ w ) of the predator. Results are shown in Figure 9. Specifically, the temporal behaviors of prey and predator’s energy accumulation at certain time steps ( T s y  in Figure 9C and  T s d  in Figure 9A) exhibit noticeable trends as these parameters are varied. Generally, as the arena length increases, the time steps required for both populations to attain specific energy levels tend to increase as well. However, the relationship between the odor injection width and these time steps is more intricate, revealing local minima when the arena length (L) is 280 and the odor injection width ( Φ w ) is 25. On the other hand, the prey population’s average energy ( E t s  in Figure 9D) at the time when the predator’s energy reaches the threshold ( T h s = 100 ) exhibits a more straightforward trend. It tends to decrease with larger odor injection widths and smaller arena lengths. Nevertheless, the disparity between the predator’s maximum and minimum energy values ( Δ E d  in Figure 9B) throughout the simulation does not exhibit a clear trend. This suggests that this variable may be influenced by other parameters, such as the motion speed of both predators and preys ( | v ( t ) | ), and may require further investigation.

3.2. Evolution Process in Prey Population

To investigate the effect of environmental factor and the predator’s trait to the prey evolution process, we first apply the histogram calculation, then the maximum number of  N j  at the initial ( t = 0 ) and final ( t = 6000 ) time step is computed:
M ( f e , t ) = max N f e j ( t ) M ( f g , t ) = max N f g j ( t )
then we get the difference:
Δ M ( f g ) = M ( f g , 6000 ) M ( f g , 0 ) Δ M ( f e ) = M ( f e , 6000 ) M ( f e , 0 )
to quantify the extent of change (evolution). A higher value indicates a greater degree of evolution, implying that more prey agents’  f g  and  f e  values are converging to the same range.
Figure 10 and Figure 11 visually represent the influence of external factors on the evolutionary processes of the prey population’s behavioral traits—escaping and gathering preference factors, respectively. These outcomes indicate that, in general, larger odor injection widths coupled with smaller arena lengths tend to exert higher selective pressure, thereby resulting in a more pronounced degree of evolution. Notably, it appears that the impact of odor injection width as a dynamic external factor on the prey population’s evolutionary degree is more potent compared to that of the arena length. Nevertheless, the relationships between these two factors and the extent of evolution do not follow linear and monotonic patterns, suggesting the existence of intricate inherent characteristics within the established prey-predator interaction.
The evolution degree  Δ M  of both the escaping preference factor ( f e ) and the gathering preference factor ( f g ) exhibits a similar trend as changes occur in the arena length and odor injection width. This observation implies that genotypes that respond to relevant or analogous environmental factors may evolve concurrently to achieve an optimal fitness. In other words, as the environmental conditions, represented by the arena length and odor injection width, vary, the behavioral traits of the prey population adapt and evolve in a coordinated manner to better suit the prevailing conditions and enhance their overall fitness.
To gain further insights into the evolved genotype of the prey population under varied external factors, we utilize Kernel Density Estimation (KDE) on the final values of alive prey agents’ escaping and gathering preference factors. We apply a Gaussian kernel with a bandwidth six times higher than the standard bandwidth to obtain a smoothed average value of  f e  and  f g  at the final time step of simulations. The results of simulations with different arena lengths and odor injection widths are presented in Figure 12.
In general, the evolutionary trends suggest that prey evolve to be more inclined towards gathering in smaller arenas (indicated by smaller values of  f g ) and to be more prone to escaping in larger arenas (indicated by smaller values of  f e ). However, as indicated by the results, the preferences of prey agents do not exhibit significant consistency across all simulation settings. This suggests that the evolution process might converge to different directions under different conditions, implying the existence of multiple fit genotypes within the given environment.
It’s worth noting that the lack of strong preference in some cases, especially for odor injection widths of  Φ w = 10  and 25, could be due to the fact that these parameter settings might not provide sufficient selective pressure, as indicated by the results shown in Figure 10 and Figure 11. However, when focusing on the results for  Φ w = 30  (represented by the blue lines in Figure 12), a clearer tendency emerges as the arena length increases: evolved prey agents become more sensitive to sensory inputs, exhibit a higher likelihood of gathering when mates are visible, and are more inclined to escape when they perceive the predator’s odor. The larger arena size offers more living space for prey agents, allowing both gathering and escaping behaviors to be preserved with higher probability.

4. Robot Experiments of the Prey-Predator Interaction

This section presents the results of experiments conducted using real robots to validate the defined prey-predator interaction system in the real world, accounting for realistic physical constraints. Four experiments were performed, each involving 6 prey robots and 1 predator robot. The experiments were conducted with different arena lengths (1200 or 800 pixels) and odor widths (80 or 100 pixels), with each experiment running for a duration of 1000 s. A brief video recording of these 4 experiments can be found in Video S2 in the supplementary material. Figure 13 displays images of the robots and the arena, featuring cyan-shelled prey and red-shelled predator robots. Prey often gather in queues or clusters, while predators roam the arena with odor fields dynamically rendered according to their real-time locations.
Figure 14 displays the results of an example real robot experiment with an arena length of 800 pixels and an odor width of 80 pixels. The results of the other three experiments with different arena lengths and odor widths are provided in Figures S1–S3 of the supplementary materials. The video recordings of these experiments are also available in Video S2 of the supplementary materials. In the shown experiment, the prey’s evolving factors, namely the gathering and escaping factors, converge as the experiment progresses, resembling the trends observed in the computer simulations.
However, there is a notable difference in the predator’s energy levels between the real robot experiment and the simulation. In the real robot experiment, the predator’s energy cannot exceed the defined stopping threshold ( T h s e = 30 ). This discrepancy could be attributed to the number of preys present in the arena. In the real robot experiment, there are only 6 preys available as a source of energy for the predator, whereas in the simulation, there are 20 preys. This difference in the number of energy sources could explain why the predator’s energy level does not reach higher values in the real robot experiment compared to the simulation.
Figure 15 presents the spatial density heat maps that illustrate how the defined prey-predator interaction influences the spatial preferences of agent populations in the real robot experiment. These heat maps offer insights into the distribution and clustering of both prey and predator robots within the arena.For instance, the prey’s tendency to visually gather in queues and the predator’s dispersal of prey clusters are evident in the real robot experiments as well. These findings provide validation for the successful implementation of the prey-predator interaction scenario within the robotics platform. For a more detailed understanding, see Video S3 in the supplementary materials, which provides a visual recording of the real robot experiments.
To compare the results of experiments conducted under different environmental conditions, we employed several metrics: (1)  t s y  and  t s d  defined in (1). These metrics indicate the time steps at which the prey and predator populations reach certain energy levels, respectively, providing insights into how environmental conditions influence the energy dynamics of both populations; (2) The minimal value of the prey’s averaged energy: This metric highlights the lowest energy level reached by the prey population over the course of the experiments. It helps to understand how different environmental conditions affect the overall energy state of the prey population; (3) The number of death/rebirth events in the prey population: This metric counts the occurrences of prey robots dying and subsequently being reborn due to their energy falling below zero. It sheds light on the impact of environmental conditions on the survivability and resilience of the prey population. By analyzing these metrics across experiments conducted under different environment factors, one can deduced how variations in arena length and odor injection width influence the dynamics, energy levels, and survival of the prey population. This comparison helps us understand the sensitivity of the prey-predator interaction to different environmental settings as shown in Figure 16:
  • Impact of Odor Width: The time taken for both the prey and predator populations to reach the defined energy levels displays varying trends based on different odor widths. This suggests that the odor width has a significant impact on the energy dynamics of the populations. The inconsistent tendencies observed could arise from factors such as the Allee effect [12], which pertains to population growth being negatively impacted at low densities. In this context, with a population of only 6 preys in the arena, the sparse distribution might lead to the observed dynamics.
  • Effect of Environment on Prey Population: The number of prey deaths and the minimal prey energy levels show consistent trends across different environmental settings. Specifically, more challenging environments, such as smaller arenas with larger odor widths, lead to a greater number of prey deaths and lower minimal prey energy levels. This pattern indicates that more challenging conditions place higher selective pressure on the prey population, resulting in increased mortality and lower energy levels.
Note that the above analysis and discussion is based on the four experiments undertaken in this study, so it is hypothetical. Running more experiments could lead to more convincing conclusions. However, as this study is method-oriented, these results are sufficient to demonstrate the applicability of applying a robotics approach to studying prey-predator interactions in the real world.

5. Conclusions and Discussion

As the first attempt of transferring the classical prey-predator interaction study from the virtual computer world to the real world, this study has provided possible techniques to implement complex scenarios with multi-robots interacts in a multi-modal way. Implementing prey-predator interaction in the real world with physical constrains intrinsically embedded benefits the studies in many ways as that of robotics-inspired biology [2,23,29,31,38,39,40,41,42]. This study verifies the feasibility of using robotics approach to investigate the prey-predator interaction especially for that involving multi-modal sensory and evolutionary processing. In systematic simulations and several real robots experiments, the emergent spatial and temporal dynamics within the defined prey-predator have been observed and analyzed. Results suggested that emergent behaviors and embodied intelligence within the prey-predator interaction system may be unveiled through the robotics approach introduced in this study, providing a potentially useful way as a great complement of traditional researching approaches.
While the results obtained from both the simulation and real robot experiments are sufficient to validate the proof-of-concept of multimodal prey-predator interaction implemented by real robots, it is important to acknowledge that these findings represent an initial step in understanding the prey-predator dynamics. Further investigations with larger number of robots involved (especially for the real robot experiment) and systematic tuning of environmental factors are necessary to unravel the intricate mechanisms governing the dynamics of prey-predator interactions. By expanding the scale of the experiment, researchers can gain a more comprehensive understanding of emergent behaviors, population dynamics, and the role of environmental influences. Additionally, by fine-tuning other environmental factors such as the motion speed of prey and predators, the geometry shape of the arena, or the control strategy of predation, it will be possible to gain deeper insights into how these variables shape the system dynamics. Such investigations will contribute to a more robust and nuanced understanding of the intricate mechanisms driving prey-predator interactions in complex ecological systems.
While this study successfully transplanted the prey-predator interaction experiment from virtual simulations to a real robotics platform, it is important to acknowledge that there are still certain technical challenges that need to be addressed. One notable challenge lies in the wireless communication subsystem, which currently limits the number of simultaneously involved robots in the system. The communication bandwidth, range constraints and time delays impose limitations on the scalability and complexity of the experiment. To overcome this challenge, advancements in wireless communication protocols and hardware are necessary to support a larger number of robots operating in a coordinated manner. Applying other communication approach such visual coding [43] is also an option. Another challenge lies in refining the sensory capabilities of the robotic agents to accurately replicate the sensory modalities of living organisms. Although we incorporated visual and olfactory sensory cues in our system, further advancements are needed to enhance the realism and fidelity of these sensory inputs. For example, the visual input of preys is relatively simple, more objects and background scenes could be added in the future, which also make great use of the VColCOS Φ  system [26]. Additionally, the locomotion and maneuverability of the robotic agents can be improved to better mimic the movements and behaviors of actual predators and prey in natural environments. Robots will different locomotion abilities like legged robot could also be incorporated in the future. Overcoming these technical issues will be crucial in advancing the application of real robotics in studying prey-predator interactions and ensuring the validity and reliability of future investigations.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/biomimetics8080580/s1, Figure S1: Real Robot Experiment Arena Length = 1200 and Odor Width = 80; Figure S2: Real Robot Experiment with Arena Length = 1200 and Odor Width = 100; Figure S3: Real Robot Experiment with Arena Length = 800 and Odor Width = 100; Video S1: Simulation Animation with Arena Length = 280 and Odor Width = 20; Video S2: Real Robot Experiment Recordings; Video S3: Emergent Real Robot Behaviors.

Author Contributions

J.P. and Q.F. directed this research, as the corresponding authors. S.Y. directed the experiments, results and analysis. X.S. and C.H. proposed the modelling of prey and predator agent; X.S. implemented the model and undertaken the simulations. X.S. devised all the experiments and presented this paper. X.S., C.H. and T.L. developed the physical odor field module to construct the odor field released by the predator. They also designed and coded the robot motion board, as the co-authors. All authors have read and agreed to the published version of the manuscript.

Funding

This research has received funding from the National Natural Science Foundation of China under the Grant No. 62206066, No. 62376063, No. 12031003 and No. 52202492, the China Postdoctoral Science Foundation under the Grant No. 2022M710864, the European Union’s Horizon 2020 research and innovation programme under the Marie Sklodowska-Curie Grant Agreement No. 778062 ULTRACEPT, and the Social Science Fund of the Ministry of Education of China under the Grant No. 22YJCZH032. The Guangdong Provincial Key Laboratory of Precision Gear Flexible Manufacturing Equipment Technology under the Grant No. 2021B1212050012.

Institutional Review Board Statement

Not applicable.

Data Availability Statement

The data of simulation and the source codes can be found via https://github.com/XuelongSun/PreyPredatorInteractionSim (accessed on 17 September 2023).

Conflicts of Interest

Author Tian Liu was employed by the company MLTOR Numerical Control Technology Co., Ltd., The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Appendix A. Detailed Methods

As the proposed multi-modal prey-predator interaction system is novel and has not yet been studied previously, this section presents details within the scenario for the better understanding. We hope these details along with the source code (get access via https://github.com/XuelongSun/PreyPredatorInteractionSim, accessed on 17 September 2023), could help the reader to reproduce the dynamics emergent in this study and for further investigations.
The computer simulation is implemented using Python with third-part packages opencv for image processing, numpy for matrix computation, pyrender and opengl for 3D simulated world and 2D off-screen image rendering.

Appendix A.1. Agents

At every time step t, the agent’s state is denoted as:  s ( t ) = { p ( t ) , h ( t ) , v ( t ) , m ( t ) , e ( t ) } , where  p ( t ) = ( p x , p y )  and  h ( t )  defines its position in the arena (i.e., the x-y plane of the 3D simulation world) and heading respectively;  v ( t )  is the velocity of the agent, the heading direction  h ( t )  is always aligned with the direction of  v ( t )  for simplicity; Therefore, agent’s moving speed along x- and y-axis can be calculated as:
v x ( t ) = | v ( t ) | cos h ( t ) , v y ( t ) = | v ( t ) | sin h ( t )
where  | v ( t ) |  is the speed of the agent that is determined by the controller. The position  p ( t )  could be updated via  v ( t )  by:
p ( t + 1 ) = p ( t ) + v ( t )
Therefore, at every time step, the agent’s motion can be controlled simply by provides the magnitude of the velocity and the heading (or the change of the heading).  m ( t )  is the current motion state which is depend on the agent’s internal state and environmental conditions and  e ( t )  is the energy updated by the formula:
e ( t + 1 ) = e ( t ) + τ δ e
where  τ δ e  is the change of the energy determined by the agent’s certain motion state and  τ  is the time constant.

Appendix A.2. Environment Settings in Simulation

The simulated 3D world consists of a square-shaped arena with a side length of L. This arena acts as the environment in which the agents, including preys and predators, interact and exhibit behaviors. The length of the arena’s side, L, is considered a crucial environmental trait under investigation. Different values of L are used to explore the effects of this static environmental factor on population dynamics. Within the simulated world, agents are in constant motion. Preys and predators move independently based on their predefined behaviors and strategies. This dynamic movement introduces variability and complexity into the environment, influencing the spatial distribution and interaction patterns among agents. Another dynamic factor is the odor field generated by the predator’s movement. As the predator moves within the arena, it leaves behind a trail of simulated odor. The odor field dynamically evolves over time, providing a sensory cue for the preys to detect and respond to. This forms a critical component of the prey-predator interaction, where the odor acts as a stimulus for preys to exhibit specific behaviors such as escaping and gathering. The combination of static environmental traits (arena length) and dynamic factors (moving agents and evolving odor field) creates a multi-modal prey-predator interaction scenario. The agents’ behaviors are influenced by both visual cues (position of other agents) and olfactory cues (odor concentration) in their surroundings. This multi-modal interaction introduces selective pressures that drive the evolution of the agents’ behaviors over time.
The simulated 3D world provides a controlled and customizable platform for investigating the interplay between static and dynamic environmental factors and their effects on the multi-modal prey-predator interaction. This setup allows researchers to gain insights into the underlying mechanisms driving emergent behaviors in swarm robotics scenarios.

Appendix A.2.1. Population Energy

We consider energy as the primary variable for assessing the performance of each agent population. As previously explained, preys expend energy during activities like escaping and wandering, while they replenish energy when stationary within a cluster formed by gathering with their peers. On the other hand, the predator expends energy for odor release and gains energy from preys that overlap spatially with the odor field. This overlap is computed using the following formula:
e p ( t ) = α i = 1 N p r e y a e i ( t )
where  N p r e y a  is the number of preys whose motion state is ‘escaping’, namely,  N p r e y a = # { i | m i ( t ) = 2 } α  is the scale factor and is set to be 0.008 in the simulation.

Appendix A.2.2. Predator’s Odor Field

The odor field  Φ ( t ) = Φ ( x , y , t )  released by the predator (see examples in Figure 3) is updated by:
Φ ( x , y , t ) t = Φ I ( x , y , t ) t + Φ D ( x , y , t ) t + Φ E ( x , y , t ) t
which represents three significant characteristics of odor:
(1) injection ( Φ I ): predator will release the odor at its position:
Φ I ( x , y , t ) t = k I δ ( x p x , y p y )
where  ( p x , p y )  is the current position of the predator,  k I  is a constant number scaling the strength of the injection of odor; In the discrete format:
Δ Φ I ( x , y , t ) Δ t = k I i f | x p x | Φ w & | y p y | Φ w
(2) diffusion ( Φ D ): the pheromone will spread along x and y direction in the 2D plane, which can be described by the diffusion equation:
Φ D ( x , y , t ) t = k D 2 Φ ( x , y , t )
In the discrete format, this operation could be implemented by convolution:
Δ Φ D ( t ) = k D Φ ( t ) * G D Δ t
where  G D  is the kernel:
G D = 1 / 8 1 / 8 1 / 8 1 / 8 1 1 / 8 1 / 8 1 / 8 1 / 8
and  k D  is a constant determines the contribution of the diffusion to the odor change. Note that in the discrete implementation given the time interval  Δ t , the overall impact of diffusion factor  k D  is separated into two parts: the size of the kernel ( 3 × 3 ) and the constant  k D .
(3) evaporation ( Φ E ): the concentration of the odor at location  ( x , y )  will decrease exponentially with respect to time.
Φ E ( x , y , t ) t = k E Φ ( x , y , t ) = 1 τ E Φ ( x , y , t )
where  k E  is a constant defines the time constant ( τ E ) of exponential decay. In the discrete time format:
Δ Φ E ( x , y , t ) Δ t = 1 τ E Φ ( x , y , t 1 )

Appendix A.2.3. Prey’s Evolution

Within the prey population, the energy variable  e ( t )  plays a critical role in determining the survival of individual preys. For instance, if the energy level falls below zero ( e ( t ) < 0 ), the prey will perish, prompting the generation of a new prey to sustain the evolutionary process. This process is influenced by two genotypes, namely  f e  and  f g  as depicted in Figure 2C. These genotypes govern the escaping and gathering behaviors of the prey, and they are inherited by the new spawns from the existing prey with the highest energy levels. In order to diversify and prevent the evolutionary process from converging to local extrema, an element of randomness is introduced. Specifically, a 10 percent probability is assigned for randomly selecting an existing prey. Subsequently, the newly generated prey will inherit the values of  f e  and  f g  from the chosen prey, fostering greater exploration of the genotype space.

Appendix A.2.4. Parameters

Table A1 lists the main parameters that were utilized throughout all the simulations. Notably, the number of agents in each group remained constant (20 preys and 1 predator). Instances where values are highlighted in red in Table A1 signify that these values were individually selected to conduct systematic experiments. This approach, while diverging from conventional studies where population size is a key variable, allows us to utilize energy as a corresponding factor to investigate population dynamics. The specific values for the arena length L and the odor injection width  Φ w  were systematically adjusted according to the red text in Table A1. For each parameter configuration, we conducted 10 trials, resulting in a total of  4 × 5 × 10 = 200  trials. Each simulation trial was executed for a duration of  T = 6000  steps.
Table A1. The parameters setting in simulations. Red text indicates that these values of the certain parameter have been used to undertake the evaluating experiments.
Table A1. The parameters setting in simulations. Red text indicates that these values of the certain parameter have been used to undertake the evaluating experiments.
CategoryParameterValueDescription
EnvironmentL200, 240, 280, 320environmental factor
Predator Φ w  (Figure 3)10, 15, 20, 25, 30prey-predator interaction factor
k I  (Equation (A7))100odor field
k D (Equation (A9))0.99
k E  (Equation (A11))1000
  N p r e d a t o r 1the number of preys is constant
T h s e  (Figure 3)100threshold of energy for stop hunting
  e ( 0 ) 50initial energy of predator population
  | v ( t ) | 8
Prey   N p r e y 20the number of preys is constant
  e ( 0 ) 2initial energy of prey population
  f g   U ( 0.02 , 0.32 ) initial value is randomly generated
  f e   U ( 0.01 , 10.01 )
  T h s  Figure 2   0.4 threshold (percent of image pixels) for stop gathering

References

  1. Agrawal, A.A. Phenotypic plasticity in the interactions and evolution of species. Science 2001, 294, 321–326. [Google Scholar] [CrossRef] [PubMed]
  2. Legreneur, P.; Laurin, M.; Bels, V. Predator–prey interactions paradigm: A new tool for artificial intelligence. Adapt. Behav. 2012, 20, 3–9. [Google Scholar] [CrossRef]
  3. Terborgh, J.; Estes, J.A. Trophic Cascades: Predators, Prey, and the Changing Dynamics of Nature; Island Press: Washington, DC, USA, 2013. [Google Scholar]
  4. Abrams, P.A. The evolution of predator-prey interactions: Theory and evidence. Annu. Rev. Ecol. Syst. 2000, 31, 79–105. [Google Scholar] [CrossRef]
  5. Schmitz, O.J.; Grabowski, J.H.; Peckarsky, B.L.; Preisser, E.L.; Trussell, G.C.; Vonesh, J.R. From individuals to ecosystem function: Toward an integration of evolutionary and ecosystem ecology. Ecology 2008, 89, 2436–2445. [Google Scholar] [CrossRef] [PubMed]
  6. Stachowicz, J.J.; Whitlatch, R.B.; Osman, R.W. Species diversity and invasion resistance in a marine ecosystem. Science 1999, 286, 1577–1579. [Google Scholar] [CrossRef] [PubMed]
  7. Preisser, E.L.; Bolnick, D.I. The many faces of fear: Comparing the pathways and impacts of nonconsumptive predator effects on prey populations. PLoS ONE 2008, 3, e2465. [Google Scholar] [CrossRef]
  8. Ryberg, W.A.; Smith, K.G.; Chase, J.M. Predators alter the scaling of diversity in prey metacommunities. Oikos 2012, 121, 1995–2000. [Google Scholar] [CrossRef]
  9. Lotka, A.J. Elements of Physical Biology; Williams & Wilkins: Philadelphia, PA, USA, 1925. [Google Scholar]
  10. Wentz, R. Mathematical Models of Predator-Prey Interactions. Ph.D. Thesis, Millersville University of Pennsylvania, Mathematics Department, Millersville, PA, USA, 2002. [Google Scholar]
  11. Mondal, B.; Roy, S.; Ghosh, U.; Tiwari, P.K. A systematic study of autonomous and nonautonomous predator–prey models for the combined effects of fear, refuge, cooperation and harvesting. Eur. Phys. J. Plus 2022, 137, 724. [Google Scholar] [CrossRef]
  12. Kumbhakar, R.; Pal, S.; Pal, N.; Tiwari, P.K. Bistability and tristability in a predator–prey model with strong Allee effect in prey. J. Biol. Syst. 2023, 31, 215–243. [Google Scholar] [CrossRef]
  13. Maity, S.S.; Tiwari, P.K.; Shuai, Z.; Pal, S. Role of Space in an Eco-Epidemic Predator-Prey System with the Effect of Fear and Selective Predation. J. Biol. Syst. 2023, 31, 883–920. [Google Scholar] [CrossRef]
  14. Ito, T.; Pilat, M.L.; Suzuki, R.; Arita, T. Population and evolutionary dynamics based on predator–prey relationships in a 3d physical simulation. Artif. Life 2016, 22, 226–240. [Google Scholar] [CrossRef] [PubMed]
  15. Baggio, J.A.; Salau, K.; Janssen, M.A.; Schoon, M.L.; Bodin, Ö. Landscape connectivity and predator–prey population dynamics. Landsc. Ecol. 2011, 26, 33–45. [Google Scholar] [CrossRef]
  16. Floreano, D.; Keller, L. Evolution of adaptive behaviour in robots by means of Darwinian selection. PLoS Biol. 2010, 8, e1000292. [Google Scholar] [CrossRef] [PubMed]
  17. Osorio, D.; Vorobyev, M. A review of the evolution of animal colour vision and visual communication signals. Vis. Res. 2008, 48, 2042–2051. [Google Scholar] [CrossRef] [PubMed]
  18. Kannan, K.; Galizia, C.G.; Nouvian, M. Olfactory strategies in the defensive behaviour of insects. Insects 2022, 13, 470. [Google Scholar] [CrossRef] [PubMed]
  19. Lucas, C.; Brossette, L.; Lefloch, L.; Dupont, S.; Christidès, J.P.; Bagnères, A.G. When predator odour makes groups stronger: Effects on behavioural and chemical adaptations in two termite species. Ecol. Entomol. 2018, 43, 513–524. [Google Scholar] [CrossRef]
  20. Despland, E. Role of olfactory and visual cues in the attraction/repulsion responses to conspecifics by gregarious and solitarious desert locusts. J. Insect Behav. 2001, 14, 35–46. [Google Scholar] [CrossRef]
  21. Reisenman, C.E.; Lorenzo Figueiras, A.N.; Giurfa, M.; Lazzari, C.R. Interaction of visual and olfactory cues in the aggregation behaviour of the haematophagous bug Triatoma infestans. J. Comp. Physiol. A 2000, 186, 961–968. [Google Scholar] [CrossRef]
  22. Bouquet, F.; Chipeaux, S.; Lang, C.; Marilleau, N.; Nicod, J.M.; Taillandier, P. Introduction to the agent approach. In Agent-Based Spatial Simulation with NetLogo; Elsevier: Amsterdam, The Netherlands, 2015; pp. 1–28. [Google Scholar]
  23. Li, J.; Li, L.; Zhao, S. Predator–prey survival pressure is sufficient to evolve swarming behaviors. New J. Phys. 2023, 25, 092001. [Google Scholar] [CrossRef]
  24. Sun, X.; Liu, T.; Hu, C.; Fu, Q.; Yue, S. Colcos φ: A multiple pheromone communication system for swarm robotics and social insects research. In Proceedings of the 2019 IEEE 4th International Conference on Advanced Robotics and Mechatronics (ICARM), Toyonaka, Japan, 3–5 July 2019; pp. 59–66. [Google Scholar]
  25. Liu, T.; Sun, X.; Hu, C.; Fu, Q.; Yue, S. A multiple pheromone communication system for swarm intelligence. IEEE Access 2021, 9, 148721–148737. [Google Scholar] [CrossRef]
  26. Liu, T.; Sun, X.; Hu, C.; Fu, Q.; Yue, S. A Versatile Vision-Pheromone-Communication Platform for Swarm Robotics. In Proceedings of the 2021 IEEE International Conference on Robotics and Automation (ICRA), Xi’an, China, 30 May–5 June 2021; pp. 7261–7266. [Google Scholar]
  27. Das, A.K.; Fierro, R.; Kumar, V.; Ostrowski, J.P.; Spletzer, J.; Taylor, C.J. A vision-based formation control framework. IEEE Trans. Robot. Autom. 2002, 18, 813–825. [Google Scholar] [CrossRef]
  28. Hu, C.; Fu, Q.; Liu, T.; Yue, S. A hybrid visual-model based robot control strategy for micro ground robots. In Animals to Animats 15, Proceedings of the 15th International Conference on Simulation of Adaptive Behavior, SAB 2018, Frankfurt/Main, Germany, 14–17 August 2018; Proceedings 15; Springer: Berlin/Heidelberg, Germany, 2018; pp. 162–174. [Google Scholar]
  29. O’Bryne, C. Emotions, Motivation-Based Action Selection and Dynamic Environments; University of Hertfordshire: Hatfield, UK, 2013. [Google Scholar]
  30. Webb, B. Can robots make good models of biological behaviour? Behav. Brain Sci. 2001, 24, 1033–1050. [Google Scholar] [CrossRef] [PubMed]
  31. Gravish, N.; Lauder, G.V. Robotics-inspired biology. J. Exp. Biol. 2018, 221, jeb138438. [Google Scholar]
  32. Feynman, R.P. Simulating physics with computers. Int. J. Theor. Phys. 2018, 21. [Google Scholar]
  33. Krause, J.; Winfield, A.F.; Deneubourg, J.L. Interactive robots in experimental biology. Trends Ecol. Evol. 2011, 26, 369–375. [Google Scholar] [CrossRef] [PubMed]
  34. Oliveri, G.; van Laake, L.C.; Carissimo, C.; Miette, C.; Overvelde, J.T. Continuous learning of emergent behavior in robotic matter. Proc. Natl. Acad. Sci. USA 2021, 118, e2017015118. [Google Scholar] [CrossRef] [PubMed]
  35. Gomez-Marin, A.; Zhang, Y. Emergent Behavior in Animal-Inspired Robotics. Front. Neurorobotics 2022, 16, 861831. [Google Scholar] [CrossRef]
  36. Duffy, B.R.; Joue, G. Intelligent Robots: The Question of Embodiment. 2000. Available online: https://www.researchgate.net/publication/228375813_Intelligent_robots_The_question_of_embodiment (accessed on 8 May 2023).
  37. Pfeifer, R.; Lungarella, M.; Iida, F. Self-Organization, Embodiment, and Biologically Inspired Robotics. Science 2007, 318, 1088–1093. [Google Scholar] [CrossRef]
  38. Webb, B. What does robotics offer animal behaviour? Anim. Behav. 2000, 60, 545–558. [Google Scholar] [CrossRef]
  39. Ramdya, P.; Ijspeert, A.J. The neuromechanics of animal locomotion: From biology to robotics and back. Sci. Robot. 2023, 8, eadg0279. [Google Scholar] [CrossRef]
  40. Ijspeert, A.J. Biorobotics: Using robots to emulate and investigate agile locomotion. Science 2014, 346, 196–203. [Google Scholar] [CrossRef] [PubMed]
  41. Li, L.; Ravi, S.; Wang, C. Editorial: Robotics to Understand Animal Behaviour. Front. Robot. AI 2022, 9, 963416. [Google Scholar] [CrossRef] [PubMed]
  42. Song, Z.; Juusola, M. A biomimetic fly photoreceptor model elucidates how stochastic adaptive quantal sampling provides a large dynamic range. J. Physiol. 2017, 595, 5439–5456. [Google Scholar] [CrossRef] [PubMed]
  43. Reina, A.; Cope, A.J.; Nikolaidis, E.; Marshall, J.A.; Sabo, C. ARK: Augmented reality for Kilobots. IEEE Robot. Autom. Lett. 2017, 2, 1755–1761. [Google Scholar] [CrossRef]
Figure 1. Agent Definition and Simulated 3D World: (A) Depiction of the simulated 3D world featuring designated agents. (B) Close-up perspective of the area outlined in (A), illustrating the geometric attributes of preys and predators, along with the visual field of view of the prey’s camera (indicated by dashed blue lines). (C) Overhead view of the simulated 3D world and its agents, as presented in (A). (D) Instances of vision input from preys positioned and oriented as demonstrated in (B), annotated as (1) and (2) correspondingly. The image dimensions are  200 × 150 .
Figure 1. Agent Definition and Simulated 3D World: (A) Depiction of the simulated 3D world featuring designated agents. (B) Close-up perspective of the area outlined in (A), illustrating the geometric attributes of preys and predators, along with the visual field of view of the prey’s camera (indicated by dashed blue lines). (C) Overhead view of the simulated 3D world and its agents, as presented in (A). (D) Instances of vision input from preys positioned and oriented as demonstrated in (B), annotated as (1) and (2) correspondingly. The image dimensions are  200 × 150 .
Biomimetics 08 00580 g001
Figure 2. Sensory-motor loop and delineated behaviors of the prey: (A) Each prey individual possesses a camera (visual input) featuring a horizontal field of view of 120 degrees and a vertical field of view of 90 degrees. Additionally, two odor sensors (olfactory input) are symmetrically placed at the agent’s base. (B) Motion attributes defined within the prey agent. (C) Flowchart depicting the determination of motion state  m p r e y ( t ) , the update rule of energy  e ( t ) , and the corresponding motion control: velocity  v ( t )  and heading direction  h ( t ) I ( t )  denotes the present visual input, while  s ( I ( t ) , c o l o r )  refers to a binary image following color matching.  # ( x )  represents the proportion of non-zero pixels to the total pixels (i.e., the image size of  200 × 150 ). (D) Representative spatial distribution of the prey population, influenced by visual aggregation (upper panel) and olfactory escape (lower panel). Orange text indicates the heading direction control, blue text describes state-related control, red and green text represent energy consuming and obtaining respectively.
Figure 2. Sensory-motor loop and delineated behaviors of the prey: (A) Each prey individual possesses a camera (visual input) featuring a horizontal field of view of 120 degrees and a vertical field of view of 90 degrees. Additionally, two odor sensors (olfactory input) are symmetrically placed at the agent’s base. (B) Motion attributes defined within the prey agent. (C) Flowchart depicting the determination of motion state  m p r e y ( t ) , the update rule of energy  e ( t ) , and the corresponding motion control: velocity  v ( t )  and heading direction  h ( t ) I ( t )  denotes the present visual input, while  s ( I ( t ) , c o l o r )  refers to a binary image following color matching.  # ( x )  represents the proportion of non-zero pixels to the total pixels (i.e., the image size of  200 × 150 ). (D) Representative spatial distribution of the prey population, influenced by visual aggregation (upper panel) and olfactory escape (lower panel). Orange text indicates the heading direction control, blue text describes state-related control, red and green text represent energy consuming and obtaining respectively.
Biomimetics 08 00580 g002
Figure 3. Motor (velocity  v ( t )  and heading  h ( t ) ), energy  e ( t )  and defined behaviors of the predator, along with instances of established odor fields exhibiting different odor injection widths ( ϕ w = 10  and  ϕ w = 20 ; Equation (A7)) but sharing the same motion trajectory. The predator’s motor behavior is akin to that of the prey. The predator is denoted by a red circle with a yellow bar, while cyan circles represent preys. Odor fields are visualized as heatmaps, with the predator’s current position and historical trajectories superimposed. Orange text indicates the heading direction control, red and green text represent energy consuming and obtaining respectively.
Figure 3. Motor (velocity  v ( t )  and heading  h ( t ) ), energy  e ( t )  and defined behaviors of the predator, along with instances of established odor fields exhibiting different odor injection widths ( ϕ w = 10  and  ϕ w = 20 ; Equation (A7)) but sharing the same motion trajectory. The predator’s motor behavior is akin to that of the prey. The predator is denoted by a red circle with a yellow bar, while cyan circles represent preys. Odor fields are visualized as heatmaps, with the predator’s current position and historical trajectories superimposed. Orange text indicates the heading direction control, red and green text represent energy consuming and obtaining respectively.
Biomimetics 08 00580 g003
Figure 4. The swarm robotics platform VColCOS Φ  platform [25,26] employed for conducting the prey-predator interaction scenario defined in this study.
Figure 4. The swarm robotics platform VColCOS Φ  platform [25,26] employed for conducting the prey-predator interaction scenario defined in this study.
Biomimetics 08 00580 g004
Figure 5. The schematic diagram of the information flow in the proposed robot experiment implementing the defined prey-predator interaction scenario.
Figure 5. The schematic diagram of the information flow in the proposed robot experiment implementing the defined prey-predator interaction scenario.
Biomimetics 08 00580 g005
Figure 6. The flowcharts of the control strategy of prey (left) and predator (right) robots. The applied hardware modules are labeled with text in brackets (cyan text for preys and red text for predator) alongside the corresponding function required in the control algorithm.  e ( t )  refers to the energy value of the agent.
Figure 6. The flowcharts of the control strategy of prey (left) and predator (right) robots. The applied hardware modules are labeled with text in brackets (cyan text for preys and red text for predator) alongside the corresponding function required in the control algorithm.  e ( t )  refers to the energy value of the agent.
Biomimetics 08 00580 g006
Figure 7. The results of one example simulation using parameters in Table A1 with arena length  L = 200  and odor injection width  Φ w = 20 . The upper four subplots provide a bird-eye view of the simulated 3D world, showcasing the positions and headings (orange arrows) of preys and predators, as well as the odor field at labeled time-steps. The lower left panel displays the energy profiles of each population (cyan curves for prey population’s maximum, mean, and minimal energy; red curves for predators with dashed red lines depict the maximum and minimum value of predator’s energy) over time, with relevant metrics annotated. The lower right panel illustrates the initial (black-dotted bars) and final (bars) distributions of evolving traits (upper for escaping preference factor  f e  and lower for gathering preference factor  f g ) within the prey population.
Figure 7. The results of one example simulation using parameters in Table A1 with arena length  L = 200  and odor injection width  Φ w = 20 . The upper four subplots provide a bird-eye view of the simulated 3D world, showcasing the positions and headings (orange arrows) of preys and predators, as well as the odor field at labeled time-steps. The lower left panel displays the energy profiles of each population (cyan curves for prey population’s maximum, mean, and minimal energy; red curves for predators with dashed red lines depict the maximum and minimum value of predator’s energy) over time, with relevant metrics annotated. The lower right panel illustrates the initial (black-dotted bars) and final (bars) distributions of evolving traits (upper for escaping preference factor  f e  and lower for gathering preference factor  f g ) within the prey population.
Biomimetics 08 00580 g007
Figure 8. The results of one example simulation using parameters in Table A1 with arena length  L = 280  and odor injection width  Φ w = 20 . Meanings of sub-figures are the same as that of Figure 7. But note that in the upper four plots, the size of the arena and agent’s bodies are scaled.
Figure 8. The results of one example simulation using parameters in Table A1 with arena length  L = 280  and odor injection width  Φ w = 20 . Meanings of sub-figures are the same as that of Figure 7. But note that in the upper four plots, the size of the arena and agent’s bodies are scaled.
Biomimetics 08 00580 g008
Figure 9. The results of the systematic investigation for evaluating the environmental factor (arena length L in x-axis) and the predator’s odor injection width ( Φ w  in the y-axis)’s effect to the temporal dynamics of the prey-predator interaction using the defined metrics. Vertices in the plots are determined by the averaged values (lighter green colors represent higher values while darker red colors indicate lower values) of 10 trials for every parameters setting of the simulation. (AD) corresponds to metrics formulated in (1)–(3).
Figure 9. The results of the systematic investigation for evaluating the environmental factor (arena length L in x-axis) and the predator’s odor injection width ( Φ w  in the y-axis)’s effect to the temporal dynamics of the prey-predator interaction using the defined metrics. Vertices in the plots are determined by the averaged values (lighter green colors represent higher values while darker red colors indicate lower values) of 10 trials for every parameters setting of the simulation. (AD) corresponds to metrics formulated in (1)–(3).
Biomimetics 08 00580 g009
Figure 10. Results of the preference factor in the evolution process. The upper four subplots illustrate the maximum number of agents within each bin of the histogram calculation (refer to (4)) at the initial ( t = 0 ) and final ( t = 6000 ) time steps. The simulations are conducted with varying arena lengths ( L = 200 , 240 , 280 , 320  from left to right) and different odor injection widths, each encoded by a specific line color. Each line corresponds to one simulation trial, with the highlighted line indicating the mean value of 10 trials. The lower subplot of Figure 10 depicts the metric representing the difference between the maximum number of agents in each bin at the initial and final time steps (calculated according to (5)). This analysis offers insights into how the combination of arena length and odor injection width impacts the evolution of the escaping preference factor in the prey population.
Figure 10. Results of the preference factor in the evolution process. The upper four subplots illustrate the maximum number of agents within each bin of the histogram calculation (refer to (4)) at the initial ( t = 0 ) and final ( t = 6000 ) time steps. The simulations are conducted with varying arena lengths ( L = 200 , 240 , 280 , 320  from left to right) and different odor injection widths, each encoded by a specific line color. Each line corresponds to one simulation trial, with the highlighted line indicating the mean value of 10 trials. The lower subplot of Figure 10 depicts the metric representing the difference between the maximum number of agents in each bin at the initial and final time steps (calculated according to (5)). This analysis offers insights into how the combination of arena length and odor injection width impacts the evolution of the escaping preference factor in the prey population.
Biomimetics 08 00580 g010
Figure 11. The arena length and predator’s odor injection width that act as the selective pressure to the prey population have effects on their degree of evolution process for gathering preference factor. Description of the figure is same as that of Figure 10.
Figure 11. The arena length and predator’s odor injection width that act as the selective pressure to the prey population have effects on their degree of evolution process for gathering preference factor. Description of the figure is same as that of Figure 10.
Biomimetics 08 00580 g011
Figure 12. The Kernel Density Estimation (KDE) analysis of the evolved escaping (left panel) and gathering (right panel) preference factor. Upper plots illustrates how to get the smoothed average using higher bandwidth exemplified by simulation with arena length  L = 240  and odor injection factor  Φ w = 20 . Cross makers depict the individual value of  f e  and  f g  in the prey population.
Figure 12. The Kernel Density Estimation (KDE) analysis of the evolved escaping (left panel) and gathering (right panel) preference factor. Upper plots illustrates how to get the smoothed average using higher bandwidth exemplified by simulation with arena length  L = 240  and odor injection factor  Φ w = 20 . Cross makers depict the individual value of  f e  and  f g  in the prey population.
Biomimetics 08 00580 g012
Figure 13. The pictures of the robots and arena captured during the experiments.
Figure 13. The pictures of the robots and arena captured during the experiments.
Biomimetics 08 00580 g013
Figure 14. The outcomes of a real robot experiment conducted with an arena length of  L = 800  pixels and an odor width of  Φ w = 80  pixels. The top row of the figure showcases the distribution of the olfactory escaping factor at specific time points, while the second row illustrates the distribution of the visual gathering factor. The bottom plot provides a visualization of the energy levels of both the predator (represented by the red curve) and the prey population (represented by the cyan curve) over time. Four vertical dotted gray lines are displayed on the plots, marking the time steps that correspond to the four bar plots presented above. Additionally, triangle markers on the energy curve indicate instances when a prey robot died and subsequently reborn. These results provide insight into the dynamics of the experiment, demonstrating the interplay between the predator’s behavior, the prey population’s evolving traits, and the energy fluctuations of both groups over the course of the experiment.
Figure 14. The outcomes of a real robot experiment conducted with an arena length of  L = 800  pixels and an odor width of  Φ w = 80  pixels. The top row of the figure showcases the distribution of the olfactory escaping factor at specific time points, while the second row illustrates the distribution of the visual gathering factor. The bottom plot provides a visualization of the energy levels of both the predator (represented by the red curve) and the prey population (represented by the cyan curve) over time. Four vertical dotted gray lines are displayed on the plots, marking the time steps that correspond to the four bar plots presented above. Additionally, triangle markers on the energy curve indicate instances when a prey robot died and subsequently reborn. These results provide insight into the dynamics of the experiment, demonstrating the interplay between the predator’s behavior, the prey population’s evolving traits, and the energy fluctuations of both groups over the course of the experiment.
Biomimetics 08 00580 g014
Figure 15. The spatial density distribution of prey and predator in four real robot experiments with different environmental conditions. The pictures with bird-eye view of the physical arena and robots are attached on the left correspondingly.
Figure 15. The spatial density distribution of prey and predator in four real robot experiments with different environmental conditions. The pictures with bird-eye view of the physical arena and robots are attached on the left correspondingly.
Biomimetics 08 00580 g015
Figure 16. The comparison of the performances of different real robot experiments under various environmental factor settings.
Figure 16. The comparison of the performances of different real robot experiments under various environmental factor settings.
Biomimetics 08 00580 g016
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Sun, X.; Hu, C.; Liu, T.; Yue, S.; Peng, J.; Fu, Q. Translating Virtual Prey-Predator Interaction to Real-World Robotic Environments: Enabling Multimodal Sensing and Evolutionary Dynamics. Biomimetics 2023, 8, 580. https://doi.org/10.3390/biomimetics8080580

AMA Style

Sun X, Hu C, Liu T, Yue S, Peng J, Fu Q. Translating Virtual Prey-Predator Interaction to Real-World Robotic Environments: Enabling Multimodal Sensing and Evolutionary Dynamics. Biomimetics. 2023; 8(8):580. https://doi.org/10.3390/biomimetics8080580

Chicago/Turabian Style

Sun, Xuelong, Cheng Hu, Tian Liu, Shigang Yue, Jigen Peng, and Qinbing Fu. 2023. "Translating Virtual Prey-Predator Interaction to Real-World Robotic Environments: Enabling Multimodal Sensing and Evolutionary Dynamics" Biomimetics 8, no. 8: 580. https://doi.org/10.3390/biomimetics8080580

Article Metrics

Back to TopTop