Evolutionary Systems

We develop and analyse neuroevolutionary systems to advance understanding of the capacity of evolutionary processes to generate increasingly intelligent behaviours in virtual creatures. 

Research Overview

Our research into open-ended evolution looks to overcome the severe scaling problems exhibited by today's evolutionary algorithms, and toward evolving true artificial intelligence through natural selection.  We developed the first closed artificial system to pass Mark Bedau et al's established statistical “ALife Test” for unbounded evolutionary dynamics [2001]. Earth's biosphere (through fossil-record databases) is the only other system to have passed the advanced form of this test. This is a very significant result: potentially a second example of unbounded evolution. The creation of a system capable of passing the test had been identified by Bedau, Snyder and Packard as “among the very highest priorities of the field of artificial life” [1998]. We made the test well-grounded even for long-term unbounded evolution in artificial systems, through the first ever method of computing individual genes' adaptive ('normalized') evolutionary activities [2003, 2006]. Our work in this area currently focuses on drawing generalized conclusions about open-ended evolution that were previously impossible given just the real-world example.

Our earliest work on the neuroevolution of articulated virtual creatures produced the first realistic co-adapted behaviours to have been evolved using general purpose neurons to control 3D physically simulated agents [2005]. The previous need for ad hoc (problem-specific) neurons was a barrier to the long-term evolution of general behaviours. Our research in this area is now focused on the incremental neuroevolution [2013] of complex reactive and deliberative behaviour [2007] coupled with motor control: evolving articulated virtual creatures capable of performing tasks that cannot be solved by reactive mechanisms alone and which would traditionally have their solutions formulated in terms of search-based planning [2015]. In related work, our biologically inspired evolutionary robotics research focuses on biological mechanisms of navigation [2012].

The group also undertakes research into the evolution of social systems and social learning.  We have presented the first example of behaviour inaccessible to incremental genetic neuroevolution alone being evolved through the addition of cultural transmission, in the form of learning by imitation [2011]; the parallel use of transcription errors (noise in the genotype to phenotype map) was a key innovation here.  And we have provided the first definitive answer to the previously open question of whether or not the “variability selection hypothesis” is sufficient to explain the adoption of social learning in increasingly variable environments [2012].  Our work on agent-based simulation of social systems has also focused on modelling the evolution of cooperation. In particular, we have studied the role of environment induced uncertainty and communication complexity in supporting the emergence of cooperation, and analysed factors that facilitate the emergence of cultural innovations.

We develop and analyse evolutionary systems to advance understanding of natural and artificial evolutionary processes. 

Through EPSRC project EP/H031936/1 Evolution as an Information Dynamic System (2010-2013), we worked with partners Drs Chris Knight, Rok Krasovec, Roman Belavkin and (now) Professor John Aston, from the Universities of Manchester, Middlesex and Warwick (now Cambridge). Our work on mutation rate plasticity established optimal mutation rate control functions, for both artificial landscapes and natural landscapes defined by DNA-transcription factor affinities, and demonstrated general applicability to biology [2014]. The Evolutionary Systems Group used tables of DNA to protein binding affinities to evolve DNA sequences in computer simulations, and a meta-Genetic Algorithm [2011] to evolve fitness-dependent mutation rate mappings that show a close match with the research team's predictions from information theory. We used Nvidia's CUDA many-core (GPGPU) technology to speed up computational experiments from 1.4 years (maximum, per run) to 3 days, enabling a step change in the rate at which the research was able to advance. The team began the follow-on BBSRC project BB/L009579/1 The theory and practice of evolvability: Effects and mechanisms of mutation rate plasticity in Febrauary 2014. In this project we are primarily investigating the effects and mechanisms of density-dependent mutation rate plasticity, although we first extended our previous work to determine optimal mutation rate control under selection [2015].

Through the above Evolution as an Information Dynamic System project, the team also investigated the relationship between mutation rate, genetic loss and population size. Above a critical mutation rate (CMR) fitter genotypes may be outcompeted by those with greater mutational robustness. Expressed in terms of fitness landscapes, narrow high fitness peaks may be lost by a population while broader, lower peaks are maintained; this phenomena is referred to as “survival of the flattest”. We established that CMR has an exponential dependence on population size in haploid populations [2011]: that as population size falls, the CMR above which fitter alleles are lost transitions unexpectedly from near-constant (the previous assumption in evolutionary biology) to drop exponentially for small populations, leaving them spiralling toward extinction. We subsequently verified that our model closely reproduces the less significant but established mathematical relationship between population size and 'error threshold' (no mathematical model has yet been derived for CMR), and established that the result also holds for diploid populations [2013]. This and the team's related research has lead to our most recently awarded BBSRC project, BB/M021157/1 Adaptive landscapes of antibiotic resistance: population size and 'survival-of-the-flattest', which will start in August 2015. In this the focus is on the small population of a microbe with a newly arisen antibiotic resistance mutation.

We also use category theoretical models to study the evolution of complex systems. This work is inspired by the use of such approaches in type theory and system behaviour modelling.  Our research on complex systems includes the network analysis of complex biological networks, for example protein interaction networks and ecological networks, and general research on formal modelling of the evolution of complex systems.  Our network analysis research looks at the determination of structurally important components of biological networks in the context of drug discovery and environmental ecology. One of our earlier projects (eXSys) led to a spin-off company, e-Therapeutics Plc, which uses network analysis of proteomics data for discovery of new drugs and drug targets. More recently our network analysis research has focussed on the use of this approach to support the understanding of large-scale complex software systems by software engineers, for example in the context of matching revised requirements. We also use network data generated by dynamic analysis of large-scale software to evaluate and experimentally validate network analysis methods.

We recognise the importance of research-led teaching. Evolutionary Systems and Neural Networks are taught together in our undergraduate programmes, through Computational Intelligence modules embedded within our single and dual honours Computer Science programmes.

Projects

Externally Funded Projects

Adaptive landscapes of antibiotic resistance: population size and 'survival-of-the-flattest', A Channon (Keele PI) and E Aston (Researcher Co-I) in collaboration with CG Knight and R Krasovec (Manchester) and R Belavkin (Middlesex).  Funded by BBSRC, £621k, 2015-2018.

The theory and practice of evolvability: Effects and mechanisms of mutation rate plasticity, A Channon and E Aston (PDRA 2014-2015) in collaboration with CG Knight and R Krasovec (Manchester) and R Belavkin (Middlesex).  Funded by BBSRC, £465k, 2014-2017.

Evolution as an Information Dynamic System, A Channon and E Aston (PhD student) in collaboration with R Belavkin (Middlesex), CG Knight (Manchester) and J Aston (Warwick, now Cambridge).  Funded by EPSRC, £423k, 2010-2013.

Protein interaction data visualization, P Andras. KTP project in collaboration with e-Therapeutics Plc, £60k, 2006.

eXSys – Network analysis of protein interaction data, P Andras. Funded by EPSRC, £180k, 2003-2004.

Network analysis of ecological systems, P Andras. Funded by DEFRA, £70k, 2003-2004.

PhD Students

Current PhD Students

Mr James Borg (supervisor: Dr Alastair Channon)

Mr Ben Jackson (supervisor: Dr Alastair Channon)

Mr Ben Jolley (supervisor: Dr Alastair Channon)

Current Research Associate

Dr Elizabeth Aston (supervisor: Dr Alastair Channon)

Past PhD Students

Dr Adam Stanton (supervisor: Dr Alastair Channon; graduated with PhD in 2017)

Dr Elizabeth Aston (supervisor: Dr Alastair Channon; graduated with PhD in 2014)

Dr Thomas Miconi (supervisor: Dr Alastair Channon; University of Birmingham, graduated with PhD in 2008)

Past Research Associates

Dr Iwo Bohr (supervisor: Prof Peter Andras; 2007; Newcastle University; currently postdoc at Newcastle University)

Mr Neil Henderson (supervisor: Prof Peter Andras; 2006; Newcastle University)

Mr William McElderry (supervisor: Prof Peter Andras; 2006; Newcastle University)

Dr Greg Maniatopoulos (supervisor: Prof Peter Andras; 2005-2006; Newcastle University; currently postdoc at Newcastle University)

Dr Olusola Idowu (supervisor: Prof Peter Andras; 2003-2005; Newcastle University)

Dr Steven Lynden (supervisor: Prof Peter Andras; 2003-2004; Newcastle University; currently postdoc at National Institute of Advanced Industrial Science and Technology, Tsukuba, Japan)

Dr Panos Periorellis (supervisor: Prof Peter Andras; 2003-2004; Newcastle University; currently program manager at Microsoft)

Dr Agnes Madalinski (supervisor: Prof Peter Andras; 2003-2004; Newcastle University; currently postdoc at Otto-von-Guericke University of Magdeburg)

Mr Robert Gwyther (supervisor: Prof Peter Andras; 2003-2004; Newcastle University; currently consultant at Accenture)

Collaborators

Dr Chris Knight (University of Manchester)

Dr Rok Krašovec (University of Manchester)

Dr Roman Belavkin (Middlesex University)

Professor John Aston (University of Cambridge)

Professor Malcolm Young (e-Therapeutics Plc, Oxford)

Dr Bruce Charlton (Newcastle University)

Dr John Lazarus (Newcastle University)

Dr Gilbert Roberts (Newcastle University)

Publications

Since 2012 (Full List of publications)

News

  • July 2016: Second workshop on Open Ended Evolution, co-organised by Dr Tim Taylor, Professor Mark Bedau and Dr Alastair Channon, at ALife XV.
  • July 2016: Workshop on Social Learning and Cultural Evolution, co-organised by Chris Marriott, Peter Andras, James Borg, and Paul Smaldino, at ALife XV.
  • July 2016: Professor Peter Andras, Dr Alastair Channon and Mr Adam Stanton will give talks on their papers at the Fifteenth International Conference on the Synthesis and Simulation of Living Systems (ALife XV).
  • July 2015: Professor Peter Andras, Dr Alastair Channon and Mr Adam Stanton will give talks on their papers at the 13th European Conference on Artificial Life (ECAL 2015).
  • July 2015: Workshop on Open Ended Evolution, co-organised by Dr Tim Taylor, Professor Mark Bedau and Dr Alastair Channon, at ECAL 2015.
  • July 2015: Dr Alastair Channon’s Faculty of Natural Sciences Acorn/FRO bid for PhD studentship funding has been awarded.  The student will start in September 2015.
  • April 2015: We have had the following papers accepted for the 13th European Conference on Artificial Life (ECAL 2015):
    • Incremental Neuroevolution of Reactive and Deliberative 3D Agents, Adam Stanton and Alastair Channon;
    • Optimal Mutation Rate Control under Selection in Hamming Spaces, Elizabeth Aston, Alastair Channon, Roman Belavkin, Rok Krasovec and Christopher Knight;
    • Environmental Factors and the Emergence of Cultural-Technical Innovations, Peter Andras.
  • April 2015: The BBSRC has awarded Dr Alastair Channon (Keele PI) and Dr Elizabeth Aston (Researcher Co-I) funding for the three-year project Adaptive landscapes of antibiotic resistance: population size and 'survival-of-the-flattest' in collaboration with partners Dr Chris Knight and Dr Rok Krasovec from the Universities of Manchester and Dr Roman Belavkin from Middlesex University.  The project will start in August 2015.
  • March 2015: Dr Alastair Channon’s Faculty of Natural Sciences Research Support Fund bid with Dr Elizabeth Aston, to produce preliminary data on Critical Mutation Rates in Large Populations, has been successful.
  • February 2015: We have completed our upgrade of the Cuda compute cluster, adding nodes containing Intel Xeon Haswell CPUs and Nvidia Maxwell GPUs. These are now running a range of the group’s simulations.
  • November 2014: Dr Channon’s Faculty of Natural Sciences Capital Investment Fund bid to upgrade our Cuda compute cluster, on behalf of a consortium of the University’s HPC users, has been successful.
  • November 2014: Professor Peter Andras gave a talk on the analysis and modelling of complex systems at the Florida Atlantic University (FAU), Boca Raton, Florida, US.
  • November 2014: Dr Alastair Channon gave a seminar on mutation and selection strategies for incremental evolution to the Department of Electronics, University of York.