REVIEW
Lamarckian Evolution and the Baldwin Effect in Evolutionary Neural Networks
Neural and Evolutionary Computing · Submitted 1 Mar 2006 · 35 references
Pith's verdict: Honest but statistically weak comparison of Lamarckian and Baldwin learning in G-Prop; the trade-off is plausible but the accuracy advantage is within noise.
T0 · AI review
Why Pith says this
Highlight any text to comment on it.
Referee report
The paper
The paper claims
G-Prop shows Lamarckian evolution makes smaller, faster nets; Baldwin-effect learning makes the most accurate ones.
The reading
What carries the argument
The load-bearing mechanism is the coupling between Quick-Propagation training and the genetic representation. In the Lamarckian version, the local-search operator trains each individual and then copies the trained weights back into the chromosome, so offspring inherit the learned solution. In the Baldwin version, the same training runs during fitness evaluation, but only the resulting validation-set ability is used for selection; the chromosome keeps the untrained weights. The Baldwin fitness function ranks individuals first by post-training ability, then by pre-training ability as a tie-breaker, and finally by network size. This coupling is what lets the paper isolate the effect of information flow from learning to evolution.
Extended reading notes
Core claim
The central discovery is a concrete trade-off between the two classic mechanisms when embedded in G-Prop. On Glass1a, the Lamarckian approach reaches 32 ± 2 percent test error with networks of about 59 weights in about 52 generations, while the Baldwinian approach reaches 31 ± 2 percent error with about 112 weights in about 119 generations. On the f2 function approximation problem, the Lamarckian variant reaches 0.09 ± 0.01 NMSE with 18 ± 8 weights, and the Baldwinian variant reaches 0.086 ± 0.004 NMSE with 85 ± 27 weights; the published fuzzy-logic result is 0.125 with 6 parameters. The Baldwin strategy is more progressive, keeps searching longer, and avoids the early stagnation seen under the elitist Lamarckian run, which tends to let one dominant individual stop evolution. The paper presents this as evidence that learning which only shapes fitness can match or beat learning that writes back into the genome, at the price of more computation and larger networks.
Load-bearing premise
The comparison with previously published results assumes those runs used the same data partitions, number of runs, training epochs, and error metric as the authors' runs, and the paper does not demonstrate that equivalence.
Editorial extensions
If this is right
- A designer who needs a deployable network quickly should use the Lamarckian operator, because it reaches a good error rate in far fewer generations and with a much smaller network.
- A designer who can afford longer runs should use the Baldwin-effect fitness function, because it produced the lowest error on both benchmarks in these experiments.
- The Lamarckian strategy's early convergence under elitism implies that its reported solution is an early local optimum; problems with many local minima are the natural territory for the Baldwin variant.
- The paper's comparison tables place both variants below the reported errors of RPROP, an earlier evolutionary method, and a fuzzy-logic approximator.
Reading between the lines
- A natural extension is a mixed strategy that first lets Baldwin-effect learning explore for a fixed number of generations and then switches to writing weights back; this could combine the low error of the Baldwin variant with the small networks of the Lamarckian variant.
- The large size gap between variants suggests the Baldwin search is exploring a wider range of architectures rather than refining one, a hypothesis that could be tested by measuring topology diversity over generations.
- Re-running the comparison under a single shared protocol, with identical data splits and run counts, would turn the reported baseline differences from suggestive into directly interpretable.
- If the size difference is robust, it implies that writing learned weights back biases evolution toward overfitting the current solution, while withholding them keeps the population exploring; this could be tested by tracking training versus validation error per generation.
Original abstract
Hybrid neuro-evolutionary algorithms may be inspired on Darwinian or Lamarckian evolu- tion. In the case of Darwinian evolution, the Baldwin effect, that is, the progressive incorporation of learned characteristics to the genotypes, can be observed and leveraged to improve the search. The purpose of this paper is to carry out an exper- imental study into how learning can improve G-Prop genetic search. Two ways of combining learning and genetic search are explored: one exploits the Baldwin effect, while the other uses a Lamarckian strategy. Our experiments show that using a Lamarckian op- erator makes the algorithm find networks with a low error rate, and the smallest size, while using the Bald- win effect obtains MLPs with the smallest error rate, and a larger size, taking longer to reach a solution. Both approaches obtain a lower average error than other BP-based algorithms like RPROP, other evolu- tionary methods and fuzzy logic based methods
The compiled record
The paper's own sentences, arranged, kept beside the review and separate from it. Each label is drawn from a closed vocabulary; the number beside it is the probability the classifier gave that label. Numbers in the tables are the authors', checked by code. No sentence in this record was written by a model.
The abstract, sentence by sentence
Hybrid neuro-evolutionary algorithms may be inspired on Darwinian or Lamarckian evolu- tion. In the case of Darwinian evolution, the Baldwin effect, that is, the progressive incorporation of learned characteristics to the genotypes, can be observed and leveraged to improve the search. The purpose of this paper is to carry out an exper- imental study into how learning can improve G-Prop genetic search. Two ways of combining learning and genetic search are explored: one exploits the Baldwin effect, while the other uses a Lamarckian strategy. Our experiments show that using a Lamarckian op- erator makes the algorithm find networks with a low error rate, and the smallest size, while using the Bald- win effect obtains MLPs with the smallest error rate, and a larger size, taking longer to reach a solution. Both approaches obtain a lower average error than other BP-based algorithms like RPROP, other evolu- tionary methods and fuzzy logic based methods
background contribution method result interpretation main claim
| # | sentence | role | the authors' own work | states the main conclusion | strength |
|---|---|---|---|---|---|
| s0 | Hybrid neuro-evolutionary algorithms may be inspired on Darwinian or Lamarckian evolu- tion. | background 1.00 | 0.04 | 0.02 | hedged possibility 1.00 |
| s1 | In the case of Darwinian evolution, the Baldwin effect, that is, the progressive incorporation of learned characteristics to the genotypes, can be observed and leveraged to improve the search. | background 1.00 | 0.06 | 0.03 | asserted 0.91 |
| s2 | The purpose of this paper is to carry out an exper- imental study into how learning can improve G-Prop genetic search. | contribution 1.00 | 0.42 | 0.03 | asserted 0.71 |
| s3 | Two ways of combining learning and genetic search are explored: one exploits the Baldwin effect, while the other uses a Lamarckian strategy. | method 0.86 | 0.58 | 0.03 | asserted 0.90 |
| s4 | Our experiments show that using a Lamarckian op- erator makes the algorithm find networks with a low error rate, and the smallest size, while using the Bald- win effect obtains MLPs with the smallest error rate, and a larger size, taking longer to reach a solution. | result 1.00 | 0.97 | 0.83 | asserted 1.00 |
| s5 | Both approaches obtain a lower average error than other BP-based algorithms like RPROP, other evolu- tionary methods and fuzzy logic based methods | result 1.00 | 0.89 | 0.25 | asserted 1.00 |
What was examined, and what was not
- arXiv listing abstract v1
- full text
- figures and tables
- references and citing sentences
- relations to other papers
- P abstract
- S sections
- T body sentences
- C citations
- R cross-paper relations
References
How the literature uses it
1 arXiv paper cite this in 2 sentences
Discussion
Disagree with the review, or know something it missed? Leave a comment, highlight any passage above to comment on it, or challenge this review formally.