Pith. sign in

REVIEW 2 cited by

Reservoir Computing Benchmarks: a tutorial review and critique

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2405.06561 v2 pith:XBI3ALYK submitted 2024-05-10 cs.ET cs.LGcs.NE

classification cs.ETcs.LGcs.NE
keywords computingreservoirbenchmarksreviewcomputationcritiqueappliedapproach
verification ladder T0 review T1 audit T2 compute T3 formal

Signed reviews

No signed human review yet.

0 comments
read the original abstract

Reservoir Computing is an Unconventional Computation model to perform computation on various different substrates, such as recurrent neural networks or physical materials. The method takes a 'black-box' approach, training only the outputs of the system it is built on. As such, evaluating the computational capacity of these systems can be challenging. We review and critique the evaluation methods used in the field of reservoir computing. We introduce a categorisation of benchmark tasks. We review multiple examples of benchmarks from the literature as applied to reservoir computing, and note their strengths and shortcomings. We suggest ways in which benchmarks and their uses may be improved to the benefit of the reservoir computing community.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 2 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. 7-Methylquinolinium Iodobismuthate Memristor: Exploring Plasticity and Memristive Properties for Digit Classification in Physical Reservoir Computing

    cond-mat.dis-nn 2025-04 reject novelty 6.0 of 10

    A lead-free bismuth-halide memristor is reported as a physical reservoir, with claimed MNIST accuracy of 82.26%, but the classification equations omit the reservoir outputs.

  2. Re-purposing a modular origami manipulator into an adaptive physical computer for machine learning and robotic perception

    cs.RO 2025-05 conditional novelty 5.0 of 10

    A modular origami manipulator can act as a trainable physical reservoir computer, and its task performance tracks two simple spectral and spatial correlation metrics.

Pith tools