A Lost Croatian Cybernetic Machine Translation Program

Ines Skelac; Leo Mr\v{s}i\'c; Sandro Skansi

REVIEW 3 major objections 5 minor 30 references

A Lost Croatian Cybernetic Machine Translation Program

T0 review · 3 major / 5 minor · reviewed 2026-08-14 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗ Review JSON

Pith's one-line read By 1959, a Zagreb linguistics group was arguing for cybernetic, learning-based machine translation—an orientation mainstream AI reached decades later.

desk verdict Solid archival reconstruction of a little-known Croatian MT group, but the abstract overclaims—the paper itself admits the translation method was never explicated. read the letter →

arxiv 1908.08917 v1 pith:7N6QFZQV submitted 2019-08-20 cs.CY cs.CL

Sandro Skansi , Leo Mršić , Ines Skelac This is my paper · ORCID

classification cs.CYcs.CL

keywords BulcsuLaszlomachinetranslationcyberneticshistoryofcomputingnaturallanguageprocessingneuralYugoslaviaentropy-basedencoding

verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

The paper recovers a nearly forgotten chapter of machine translation: in the late 1950s, a group of Zagreb linguists led by Bulcsu Laszlo argued that translation by machine should be treated as a cybernetic problem, built on analogies between machines and the human nervous system, on entropy-based coding, and on the ability to learn, rather than on the logical and interlingua schemes favored in the United States and the Soviet Union. The authors situate the group's two key papers, from 1959 and 1962, against the American and Soviet programs and claim that this cybernetic orientation anticipated statistical and neural machine translation by decades. If the claim is right, the standard history of machine translation is incomplete: there was a Yugoslav line of descent that chose association and learning over logic long before those choices became mainstream.

What carries the argument

The load-bearing object is the group's definition of cybernetics, taken from a 1948 book that coined the term: the discipline that studies analogies between machines and living organisms, with the specific analogy between machine functioning and the human nervous system. That framing is what turns a dictionary-and-frequency pipeline into something the authors can call a precursor of neural translation. The concrete machinery likewise consists of four proposed modules: an inverse, reverse-alphabetical dictionary to support stemming and lemmatization; a word-frequency table to select a few thousand useful words; entropy-based binary encoding of lemmas; and a meaning-keyed thesaurus, illustrated in the 1962 paper with the sentence 'A man is smoking a pipe.' What is missing, as the paper acknowledges, is any explicit description of how candidate meanings are chosen, which is why the cybernetic framing has to bear the weight of the anticipation claim.

What would settle it

Search the 1959 volume and the 1962 paper for any passage specifying how the machine chooses between competing thesaurus meanings during alignment; if the only proposed selection mechanism is entropy-ordered frequency counts with no association or learning step, the neural-anticipation claim fails. A second concrete check is to reconstruct the group's sample alignment from [27]: if the available information is character-level compression with no cross-language correspondence, the claimed prefiguration of statistical alignment evaporates.

Watch

Extended reading notes

Core claim

On the paper's own terms, the central discovery is that the Zagreb group committed itself, by 1959, to a cybernetic conception of machine translation: it explicitly rejected the idea that cybernetics is just the theory of electronic computers and insisted that the important analogy is between the functioning of the machine and the human nervous system. The group coupled this with a concrete but never-implemented pipeline: an inverse dictionary for lemmatization, a word-frequency table, entropy-based binary encoding of words, and a thesaurus whose keys are meanings rather than surface words, with sentential alignment as the translation step. The authors read the group's call for in-built conduits for concept association and the ability to learn fast as pointing toward artificial neural networks, and they argue that this cybernetic stance was a genuine alternative to the logical and interlingua orthodoxy of the period. The paper is candid that no prototype was built and that the translation method itself was never explicated, so the historical claim rests on the group's stated orientation rather than on a demonstrated system.

Load-bearing premise

The load-bearing premise is that describing machine translation as a cybernetic task and invoking machine-nervous-system analogies, entropy coding, and fast learning counts as an anticipation of statistical and neural machine translation, even though the paper itself states that the translation method was never explicated and that the group closely followed the Soviet dictionary-based approaches.

Editorial extensions

If this is right

If the cybernetic reading is right, standard histories of machine translation should include the Zagreb group as an independent line of descent rather than as a mere footnote to the American and Soviet programs.
The group's emphasis on word frequencies, entropy coding, lemmatization, and sentential alignment would mean that several ideas central to statistical natural language processing were already present in Yugoslavia in the late 1950s.
The claim that the group's call for fast learning and concept association anticipates neural translation would shift the origin story of neural machine translation from computational practice to earlier philosophical and linguistic commitments.
The paper's account implies that the failure was institutional and financial, not intellectual: without a computer or federal funding, the group could produce a research program but not a prototype.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

Because the paper itself concedes that the translation method was never explicated, the strongest defensible form of the claim is that the group anticipated the research orientation of neural translation—association, learning, and entropy-based encoding—rather than any specific translation algorithm.
A testable extension would be to recover the 1957 dissertation on which the group drew and determine whether its bigram and trigram proposal was character-level or word-level; the word-level case would push known word-context modeling earlier than the Western precedents the paper cites.
The meaning-keyed thesaurus described in the 1962 paper resembles modern embedding and semantic-space thinking in spirit, but its numbered meaning codes are never explained; resolving what those numbers were meant to do would clarify whether the group had an interlingua or something closer to a statistical model.
If future archival work finds notes or drafts from 1958 to 1962 describing a learning rule for choosing among competing thesaurus meanings, the anticipation claim would upgrade from philosophical to technical; the paper's current evidence does not establish such a rule.

Share X Bluesky LinkedIn Reddit HN

Signed reviews

No signed human review yet.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Desk Editor's Note

read the letter

The thing to know: this is a genuine historical contribution that oversells its own headline. The authors document a previously obscure machine translation program in Zagreb from the late 1950s, with real primary sources—the 1959 collection, the 1962 Jezik paper, the Matković dissertation. That part is solid. Anyone writing the history of MT in Europe should know about this group, and the paper gives a clear account of their data-preparation ideas: inverse dictionary, lemmatization, frequency tables, thesaurus-as-interlingua, and the statistical sense-selection algorithm from Spalatin. The sourcing is careful, and the authors are honest about the group's lack of a computer and its dependence on Soviet approaches.

The problem is the central claim, which the abstract states as fact: that Laszlo's cybernetic framing anticipated what the AI mainstream adopted decades later (neural/statistical MT). The body does not support that. Section 3 explicitly says 'the translation method is never explicated,' and the one algorithm described is a transfer-based lookup with frequency-based sense selection—not a neural or learned model. The quotes about machines and organisms, and about concept association and learning, show a cybernetic vocabulary, not a translation architecture. The paper even says the group followed the Soviet approach(es) closely, which undercuts the 'different from the logical approaches' angle. And Section 4 concedes it is 'leaving the historical analysis behind to speculate.' So the abstract is not just bold; it is in tension with the paper's own admissions. The stress-test note lands.

That said, this is fixable. If the abstract is softened to 'a cybernetic framing that anticipated in spirit later developments' and the speculative Section 4 is clearly labeled as interpretation (it already is, mostly), the paper becomes a solid contribution to the history of MT. There is no circularity, no invented entities, and the citation pattern looks appropriate for a national-history piece.

Who is it for? Historians of AI/MT, and people working on Croatian science history. A technical NLP reader will not learn new methods, but the historical context is useful. I would send it to peer review—a history of science venue, not a technical one—and ask the authors to bring the abstract in line with the body. If they can find one more archival document that actually describes a learning mechanism, the stronger claim would be justified; absent that, the interpretation should be marked as speculation.

Referee Report

3 major / 5 minor

Summary. The paper reconstructs the history of a machine translation research group active in Zagreb in the late 1950s and early 1960s under the leadership of linguist Bulcsu Laszlo. It situates the group's work against the early US and Soviet MT programs, describes the group's data-preparation ideas (inverse dictionaries, frequency tables, thesaurus-as-interlingua, entropy-based coding, lemmatization, and alignment), and argues that the group's cybernetic orientation anticipated the statistical and neural machine translation approaches that became mainstream decades later. The historical reconstruction is based on Croatian-language primary sources from 1959 and 1962, especially the collected volume edited by Laszlo and Petrović, plus later secondary accounts.

Significance. If the historical reconstruction is accepted, the paper is a valuable contribution to the historiography of machine translation in Eastern Europe. Its concrete strengths are the recovery of hard-to-access Croatian primary sources, the identification of specific technical precursors in the Zagreb group's writings (entropy-based coding, frequency-based sense selection, thesaurus-as-interlingua, and word-bigram context modeling), and the careful documentation of the group's institutional history and lack of computing resources. However, the paper's strongest interpretive claim—that the group anticipated neural machine translation—is not supported by the evidence the authors themselves present. The value of the paper lies in the documented historical recovery and in raising the question of the group's influence, not in establishing a direct line from Laszlo's cybernetic vocabulary to modern neural MT.

major comments (3)

[Abstract; §3 (paragraph following the quote from [11], p. 117)] The abstract's claim that Laszlo advocated cybernetic methods 'which would be adopted as a canon by the mainstream AI community only decades later' is not established by the body of the paper. In §3 the authors state that 'the translation method is never explicated' and that 'the Croatian group followed the Soviet approach(es) closely'; the only worked algorithm described, from [27], is lemma/thesaurus lookup with frequency-based sense selection, and the authors themselves note that 'the meaning of the numbers used is never explained.' The inference 'would most probably mean artificial neural networks' is explicitly speculative, yet the abstract presents the anticipation as a factual result. This is load-bearing for the paper's stated significance, so the abstract and conclusion should be revised to present the neural-MT anticipation as an open hypothesis, not as a demonstrated historical finding.
[§1 (Soviet approaches) and §3] The paper simultaneously claims that the Croatian group's approach was 'different from the usual logical approaches of the period' and that it 'followed the Soviet approach(es) closely.' Section 1 identifies the third Soviet approach as 'mainly information-theoretic, which was considered cybernetic at that time' and describes it as 'the main role model for the Croatian efforts from 1957 onwards.' In §3 the authors also write that 'the Croatian group followed the Soviet approach(es) closely.' These statements are in tension with the claim of an independent, distinctive 'cybernetic' path, and the paper should clarify which elements of the Zagreb program were original and which were adopted from Soviet information-theoretic MT.
[§4] The concluding counterfactual—'The step which was needed here was to eliminate the notion of structure alignment and just seek sentential alignment' and the proposed entropy-based alignment—appears to be the authors' own construction rather than a reconstruction from the sources. Because this section is used to support the claim that the group 'had contemporary views and necessary competencies,' the discussion should clearly separate historical fact from the authors' speculation, and the speculative proposal should not be attributed to the group.

minor comments (5)

[Abstract and §1] The phrase 'We are exploring' is repeated in the abstract and in the opening of Section 1; a direct historical narrative would be more appropriate for a journal article.
[References [25]] The text attributes the introduction of KL-ONE to 'Brachman and Schmolze [25],' but reference [25] lists Baader, Horrocks, and Sattler, 'Description logics.' The citation should be corrected to the original KL-ONE paper.
[Throughout] Diacritics and spelling of Croatian names are inconsistent (e.g., 'Prani´ c' vs 'Pranjić', 'Muli´ c' vs 'Mulić', 'Laszlo' vs 'László'); standardize and transliterate consistently.
[§2] Section 2 states that organized MT effort in Yugoslavia started in 1959, while the group is described as having been formed in 1958; clarify whether the group's formal activity began in 1958 or 1959.
[§3] The text refers to 'Fig. 1' as illustrating the described process, but no figure appears in the submission; either include the figure or remove the reference.

Circularity Check

0 steps flagged · score 0.0 of 10

No circularity: historical paper with no fitted inputs, derivations, or load-bearing self-citation; interpretive leaps are a correctness concern, not circular reasoning.

full rationale

This is a historical reconstruction paper, not a derivation or empirical study. It contains no equations, no fitted parameters, and no quantity is defined in terms of another. The authors are not the historical actors, and the argument rests on primary sources ([7], [10], [11], [22], [27]) plus secondary histories ([8], [16], [20], [24]). There is no instance where a 'prediction' or 'first-principles result' reduces to its own inputs by construction. The paper's strongest claim, that Laszlo's cybernetic vocabulary anticipated statistical/neural machine translation, is an interpretive inference; indeed the paper itself admits 'the translation method is never explicated' and that 'the Croatian group followed the Soviet approach(es) closely.' That admission weakens the historical claim, but it is a matter of evidential support and interpretive caution, not circularity. No cited 'uniqueness theorem,' no ansatz smuggled in by citation, and no renaming of a known result is present. The normal scholarly reliance on primary and secondary sources does not constitute circular reasoning on this axis. Therefore the appropriate finding is no significant circularity, score 0.

Assumptions & free parameters 0 free parameters · 2 assumptions · 0 invented entities

As a historical paper, there are no fitted parameters, no invented physical entities, and no formal axioms in the mathematical sense. The load-bearing assumptions are historiographic: the reliability and representativeness of the cited primary sources, and the interpretive leap from 'cybernetic' to modern machine learning.

assumptions (2)

domain assumption The cited primary sources [6],[7],[10],[11],[16],[22],[27] accurately represent the methods and beliefs of the Zagreb group.
The entire historical reconstruction is built on these sources, which are authored by the group members or their colleagues; no independent archival verification is presented.
ad hoc to paper The word 'cybernetic' in Laszlo and Petrović [11] carries substantive meaning that foreshadows statistical and neural machine translation.
The paper itself notes the translation method was never explicated, so this interpretive link is an assumption added by the current authors to support the prescience claim.

how reviews work

0 comments

Cite this review

Pith. "Pith review of A Lost Croatian Cybernetic Machine Translation Program." pith.science (2026). https://pith.science/paper/7N6QFZQV

@misc{pith2026190808917,
  author       = {Pith},
  title        = {Pith review of: A Lost Croatian Cybernetic Machine Translation Program},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/7N6QFZQV}},
  note         = {Machine review of arXiv:1908.08917}
}

read the original abstract

We are exploring the historical significance of research in the field of machine translation conducted by Bulcsu Laszlo, Croatian linguist, who was a pioneer in machine translation in Yugoslavia during the 1950s. We are focused on two important seminal papers written by members of his research group from 1959 and 1962, as well as their legacy in establishing a Croatian machine translation program based around the Faculty of Humanities and Social Sciences of the University of Zagreb in the late 1950s and early 1960s. We are exploring their work in connection with the beginnings of machine translation in the USA and USSR, motivated by the Cold War and the intelligence needs of the period. We also present the approach to machine translation advocated by the Croatian group in Yugoslavia, which is different from the usual logical approaches of the period, and his advocacy of cybernetic methods, which would be adopted as a canon by the mainstream AI community only decades later.

Figures

Figures reproduced from arXiv: 1908.08917 by the authors.

**Figure 1.** Several remarks are in order. First, the group seemed to think that encodings would be needed, but it seems that entropy-based encodings and calculations added no real benefits (i.e. added no benefit that would not be offset by the cost of calculating the codes). In addition, Finka and Laszlo [7] seem to place great emphasis on lemmatization instead of stemming, which, if they had constructed a prototype, they would… view at source ↗

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

30 extracted references · 30 canonical work pages

[27]

C. E. Shannon. A mathematical theory of communication. The Bell System Technical Journal, 27:379–423, 1948

work page 1948
[1]

Alkhouli, G

T. Alkhouli, G. Bretschner, J.-T. Peter, M. Hethnawi, A. Guta, and H. Ney. Alignment-based neural machine translation. In O. Bojar, Ch. Buc, and et al, editors, Proceedings of the First Conference on a Machine Transla- tion, Volume 1: Research Papers, WMT 2016, Berlin, Germany, August 7-12, 2016, pages 54–65. Berlin: Association for Computational Linguist...

work page 2016
[2]

Bahbanau, K

D. Bahbanau, K. H. Cho, and Y. Bengio. Neural machine translation by jointly learning to align and translate. In International Conference on Learning Representations, ICLR 2015, San Diego, CA , 2015

work page 2015
[3]

Bar-Hillel

Y. Bar-Hillel. The present state of research on mechanical translation. American Documentation, 2:229–236, 1951

work page 1951
[4]

Bar-Hillel

Y. Bar-Hillel. Machine translation. Computers and Automation , 2:1–6, 1953

work page 1953
[5]

Descartes

R. Descartes. Selected Correspondence of Descartes . Cambridge:: Early Modern Philosophy, 2017

work page 2017
[6]

B. Finka. Odjeci sp u jugoslaviji. In B. Laszlo and S. Petrovic, editors, Strojno prevodenje i statistika u jeziku , pages 249–260. Zagreb: Naˇ se teme, 1959

work page 1959
[7]

Finka and B

B. Finka and B. Laszlo. Strojno prevodenje i naˇ si neposredni zadaci [ma- chine translation and our immediate tasks]. Jezik, 10:117–121, 1962

work page 1962

Show all 30 references

[8]

Hutchins

J. Hutchins. Yehoshua bar-hillel. a philosopher’s contribution to machine translation. In J. Hutchins, editor, Early years in machine translation , pages 299–312. Amsterdam: John Benjamins, 2000

2000
[9]

J. Lambek. The mathematics of sentence structure. Amer. Math. Monthly, 65:154–170, 1958

1958
[10]

B. Laszlo. Broj u jeziku. In B. Laszlo and S. Petrovic, editors, Strojno prevodenje i statistika u jeziku , pages 224–239. Zagreb: Naˇ se teme, 1959

1959
[11]

Laszlo and S

B. Laszlo and S. Petrovic. Uvod. In B. Laszlo and S. Petrovic, editors, Strojno prevodenje i statistika u jeziku , page 105–298. Zagreb: Naˇ se teme, 1959

1959
[12]

D. D. Lewis. An evaluation of phrasal and clustered representations on a text categorization task. In N. J. Belkin, P. Ingwersen, , and A. M. Pe- jtersen, editors, Proceedings of SIGIR ’92, 15th ACM International Con- ference on Research and Development in Information Retrieva...

1992
[13]

McCulloch and W

W. McCulloch and W. Pitts. A logical calculus of ideas immanent in ner- vous activity. Bulletin of Mathematical Biophysic , 5:115–133, 1943

1943
[14]

V. Mnih, N. Heess, A. Graves, and K. Kavukcuoglu. Recurrent models of visual attention. In Z. Ghahramani and et al, editors, NIPS’14 Proceedings of the 27th International Conference on Neural Information Processing Sys- tems - Volume 2, NIPS 2014, Montreal, Canada, December 08...

2014
[15]

E. N. Gilbert; E. F. Moore. Variable-length binary encodings. The Bell System Technical Journal, 38:933–967, 1959

1959
[16]

M. Mulic. Sp u sssr. In B. Laszlo and S. Petrovic, editors,Strojno prevodenje i statistika u jeziku [Machine Translation and Statistics in Language], pages 213–221. Zagreb: Naˇ se teme, 1959

1959
[17]

P. Norvig. Paradigms of Artiﬁcial Intelligence Programming. San Francisco: Morgan Kaufmann, 1991

1991
[18]

F. J. Och, Ch. Tillmann, and H. Ney. Improved alignment models for statistical machine translation. In H. Schiitze and K-Y. Su, editors, Joint SIGDAT Conference on Empirical Methods in Natural Language Processing and Very Large Corpora, SIGDAT 1999, College Park, MD, USA, June...

1999
[19]

Petrovic

S. Petrovic. Moˇ ze li stroj prevoditi poeziju. In B. Laszlo and S. Petrovic, editors, Strojno prevodenje i statistika u jeziku , pages 177–197. Zagreb: Naˇ se teme, 1959

1959
[20]

Piotrowski and Y

R. Piotrowski and Y. Romanov. Machine translation in the former soviet union and in the newly independent states.Histoire Epistemologie Langage, 21:105–117, 1999

1999
[21]

Pogbrelec

B. Pogbrelec. Poˇ ceci rada na sp. In B. Laszlo and S. Petrovic, editors, Strojno prevodenje i statistika u jeziku , pages 222–223. Zagreb: Naˇ se teme, 1959

1959
[22]

K. Pranjic. Suvremeno stanje sp. In B. Laszlo and S. Petrovic, editors, Strojno prevodenje i statistika u jeziku , pages 224–239. Zagreb: Naˇ se teme, 1959

1959
[23]

H. Putnam. Mathematics, Matter, and Method: Philosophical Papers, Vol
[24]

Cambridge, MA: The MIT Press, 1979

1979
[25]

Russell and P

S. Russell and P. Norvig. Artiﬁcial Intelligence, a Modern Approach . New York: Pearsons, 2009

2009
[26]

Baader; I

F. Baader; I. Horrocks; U. Sattler. Description logics. In F. van Harmelen, V. Lifschitz, and B. Porter, editors,Handbook of Knowledge Representation, pages 135–180. Oxford: Elsevier, 2007. 12

2007
[28]

Spalatin

L. Spalatin. Rjeˇ cnik sinonima kao jezik posrednik. In B. Laszlo and S. Petrovic, editors, Strojno prevodenje i statistika u jeziku , pages 240–248. Zagreb: Naˇ se teme, 1959

1959
[29]

Vogel, S

S. Vogel, S. H. Ney, and H. C. Tillmann. Hmm-based word alignment in statistical translation. In J. Tsujii, editor, 16th International Conference on Computational Linguistics, Proceedings of the Conference, COLING ’96, Copenhagen, Denmark, August 05-09, 1996 , pages 836–841. C...

1996
[30]

N. Wiener. Cybernetics: On Control and Communication in the Animal and the Machine . Cambridge, MA: The MIT Press, 1948. 13

1948

Pith tools

Reviewed August 14, 2026 · model on record in the stance chip above.

[1] [27]

C. E. Shannon. A mathematical theory of communication. The Bell System Technical Journal, 27:379–423, 1948

work page 1948

[2] [1]

Alkhouli, G

T. Alkhouli, G. Bretschner, J.-T. Peter, M. Hethnawi, A. Guta, and H. Ney. Alignment-based neural machine translation. In O. Bojar, Ch. Buc, and et al, editors, Proceedings of the First Conference on a Machine Transla- tion, Volume 1: Research Papers, WMT 2016, Berlin, Germany, August 7-12, 2016, pages 54–65. Berlin: Association for Computational Linguist...

work page 2016

[3] [2]

Bahbanau, K

D. Bahbanau, K. H. Cho, and Y. Bengio. Neural machine translation by jointly learning to align and translate. In International Conference on Learning Representations, ICLR 2015, San Diego, CA , 2015

work page 2015

[4] [3]

Bar-Hillel

Y. Bar-Hillel. The present state of research on mechanical translation. American Documentation, 2:229–236, 1951

work page 1951

[5] [4]

Bar-Hillel

Y. Bar-Hillel. Machine translation. Computers and Automation , 2:1–6, 1953

work page 1953

[6] [5]

Descartes

R. Descartes. Selected Correspondence of Descartes . Cambridge:: Early Modern Philosophy, 2017

work page 2017

[7] [6]

B. Finka. Odjeci sp u jugoslaviji. In B. Laszlo and S. Petrovic, editors, Strojno prevodenje i statistika u jeziku , pages 249–260. Zagreb: Naˇ se teme, 1959

work page 1959

[8] [7]

Finka and B

B. Finka and B. Laszlo. Strojno prevodenje i naˇ si neposredni zadaci [ma- chine translation and our immediate tasks]. Jezik, 10:117–121, 1962

work page 1962