Pith. sign in

REVIEW 3 major objections 5 minor 185 references

The intrinsic motivation of reinforcement and imitation learning for sequential tasks

T0 review · 3 major / 5 minor · reviewed 2026-08-10 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗ Review JSON

Pith's one-line read A single competence-progress measure, weighted by strategy cost, is claimed to unify a robot's choice of task, tutor, and learning strategy.

desk verdict A transparent habilitation synthesis that restates the SGIM progress-based intrinsic-motivation formula from prior papers and is honest about its own main weakness: the cost coefficient κ is an arbitrary constant. read the letter →

arxiv 2412.20573 v1 pith:5KJRUHHG submitted 2024-12-29 cs.AI cs.HCcs.LGcs.RO

Sao Mai Nguyen This is my paper · ORCID
classification cs.AIcs.HCcs.LGcs.RO
keywords intrinsicmotivationactiveimitationlearningsocialguidancecurriculumhierarchicalreinforcementmulti-tasksociallyassistiveroboticsactivitiesofdailyliving
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

This thesis argues that one quantity can drive a robot's entire learning strategy: the recent improvement in the robot's competence on a task, discounted by the cost of the learning method used. The same formula $im(\sigma,\omega)=\kappa(\sigma)\cdot progress(\sigma,\omega)$ is claimed to cover exploring on its own, asking a tutor for a demonstration, choosing among several tutors, and deciding whether to learn a task directly or break it into subtasks. If the claim holds, a robot becomes an active consumer of human guidance instead of a passive receiver of datasets: it decides when to ask, whom to ask, and what kind of help to request, and it keeps learning effectively even when tutors are imperfect. The practical payoff would be faster learning of sequential, compositional tasks with fewer demonstrations, and the same progress measure can drive a robot coach that personalises exercise curricula for human pupils.

What carries the argument

The load-bearing machinery is the cost-weighted competence-progress identity $im(\sigma,\omega)=\kappa(\sigma)\cdot progress(\sigma,\omega)$. Here $progress(\sigma,\omega)$ is the empirical change in competence for goal $\omega$ under strategy $\sigma$ over recent episodes, with competence defined in the multi-task setting as a common reward typically based on the distance between the desired and reached outcome. The identity carries the argument because the same $progress$ term is used to score autonomous action exploration, autonomous outcome-space exploration, autonomous task-decomposition exploration, mimicry of demonstrated actions, emulation of demonstrated goals, and imitation of a demonstrated task decomposition. The cost coefficient $\kappa(\sigma)$ converts teacher availability, willingness, and other interaction costs into a comparable scale, so the learner can choose rationally among strategies that consume very different human or physical resources.

What would settle it

Run the SGIM-PB learner on a fixed hierarchical task set with two tutors, one helpful and one repetitive, while sweeping the autonomous-exploration cost $\kappa$ from much smaller to much larger than the imitation cost. If learning speed and final competence vary sharply across the sweep, the unification claim is only as strong as the cost calibration; a truly unified formulation should be insensitive to that arbitrary constant.

Watch

Extended reading notes

Core claim

The central discovery is a unification claim: one intrinsic-motivation measure based on empirical progress is valid for both autonomous exploration and social guidance, whether the demonstration requested is a low-level policy, a goal, or a decomposition into subgoals. Formally, the thesis proposes $im(\sigma,\omega)=\kappa(\sigma)\cdot progress(\sigma,\omega)$, where $\sigma$ is a learning strategy, $\omega$ a task or goal outcome, $progress$ is measured over the last episodes on that strategy and goal, and $\kappa(\sigma)$ is the cost of the strategy, representing tutor availability and willingness. This turns previously separate decisions — which task to practise, whether to explore or imitate, whether to ask for an action or a goal, and which tutor to consult — into one selection problem in which each (strategy, goal) option is scored by the same estimated reward. The thesis reports that the resulting Socially Guided Intrinsic Motivation (SGIM) algorithms learn multi-task and hierarchical task sets, transfer knowledge across tasks, switch automatically from simple to complex tasks, and remain effective when tutors give poor or repetitive demonstrations. It also argues that the same progress measure supports emerging symbolic task representations, bridging continuous sensorimotor learning and language-like communication with tutors.

Load-bearing premise

The argument rests on being able to choose, for each way of learning, a number that says how expensive that way is; the thesis admits in Section 5.3 that this number was picked arbitrarily in earlier experiments, and picking it badly could undo the promised gains in speed and robustness.

Editorial extensions

If this is right

  • A robot using the progress criterion will automatically order its curriculum: it practises easy tasks early, moves to hierarchical tasks only after their subtasks are mastered, and switches from imitation early in training to autonomous exploration later.
  • Choosing between mimicry and emulation, and between asking for a policy, a goal, or a task decomposition, becomes an empirical question the learner answers from its own progress data rather than a designer's choice.
  • With several tutors, the learner weights each tutor by the competence progress that tutor enables, so it can ignore a poor teacher and concentrate requests on the teacher that is expert for each outcome.
  • The same reward can be applied in an intelligent tutoring system: instead of a fixed exercise schedule, a robot coach selects exercises that maximise each student's progress, and can discover prerequisite relationships between exercises from score data alone.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • Extension: because the formula treats imitation and exploration as strategies with a common currency, one could apply it to a single learner that switches between reinforcement learning and behaviour cloning at the level of neural policies, rather than only the low-level continuous control tasks studied here.
  • Extension: the progress term is a derivative of competence, so the method's practical success should depend on the time scale used to estimate progress; a natural next step is a statistical treatment of progress estimation.
  • Extension: if the cost coefficient were learned from human coaching data instead of set arbitrarily, the model could predict when a human learner asks for help, connecting to models of help-seeking behaviour in education.
  • Extension: placing progress-based selection on top of a reachability-based symbolic abstraction, like the one in the STAR algorithm, would yield a tutor-aware version of goal-conditioned hierarchical reinforcement learning.
Share X Bluesky LinkedIn Reddit HN

Signed reviews

No signed human review yet.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

3 major / 5 minor

Summary. The manuscript is the author's Habilitation à Diriger des Recherches thesis, posted on arXiv, synthesizing roughly a decade of work in developmental cognitive robotics. The central claim is that a single intrinsic-motivation criterion, im(σ,ω)=κ(σ)·progress(σ,ω) (Eqs. 3.1 and 5.1), lets a learner choose its own curriculum by actively selecting the task ω, the learning strategy σ (autonomous exploration versus imitation, low-level actions versus task decomposition), and the tutor from whom to request demonstrations. The thesis reviews the SGIM family of algorithms (SGIM-D, SGIM-ACTS, SGIM-PB), the IM-PB and CHIME architectures for compositional tasks, the STAR hierarchical-RL algorithm, and several applications to socially assistive robotics, and it claims that an active learner is more robust to poor tutors and learns faster with fewer demonstrations. No new experiments are reported; the empirical claims are inherited from the cited papers.

Significance. If the unified criterion works as claimed, it would provide a valuable bridge between reinforcement learning, imitation learning, and hierarchical task decomposition, and it would give a concrete computational model of an active learner that selects teachers and learning strategies. The thesis contains a useful structured survey of active imitation learning, a taxonomy (Table 1.4.1), and a coherent synthesis of the author's previously published algorithms, including STAR's reachability-based spatial abstraction, which carries theoretical suboptimality guarantees. The discussion of rehabilitation and ASD coaching also indicates practical impact. However, the document contains no new experiments, and the formal framework leaves the cost coefficient in the central equation as an arbitrary constant; the claimed empirical advantages are therefore not verified within the manuscript. The significance is conditional on a validation that is currently absent.

major comments (3)
  1. [§5.3, Eqs. (3.1) and (5.1)] Eqs. (3.1) and (5.1) define the central criterion im(σ,ω)=κ(σ)·progress(σ,ω), but §5.3 states that in previous studies κ was 'a constant set arbitrarily'. Because the learner selects strategies by comparing im values, κ is not a harmless normalization: it is the explicit trade-off weight between autonomous exploration, imitation of policies, goals, and task decompositions, and between tutors with different availability and reliability. A poorly chosen κ can change the learner's curriculum and the number of demonstrations requested, so the headline claims of robustness and faster learning are conditional on a parameter the thesis does not justify. A revision should include a sensitivity analysis over κ, a principled estimation procedure, or an explicit removal of the empirical claims from the statement of the contribution.
  2. [Chapters 3 and 4] The manuscript presents no new experimental data; every empirical assertion in Chapters 3 and 4 is a summary of previously published work. The text reports qualitative outcomes, such as 'SGIM-PB outperforms SGIM-ACTS' in §3.4 and robustness to poor demonstrations in §3.3, without effect sizes, error bars, or comparisons in this document. Consequently, the reader cannot independently verify the central 'more robust and faster' claim. The document should either reproduce key experiments, include quantitative summaries of the underlying papers, or be explicitly framed as a review with the unifying equation as the sole new contribution.
  3. [§1.3–§3.5] The core notion progress(σ,ω) is never formally defined in the thesis. Section 1.3.1 defines strategies only as data-collection heuristics, and §3.5 says progress is 'measured through the last episodes' without specifying the estimator, the window size, or how competence is computed for hierarchical goals. Since the same progress measure is used both to define intrinsic motivation and to update the interest map that drives the curriculum, the 'common formulation' is hard to falsify without a precise definition. The thesis should give an explicit definition of progress and state the assumptions under which Eq. (3.1) is a valid reward for strategy selection.
minor comments (5)
  1. [§5.3] The sentence 'this is was considered a constant set arbitrarily' contains a typo ('is was') and should read 'this was considered a constant set arbitrarily'.
  2. [§3.5] The phrase 'may the demonstrations requested to teachers be low-level policies, goals or decomposition into subgoals' is ungrammatical; consider 'whether the demonstrations requested from teachers are low-level policies, goals, or decompositions into subgoals'.
  3. [Table 1.4.1] The column headers 'Environ.', 'Imitation', and 'Query' are ambiguous, and several cells mix 'Low-level', 'Policy', and 'Outcome' without explaining the taxonomy; adding a legend would improve readability.
  4. [Fig. 2.2.2] There are typos in the caption: 'ST AR' should be 'STAR' and 'seperated' should be 'separated'.
  5. [Algo. 2.1.1] The line 'Ensure: partition of outcome spaces R ← F i{Ωi}' is not standard notation and should be defined explicitly, including the condition under which a region is split.

Circularity Check

0 steps flagged · score 0.0 of 10

No significant circularity: the central formulation im = κ·progress is a stated definition summarizing prior published work, not a result derived from its own conclusion; the admitted arbitrary κ is a limitation, not a concealed input.

full rationale

The thesis's central claim is a common formulation of intrinsic motivation, im(σ,ω)=κ(σ)·progress(σ,ω) (Eqs. 3.1/5.1). This is presented as a definition/notation that unifies the author's existing SGIM algorithms, and the empirical support is carried by cited published experiments (e.g., Nguyen and Oudeyer 2012d, Duminy et al. 2021) that compare the active learner against baselines on robot setups. The progress term is an empirical statistic of competence history, and the cost term is explicitly acknowledged in Section 5.3: 'this was considered a constant set arbitrarily.' That admission identifies an unvalidated parameter and a correctness/robustness concern, but it is not a case of fitting a parameter and then calling the output a prediction, nor does any equation reduce to its own input by construction. Self-citations are descriptive of the author's own prior body of work and are not used as an unverified authority to forbid alternatives. Even if one views the unified equation as a post-hoc notation for an existing selection rule, that is a presentational choice rather than a circular derivation. No load-bearing circular step could be quoted from the text, so the appropriate finding is no significant circularity.

Assumptions & free parameters 1 free parameters · 3 assumptions · 0 invented entities

The framework rests on a single free parameter κ(σ), which is admitted to be arbitrary, and on three domain assumptions about demonstration structure, task decomposition, and the validity of internal progress as a learning signal. No new entities such as particles or forces are introduced.

free parameters (1)
  • κ(σ) (cost per strategy) = set arbitrarily in prior studies
    Appears in Eq. 3.1/5.1; the thesis states it represents teacher availability and willingness but was set to a constant without a principled method. This parameter directly scales the intrinsic motivation and therefore affects the curriculum the learner follows.
assumptions (3)
  • domain assumption Human demonstrations carry a beneficial structural bias (e.g., monotonic joint trajectories) that improves generalization.
    Section 3.1 claims human demonstrations are 'smaller, denser and more structured' than robot-generated data, which is an empirical assumption about human movement that may not hold for all tasks or teachers.
  • domain assumption Sequential tasks can be adequately represented as recursive decompositions into parametrised subgoals.
    The SGIM-SAHT and SGIM-PB algorithms rely on this representation (Fig. 2.1.1, Section 2.1.2); if the representation is not rich enough, the claimed transfer from simple to complex tasks fails.
  • domain assumption Competence progress computed from the learner's own success history is a valid proxy for the value of a learning strategy.
    The entire intrinsic motivation framework is built on this assumption, but the thesis does not prove that maximizing internal progress leads to the fastest acquisition of externally verifiable skills.

how reviews work

0 comments
Cite this review

Pith. "Pith review of The intrinsic motivation of reinforcement and imitation learning for sequential tasks." pith.science (2026). https://pith.science/paper/5KJRUHHG

@misc{pith2026241220573,
  author       = {Pith},
  title        = {Pith review of: The intrinsic motivation of reinforcement and imitation learning for sequential tasks},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/5KJRUHHG}},
  note         = {Machine review of arXiv:2412.20573}
}
read the original abstract

This work in the field of developmental cognitive robotics aims to devise a new domain bridging between reinforcement learning and imitation learning, with a model of the intrinsic motivation for learning agents to learn with guidance from tutors multiple tasks, including sequential tasks. The main contribution has been to propose a common formulation of intrinsic motivation based on empirical progress for a learning agent to choose automatically its learning curriculum by actively choosing its learning strategy for simple or sequential tasks: which task to learn, between autonomous exploration or imitation learning, between low-level actions or task decomposition, between several tutors. The originality is to design a learner that benefits not only passively from data provided by tutors, but to actively choose when to request tutoring and what and whom to ask. The learner is thus more robust to the quality of the tutoring and learns faster with fewer demonstrations. We developed the framework of socially guided intrinsic motivation with machine learning algorithms to learn multiple tasks by taking advantage of the generalisability properties of human demonstrations in a passive manner or in an active manner through requests of demonstrations from the best tutor for simple and composing subtasks. The latter relies on a representation of subtask composition proposed for a construction process, which should be refined by representations used for observational processes of analysing human movements and activities of daily living. With the outlook of a language-like communication with the tutor, we investigated the emergence of a symbolic representation of the continuous sensorimotor space and of tasks using intrinsic motivation. We proposed within the reinforcement learning framework, a reward function for interacting with tutors for automatic curriculum learning in multi-task learning.

Figures

Figures reproduced from arXiv: 2412.20573 by the authors.

Figure 1.3
Figure 1.3. 1: The goal is to learn a mapping from the policy space A of the learner and the outcome space Ω. The mapping from the policy space to the outcome space is the forward model, used for predicting the effects of an action. The mapping from the outcome space to the policy space is the inverse model, used to choose the appropriate action to reach the goal. Emulation and mimicry are two types of imitation learning. In em… view at source ↗
Figure 2.1
Figure 2.1. 1: Our goal-oriented representation of sequential tasks decomposes a task into goals of subtasks. Each subtask can then recursively be decomposed into subtasks, to be in fine executed by a policy : m1 is decomposed into (d2, p1). d2 is the decomposed into (b2, v2) Thus a sequential task is in fine realised by a sequence of policies : m1 is realised by the sequence (a1, a2, a3). When learning with a teacher, the lear… view at source ↗
Figure 2.1
Figure 2.1. 2: The algorithmic architecture of SGIM-SAHT SGIM-SAHT chooses an adequate task Ti , i.e. when the input space of LT i includes (s, ωg). Then it applies LT i to find the action a i = LT i(ci). This inference process may be recursive until the output is an action, using the hierarchy between tasks. SGIM-SAHT thus infers from lc a compound action a = [a1, . . . , an] ∈ AN, to be executed by the robot. The trajectory o… view at source ↗
Figures from the paper (14 more)
Figure 2.1
Figure 2.1. Figure 2.1: 3: Top: Experimental setup: a robotic arm, can interact with the different objects in its environment (a pen and two joysticks). Both joysticks enable to control a video-game character (represented in top-right corner). A grey floor limits its motions and can be draw…
Figure 2.1
Figure 2.1. Figure 2.1: 4: Representation of task hierarchy as a sequence of parametrised subgoals. To make a drawing ωg between points (xa, ya) and (xb, yb), a robot can recruit subtasks consisting in (ωi) moving the pen to (xa, ya), then (ωj ) moving the pen to (xb, yb). These subtasks wi…
Figure 2.1
Figure 2.1. Figure 2.1: 5: Experimental setup used: at the center is a mobile robot, the green objects represent movable entities, at the opposite of the red ones. The room is closed. 2.2 STAR : Goal-Conditioned Hierarchical Learning Yet, CHIME still shows limitations for scaling to higher …
Figure 2.2
Figure 2.2. Figure 2.2: 1: Architecture of STAR. The algorithm’s inputs are the initial state s0, the task goal g ∗ , and an initial abstraction N0. STAR runs in a feedback loop a Feudal HRL algorithm (dashed red block) and an abstraction refinement (blue box). The solid red blocks show the…
Figure 2.2
Figure 2.2. Figure 2.2: 3: Frequency of goals visited by the Commander when evaluating a policy learned after 1M, 2M, and 3M timesteps (averaged over 5 different evaluations with 500 maximum timesteps). The subdivision of the mazes represent (abstract) goals. The color gradient represents t…
Figure 3.1
Figure 3.1. Figure 3.1: 1: The robot observes the outcome a, the final position of the ball after its movement. It learns which movement can reach different positions on the floor. The camera is placed above the white surface, and can only see the white surface which materialises the outcom…
Figure 3.1
Figure 3.1. Figure 3.1: 2: Three implementations of the SGIM framework are presented with various illustrative experiments and their corresponding publication, as well as the main hypotheses and results. Each algorithmic architecture allows the agent to take active control of various aspect…
Figure 3.1
Figure 3.1. Figure 3.1: 3: Comparison of the timeline of several learning algorithms : (a) Random exploration of the action space A; (b) autonomous exploration with Reinforcement Learning; (c) Mimicry to reproduce a demonstrated action, received at a fixed frequency; (d) Emulation learning …
Figure 3.4
Figure 3.4. Figure 3.4: 1: Task hierarchy of the Yumi experimental setup : blue lines represent task decomposition for the simulation setup, dashed lines for the physical setup, red lines for the direct inverse model. Both task decomposition and inverse model are learned online. Eg. to move…
Figure 3.4
Figure 3.4. Figure 3.4: 2: Choices of strategy and goal outcome for the SGIM-PB learner during the learning process. Strategies are autonomous exploration of the action space, task decomposition (=procedure), mimicry of actions, or imitation of task decomposition (=procedural teacher). Besi…
Figure 3.4
Figure 3.4. Figure 3.4: 4: Evolution of choices of strategies for the SGIM-PB learner during the learning process on the physical setup. To summarise, SGIM-PB shows the following characteristics : • Hierarchical RL: it learns online task decomposition on 4 levels of hierarchy using the proc…
Figure 4.2
Figure 4.2. Figure 4.2: 1: The robot learns the probabilistic model of exercises from demonstrations using GMM on Riemannian manifolds. The robot assesses the patient’s movements per body part and temporal segment by estimating the likelihood, and gives a feedback after classification of th…
Figure 4.2
Figure 4.2. Figure 4.2: 2: The shared GP-LVM algorithms learn a latent space X from paired data from teacher’s and a patient’s movements, and the parameters W and Φ to translate between each person’s movement space and the latent space. Using Gaussian Mixture Model (GMM) and Gaussian Mixtur…
Figure 5.0
Figure 5.0. Figure 5.0: 1: Fields of our research projects 5.1 Research problem Developmental psychology works such as [Fagard et al., 2016] have started to study the influence of social guidance beyond the learning of simple motor skills, but have researched the learning of hierarchical sk…

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

185 extracted references · 41 canonical work pages

  1. [1]

    Value preserving state-action abstractions

    David Abel, Nate Umbanhowar, Khimya Khetarpal, Dilip Arumugam, Doina Precup, and Michael Littman. Value preserving state-action abstractions. In Silvia Chiappa and Roberto Calandra, editors, Proceedings of the Twenty Third International Conference on Artificial Intelligence and Statistics, volume 108 of Proceedings of Machine Learning Research, pages 1639...

    2020

  2. [2]

    Andry, P

    P. Andry, P. Gaussier, S. Moga, J.P. Banquet, and J. Nadel. Learning and communication via imitation: an autonomous robot perspective. IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans, 31 0 (5): 0 431--442, Sep. 2001. ISSN 1558-2426. doi:10.1109/3468.952717

    arXiv 2001

  3. [4]

    Prerequisite structure discovery for an intelligent tutoring system based on intrinsic motivation

    Louis Annabi and Sao Mai Nguyen. Prerequisite structure discovery for an intelligent tutoring system based on intrinsic motivation. In Intrinsically Motivated Open-ended Learning , Paris, France, September 2023 b . URL https://hal.science/hal-04201624v1

    2023

  4. [5]

    Unsupervised motion retargeting for human-robot imitation

    Louis Annabi, Ziqi Ma, and Sao Mai Nguyen. Unsupervised motion retargeting for human-robot imitation. In Companion of the 2024 ACM/IEEE International Conference on Human-Robot Interaction, HRI '24, pages 587--591. Association for Computing Machinery, March 2024. doi:3610978.3640588. URL doi.acm.org?doi=3610978.3640588

    arXiv 2024

  5. [6]

    A computerized recognition system for the home-based physiotherapy exercises using an rgbd camera

    Ilktan Ar and Yusuf Akgul. A computerized recognition system for the home-based physiotherapy exercises using an rgbd camera. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 22, 05 2014. doi:10.1109/TNSRE.2014.2326254

    work page arXiv 2014

  6. [7]

    M. Arbib. Handbook of Physiology: The Nervous System, II. Motor Control,, chapter Perceptual structures and distributed motor control, pages pp. 1448--1480. MIT Press, Cambridge, MA, USA, 1981

    1981

  7. [8]

    Argall, Sonia Chernova, Manuela Veloso, and Brett Browning

    Brenna D. Argall, Sonia Chernova, Manuela Veloso, and Brett Browning. A survey of robot learning from demonstration. Robotics and Autonomous Systems, 57 0 (5): 0 469 -- 483, 2009. ISSN 0921-8890. doi:10.1016/j.robot.2008.10.024. URL http://www.sciencedirect.com/science/article/pii/S0921889008001772

    doi:10.1016/j.robot.2008.10.024 2009

  8. [9]

    Argall, B

    Brenna D. Argall, B. Browning, and Manuela Veloso. Teacher feedback to scaffold and refine demonstrated motion primitives on a mobile robot. Robotics and Autonomous Systems, 59 0 (3-4): 0 243--255, 2011

    2011

Show all 185 references
  1. [10]

    A survey on interactive reinforcement learning: Design principles and open challenges

    Christian Arzate Cruz and Takeo Igarashi. A survey on interactive reinforcement learning: Design principles and open challenges. In Proceedings of the 2020 ACM Designing Interactive Systems Conference, DIS '20, pages 1195--1209, New York, NY, USA, 2020. Association for Computi...

    2020

  2. [11]

    MacDorman, Hiroshi Ishiguro, and Yasuo Kuniyoshi

    Minoru Asada, Karl F. MacDorman, Hiroshi Ishiguro, and Yasuo Kuniyoshi. Cognitive developmental robotics as a new paradigm for the design of humanoid robots . Robotics and Autonomous Systems, 37 0 (2-3): 0 185--193, 2001. ISSN 09218890. doi:10.1016/S0921-8890(01)00157-9

    2001 doi

  3. [12]

    Cognitive developmental robotics: a survey

    Minoru Asada, Koh Hosoda, Yasuo Kuniyoshi, Hiroshi Ishiguro, Toshio Inui, Yuichiro Yoshikawa, Masaki Ogino, and Chisato Yoshida. Cognitive developmental robotics: a survey. IEEE Transactions on Autonomous Mental Development , 1 0 (1): 0 12--34, 2009. URL http://www.er.ams.eng....

    2009

  4. [13]

    Online human activity recognition employing hierarchical hidden markov models, 2019

    Parviz Asghari, Elnaz Soelimani, and Ehsan Nazerfard. Online human activity recognition employing hierarchical hidden markov models, 2019

    2019

  5. [14]

    M. S. H. Aung , S. Kaltwang , B. Romera-Paredes , B. Martinez , A. Singh , M. Cella , M. Valstar , H. Meng , A. Kemp , M. Shafizadeh , A. C. Elkins , N. Kanakam , A. de Rothschild , N. Tyler , P. J. Watson , A. C. d. C. Williams , M. Pantic , and N. Bianchi-Berthouze . The aut...

    2016

  6. [15]

    Social learning theory, 1971

    Albert Bandura. Social learning theory, 1971

    1971

  7. [16]

    Barto and Sridhar Mahadevan

    Andrew G. Barto and Sridhar Mahadevan. Recent advances in hierarchical reinforcement learning. Discrete Event Dynamic Systems, 13 0 (1): 0 41--77, Jan 2003. ISSN 1573-7594. doi:10.1023/A:1022140919877. URL https://doi.org/10.1023/A:1022140919877

    2003 doi

  8. [17]

    Behavioral hierarchy: exploration and representation

    Andrew G Barto, George Konidaris, and Christopher Vigorito. Behavioral hierarchy: exploration and representation. In Computational and robotic models of the hierarchical organization of behavior, pages 13--46. Springer, 2013

    2013

  9. [18]

    Katarina Begus and Victoria Southgate. Active Learning from Infancy to Childhood, chapter Curious Learners: How Infants' Motivation to Learn Shapes and Is Shaped by Infants' Interactions with the Social World, pages 13--37. Springer International Publishing, Cham, 2018. ISBN 9...

    2018 doi

  10. [19]

    Infants' preferences for native speakers are associated with an expectation of information

    Katarina Begus, Teodora Gliga, and Victoria Southgate. Infants' preferences for native speakers are associated with an expectation of information. Proceedings of the National Academy of Sciences, 113 0 (44): 0 12397--12402, 2016. ISSN 0027-8424. doi:10.1073/pnas.1603261113. UR...

    2016 doi

  11. [20]

    Curriculum learning

    Yoshua Bengio, J \'e r\^ o me Louradour, Ronan Collobert, and Jason Weston. Curriculum learning. In Proceedings of the 26th Annual International Conference on Machine Learning, ICML '09, pages 41--48, New York, NY, USA, 2009. ACM. ISBN 978-1-60558-516-1. doi:10.1145/1553374.15...

    2009

  12. [21]

    Siegward

    Aude Billard and R. Siegward. Robot learning from demonstration. Robotics and Autonomous Systems, 47 0 (2-3): 0 65--67, June 2004

    2004

  13. [22]

    Handbook of Robotics, chapter Robot Programming by Demonstration

    Aude Billard, Sylvain Calinon, Ruediger Dillmann, and Stefan Schaal. Handbook of Robotics, chapter Robot Programming by Demonstration. Number 59. MIT Press, 2007

    2007

  14. [23]

    Technical feasibility of supervision of stretching exercises by a humanoid robot coach for chronic low back pain: The r-cool randomized trial

    Agathe Blanchard, Sao Mai Nguyen, Maxime Devanne, Mathieu Simonnet, Myriam Le Goff-Pronost, and Olivier Remy-Neris. Technical feasibility of supervision of stretching exercises by a humanoid robot coach for chronic low back pain: The r-cool randomized trial. BioMed Research In...

    2022 doi

  15. [24]

    Generative Pretrained Embedding and Hierarchical Irregular Time Series Representation for Daily Living Activity Recognition, pages 4764 -- 4771

    Damien Bouchabou and Sao Mai Nguyen. Generative Pretrained Embedding and Hierarchical Irregular Time Series Representation for Daily Living Activity Recognition, pages 4764 -- 4771. IOS Press, October 2024. ISBN 9781643685489. doi:10.3233/faia241075. URL http://dx.doi.org/10.3...

    2024 doi

  16. [25]

    Fully convolutional network bootstrapped by word encoding and embedding for activity recognition in smart homes

    Damien Bouchabou, Sao Mai Nguyen, Christophe Lohr, Benoit LeDuc, and Ioannis Kanellos. Fully convolutional network bootstrapped by word encoding and embedding for activity recognition in smart homes. In Xiaoli Li, Min Wu, Zhenghua Chen, and Le Zhang, editors, Deep Learning for...

    2021 doi

  17. [26]

    Using language model to bootstrap human activity recognition ambient sensors based in smart homes

    Damien Bouchabou, Sao Mai Nguyen, Christophe Lohr, Benoit LeDuc, and Ioannis Kanellos. Using language model to bootstrap human activity recognition ambient sensors based in smart homes. Electronics, 10 0 (20), 2021 b . ISSN 2079-9292. doi:10.3390/electronics10202498. URL https...

    2021 doi

  18. [27]

    A survey of human activity recognition in smart homes based on iot sensors algorithms: Taxonomies, challenges, and opportunities with deep learning

    Damien Bouchabou, Sao Mai Nguyen, Christophe Lohr, Benoit LeDuc, and Ioannis Kanellos. A survey of human activity recognition in smart homes based on iot sensors algorithms: Taxonomies, challenges, and opportunities with deep learning. Sensors, 21 0 (18): 0 6037, sep 2021 c . ...

    2021 doi

  19. [28]

    What if time, or past context, improved human activity recognition in smart homes? In IEEE ICCE, Da Nang, Viet Nam, 2022

    Damien Bouchabou, Sao Mai Nguyen, Christophe Lohr, Benoit Leduc, and Ioannis Kanellos. What if time, or past context, improved human activity recognition in smart homes? In IEEE ICCE, Da Nang, Viet Nam, 2022

    2022

  20. [29]

    A smart home digital twin to support the recognition of activities of daily living

    Damien Bouchabou, Juliette Grosset, Sao Mai Nguyen, Christophe Lohr, and Xavier Puig. A smart home digital twin to support the recognition of activities of daily living. Sensors, 23 0 (17): 0 7586, sep 2023 a . doi:10.3390/s23177586

    2023 doi

  21. [30]

    Reconnaissance d'activit \'e s de la vie quotidienne au moyen de capteurs domotiques et d'apprentissage profond: lorsque syntaxe, s \'e mantique et contexte se rencontrent

    Damien Bouchabou, Sao Mai Nguyen, Christophe Lohr, Ioannis Kanellos, and Benoit LeDuc. Reconnaissance d'activit \'e s de la vie quotidienne au moyen de capteurs domotiques et d'apprentissage profond: lorsque syntaxe, s \'e mantique et contexte se rencontrent. Revue Ouverte d'I...

    2023 doi

  22. [31]

    Representation of irregularly sampled time series with generative language models for classification and transfer learning: a case study in activities of daily living recognition

    Damien Bouchabou, Sao Mai Nguyen, Christophe Lohr, Benoit Leduc, and Ioannis Kanellos. Representation of irregularly sampled time series with generative language models for classification and transfer learning: a case study in activities of daily living recognition. In Machine...

    2023

  23. [32]

    Scassellati

    Cynthia Breazeal and B. Scassellati. Robots that imitate humans. Trends in Cognitive Sciences, 6 0 (11): 0 481--487, 2002

    2002

  24. [33]

    R. A. Brooks. Intelligence without representation. Artificial Intelligence, 47: 0 139--160, 1991

    1991

  25. [34]

    Robot Programming by Demonstration: A Probabilistic Approach

    Sylvain Calinon. Robot Programming by Demonstration: A Probabilistic Approach. EPFL/CRC Press, 2009. EPFL Press ISBN 978-2-940222-31-5, CRC Press ISBN 978-1-4398-0867-2

    2009

  26. [35]

    Call and M

    J. Call and M. Carpenter. Imitation in animals and artifacts, chapter Three sources of information in social learning, pages 211--228. Cambridge, MA: MIT Press., 2002

    2002

  27. [36]

    Cognitive Robotics

    Angelo Cangelosi and Minoru Asada. Cognitive Robotics. The MIT Press, 2022. doi:https://doi.org/10.7551/mitpress/13780.001.0001

    2022 doi

  28. [37]

    Developmental robotics: From babies to robots

    Angelo Cangelosi and Matthew Schlesinger. Developmental robotics: From babies to robots. MIT press, Cambridge, MA, USA, 2015. URL https://idoc.pub/documents/developmental-robotics-from-babies-to-robots-d47ey87vq2n2

    2015

  29. [38]

    The kimore dataset: Kinematic assessment of movement and clinical scores for remote monitoring of physical rehabilitation

    Marianna Capecci, Maria Gabriella Ceravolo, Francesco Ferracuti, Sabrina Iarlori, Andrea Monteri \`u , Luca Romeo, and Federica Verdini. The kimore dataset: Kinematic assessment of movement and clinical scores for remote monitoring of physical rehabilitation. IEEE Transactions...

    2019

  30. [39]

    Interactive policy learning through confidence-based autonomy

    Sonia Chernova and Manuela Veloso. Interactive policy learning through confidence-based autonomy. Journal of Artificial Intelligence Research, 34 0 (1): 0 1, 2009

    2009

  31. [40]

    Deep reinforcement learning from human preferences

    Paul F Christiano, Jan Leike, Tom Brown, Miljan Martic, Shane Legg, and Dario Amodei. Deep reinforcement learning from human preferences. In I. Guyon, U. Von Luxburg, S. Bengio, H. Wallach, R. Fergus, S. Vishwanathan, and R. Garnett, editors, Advances in Neural Information Pro...

    2017

  32. [41]

    On Integrating Apprentice Learning and Reinforcement Learning

    Jeffrey Allen Clouse. On Integrating Apprentice Learning and Reinforcement Learning. PhD thesis, University of Massachissetts Amherst, 1996

    1996

  33. [42]

    D. A. Cohn, Z. Ghahramani, and M. I. Jordan. Active learning with statistical models. J. Artif. Intell. Res.,, 4: 0 129--145, 1996

    1996

  34. [43]

    CURIOUS : Intrinsically motivated modular multi-goal reinforcement learning

    C \'e dric Colas, Pierre Fournier, Mohamed Chetouani, Olivier Sigaud, and Pierre-Yves Oudeyer. CURIOUS : Intrinsically motivated modular multi-goal reinforcement learning. In Kamalika Chaudhuri and Ruslan Salakhutdinov, editors, Proceedings of the 36th International Conference...

    2019

  35. [44]

    Casas: A smart home in a box

    Diane J Cook, Aaron S Crandall, Brian L Thomas, and Narayanan C Krishnan. Casas: A smart home in a box. Computer, 46 0 (7): 0 62--69, 2012

    2012

  36. [45]

    Teleological and referential understanding of action in infancy

    Gergely Csibra. Teleological and referential understanding of action in infancy. Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences, 358 0 (1431): 0 447, 2003

    2003

  37. [46]

    Kerstin Dautenhahn and Chrystopher L. Nehaniv. Imitation in Animals and Artifacts. MIT Press, 2002

    2002

  38. [47]

    Kaspar--a minimally expressive humanoid robot for human--robot interaction research

    Kerstin Dautenhahn, Chrystopher L Nehaniv, Michael L Walters, Ben Robins, Hatice Kose-Bagci, N Assif Mirza, and Mike Blow. Kaspar--a minimally expressive humanoid robot for human--robot interaction research. Applied Bionics and Biomechanics, 6 0 (3-4): 0 369--397, 2009

    2009

  39. [48]

    Feudal reinforcement learning

    Peter Dayan and Geoffrey E Hinton. Feudal reinforcement learning. In S. Hanson, J. Cowan, and C. Giles, editors, Advances in Neural Information Processing Systems, volume 5. Morgan-Kaufmann, 1992. URL https://proceedings.neurips.cc/paper/1992/file/d14220ee66aeec73c49038385428e...

    1992

  40. [49]

    Multi-level motion analysis for physical exercises assessment in kinaesthetic rehabilitation

    Maxime Devanne and Sao Mai Nguyen. Multi-level motion analysis for physical exercises assessment in kinaesthetic rehabilitation. In IEEE, editor, International Conference on Humanoid Robots (Humanoids), 2017. doi:10.1109/HUMANOIDS.2017.8246923. URL https://hal.science/hal-0188...

    2017

  41. [50]

    Generating shared latent variables for robots to imitate human movements and understand their physical limitations

    Maxime Devanne and Sao Mai Nguyen. Generating shared latent variables for robots to imitate human movements and understand their physical limitations. In Laura Leal-Taix \'e and Stefan Roth, editors, Computer Vision -- ECCV 2018 Workshops, pages 190--197, Cham, 2019. Springer ...

    2018 doi

  42. [51]

    A co-design approach for a rehabilitation robot coach for physical rehabilitation based on the error classification of motion errors

    Maxime Devanne, Sao Mai Nguyen, Olivier Remy-Neris, B \'e atrice Le Gales-Garnett, Gilles Kermarrec, and Andr \'e Thepaut. A co-design approach for a rehabilitation robot coach for physical rehabilitation based on the error classification of motion errors. In IEEE Internationa...

    2018

  43. [52]

    Recognition of activities of daily living via hierarchical long-short term memory networks

    Maxime Devanne, Panagiotis Papadakis, and Sao Mai Nguyen. Recognition of activities of daily living via hierarchical long-short term memory networks. In International Conference on Systems, Man and Cybernetics (SMC), pages 3318--3324. IEEE, July 2019. doi:10.1109/SMC.2019.8914...

    2019

  44. [53]

    The toronto rehab stroke pose dataset to detect compensation during stroke rehabilitation therapy

    Elham Dolatabadi, Ying Xuan Zhi, Bing Ye, Marge Coahran, Giorgia Lupinacci, Alex Mihailidis, Rosalie Wang, and Babak Taati. The toronto rehab stroke pose dataset to detect compensation during stroke rehabilitation therapy. In Proceedings of the 11th EAI International Conferenc...

    2017

  45. [54]

    Roijers, Beno \^ t Girard, Nicolas Perrin, and Olivier Sigaud

    Stephane Doncieux, David Filliat, Natalia D \' az-Rodr \' guez, Timothy Hospedales, Richard Duro, Alexandre Coninx, Diederik M. Roijers, Beno \^ t Girard, Nicolas Perrin, and Olivier Sigaud. Open-ended learning: A conceptual framework based on representational redescription. F...

    2018

  46. [55]

    Strategic and interactive learning of a hierarchical set of tasks by the Poppy humanoid robot

    Nicolas Duminy, Sao Mai Nguyen, and Dominique Duhaut. Strategic and interactive learning of a hierarchical set of tasks by the Poppy humanoid robot . In ICDL-EPIROB 2016 : 6th Joint IEEE International Conference Developmental Learning and Epigenetic Robotics, pages 204--209, S...

    2016

  47. [56]

    Learning sequences of policies by using an intrinsically motivated learner and a task hierarchy

    Nicolas Duminy, Alexandre Manoury, Sao Mai Nguyen, C \'e dric Buche, and Dominique Duhaut. Learning sequences of policies by using an intrinsically motivated learner and a task hierarchy. In Workshop on Continual Unsupervised Sensorimotor Learning, ICDL-EpiRob, Tokyo, Japan, S...

    2018

  48. [57]

    Effects of social guidance on a robot learning sequences of policies in hierarchical learning

    Nicolas Duminy, Sao Mai Nguyen, and Dominique Duhaut. Effects of social guidance on a robot learning sequences of policies in hierarchical learning. In IEEE, editor, International Conference on Systems Man and Cybernetics, 2018 b . doi:10.1109/SMC.2018.00636. URL https://hal.s...

    2018

  49. [58]

    Learning a set of interrelated tasks by using sequences of motor policies for a strategic intrinsically motivated learner

    Nicolas Duminy, Sao Mai Nguyen, and Dominique Duhaut. Learning a set of interrelated tasks by using sequences of motor policies for a strategic intrinsically motivated learner. In Proceedings of IEEE International Conference on Robotic Computing, 2018 c . doi:doi:10.1109/IRC.2...

    2018

  50. [59]

    Learning a set of interrelated tasks by using a succession of motor policies for a socially guided intrinsically motivated learner

    Nicolas Duminy, Sao Mai Nguyen, and Dominique Duhaut. Learning a set of interrelated tasks by using a succession of motor policies for a socially guided intrinsically motivated learner. Frontiers in Neurorobotics, 12: 0 87, 2019. ISSN 1662-5218. doi:10.3389/fnbot.2018.00087. U...

    2019

  51. [60]

    Intrinsically motivated open-ended multi-task learning using transfer learning to discover task hierarchy

    Nicolas Duminy, Sao Mai Nguyen, Junshuai Zhu, Dominique Duhaut, and Jerome Kerdreux. Intrinsically motivated open-ended multi-task learning using transfer learning to discover task hierarchy. Applied Sciences, 11 0 (3), 2021. ISSN 2076-3417. doi:10.3390/app11030975. URL https:...

    2021 doi

  52. [61]

    How the mind creates structure: Hierarchical learning of action sequences

    Maria K Eckstein and Anne G E Collins. How the mind creates structure: Hierarchical learning of action sequences. In Cognitive Science Society, editor, CogSci Conference of the Cognitive Science Society, volume 43, pages 618--624, 2021

    2021

  53. [62]

    Search on the replay buffer: Bridging planning and reinforcement learning

    Ben Eysenbach, Ruslan Salakhutdinov, and Sergey Levine. Search on the replay buffer: Bridging planning and reinforcement learning. In NeurIPS, pages 15220--15231, 2019

    2019

  54. [63]

    Jacqueline Fagard, Lauriane Rat-Fischer, Rana Esseily, Eszter Somogyi, and J. K. O'Regan. What does it take for an infant to learn how to use a tool by observation? Frontiers in Psychology, 7, March 2016. ISSN 1664-1078. doi:10.3389/fpsyg.2016.00267. URL http://dx.doi.org/10.3...

    2016

  55. [64]

    V. Fedorov. Theory of Optimal Experiment. Academic Press, Inc., New York, NY, 1972

    1972

  56. [65]

    Clic: Curriculum learning and imitation for object control in non-rewarding environments

    Pierre Fournier, C \'e dric Colas, Olivier Sigaud, and Mohamed Chetouani. Clic: Curriculum learning and imitation for object control in non-rewarding environments. IEEE Transactions on Cognitive and Developmental Systems, pages 1--1, 2019. ISSN 2379-8920. doi:10.1109/TCDS.2019...

    2019

  57. [66]

    El-Yacoubi, and Ons Jelassi

    Qi Gan, Sao Mai Nguyen, Eric Fenaux, Stephan Clemencon, Mounim A. El-Yacoubi, and Ons Jelassi. Reconstruction of trajectories of athletes using computer vision models and kinetic analysis. In MIT Sloan Sports Analytics Conference, 2023

    2023

  58. [67]

    El-Yacoubi, Eric Fenaux, and Stephan Clemencon

    Qi Gan, Sao Mai Nguyen, Mounim A. El-Yacoubi, Eric Fenaux, and Stephan Clemencon. Human pose estimation based biomechanical feature extraction for long jumps. In Human System Interaction, 2024

    2024

  59. [68]

    Towards deep symbolic reinforcement learning, 2016

    Marta Garnelo, Kai Arulkumaran, and Murray Shanahan. Towards deep symbolic reinforcement learning, 2016

    2016

  60. [69]

    Learning actionable representations with goal conditioned policies

    Dibya Ghosh, Abhishek Gupta, and Sergey Levine. Learning actionable representations with goal conditioned policies. In International Conference on Learning Representations, 2019. URL https://openreview.net/forum?id=Hye9lnCct7

    2019

  61. [70]

    J.J. Gibson. The Ecological Approach to Visual Perception, chapter The Theory of Affordances, pages 67--82. Houghton Mifflin, Boston, MA, USA, 1979

    1979

  62. [71]

    Information-seeking, curiosity, and attention: computational and neural mechanisms

    Jacqueline Gottlieb, Pierre-Yves Oudeyer, Manuel Lopes, and Adrien Baranes. Information-seeking, curiosity, and attention: computational and neural mechanisms. Trends in Cognitive Sciences, 17 0 (11): 0 585--593, 10 2013. doi:10.1016/j.tics.2013.09.001. URL https://doi.org/10....

    2013 doi

  63. [72]

    Grafton and Antonia F

    Scott T. Grafton and Antonia F. de C. Hamilton . Evidence for a distributed hierarchy of action representation in the brain. Human Movement Science, 26 0 (4): 0 590--616, 2007. ISSN 0167-9457. doi:https://doi.org/10.1016/j.humov.2007.05.009. URL https://www.sciencedirect.com/s...

    2007 doi

  64. [73]

    Evidential fusion of sensor data for activity recognition in smart homes

    Xin Hong, Chris Nugent, Maurice Mulvenna, Sally McClean, Bryan Scotney, and Steven Devlin. Evidential fusion of sensor data for activity recognition in smart homes. Pervasive and Mobile Computing, 5 0 (3): 0 236 -- 252, 2009. ISSN 1574-1192. doi:https://doi.org/10.1016/j.pmcj....

    2009 doi

  65. [74]

    McIlraith

    Le \' o n Illanes, Xi Yan, Rodrigo Toro Icarte, and Sheila A. McIlraith. Symbolic plans as high-level instructions for reinforcement learning. Proceedings of the International Conference on Automated Planning and Scheduling, 30: 0 540--550, jun 2020. doi:10.1609/icaps.v30i1.6750

    2020 doi

  66. [75]

    Object learning through active exploration

    Serena Ivaldi, Sao Mai Nguyen, Natalia Lyubova, Alain Droniou, Vincent Padois, David Filliat, Pierre-Yves Oudeyer, and Olivier Sigaud. Object learning through active exploration. Transactions on Autonomous Mental Development, PP 0 (99): 0 1--1, 2013. ISSN 1943-0604. doi:10.110...

    2013

  67. [76]

    Bridging natural language and emergent representation in hierarchical reinforcement learning

    Zihe Ji, Sao Mai Nguyen, and Mehdi Zadem. Bridging natural language and emergent representation in hierarchical reinforcement learning. In Intrinsically-Motivated and Open-Ended Learning Workshop @NeurIPS2024, 2024 a . URL https://openreview.net/forum?id=HMJJ10SAFy

    2024

  68. [77]

    Llm to bridge human instructions with a dynamic symbolic representation in hierarchical reinforcement learning

    Zihe Ji, Mehdi Zadem, and Sao Mai Nguyen. Llm to bridge human instructions with a dynamic symbolic representation in hierarchical reinforcement learning. In NeurIPS 2024 Workshop on Behavioral Machine Learning, 2024 b . URL https://openreview.net/forum?id=GNVfcHACC6

    2024

  69. [78]

    Dynamic symbolic representation and LLM to enhance task abstraction in hierarchical reinforcement learning

    Zihe Ji, Mehdi Zadem, and Sao Mai Nguyen. Dynamic symbolic representation and LLM to enhance task abstraction in hierarchical reinforcement learning. In NeurIPS 2024 Workshop on Compositional Learning: Perspectives, Methods, and Paths Forward, 2024 c . URL https://openreview.n...

    2024

  70. [79]

    The body in the mind: The bodily basis of meaning, imagination, and reason

    Mark Johnson. The body in the mind: The bodily basis of meaning, imagination, and reason. University of Chicago Press, 1987

    1987

  71. [80]

    Goliah (gaming open library for intervention in autism at home): a 6-month single blind matched controlled exploratory study

    Anne-Lise Jouen, Antonio Narzisi, Jean Xavier, Elodie Tilmont, Nicolas Bodeau, Valentina Bono, Nabila Ketem-Premel, Salvatore Anzalone, Koushik Maharatna, Mohamed Chetouani, Filippo Muratori, and David Cohen. Goliah (gaming open library for intervention in autism at home): a 6...

    2017 doi

  72. [81]

    Fern, Thomas G

    Kshitij Judah, Alan P. Fern, Thomas G. Dietterich, and Prasad Tadepalli. Active imitation learning: Formal and practical reductions to i.i.d. learning. Journal of Machine Learning Research, 15 0 (120): 0 4105--4143, 2014. URL http://jmlr.org/papers/v15/judah14a.html

    2014

  73. [82]

    Mirroring effect in 2- and 3-year-olds with autism spectrum disorder

    Masatoshi Katagiri, Naoko Inada, and Yoko Kamio. Mirroring effect in 2- and 3-year-olds with autism spectrum disorder. Research in Autism Spectrum Disorders, 4 0 (3): 0 474 -- 478, 2010. ISSN 1750-9467. doi:https://doi.org/10.1016/j.rasd.2009.11.004. URL http://www.sciencedire...

    2010 doi

  74. [83]

    Assessing self-maintenance: activities of daily living, mobility, and instrumental activities of daily living

    Sidney Katz. Assessing self-maintenance: activities of daily living, mobility, and instrumental activities of daily living. Journal of the American Geriatrics Society, 31 0 (12): 0 721--727, 1983

    1983

  75. [84]

    e s, Fabrice Gzil, Ben Hicks, Anthea Innes, Sao Mai Nguyen, Louise Nyg rd, Maribel Pino, Guillaume Sacco, Eric Salmon, Henri \

    Paul-Ariel Kenigsberg, Jean-Pierre Aquino, Alain B \'e rard, Fran c ois Br \'e mond, Kevin Charras, Tom Dening, Rose-Marie Dro \"e s, Fabrice Gzil, Ben Hicks, Anthea Innes, Sao Mai Nguyen, Louise Nyg rd, Maribel Pino, Guillaume Sacco, Eric Salmon, Henri \"e tte van der Roest, ...

    2017

  76. [85]

    Bradley Knox, Peter Stone, and Cynthia Breazeal

    W. Bradley Knox, Peter Stone, and Cynthia Breazeal. Training a Robot via Human Feedback: A Case Study, pages 460--470. Springer International Publishing, 2013. ISBN 9783319026756. doi:10.1007/978-3-319-02675-6_46. URL http://dx.doi.org/10.1007/978-3-319-02675-6_46

    2013 doi

  77. [86]

    Hideki Kozima, Marek P Michalowski, and Cocoro Nakagawa. Keepon. International Journal of Social Robotics, 1 0 (1): 0 3--18, 2009

    2009

  78. [87]

    Krakauer and Reza Shadmehr

    John W. Krakauer and Reza Shadmehr. Towards a computational neuropsychology of action. In Paul Cisek, Trevor Drew, and John F. Kalaska, editors, Computational Neuroscience: Theoretical Insights into Brain Function, volume 165 of Progress in Brain Research, pages 383 -- 394. El...

    2007 doi

  79. [88]

    Combining social and intrinsically motivated learning for multitask robot skill acquisition

    Thibaut Kulak and Sylvain Calinon. Combining social and intrinsically motivated learning for multitask robot skill acquisition. IEEE Transactions on Cognitive and Developmental Systems, 15 0 (2): 0 385--394, June 2023. ISSN 2379-8939. doi:10.1109/TCDS.2021.3069341

    2023

  80. [89]

    Hierarchical deep reinforcement learning: Integrating temporal abstraction and intrinsic motivation

    Tejas D Kulkarni, Karthik Narasimhan, Ardavan Saeedi, and Josh Tenenbaum. Hierarchical deep reinforcement learning: Integrating temporal abstraction and intrinsic motivation. In D. D. Lee, M. Sugiyama, U. V. Luxburg, I. Guyon, and R. Garnett, editors, Advances in Neural Inform...

    2016

  81. [90]

    Benchmarking human motion analysis using kinect one: An open source dataset

    Daniel Leightley, Moi Hoon Yap, Jessica Coulson, Yoann Barnouin, and Jamie S McPhee. Benchmarking human motion analysis using kinect one: An open source dataset. In 2015 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA), pages 1--...

    2015

  82. [91]

    Active hierarchical exploration with stable subgoal representation learning

    Siyuan Li, Jin Zhang, Jianhao Wang, Yang Yu, and Chongjie Zhang. Active hierarchical exploration with stable subgoal representation learning. In International Conference on Learning Representations, 2022. URL https://openreview.net/forum?id=sNuFKTMktcY

    2022

  83. [92]

    Blending imitation and reinforcement learning for robust policy improvement

    Xuefeng Liu, Takuma Yoneda, Rick Stevens, Matthew Walter, and Yuxin Chen. Blending imitation and reinforcement learning for robust policy improvement. In The Twelfth International Conference on Learning Representations, 2024. URL https://openreview.net/forum?id=eJ0dzPJq1F

    2024

  84. [93]

    From Motor to Interaction Learning in Robots, chapter Abstraction Levels for Robotic Imitation: Overview and Computational Approaches

    Manuel Lopes, Francisco Melo, Luis Montesano, and Jose Santos-Victor. From Motor to Interaction Learning in Robots, chapter Abstraction Levels for Robotic Imitation: Overview and Computational Approaches. Springer, 2009

    2009

  85. [94]

    Lungarella, Giorgio Metta, R

    M. Lungarella, Giorgio Metta, R. Pfeifer, and Giulio Sandini. Developmental robotics: a survey. Connection Science, 15 0 (4): 0 151--190, 2003

    2003

  86. [95]

    What matters in learning from offline human demonstrations for robot manipulation

    Ajay Mandlekar, Danfei Xu, Josiah Wong, Soroush Nasiriany, Chen Wang, Rohun Kulkarni, Li Fei-Fei, Silvio Savarese, Yuke Zhu, and Roberto Mart \' n-Mart \' n. What matters in learning from offline human demonstrations for robot manipulation. arXiv preprint arXiv:2108.03298, 2021

    2021 arXiv

  87. [96]

    Chime: An adaptive hierarchical representation for continuous intrinsically motivated exploration

    Alexandre Manoury, Sao Mai Nguyen, and C \'e dric Buche. Chime: An adaptive hierarchical representation for continuous intrinsically motivated exploration. In IEEE, editor, International Robotics Conference, pages 167--170, February 2019 a . doi:10.1109/IRC.2019.00032

    2019

  88. [97]

    Hierarchical affordance discovery using intrinsic motivation

    Alexandre Manoury, Sao Mai Nguyen, and C\' e dric Buche. Hierarchical affordance discovery using intrinsic motivation. In Proceedings of the 7th International Conference on Human-Agent Interaction, HAI '19, pages 186--193, New York, NY, USA, 2019 b . Association for Computing ...

    2019

  89. [98]

    Analyzing data efficiency and performance of machine learning algorithms for assessing low back pain physical rehabilitation exercises

    Aleksa Marusic, Louis Annabi, Sao Mai Nguyen, and Adriana Tapus. Analyzing data efficiency and performance of machine learning algorithms for assessing low back pain physical rehabilitation exercises. In ACM/IEEE, editor, European Conference on Mobile Robots, 2023 a . doi:10.1...

    2023

  90. [99]

    Evaluating kinect, openpose and blazepose for human body movement analysis on a low back pain physical rehabilitation dataset

    Aleksa Marusic, Sao Mai Nguyen, and Adriana Tapus. Evaluating kinect, openpose and blazepose for human body movement analysis on a low back pain physical rehabilitation dataset. In Companion of the 2023 ACM/IEEE International Conference on Human-Robot Interaction, HRI '23, pag...

    2023

  91. [100]

    Physioformer: A spatio-temporal transformer for physical rehabilitation assessmen

    Aleksa Marusic, Sao Mai Nguyen, and Adriana Tapus. Physioformer: A spatio-temporal transformer for physical rehabilitation assessmen. In ICSR, 2024

    2024

  92. [101]

    Intellirehabds (irds) - a dataset of physical rehabilitation movements

    Alina Dana Miron, Noureddin M Sadawi, Waidah Ismail, Hafez Hussain, and Crina Grosan. Intellirehabds (irds) - a dataset of physical rehabilitation movements. Data, 6: 0 46, 2021

    2021

  93. [102]

    Mitriakov , P

    A. Mitriakov , P. Papadakis , Sao Mai Nguyen, and S. Garlatti . Staircase negotiation learning for articulated tracked robots with varying degrees of freedom. In 2020 IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR), pages 394--400, Nov 2020. doi:10...

    2020

  94. [103]

    Learning-based modelling of physical interaction for assistive robots

    Andrei Mitriakov, Panagiotis Papadakis, Sao Mai Nguyen, and Serge Garlatti. Learning-based modelling of physical interaction for assistive robots. Journ \'e es Francophones sur la Planification, la D \'e cision et l'Apprentissage pour la conduite de syst \`e mes (JFPDA), July ...

    2019

  95. [104]

    Staircase traversal via reinforcement learning for active reconfiguration of assistive robots

    Andrei Mitriakov, Panagiotis Papadakis, Sao Mai Nguyen, and Serge Garlatti. Staircase traversal via reinforcement learning for active reconfiguration of assistive robots. In 2020 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE), pages 1--8, July 2020. doi:10.1109/FUZ...

    2020

  96. [105]

    The role of intrinsic motivations in early vocal development: a computational study

    Clement Moulin-Frier, Sao Mai Nguyen, and Pierre-Yves Oudeyer. The role of intrinsic motivations in early vocal development: a computational study. In Workshop on Intrinsic Motivations, Rome, Italy, June 2013

    2013

  97. [106]

    Self-organization of early vocal development in infants and machines: The role of intrinsic motivation

    Cl \'e ment Moulin-Frier, Sao Mai Nguyen, and Pierre-Yves Oudeyer. Self-organization of early vocal development in infants and machines: The role of intrinsic motivation. Frontiers in Psychology, 4 0 (1006), 2014. ISSN 1664-1078. doi:10.3389/fpsyg.2013.01006. URL https://inria...

    2014

  98. [107]

    Near-optimal representation learning for hierarchical reinforcement learning

    Ofir Nachum, Shixiang Gu, Honglak Lee, and Sergey Levine. Near-optimal representation learning for hierarchical reinforcement learning. In 7th International Conference on Learning Representations, ICLR 2019, New Orleans, LA, USA, May 6-9, 2019 . OpenReview.net, 2019. URL https...

    2019

  99. [108]

    Nadel, A

    J. Nadel, A. Revel, P. Andry, and Ph. Gaussier. Toward communication: First imitations in infants, low-functioning children with autism and robots. Interaction Studies, 5 0 (1): 0 45--74, 2004. URL http://publi-etis.ensea.fr/2004/NRAG04

    2004

  100. [109]

    L'autisme, chapter Imitation et austisme

    Jacqueline Nadel. L'autisme, chapter Imitation et austisme. Apr 2005

    2005

  101. [110]

    Guest editorial special issue on continual unsupervised sensorimotor learning

    Nicol \'a s Navarro-Guerrero, Sao Mai Nguyen, Erhan Oztop, and Junpei Zhong. Guest editorial special issue on continual unsupervised sensorimotor learning. IEEE Transactions on Cognitive and Developmental Systems, 13 0 (2): 0 234--238, 2021. doi:10.1109/TCDS.2021.3082880

    2021

  102. [111]

    Imitation and Social Learning in Robots, Humans and Animals: Behavioural, Social and Communicative Dimensions

    Chrystopher L Nehaniv and Kerstin Dautenhahn. Imitation and Social Learning in Robots, Humans and Animals: Behavioural, Social and Communicative Dimensions. Cambridge Univ. Press, Cambridge, March 2007. URL file:///Users/mai/Sites/bibblywiki.html

    2007

  103. [112]

    Ng and Stuart Russell

    Andrew Y. Ng and Stuart Russell. Algorithms for inverse reinforcement learning. In in Proc. 17th International Conf. on Machine Learning, pages 663--670. Morgan Kaufmann, 2000

    2000

  104. [113]

    Role of default network in the understanding of subjectivity of desire

    Sao Mai Nguyen. Role of default network in the understanding of subjectivity of desire. In NIPS International Workshop for Scientific Study of Consciousness at Neuroscience, volume NIPS International Workshop for Scientific Study of Consciousness at Neuroscience, 2009

    2009

  105. [114]

    Real-time face swapping based on head posture using particle filter towards the understanding of infant self-recognition

    Sao Mai Nguyen. Real-time face swapping based on head posture using particle filter towards the understanding of infant self-recognition. Master's thesis, Osaka University, 2010

    2010

  106. [115]

    A Curious Robot Learner for Interactive Goal-Babbling: Strategically Choosing What, How, When and from Whom to Learn

    Sao Mai Nguyen. A Curious Robot Learner for Interactive Goal-Babbling: Strategically Choosing What, How, When and from Whom to Learn. PhD thesis, INRIA, 2013

    2013

  107. [116]

    Online learning a symbolic abstraction of actions in hierarchical rl with formal methods

    Sao Mai Nguyen. Online learning a symbolic abstraction of actions in hierarchical rl with formal methods. In ActSynt at ECAI, 2024

    2024

  108. [117]

    Properties for efficient demonstrations to a socially guided intrinsically motivated learner

    Sao Mai Nguyen and Pierre-Yves Oudeyer. Properties for efficient demonstrations to a socially guided intrinsically motivated learner. In 21st IEEE International Symposium on Robot and Human Interactive Communication, 2012 a . doi:10.1109/ROMAN.2012.6343819. URL https://inria.h...

    2012

  109. [118]

    Socially guided intrinsically motivated learner

    Sao Mai Nguyen and Pierre-Yves Oudeyer. Socially guided intrinsically motivated learner. In Development and Learning and Epigenetic Robotics (ICDL), 2012 IEEE International Conference on, pages 1 --2, nov. 2012 b . doi:10.1109/DevLrn.2012.6400809

    2012

  110. [119]

    Interactive learning gives the tempo to an intrinsically motivated robot learner

    Sao Mai Nguyen and Pierre-Yves Oudeyer. Interactive learning gives the tempo to an intrinsically motivated robot learner. In IEEE-RAS International Conference on Humanoid Robots (Humanoids 2012), pages 645--652, 2012 c . doi:10.1109/HUMANOIDS.2012.6651588

    2012

  111. [120]

    Active choice of teachers, learning strategies and goals for a socially guided intrinsic motivation learner

    Sao Mai Nguyen and Pierre-Yves Oudeyer. Active choice of teachers, learning strategies and goals for a socially guided intrinsic motivation learner. Paladyn Journal of Behavioural Robotics, 3 0 (3): 0 136--146, 2012 d . ISSN 2080-9778. doi:10.2478/s13230-013-0110-z. URL https:...

    2012 doi

  112. [121]

    Sao Mai Nguyen and Pierre-Yves Oudeyer. Whom will an intrinsically motivated robot learner choose to imitate from? In Joanna Szufnarowska, editor, Proceedings of the Post-Graduate Conference on Robotics and Development of Cognition, pages 32--35, September 2012 e . doi:10.2390...

    2012 doi

  113. [122]

    Socially guided intrinsic motivation

    Sao Mai Nguyen and Pierre-Yves Oudeyer. Socially guided intrinsic motivation. In Spring School on Developmental Robotics and Cognitive Bootstrapping, 2012 f

    2012

  114. [123]

    Strategic robot learner for interactive goal-babbling

    Sao Mai Nguyen and Pierre-Yves Oudeyer. Strategic robot learner for interactive goal-babbling. In Reinforcement Learning and Decision Making, Princeton, New Jersey, U.S.A, 2013 a

    2013

  115. [124]

    Strategic robot learner for active goal-babbling

    Sao Mai Nguyen and Pierre-Yves Oudeyer. Strategic robot learner for active goal-babbling. In Workshop in Active Learning in Robotics at Robotic Science and Systems, Berlin, Germany, 2013 b

    2013

  116. [125]

    Data collection of an interactive learner for strategy, outcome and policy exploration

    Sao Mai Nguyen and Pierre-Yves Oudeyer. Data collection of an interactive learner for strategy, outcome and policy exploration. In Workshop in Hierarchical Learning at Robotic Science and Systems, Berlin, Germany, 2013 c

    2013

  117. [126]

    Socially guided intrinsic motivation for robot learning of motor skills

    Sao Mai Nguyen and Pierre-Yves Oudeyer. Socially guided intrinsic motivation for robot learning of motor skills. Autonomous Robots, 36 0 (3): 0 273--294, 2014. doi:10.1007/s10514-013-9339-y. URL https://inria.hal.science/hal-00936938

    2014 doi

  118. [127]

    Cognitive architecture of a humanoid robot for coaching physical exercises in kinaesthetic rehabilitation

    Sao Mai Nguyen and Philippe Tanguy. Cognitive architecture of a humanoid robot for coaching physical exercises in kinaesthetic rehabilitation. In International Workshop on Cognitive Robotics, 2016

    2016

  119. [128]

    Real-time face swapping as a tool for understanding infant self-recognition

    Sao Mai Nguyen, Masaki Ogino, and Minoru Asada. Real-time face swapping as a tool for understanding infant self-recognition. In Proceedings of the 10th International Conference on Epigenetic Robotics, pages pp.171--172, Glumslov, Sweden, 2010

    2010

  120. [129]

    Bootstrapping intrinsically motivated learning with human demonstrations

    Sao Mai Nguyen, Adrien Baranes, and Pierre-Yves Oudeyer. Bootstrapping intrinsically motivated learning with human demonstrations. In IEEE International Conference on Development and Learning, volume 2, pages 1--8, Frankfurt, Germany, Aug 2011 a . doi:10.1109/DEVLRN.2011.6037329

    2011

  121. [130]

    Constraining the size growth of the task space with socially guided intrinsic motivation using demonstrations

    Sao Mai Nguyen, Adrien Baranes, and Pierre-Yves Oudeyer. Constraining the size growth of the task space with socially guided intrinsic motivation using demonstrations. In IJCAI Workshop on Agents Learning Interactively from Human Teachers, 2011 b

    2011

  122. [131]

    Learning to recognize objects through curiosity-driven manipulation with the icub humanoid robot

    Sao Mai Nguyen, Serena Ivaldi, Natalia Lyubova, Alain Droniou, Damien Gerardeaux-Viret, David Filliat, Vincent Padois, Olivier Sigaud, and Pierre-Yves Oudeyer. Learning to recognize objects through curiosity-driven manipulation with the icub humanoid robot. In IEEE Internation...

    2013

  123. [132]

    Computational Architecture of a Robot Coach for Physical Exercises in Kinesthetic Rehabilitation

    Sao Mai Nguyen, Philippe Tanguy, and Olivier R \'e my-N \'e ris. Computational Architecture of a Robot Coach for Physical Exercises in Kinesthetic Rehabilitation . In RO-MAN 2016 : IEEE International Symposium on Human and Robot Interactive Communication, pages 1138--1143, Aug...

    2016

  124. [133]

    Plug and play your robot into your smart home: Illustration of a new framework

    Sao Mai Nguyen, Christophe Lohr, Philippe Tanguy, and Yiqiao Chen. Plug and play your robot into your smart home: Illustration of a new framework. KI - K \"u nstliche Intelligenz , pages 1--7, 2017. ISSN 1610-1987. doi:10.1007/s13218-017-0494-8. URL http://dx.doi.org/10.1007/s...

    2017 doi

  125. [134]

    An implementation of an imitation game with asd children to learn nursery rhymes

    Sao Mai Nguyen, Nathalie Collot-Lavenne, Christophe Lohr, Sebastien Guillon, Patricio Tula, Alvaro Paez, Mouad Bouaida, Arthus Anin, and Saad El Qacemi. An implementation of an imitation game with asd children to learn nursery rhymes. In HAI Workshop on Clinical Use of Technol...

    2019

  126. [135]

    Robots learn increasingly complex tasks with intrinsic motivation and automatic curriculum learning

    Sao Mai Nguyen, Nicolas Duminy, Alexandre Manoury, Dominique Duhaut, and Cedric Buche. Robots learn increasingly complex tasks with intrinsic motivation and automatic curriculum learning. KI - K \"u nstliche Intelligenz , 35: 0 81--90, March 2021. doi:10.1007/s13218-021-00708-...

    2021 doi

  127. [136]

    A medical low-back pain physical rehabilitation dataset for human body movement analysis

    Sao Mai Nguyen, Maxime Devanne, Olivier Remy-Neris, Mathieu Lempereur, and Andre Thepaut. A medical low-back pain physical rehabilitation dataset for human body movement analysis. In International Joint Conference on Neural Networks, 2024

    2024

  128. [137]

    Nicolescu and M.J

    M.N. Nicolescu and M.J. Mataric. Natural methods for robot task learning: Instructive demonstrations, generalization and practice. In Proceedings of the second international joint conference on Autonomous agents and multiagent systems, pages 241--248. ACM, 2003

    2003

  129. [138]

    What is intrinsic motivation? a typology of computational approaches

    Pierre-Yves Oudeyer and Frederic Kaplan. What is intrinsic motivation? a typology of computational approaches. Frontiers in Neurorobotics, 1 0 (6), 2009

    2009

  130. [139]

    Training language models to follow instructions with human feedback

    Long Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida, Carroll Wainwright, Pamela Mishkin, Chong Zhang, Sandhini Agarwal, Katarina Slama, Alex Ray, John Schulman, Jacob Hilton, Fraser Kelton, Luke Miller, Maddie Simens, Amanda Askell, Peter Welinder, Paul F Christiano, Jan Leike, a...

    2022

  131. [140]

    Mirror neurons and imitation: A computationally guided review

    Erhan Oztop, Mitsuo Kawato, and Michael Arbib. Mirror neurons and imitation: A computationally guided review. Neural networks, 19 0 (3): 0 254--271, 2006

    2006

  132. [141]

    Rolf Pfeifer and C. Scheier. Understanding Intelligence. MIT Press, Cambridge, MA, 1999

    1999

  133. [142]

    The origins of intelligence in children, volume 8

    Jean Piaget. The origins of intelligence in children, volume 8. International Universities Press New York, 1952. doi:10.1037/11494-000

    1952 doi

  134. [143]

    Human-robot interaction in autism: Face, an android-based social therapy

    Giovanni Pioggia, ML Sica, Marcello Ferro, Roberta Igliozzi, Filippo Muratori, Arti Ahluwalia, and Danilo De Rossi. Human-robot interaction in autism: Face, an android-based social therapy. In RO-MAN 2007-the 16th IEEE international symposium on robot and human interactive com...

    2007

  135. [144]

    Infants prefer to imitate a reliable person

    Diane Poulin-Dubois, Ivy Brooker, and Alexandra Polonia. Infants prefer to imitate a reliable person. Infant Behavior and Development, 34 0 (2): 0 303 -- 309, 2011. ISSN 0163-6383. doi:https://doi.org/10.1016/j.infbeh.2011.01.006. URL http://www.sciencedirect.com/science/artic...

    2011 doi

  136. [145]

    Implicit imitation in multiagent reinforcement learning

    Bob Price and Craig Boutilier. Implicit imitation in multiagent reinforcement learning. In ICML, pages 325--334, 1999

    1999

  137. [146]

    Polydoros, Sonia Chernova, and Aude Billard

    Harish Ravichandar, Athanasios S. Polydoros, Sonia Chernova, and Aude Billard. Recent advances in robot learning from demonstration. Annual Review of Control, Robotics, and Autonomous Systems, 3 0 (1): 0 297--330, 2020. doi:10.1146/annurev-control-100819-063206. URL https://do...

    2020 doi

  138. [147]

    Continual learning in reinforcement environments

    Mark Bishop Ring. Continual learning in reinforcement environments. PhD thesis, University of Texas at Austin Austin, Texas 78712, 1994

    1994

  139. [148]

    Mirrors in the brain: How our minds share actions and emotions

    Giacomo Rizzolatti, Corrado Sinigaglia, and Frances Anderson. Mirrors in the brain: How our minds share actions and emotions. Oxford University Press, 2008

    2008

  140. [149]

    Gordon, and J

    Stephane Ross, Geoffrey J. Gordon, and J. Andrew Bagnell. A reduction of imitation learning and structured prediction to no-regret online learning. 11 2010. URL https://arxiv.org/pdf/1011.0686.pdf

    2010 arXiv

  141. [150]

    Roy and A

    N. Roy and A. McCallum. Towards optimal active learning through sampling estimation of error reduction. In Proc. 18th Int. Conf. Mach. Learn., volume 1, pages 143--160, 2001

    2001

  142. [151]

    Ryan and Edward L

    Richard M. Ryan and Edward L. Deci. Intrinsic and extrinsic motivations: Classic definitions and new directions. Contemporary Educational Psychology, 25 0 (1): 0 54 -- 67, 2000

    2000

  143. [152]

    Shared minds: Effects of a mother's imitation of her child on the mother--child interaction

    Wakako Sanefuji, Hiroshi Yamashita, and Hidehiro Ohgami. Shared minds: Effects of a mother's imitation of her child on the mother--child interaction. Infant Mental Health Journal: Official Publication of The World Association for Infant Mental Health, 30 0 (2): 0 145--157, 2009

    2009

  144. [153]

    Episodic curiosity through reachability

    Nikolay Savinov, Anton Raichuk, Damien Vincent, Raphael Marinier, Marc Pollefeys, Timothy Lillicrap, and Sylvain Gelly. Episodic curiosity through reachability. In International Conference on Learning Representations, 2019. URL https://openreview.net/forum?id=SkeK3s0qKQ

    2019

  145. [154]

    Is imitation learning the route to humanoid robots? Trends in Cognitive Sciences, 3 0 (6): 0 233 -- 242, 1999

    Stefan Schaal. Is imitation learning the route to humanoid robots? Trends in Cognitive Sciences, 3 0 (6): 0 233 -- 242, 1999. ISSN 1364-6613. doi:http://dx.doi.org/10.1016/S1364-6613(99)01327-3. URL http://www.sciencedirect.com/science/article/pii/S1364661399013273

    1999 doi

  146. [155]

    Computational approaches to motor learning by imitation

    Stefan Schaal, Auke Jan Ijspeert, and Aude Billard. Computational approaches to motor learning by imitation. Philosophical transactions of the Royal Society of London. Series B, Biological sciences, 358 0 (1431), 03 2003. URL http://ukpmc.ac.uk/abstract/MED/12689379

    2003

  147. [156]

    Schmidhuber

    J. Schmidhuber . Formal theory of creativity, fun, and intrinsic motivation (1990--2010). IEEE Transactions on Autonomous Mental Development, 2 0 (3): 0 230--247, Sep. 2010. ISSN 1943-0612. doi:10.1109/TAMD.2010.2056368

    1990

  148. [157]

    A.P. Shon, D. Verma, and Rajesh PN Rao. Active imitation learning. In American Association for Artificial Intelligence, volume 22, page 756. Menlo Park, CA; Cambridge, MA; London; AAAI Press; MIT Press; 1999, 2007

    1999

  149. [158]

    Open the chests: An environment for activity recognition and sequential decision problems using temporal logic

    Ivelina Stoyanova, Nicolas Museux, Sao Mai Nguyen, and David Filliat. Open the chests: An environment for activity recognition and sequential decision problems using temporal logic. In LIPIcs, TIME, volume 318, 2024

    2024

  150. [159]

    Sutton and Andrew G

    Richard S. Sutton and Andrew G. Barto. Reinforcement Learning: an Introduction. MIT Press, Cambridge, MA, USA, 1998. URL http://webdocs.cs.ualberta.ca/ sutton/book/the-book.html

    1998

  151. [160]

    Sutton and Andrew G

    Richard S. Sutton and Andrew G. Barto. Reinforcement Learning: an Introduction. MIT Press, Cambridge, MA, USA, 2018. URL http://incompleteideas.net

    2018

  152. [161]

    Sutton, Doina Precup, and Satinder Singh

    Richard S. Sutton, Doina Precup, and Satinder Singh. Between mdps and semi-mdps: A framework for temporal abstraction in reinforcement learning. Artificial Intelligence, 112: 0 181 -- 211, 1999. ISSN 0004-3702. doi:http://dx.doi.org/10.1016/S0004-3702(99)00052-1. URL http://ww...

    1999 doi

  153. [162]

    Symbol emergence in cognitive developmental systems: a survey

    Tadahiro Taniguchi, Emre Ugur, Matej Hoffmann, Lorenzo Jamone, Takayuki Nagai, Benjamin Rosman, Toshihiko Matsuka, Naoto Iwahashi, Erhan Oztop, Justus Piater, and Florentin W \"o rg \"o tter. Symbol emergence in cognitive developmental systems: a survey. IEEE Transactions on C...

    2018

  154. [163]

    T \'e l \'e -r \'e \'e ducation fonctionnelle dans le cadre du projet VITAAL

    Andr \'e Th \'e paut, Sao Mai Nguyen, and Christophe Lohr. T \'e l \'e -r \'e \'e ducation fonctionnelle dans le cadre du projet VITAAL . Actualit \'e s en m \'e decine physique et de r \'e adaptation : actualit \'e s en r \'e \'e ducation fonctionnelle et r \'e adaptation , 0...

    2017

  155. [164]

    R \'e \'e ducation fonctionnelle assist \'e e par robot humano \" de

    Andr \'e Th \'e paut, Sao Mai Nguyen, Maxime Devanne, and Olivier R \'e my-N \'e ris. R \'e \'e ducation fonctionnelle assist \'e e par robot humano \" de. In Serge Tisseron and Fr \'e d \'e ric Tordo, editors, Des robots au service des soign \'e s, et des soignants . Editions...

    2018 doi

  156. [165]

    Andrea L. Thomaz. Socially Guided Machine Learning. PhD thesis, MIT, 5 2006. URL http://www.cc.gatech.edu/ athomaz/pubs.html

    2006

  157. [166]

    Thomaz and Cynthia Breazeal

    Andrea L. Thomaz and Cynthia Breazeal. Teachable robots: Understanding human teaching behavior to build more effective robot learners. Artificial Intelligence Journal, 172: 0 716--737, 2008. URL http://www.cc.gatech.edu/ athomaz/pubs.html

    2008

  158. [167]

    Real-time interactive reinforcement learning for robots

    Andrea Lockerd Thomaz, Guy Hoffman, and Cynthia Breazeal. Real-time interactive reinforcement learning for robots. In AAAI 2005 workshop on human comprehensible machine learning, volume 3, page 1, 2005

    2005

  159. [168]

    A data set of human body movements for physical rehabilitation exercises

    Aleksandar Vakanski, Hyung-pil Jun, David Paul, and Russell Baker. A data set of human body movements for physical rehabilitation exercises. Data, 3 0 (1): 0 2, Jan 2018. ISSN 2306-5729. doi:10.3390/data3010002. URL https://www.kaggle.com/derekdb/toronto-robot-stroke-posture-dataset?

    2018 doi

  160. [169]

    How an automated gesture imitation game can improve social interactions with teenagers with asd

    Linda Vallee, Sao Mai Nguyen, Christophe Lohr, Ioannis Kanellos, and Olivier Asseu. How an automated gesture imitation game can improve social interactions with teenagers with asd. In IEEE ICRA workshop on Social Robotics for Neurodevelopmental Disorders, 06 2020. doi:10.13140...

    2020

  161. [170]

    Varela, E

    F. Varela, E. Thompson, and E. Rosch. The embodied mind : cognitive science and human experience. MIT Press, 1991

    1991

  162. [171]

    Feudal networks for hierarchical reinforcement learning

    Alexander Sasha Vezhnevets, Simon Osindero, Tom Schaul, Nicolas Heess, Max Jaderberg, David Silver, and Koray Kavukcuoglu. Feudal networks for hierarchical reinforcement learning. CoRR, abs/1703.01161, 2017. URL http://arxiv.org/abs/1703.01161

    2017 arXiv

  163. [172]

    Thought and Language

    Lev S Vygotsky. Thought and Language. MIT press, 1934

    1934

  164. [173]

    Mind in society : The development of higher mental processes

    Lev S Vygotsky. Mind in society : The development of higher mental processes. Cambridge, MA: Harvard University Press, 1978. ISBN 9780674576292. URL https://www.hup.harvard.edu/catalog.php?isbn=9780674576292

    1978

  165. [174]

    Human activity recognition based on wearable sensor using hierarchical deep lstm networks

    LuKun Wang and RuYue Liu. Human activity recognition based on wearable sensor using hierarchical deep lstm networks. Circuits, Systems, and Signal Processing, 39 0 (2): 0 837--856, 2020. doi:10.1007/s00034-019-01116-y. URL https://doi.org/10.1007/s00034-019-01116-y

    2020 doi

  166. [175]

    R. White. Motivation reconsidered: The concept of competence. Psychological review, 0 (66): 0 297--333, 1959

    1959

  167. [176]

    Towards automata-based abstraction of goals in hierarchical reinforcement learning

    Mehdi Zadem, Sergio Mover, Sao Mai Nguyen, and Sylvie Putot. Towards automata-based abstraction of goals in hierarchical reinforcement learning. In Intrinsically Motivated Open-ended Learning IMOL 2022 , T \"u bingen, Germany, April 2022. URL https://hal.science/hal-03600799

    2022

  168. [177]

    Goal space abstraction in hierarchical reinforcement learning via set-based reachability analysis

    Mehdi Zadem, Sergio Mover, and Sao Mai Nguyen. Goal space abstraction in hierarchical reinforcement learning via set-based reachability analysis. In 2023 IEEE International Conference on Development and Learning (ICDL), pages 423--428, Nov 2023 a . doi:10.1109/ICDL55364.2023.1...

    2023

  169. [178]

    Goal space abstraction in hierarchical reinforcement learning via reachability analysis

    Mehdi Zadem, Sergio Mover, and Sao Mai Nguyen. Goal space abstraction in hierarchical reinforcement learning via reachability analysis. In Intrinsically Motivated Open-ended Learning , T \"u bingen, Germany, September 2023 b . URL https://hal.science/hal-03600799

    2023

  170. [179]

    Emergence of a symbolic goal representation with an intelligent tutoring system based on intrinsic motivation

    Mehdi Zadem, Sergio Mover, and Sao Mai Nguyen. Emergence of a symbolic goal representation with an intelligent tutoring system based on intrinsic motivation. In Intrinsically Motivated and Open-Ended Learning Workshop @NeurIPS2023, 2023 c . URL https://openreview.net/forum?id=...

    2023

  171. [180]

    Reconciling spatial and temporal abstractions for goal representation

    Mehdi Zadem, Sergio Mover, and Sao Mai Nguyen. Reconciling spatial and temporal abstractions for goal representation. In The Twelfth International Conference on Learning Representations, 2024. URL https://openreview.net/forum?id=odY3PkI5VB

    2024

  172. [181]

    An approach for imitation learning on riemannian manifolds

    Martijn JA Zeestraten, Ioannis Havoutis, Joao Silv \'e rio, Sylvain Calinon, and Darwin G Caldwell. An approach for imitation learning on riemannian manifolds. IEEE Robotics and Automation Letters, 2017

    2017

  173. [182]

    Ballard, and Peter Stone

    Ruohan Zhang, Faraz Torabi, Lin Guan, Dana H. Ballard, and Peter Stone. Leveraging human guidance for deep reinforcement learning tasks. In Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence, IJCAI-19 , pages 6339--6346. International Jo...

    2019 doi

  174. [183]

    Generating adjacency-constrained subgoals in hierarchical reinforcement learning

    Tianren Zhang, Shangqi Guo, Tian Tan, Xiaolin Hu, and Feng Chen. Generating adjacency-constrained subgoals in hierarchical reinforcement learning. 06 2020. URL https://arxiv.org/pdf/2006.11485.pdf

    2020 arXiv

  175. [184]

    @esa ( ) , n @biblabelnum##1 ##1

    \@ifclassloaded aguplus natbib The aguplus class already includes natbib coding, so you should not add it explicitly Type <Return> for now, but then later remove the command natbib from the document \@ifclassloaded nlinproc natbib The nlinproc class already includes natbib cod...

  176. [185]

    @stdbsttrue NAT@ctr \@lbibitem[ NAT@ctr ] \@lbibitem[#1]#2 \@extra@b@citeb \@ifundefined br@#2\@extra@b@citeb \@namedef br@#2 \@nameuse br@#2\@extra@b@citeb \@ifundefined b@#2\@extra@b@citeb @num @parse #2 [ @natanchorstart #2\@extra@b@citeb \@biblabel @num @natanchorend] @ifc...

  177. [186]

    author-maintained

    @open @close @open @close and [1] URL: #1 \@ifundefined chapter * \@mkboth \@ifundefined NAT@sectionbib * \@mkboth * \@mkboth\@gobbletwo \@ifclassloaded amsart * \@ifclassloaded amsbook * \@ifundefined bib@heading @heading NAT@ctr thebibliography [1] @ \@biblabel NAT@ctr \@bib...

    1995

Pith tools

Reviewed August 10, 2026 · model on record in the stance chip above.