Pith. sign in

Paper Citation Record · LEDGER

Batch Recurrent Q-Learning for Backchannel Generation Towards Engaging Agents

As of 16 August 2026, this Paper Citation Record lists 28 of 28 outbound references and 0 inbound Pith citation observations for arXiv:1908.02037.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
1908.02037 v1

Coverage vector

measured 28 of 28 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-14T15:01:13.326513Z

measured 28 of 28 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-16T06:30:59.297886+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

28 of 28 outbound references displayed

  • verified exact0
  • verified fuzzy24
  • unresolved4
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 629403b6-76df-4f7d-82a7-cf4897cc09e6 · outbound

This paper cites Analysis of engagement and user experience with a laughter responsive social robot,.

Batch Recurrent Q-Learning for Backchannel Generation Towards Engaging Agents Analysis of engagement and user experience with a laughter responsive social robot,

Reference 1

Resolution
verified fuzzy
raw_fallback, observed 2026-08-14T15:01:13.649775Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-14T15:01:13.231854Z digest=sha256:baf724744ad16ba8686b20629049136f17a594bdc31c4283eb51a30ef8406f08

Observation 3ce93b11-335d-4c5c-9b07-1d903bbf9ab9 · outbound

This paper cites Timing and entrainment of multimodal backchanneling behavior for an embodied conversational agent,.

Batch Recurrent Q-Learning for Backchannel Generation Towards Engaging Agents Timing and entrainment of multimodal backchanneling behavior for an embodied conversational agent,

Reference 2

Resolution
verified fuzzy
raw_fallback, observed 2026-08-14T15:01:13.639467Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-14T15:01:13.235911Z digest=sha256:f49c6ccaf7f3967d675306d290036d7f92a930c7c145a3e50fb72e3dd271ee72

Observation 80c1b059-43fe-4ee6-bf3b-6ab3b41d0e0b · outbound

This paper cites Definitions of engagement in human-agent interaction,.

Batch Recurrent Q-Learning for Backchannel Generation Towards Engaging Agents Definitions of engagement in human-agent interaction,

Reference 3

Resolution
verified fuzzy
raw_fallback, observed 2026-08-14T15:01:13.628728Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-14T15:01:13.239317Z digest=sha256:2d9a85efb590971507a7be52fde7b639208e511118077a2332301d1934b4f567

Observation 07f7e90a-c53e-42e2-b6c8-ee3c09890f3b · outbound

This paper cites Poggi, Mind, hands, face and body: a goal and belief view of multimodal communication.

Batch Recurrent Q-Learning for Backchannel Generation Towards Engaging Agents Poggi, Mind, hands, face and body: a goal and belief view of multimodal communication

Reference 4

Resolution
verified fuzzy
raw_fallback, observed 2026-08-14T15:01:13.617460Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-14T15:01:13.243464Z digest=sha256:bff888e5a92dbd8137c7cb32b1d50ca28c32b72d3b99f4e63306bd242dea2d6e

Observation d3a8c68c-8d5f-455a-8354-b2e4cff02d2c · outbound

This paper cites Deep Recurrent Q-Learning for Partially Observable MDPs.

Batch Recurrent Q-Learning for Backchannel Generation Towards Engaging Agents Deep Recurrent Q-Learning for Partially Observable MDPs

Reference 5

Resolution
unresolved
no resolver link, observed 2026-08-14T15:01:13.247809Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-14T15:01:13.247809Z digest=sha256:ac49a43873b0e084b49ca7245e0d96eeb2564d5f7ef239e5518fcd72b509cdd2

Observation 5993df38-fdf6-44cc-a986-c3924466429d · outbound

This paper cites Q-learning,.

Batch Recurrent Q-Learning for Backchannel Generation Towards Engaging Agents Q-learning,

Reference 6

Resolution
unresolved
no resolver link, observed 2026-08-14T15:01:13.252437Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-14T15:01:13.252437Z digest=sha256:2a9f2c0e32f4558a6f5ed6b9ecb9461d43b3f4c7d6bf922b99d4fbebc29e3f03

Observation 0c31758a-b30b-478f-a5d6-567ced8cbe49 · outbound

This paper cites an unresolved cited work.

Batch Recurrent Q-Learning for Backchannel Generation Towards Engaging Agents Unresolved cited work

Reference 7

Resolution
unresolved
raw_fallback, observed 2026-08-14T15:01:13.597908Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-14T15:01:13.256371Z digest=sha256:8c34927a1b5631f64680f1290b3e757fbdc2a10c1cf86e9798cddad5a38156f1

Observation bf384db1-edf5-4cbc-8c1e-ae98e33c4514 · outbound

This paper cites Batch reinforcement learning,.

Batch Recurrent Q-Learning for Backchannel Generation Towards Engaging Agents Batch reinforcement learning,

Reference 8

Resolution
verified fuzzy
raw_fallback, observed 2026-08-14T15:01:13.585589Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-14T15:01:13.259725Z digest=sha256:a70c0de07852afbba0c8d1dad8d80fa176ac2ddd2bef801a339aea20a3ee9bcf

Observation f80e8beb-e119-4367-9055-f3fd8c91eb6c · outbound

This paper cites Human-level control through deep reinforcement learning,.

Batch Recurrent Q-Learning for Backchannel Generation Towards Engaging Agents Human-level control through deep reinforcement learning,

Reference 9

Resolution
verified fuzzy
raw_fallback, observed 2026-08-14T15:01:13.575254Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-14T15:01:13.263120Z digest=sha256:999fa3b292d35883dbd34e71f0b9fd1c81177065cc591904256a3d43d43ebce7

Observation 6f5097f4-c362-4048-a6a4-ad15478bffe2 · outbound

This paper cites Tree-based batch mode reinforcement learning,.

Batch Recurrent Q-Learning for Backchannel Generation Towards Engaging Agents Tree-based batch mode reinforcement learning,

Reference 10

Resolution
verified fuzzy
raw_fallback, observed 2026-08-14T15:01:13.565622Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-14T15:01:13.266415Z digest=sha256:8c6948ef904450bc41e3e800645f5b64ccb673903e6ee4b71889918fa96ee173

Observation 9b8b33a3-1e81-4c45-a9e1-7196c4962d28 · outbound

This paper cites Neural fitted q iteration–first experiences with a data efficient neural reinforcement learning method,.

Batch Recurrent Q-Learning for Backchannel Generation Towards Engaging Agents Neural fitted q iteration–first experiences with a data efficient neural reinforcement learning method,

Reference 11

Resolution
verified fuzzy
raw_fallback, observed 2026-08-14T15:01:13.556078Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-14T15:01:13.269440Z digest=sha256:d9ecca99fac3a28dc129a96764002c355d0e35b47cffa65fe6faae6c666a0ff6

Observation fa02c569-5869-4cea-8130-7d7f72236022 · outbound

This paper cites Robot gains social intelligence through multimodal deep reinforcement learning,.

Batch Recurrent Q-Learning for Backchannel Generation Towards Engaging Agents Robot gains social intelligence through multimodal deep reinforcement learning,

Reference 12

Resolution
verified fuzzy
raw_fallback, observed 2026-08-14T15:01:13.545485Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-14T15:01:13.272232Z digest=sha256:ef6c5ef854f1e2f274f758276112abbbefdede6e9f47e60adcdaab4c39ce9526

Observation faec84c1-2a04-4d99-9c57-2fdd13786940 · outbound

This paper cites Show, attend and interact: Perceivable human-robot social interaction through neural attention q-network,.

Batch Recurrent Q-Learning for Backchannel Generation Towards Engaging Agents Show, attend and interact: Perceivable human-robot social interaction through neural attention q-network,

Reference 13

Resolution
verified fuzzy
raw_fallback, observed 2026-08-14T15:01:13.534280Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-14T15:01:13.275088Z digest=sha256:3c6b65c91d8173cd2038d4683e769cda6c664ae9a28675635970d4610ff71652

Observation bc81b9ae-a074-4e07-bfda-05b06cec44c8 · outbound

This paper cites Robot behavior adaptation for human-robot interaction based on policy gradient reinforcement learning,.

Batch Recurrent Q-Learning for Backchannel Generation Towards Engaging Agents Robot behavior adaptation for human-robot interaction based on policy gradient reinforcement learning,

Reference 14

Resolution
verified fuzzy
raw_fallback, observed 2026-08-14T15:01:13.522166Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-14T15:01:13.278419Z digest=sha256:7c954316850881fba8ff94e863a06f336cfd554121c34a8e87c5db53221476fc

Observation 88a6ad9a-7a26-474e-966e-7ec1485ad237 · outbound

This paper cites Neural network based reinforcement learning for audio–visual gaze control in human–robot interaction,.

Batch Recurrent Q-Learning for Backchannel Generation Towards Engaging Agents Neural network based reinforcement learning for audio–visual gaze control in human–robot interaction,

Reference 15

Resolution
verified fuzzy
raw_fallback, observed 2026-08-14T15:01:13.511710Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-14T15:01:13.281467Z digest=sha256:3cdd4e654f8c9a4bd73c88bd0ce1d440d6e534411f65731fe4435ad746473bcf

Observation 5cbe9ba9-996a-4aa6-b412-70622d0f7f80 · outbound

This paper cites Fostering user engagement in face-to-face human-agent interactions: a survey,.

Batch Recurrent Q-Learning for Backchannel Generation Towards Engaging Agents Fostering user engagement in face-to-face human-agent interactions: a survey,

Reference 16

Resolution
verified fuzzy
raw_fallback, observed 2026-08-14T15:01:13.500866Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-14T15:01:13.284635Z digest=sha256:9c50b0d6ce0a1ba5672a44dd7464ebabbc56b521b9b63ddcd23d2e31f02f73f0

Observation 3deb7a1a-5320-45fe-b89b-eab1eb94c3c5 · outbound

This paper cites Generating robot/agent backchannels during a storytelling experiment,.

Batch Recurrent Q-Learning for Backchannel Generation Towards Engaging Agents Generating robot/agent backchannels during a storytelling experiment,

Reference 17

Resolution
verified fuzzy
raw_fallback, observed 2026-08-14T15:01:13.490371Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-14T15:01:13.287620Z digest=sha256:01720401c7eca2162b185948e13dee1f8ce0e135688beea72610e5c334cff803

Observation dbafc922-4f9e-4eb4-a58b-b8f1ca36aad0 · outbound

This paper cites Generation of nodding, head tilting and eye gazing for human-robot dialogue interaction,.

Batch Recurrent Q-Learning for Backchannel Generation Towards Engaging Agents Generation of nodding, head tilting and eye gazing for human-robot dialogue interaction,

Reference 18

Resolution
verified fuzzy
raw_fallback, observed 2026-08-14T15:01:13.479265Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-14T15:01:13.290685Z digest=sha256:fea2cb4cefc0187df3f90192719742bbcbcd3897516d5b5537ab275626c4f50d

Observation c668c4a4-8576-4ddd-90ed-65091435f368 · outbound

This paper cites Data-driven model of nonverbal behavior for socially assistive human-robot interactions,.

Batch Recurrent Q-Learning for Backchannel Generation Towards Engaging Agents Data-driven model of nonverbal behavior for socially assistive human-robot interactions,

Reference 19

Resolution
verified fuzzy
raw_fallback, observed 2026-08-14T15:01:13.467865Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-14T15:01:13.294306Z digest=sha256:115c3ae7319607813d7d8671c7b254d72f2df3a6beae768085e39dd99c8a2a06

Observation e61ccbdd-083a-45b5-89ae-bcaf0346f9e3 · outbound

This paper cites Recognizing engagement in human-robot interaction,.

Batch Recurrent Q-Learning for Backchannel Generation Towards Engaging Agents Recognizing engagement in human-robot interaction,

Reference 20

Resolution
verified fuzzy
raw_fallback, observed 2026-08-14T15:01:13.457095Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-14T15:01:13.297954Z digest=sha256:3a735be0a6c34cb10686e58a00f1a5f01fd684beacdaf7210523fd4424f95574

Observation 6f683ea6-d8fe-4ed3-b46a-63be7618cdf0 · outbound

This paper cites Iemocap: Interactive emotional dyadic motion capture database,.

Batch Recurrent Q-Learning for Backchannel Generation Towards Engaging Agents Iemocap: Interactive emotional dyadic motion capture database,

Reference 21

Resolution
verified fuzzy
raw_fallback, observed 2026-08-14T15:01:13.446602Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-14T15:01:13.301447Z digest=sha256:8bc7126b12a024507a8cb59821d97e78b906f1fbca8d1d02b524af3fbd5274c2

Observation ff52c2a4-0903-4b1f-a809-95c4989b5a73 · outbound

This paper cites Multimodal analysis of speech and arm motion for prosody-driven synthesis of beat gestures,.

Batch Recurrent Q-Learning for Backchannel Generation Towards Engaging Agents Multimodal analysis of speech and arm motion for prosody-driven synthesis of beat gestures,

Reference 22

Resolution
verified fuzzy
raw_fallback, observed 2026-08-14T15:01:13.434958Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-14T15:01:13.305221Z digest=sha256:e4f50b7fb6bb3e41b57cb0bb5e8b30af7dcc136233d68777a5df828722169703

Observation 093301d9-22ba-40de-8881-fc1d340d3470 · outbound

This paper cites Tracking continuous emotional trends of participants during affective dyadic interactions using body language and speech information,.

Batch Recurrent Q-Learning for Backchannel Generation Towards Engaging Agents Tracking continuous emotional trends of participants during affective dyadic interactions using body language and speech information,

Reference 23

Resolution
verified fuzzy
raw_fallback, observed 2026-08-14T15:01:13.424280Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-14T15:01:13.309504Z digest=sha256:83fac2925a24df731584e8eb4494f3745d7f7740b61c4c38b95310ade7ef6fb5

Observation ca6eb764-29f4-4a1c-9ece-c258af004ac9 · outbound

This paper cites Residual algorithms: Reinforcement learning with function approximation,.

Batch Recurrent Q-Learning for Backchannel Generation Towards Engaging Agents Residual algorithms: Reinforcement learning with function approximation,

Reference 24

Resolution
verified fuzzy
raw_fallback, observed 2026-08-14T15:01:13.413830Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-14T15:01:13.312977Z digest=sha256:30bfa2b90a63f23f9c630b1ceee45ecd4b0b2d895c96da0ec8a91a41e7115aa9

Observation 339146ee-7a4a-4c47-a908-762ac2a4f991 · outbound

This paper cites Data-efficient off-policy policy evaluation for reinforcement learning,.

Batch Recurrent Q-Learning for Backchannel Generation Towards Engaging Agents Data-efficient off-policy policy evaluation for reinforcement learning,

Reference 25

Resolution
verified fuzzy
raw_fallback, observed 2026-08-14T15:01:13.402603Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-14T15:01:13.316576Z digest=sha256:9fe4bd64dd99dbaf00cee711f8b3b7c9d0f421c889a018206caa0892c104bdb6

Observation dfcb2235-968e-4195-83c4-38bf8c414324 · outbound

This paper cites Importance sampling for fair policy selection.

Batch Recurrent Q-Learning for Backchannel Generation Towards Engaging Agents Importance sampling for fair policy selection

Reference 26

Resolution
verified fuzzy
raw_fallback, observed 2026-08-14T15:01:13.390822Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-14T15:01:13.319712Z digest=sha256:48cda9d28d48edbdbcd5726bdd66cc9026cd5aa022bdca53cbb91be6563df208

Observation bf3e7dc8-4ff1-4e96-aabd-49d72844b742 · outbound

This paper cites Behaviour Policy Estimation in Off-Policy Policy Evaluation: Calibration Matters.

Batch Recurrent Q-Learning for Backchannel Generation Towards Engaging Agents Behaviour Policy Estimation in Off-Policy Policy Evaluation: Calibration Matters

Reference 27

Resolution
unresolved
no resolver link, observed 2026-08-14T15:01:13.322853Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-14T15:01:13.322853Z digest=sha256:2ca629dbfa6109fa235cf4f0018df56f1b54373e181692bbc2a115e1b9b82a5d

Observation bfc8ab65-334e-47f3-9582-2716b491553b · outbound

This paper cites Fast nearest neighbor search through sparse random projections and voting,.

Batch Recurrent Q-Learning for Backchannel Generation Towards Engaging Agents Fast nearest neighbor search through sparse random projections and voting,

Reference 28

Resolution
verified fuzzy
raw_fallback, observed 2026-08-14T15:01:13.380076Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-14T15:01:13.326513Z digest=sha256:919989b0d2f79065e1790bfb6f8de2c5c76ab2710ffa57da875bb4ee28093703

Pith citing papers

No inbound Pith citation observations are available.