DIJE: Dense Image Jacobian Estimation for Robust Robotic Self-Recognition and Visual Servoing

Akihiro Miki; Kei Okada; Kento Kawaharazuka; Masayuki Inaba; Yasunori Toshimitsu

REVIEW 5 major objections 5 minor 20 references

DIJE: Dense Image Jacobian Estimation for Robust Robotic Self-Recognition and Visual Servoing

T0 review · 5 major / 5 minor · reviewed 2026-08-06 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗ Review JSON

Pith's one-line read This paper claims that a dense per-pixel image Jacobian, estimated online from optical flow and joint velocity by a simplified Kalman filter, lets a robot with no kinematic model and no markers recognize its own body and visually servo to…

desk verdict A dense per-pixel image Jacobian estimator with a self-warp update that is clever and works on hardware, but the paper lacks derivations, baselines, and any analysis of the bootstrapped warp. read the letter →

arxiv 2507.00446 v1 pith:T4NIEEN6 submitted 2025-07-01 cs.RO

Yasunori Toshimitsu , Kento Kawaharazuka , Akihiro Miki , Kei Okada , Masayuki Inaba This is my paper · ORCID

classification cs.RO

keywords denseimageJacobianvisualservoingself-recognitionKalmanfilteropticalflowmusculoskeletalrobotmodel-freecontrolmarkerless

verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

This paper proposes DIJE, an algorithm that learns an image Jacobian for every pixel of the camera image, giving a robot a dense map of how each of its joints moves each point on its body. The map is estimated online from optical flow and joint velocity using a simplified Kalman filter, without markers and without any prior knowledge of the robot's kinematic structure. With this map alone, the robot can segment its own body from the background even when external motion overlaps, and can control an unmarked point on its body or on a held tool to track a target in the image. Experiments on a musculoskeletal humanoid show reaching, rake-tip, and vacuum-tip control, all starting from a zero-initialized Jacobian. The paper's broader claim is that a dense visuomotor policy of this sort can unify self-perception and control.

What carries the argument

The load-bearing object is the dense image Jacobian $\mathbf{J}^D$, a per-pixel array of $2 \times N_j$ matrices where $N_j$ is the number of joints. Each pixel's Jacobian is updated by a simplified Kalman filter: the observation is the dense optical flow $u$, the observation matrix is built from the joint velocity $\dot{q}$, and the state covariance is approximated as diagonal, so only one variance per joint is stored. The update rule $J_{k|k-1,i} \leftarrow \mathrm{interpolate}(J^D_{k-1},\, x_i - J_{k-1,i}\,\dot{q})$ warps the previous Jacobian field by the predicted flow, which is what keeps external movement from contaminating the map. On top of this, self-recognition clusters the per-pixel Jacobian vectors with k-means and scores cluster centers by how consistent they are over time, while the servoing controller uses $\Delta q = k_p\, J_{\mathrm{self}}^{\#}(p_{\mathrm{target}} - p_{\mathrm{self}})$.

What would settle it

Repeatedly run the visual servoing experiment with the dense Jacobian initialized to different nonzero matrices (rather than zeros) and record the joint angles at convergence; if the robot consistently reaches the clicked target in image space but ends up in measurably different arm postures across initializations, the warped update has frozen a self-consistent but incorrect Jacobian rather than converging to the true kinematic map.

Watch

Extended reading notes

Core claim

The central claim is that the image Jacobian — the linear map from joint velocity to flow at a point — does not need to be estimated only at a few marked points. DIJE estimates it for every pixel in real time, and this single dense representation is sufficient for both recognizing the robot's own body and servoing it. The per-pixel estimator is a Kalman filter whose state is the concatenated Jacobian; by approximating the state covariance as diagonal with matched horizontal and vertical variance, memory use drops from $O(N_j^2)$ to $O(N_j)$ per pixel, making dense estimation tractable for many-joint robots. The paper's key design choice is the transport step: each pixel's Jacobian is warped to its new image location using the flow predicted from the current Jacobian estimate, not the measured optical flow, so background motion does not leak into the map. From the resulting dense field, k-means on the per-pixel Jacobian vectors plus a temporal-consistency score labels the body, and the pseudoinverse of the interpolated Jacobian at a clicked point generates joint commands.

Load-bearing premise

The whole method stands on the assumption that the linear model $u = J \dot{q}$ holds for every pixel on the robot over a single timestep, so that warping the previous Jacobian estimate by the predicted flow moves it to the right image location; if the Jacobian is still wrong early in learning or the motion is too large, the warped estimate can lock in an incorrect but self-consistent map.

Editorial extensions

If this is right

A robot with no kinematic model can start from a zero-initialized dense Jacobian and learn, in real time, a complete visuomotor map of its body from its own motion.
Because the map is dense, a point that was never tracked before — such as the elbow after controlling the wrist — already has a Jacobian estimate, so the target can be switched instantly without relearning.
The same dense Jacobian field supports both perception (self/non-self segmentation) and control (servoing), and it transfers immediately to tools held in the hand.
The predicted-flow transport step prevents background motion from corrupting the self-label, even when the external motion overlaps the robot's body.
All algorithms run at 30 fps on a conventional notebook computer, so the approach is deployable online on physical robots.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

The dense Jacobian is effectively a global visuomotor policy, so a natural extension is to use it for tasks the paper does not test, such as predicting the visual outcome of a planned trajectory or selecting which joints to recruit for a given image-space goal.
The consistency-scoring step for self-recognition is essentially slow-feature analysis applied to learned Jacobian vectors; this suggests that self-attribution may be framed generally as temporal stability of a learned sensorimotor feature, beyond vision.
Because optical flow lacks object constancy, the method breaks under occlusion, deformation, or out-of-frame motion; combining the dense Jacobian with a dense appearance-based descriptor, as the authors note, would let the map persist across such events at the cost of also estimating a deformation field.
Since the controller is purely 2D, a testable extension is to add a depth channel to the image Jacobian, which would lift the same framework to 3D servoing without changing the per-pixel estimation machinery.

Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Desk Editor's Note

read the letter

Short version: this is a real systems contribution. The dense per-pixel image Jacobian, the diagonal-covariance Kalman simplification, and the predicted-flow warp (Eq. 14) are new relative to the sparse Jacobian literature, and the hardware experiments on the musculoskeletal robot are believable. The method runs at 30fps and demonstrably handles background motion and tool-tip servoing without markers or kinematic models.

What I credit: the diagonal covariance idea is sensible and actually needed for dense scaling; the predicted-flow warp is a clever fix for the label-leak problem that occurs when you warp with observed optical flow, and the side-by-side in Fig. 4 makes the point. The self-recognition via k-means on Jacobian clusters plus temporal consistency is heuristic but works, and the authors are upfront that static body parts are not segmented.

Soft spots, in proportion: the dimensional error in Eq. (3) is real: Mq as written is 2×Nj, which cannot multiply the 2Nj state j. The Kalman update equations (10)-(11) are stated without derivation; the claim that the diagonal covariance is preserved by induction is plausible but not shown. The experiments are single-run, with no error bars, baselines, or ablation of the KF parameters. That matters, but for a systems paper with a working hardware demo, it is a validation gap rather than a fatal flaw.

The deeper concern is the bootstrapped warp: Eq. (14) transports the Jacobian estimate using flow predicted by that same estimate. If the initial estimate is wrong, the warp can systematically misassociate Jacobians with image locations, and the estimate could settle into a self-consistent but incorrect map. The paper gives no analysis of this, and the closed-loop experiments would not necessarily reveal it, since servoing only needs a gradient-like direction. I don't think this is lethal—many online estimation methods lack formal stability proofs—but it is the one place where I'd want more than plausibility.

Bottom line: this paper deserves a serious referee. It's a clear, honest, novel-enough systems contribution whose limitations are openly acknowledged. I'd send it to review with a request to fix the typo, sketch the KF derivation, and either add repeated runs with statistics or label the plots as illustrative.

Referee Report

5 major / 5 minor

Summary. The paper proposes DIJE, a dense per-pixel image Jacobian estimator that combines dense optical flow with a simplified Kalman filter and a frame-to-frame warp update. The same estimated Jacobian field is then used for two applications: a k-means-based self-recognition scheme that labels the robot's body while rejecting background motion, and a markerless visual servoing controller that drives a user-selected self-body point to a target image point. Experiments on the musculoskeletal humanoid Musashi demonstrate reaching, rake-tip, and vacuum-tool-tip control, together with a qualitative comparison against an observed-flow warp update for self-recognition. The central claim is that a single model-free, real-time dense visuomotor representation can support both body awareness and control without kinematic knowledge or markers.

Significance. If the method is sound, the contribution is significant for robot learning and uncalibrated visual servoing: a dense, real-time image Jacobian estimated from raw observations without markers or a kinematic model, and used for both perception and control, is an appealing and potentially general framework. The paper's strengths include a clear problem formulation, a real-time implementation on a physical musculoskeletal robot, and honest discussion of acknowledged limitations such as the failure to label static body parts and the absence of depth. However, the significance is tempered by the lack of a derivation for the Kalman filter equations, the absence of convergence or stability analysis for the bootstrapped warp update, and the purely qualitative single-run experimental evaluation; these issues need to be addressed before the paper's claims can be regarded as fully supported.

major comments (5)

[III-A, Eq. (3)] The observation matrix Mq is defined as [qdot^T; qdot^T], which is 2 x N_j, but it multiplies the state vector j of length 2 N_j. This is a dimensional mismatch: the correct form should be a block-diagonal matrix diag(qdot^T, qdot^T) of size 2 x 2 N_j. As written, the observation model u = Mq j is inconsistent with Eq. (10)-(11), and readers cannot reproduce the estimator from the paper. Please correct this equation and provide the surrounding derivation.
[III-A, Eqs. (8)-(11)] The simplified Kalman filter equations are stated without derivation, and the claim that the covariance symmetry in Eq. (6) is preserved 'by mathematical induction' is not proven. Since these equations are the core of the proposed estimator, the full derivation, including the diagonal-covariance approximation and the equal-x/y-variance reduction, should be included in an appendix or supplementary material. Without this, the approximations cannot be checked and the relationship to the standard Kalman filter remains opaque.
[III-B, Eq. (14)] The warp update J_{k|k-1,i} <- interpolate(J^D_{k-1}, x_i - J_{k-1,i} qdot) is a bootstrapped transport: the current Jacobian estimate determines the location to which the previous estimate is warped. Since J is initialized to zero, the predicted flow is initially zero and the warp is identity, and if the estimate is biased, the bias can be transported to incorrect image locations in a self-consistent way. The paper provides no convergence or stability analysis for this coupled estimator, and the experiments do not detect such a failure because both servoing and self-recognition can succeed with a temporally consistent but incorrect Jacobian field. Please provide a synthetic or ground-truth validation (e.g., comparing the estimated dense Jacobian to one computed from a known kinematic and camera model) and, ideally, an analysis or empirical study of error growth under the warp update.
[V, Experiments] All experiments are single-run qualitative demonstrations without error bars, baselines, or quantitative performance metrics. The abstract and introduction claim robustness and verifiability, but the reported evidence is not sufficient to support these claims. Please add repeated trials with quantitative metrics: labeling accuracy or IoU against manually labeled ground truth for self-recognition, steady-state error and convergence time for visual servoing, and comparisons against the observed-flow update in Eq. (13) as well as a marker-based or kinematic-model baseline.
[VI, Discussion] The paper acknowledges that the self-recognition method does not label non-moving parts of the robot, citing the static shoulder in Fig. 2. This is a substantive limitation of the central 'self-recognition' claim: the output is not a dense binary label of the robot's body, but only of the body parts that are currently moving in a way correlated with the robot's joints. The contribution statement and abstract should be revised to reflect this scope, or the method should be extended to identify static self-parts.

minor comments (5)

[V-B] The feedback gain is stated as 'r = 0.034' in the reaching experiment, but r is already used for the observation noise variance in the Kalman filter; this is likely a typo for kp.
[V-B] The text says 'ptarget converges to the target point ptarget' in the rake and vacuum experiments; this should be 'pself converges to ptarget.'
[VII, Conclusions] There is a typo, 'cosider' should be 'consider.'
[Algorithm 1] The consistency update formula and the normalization of EvalList are introduced without justification, and the values N_kmeans=5 and e_thresh=0.2 appear to be chosen heuristically; a sensitivity analysis or a brief rationale would improve reproducibility.
[Fig. 4] The labels in Fig. 4, especially 'External movement,' could be confused with the ground-truth label; please clarify which regions correspond to the robot and which to the background in the figure caption.

Circularity Check

0 steps flagged · score 0.0 of 10

No significant circularity: DIJE estimates the dense image Jacobian from measured optical flow and joint velocities via a standard recursive estimator, and no prediction reduces to a fitted input.

full rationale

The derivation chain is self-contained. The image Jacobian is defined by the differential relation u = J q_dot in Eq. (1), and the Kalman observation model in Eq. (3) is a direct restatement of that definition rather than an independent predicted quantity. The correction step in Eq. (10) uses the measured optical flow u_k and the observed joint velocity, so the estimate is driven by external sensor data. The dense update in Eq. (14) does use the current Jacobian estimate to predict the flow that transports the estimate itself, which is a bootstrapped state-transition model, but it is not circular in the sense of assuming its own conclusion: the Kalman correction still incorporates measured observations, and the visual servoing target in Eq. (17) is user-specified and external to the estimator. No parameter is fitted to a subset of data and then relabeled as a prediction, and no uniqueness theorem is imported from prior work to force the chosen form. The self-citations to the Musashi platform and low-level joint-muscle controllers [13], [15], [16] are hardware and infrastructure references, not load-bearing evidence for the DIJE estimation claim. The paper explicitly acknowledges limitations such as lack of depth handling, dependence on two-frame optical flow, and inability to recognize static body parts; these are honest scope restrictions rather than circular steps. The main open concern is the convergence and stability of the bootstrapped transport in Eq. (14), which is a correctness risk about a recursive estimator, not a circularity in the derivation chain.

Assumptions & free parameters 9 free parameters · 6 assumptions · 0 invented entities

The central claim rests on the standard image Jacobian linear model, optical-flow tracking quality, and several hand-chosen constants (KF noise variances, k-means parameters, feedback gain, control period). The most consequential unstated inputs are the Kalman filter noise variances q and r, whose values are not reported. No new physical entities are introduced; the dense image Jacobian is a new algorithmic representation rather than a postulated entity.

free parameters (9)

KF process noise variance q = not reported
Added uniformly to all variance elements in Eq (9); controls how quickly the filter forgets old Jacobian estimates. No value or tuning procedure is given.
KF observation noise variance r = not reported
Sets measurement confidence in Eqs (10)-(11). The paper never reports its numerical value; the symbol r is later reused for the feedback gain in Section V-B.
Number of k-means clusters N_kmeans = 5
Hand-chosen in Section V-A; authors state 2 should suffice in theory but 5 is used for robustness.
Self-body evaluation threshold e_thresh = 0.2
Hand-chosen threshold in Algorithm 1 that determines which clusters are labeled as self.
Consistency update coefficients = 0.1 multiplier and 0.1 denominator offset
Hand-tuned constants in Algorithm 1 controlling how quickly cluster evaluation values change; no sensitivity analysis is provided.
Visual servoing feedback gain kp = 0.034 (labeled r in Section V-B)
Gain in Eq (17); chosen for experiments without tuning analysis.
Control period for joint updates = 0.7 s
The robot executes each Delta-q command every 0.7 s; this affects closed-loop stability and convergence.
Initial state covariance p0 = 1
Initial variance of all Jacobian entries; affects early learning speed.
Initial dense image Jacobian J^D_0 = 0
The Jacobian field is initialized with zeros at the start of each experiment, so early control commands rely on learned increments.

assumptions (6)

domain assumption Per-pixel linear model u = J(q) \dot q (Eq (1)) holds for every pixel over the estimation window.
The whole algorithm estimates J from this linear relationship; large joint motions or rotations can violate it.
domain assumption Dense optical flow (Gunnar-Farneback) tracks physical points across two frames via brightness constancy.
Optical flow is both the measurement and, through the predicted-flow warp, the transport model for J. Occlusions, deformations, and out-of-frame motion break it, as acknowledged in the Conclusions.
domain assumption The tendon-driven Musashi can be treated as a conventional joint-axis robot in the control loop.
The experiments rely on prior low-level controllers [15],[16] to map joint angle commands to muscle lengths; if that mapping is imperfect, measured joint velocities do not correspond to actual motion.
ad hoc to paper The diagonal and equal-x/y-variance covariance approximation (Eqs (5)-(7)) is stable and sufficient for dense estimation.
The simplified KF keeps only diagonal, equal x/y variances; the paper states the equality is preserved by induction but does not prove it.
ad hoc to paper The predicted-flow warp (Eq (14)) correctly transports Jacobian estimates across timesteps.
This is the core dense update rule; it assumes the current Jacobian estimate is accurate enough to predict the motion of the same physical point.
ad hoc to paper For self-recognition, robot-body Jacobian clusters are temporally consistent while external-motion clusters fluctuate.
The k-means evaluation heuristic in Algorithm 1 depends on this; the paper acknowledges it fails for non-moving body parts.

how reviews work

0 comments

Cite this review

Pith. "Pith review of DIJE: Dense Image Jacobian Estimation for Robust Robotic Self-Recognition and Visual Servoing." pith.science (2026). https://pith.science/paper/T4NIEEN6

@misc{pith2026250700446,
  author       = {Pith},
  title        = {Pith review of: DIJE: Dense Image Jacobian Estimation for Robust Robotic Self-Recognition and Visual Servoing},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/T4NIEEN6}},
  note         = {Machine review of arXiv:2507.00446}
}

read the original abstract

For robots to move in the real world, they must first correctly understand the state of its own body and the tools that it holds. In this research, we propose DIJE, an algorithm to estimate the image Jacobian for every pixel. It is based on an optical flow calculation and a simplified Kalman Filter that can be efficiently run on the whole image in real time. It does not rely on markers nor knowledge of the robotic structure. We use the DIJE in a self-recognition process which can robustly distinguish between movement by the robot and by external entities, even when the motion overlaps. We also propose a visual servoing controller based on DIJE, which can learn to control the robot's body to conduct reaching movements or bimanual tool-tip control. The proposed algorithms were implemented on a physical musculoskeletal robot and its performance was verified. We believe that such global estimation of the visuomotor policy has the potential to be extended into a more general framework for manipulation.

Figures

Figures reproduced from arXiv: 2507.00446 by the authors.

**Figure 2.** Visualization of each processing step in DIJE and the dense self recognition algorithm. [PITH_FULL_IMAGE:figures/full_fig_p003_2.png] view at source ↗

**Figure 3.** Structure of musculoskeletal humanoid Musashi’s [PITH_FULL_IMAGE:figures/full_fig_p005_3.png] view at source ↗

Figures from the paper (5 more)

**Figure 4.** Figure 4: Self body label ”leaking out” of the actual robot body [PITH_FULL_IMAGE:figures/full_fig_p005_4.png]

**Figure 5.** Figure 5: Experiment setup for the dense image Jacobian [PITH_FULL_IMAGE:figures/full_fig_p006_5.png]

**Figure 7.** Figure 7: Result of reaching experiment for the DIJE-based [PITH_FULL_IMAGE:figures/full_fig_p006_7.png]

**Figure 8.** Figure 8: Result of rake tool-tip control experiment control [PITH_FULL_IMAGE:figures/full_fig_p006_8.png]

**Figure 9.** Figure 9: Result of vacuum tool-tip control experiment using [PITH_FULL_IMAGE:figures/full_fig_p007_9.png]

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

20 extracted references · 20 canonical work pages

[1]

Versatile visual servoing without knowl- edge of true jacobian,

K. Hosoda and M. Asada, “Versatile visual servoing without knowl- edge of true jacobian,” in Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS’94) , vol. 1, Sept. 1994, pp. 186–193 vol.1

work page 1994
[2]

Image jacobian matrix estimation based on online support vector regression,

S. Mao, X. Huang, and M. Wang, “Image jacobian matrix estimation based on online support vector regression,” Int. J. Adv. Rob. Syst. , vol. 9, no. 4, p. 111, Oct. 2012

work page 2012
[3]

Fuzzy adaptive kalman filtering based esti- mation of image jacobian for uncalibrated visual servoing,

X. Lv and X. Huang, “Fuzzy adaptive kalman filtering based esti- mation of image jacobian for uncalibrated visual servoing,” in 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems, Oct. 2006, pp. 2167–2172

work page 2006
[4]

Global visual- motor estimation for uncalibrated visual servoing,

A. M. Farahmand, A. Shademan, and M. Jagersand, “Global visual- motor estimation for uncalibrated visual servoing,” in 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems . IEEE, Oct. 2007, pp. 1969–1974

work page 2007
[5]

Online estimation of image jacobian matrix by Kalman-Bucy filter for uncalibrated stereo vision feedback,

J. Qian and J. Su, “Online estimation of image jacobian matrix by Kalman-Bucy filter for uncalibrated stereo vision feedback,” in Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292) , vol. 1, May 2002, pp. 562–567 vol.1

work page 2002
[6]

Robot-Supervised learning for object segmentation,

V . Florence, J. J. Corso, and B. Griffin, “Robot-Supervised learning for object segmentation,” in 2020 IEEE International Conference on Robotics and Automation (ICRA) , May 2020, pp. 1343–1349

work page 2020
[7]

Robust Few-Shot pose estimation of articulated robots using monocular cameras and Deep-Learning-based keypoint detec- tion,

J. Lambrecht, “Robust Few-Shot pose estimation of articulated robots using monocular cameras and Deep-Learning-based keypoint detec- tion,” in 2019 7th International Conference on Robot Intelligence Technology and Applications (RiTA) , Nov. 2019, pp. 136–141

work page 2019
[8]

Visual articulated tracking in the presence of occlusions,

C. Rauch, T. Hospedales, J. Shotton, and M. Fallon, “Visual articulated tracking in the presence of occlusions,” in 2018 IEEE International Conference on Robotics and Automation (ICRA) , May 2018, pp. 643– 650

work page 2018

Show all 20 references

[9]

Robot arm pose estimation by pixel-wise regression of joint angles,

F. Widmaier, D. Kappler, S. Schaal, and J. Bohg, “Robot arm pose estimation by pixel-wise regression of joint angles,” in 2016 IEEE International Conference on Robotics and Automation (ICRA) , May 2016, pp. 616–623

2016
[10]

Early integration of vision and manipula- tion,

G. Metta and P. Fitzpatrick, “Early integration of vision and manipula- tion,” in Proceedings of the International Joint Conference on Neural Networks, 2003. IEEE, 2004

2003
[11]

Motion-based robotic self- recognition,

P. Michel, K. Gold, and B. Scassellati, “Motion-based robotic self- recognition,” in 2004 IEEE/RSJ International Conference on Intelli- gent Robots and Systems (IROS) (IEEE Cat. No.04CH37566) , vol. 3, Sept. 2004, pp. 2763–2768 vol.3

2004
[12]

What can i control?: The development of visual categories for a robot’s body and the world that it influences,

C. Kemp and A. Edsinger, “What can i control?: The development of visual categories for a robot’s body and the world that it influences,” Proceedings of the Fifth International Conference , 2006

2006
[13]

Component modularized design of musculoskeletal humanoid platform musashi to investigate learning control systems,

K. Kawaharazuka, S. Makino, K. Tsuzuki, M. Onitsuka, Y . Nagamatsu, K. Shinjo, T. Makabe, Y . Asano, K. Okada, K. Kawasaki, and M. In- aba, “Component modularized design of musculoskeletal humanoid platform musashi to investigate learning control systems,” in 2019 IEEE/RSJ Int...

2019
[14]

Human mimetic musculoskele- tal humanoid kengoro toward real world physically interactive ac- tions,

Y . Asano, T. Kozuki, S. Ookubo, M. Kawamura, S. Nakashima, T. Katayama, I. Yanokura, T. Hirose, K. Kawaharazuka, S. Makino, Y . Kakiuchi, K. Okada, and M. Inaba, “Human mimetic musculoskele- tal humanoid kengoro toward real world physically interactive ac- tions,” in 2016 IEE...

2016
[15]

Online self-body image acquisition con- sidering changes in muscle routes caused by softness of body tissue for tendon-driven musculoskeletal humanoids,

K. Kawaharazuka, S. Makino, M. Kawamura, A. Fujii, Y . Asano, K. Okada, and M. Inaba, “Online self-body image acquisition con- sidering changes in muscle routes caused by softness of body tissue for tendon-driven musculoskeletal humanoids,” in 2018 IEEE/RSJ International Confe...

2018
[16]

Online learning of Joint-Muscle mapping using vision in Tendon-Driven musculoskeletal humanoids,

K. Kawaharazuka, S. Makino, M. Kawamura, Y . Asano, K. Okada, and M. Inaba, “Online learning of Joint-Muscle mapping using vision in Tendon-Driven musculoskeletal humanoids,” IEEE Robotics and Automation Letters, vol. 3, no. 2, pp. 772–779, Apr. 2018

2018
[17]

Two-Frame motion estimation based on polynomial expansion,

G. Farneb ¨ack, “Two-Frame motion estimation based on polynomial expansion,” in Image Analysis . Springer Berlin Heidelberg, 2003, pp. 363–370

2003
[18]

Unsupervised learning of dense visual representations,

P. O. O. Pinheiro, A. Almahairi, R. Benmalek, F. Golemo, and A. C. Courville, “Unsupervised learning of dense visual representations,” in Advances in Neural Information Processing Systems , H. Larochelle, M. Ranzato, R. Hadsell, M. F. Balcan, and H. Lin, Eds., vol. 33. Curran ...

2020
[19]

Dense object nets: Learn- ing dense visual object descriptors by and for robotic manipulation,

P. R. Florence, L. Manuelli, and R. Tedrake, “Dense object nets: Learn- ing dense visual object descriptors by and for robotic manipulation,” June 2018

2018
[20]

RAFT-3D: Scene flow using Rigid-Motion embeddings,

Z. Teed and J. Deng, “RAFT-3D: Scene flow using Rigid-Motion embeddings,” in 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), June 2021, pp. 8371–8380

2021

Pith tools

Reviewed August 6, 2026 · model on record in the stance chip above.

[1] [1]

Versatile visual servoing without knowl- edge of true jacobian,

K. Hosoda and M. Asada, “Versatile visual servoing without knowl- edge of true jacobian,” in Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS’94) , vol. 1, Sept. 1994, pp. 186–193 vol.1

work page 1994

[2] [2]

Image jacobian matrix estimation based on online support vector regression,

S. Mao, X. Huang, and M. Wang, “Image jacobian matrix estimation based on online support vector regression,” Int. J. Adv. Rob. Syst. , vol. 9, no. 4, p. 111, Oct. 2012

work page 2012

[3] [3]

Fuzzy adaptive kalman filtering based esti- mation of image jacobian for uncalibrated visual servoing,

X. Lv and X. Huang, “Fuzzy adaptive kalman filtering based esti- mation of image jacobian for uncalibrated visual servoing,” in 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems, Oct. 2006, pp. 2167–2172

work page 2006

[4] [4]

Global visual- motor estimation for uncalibrated visual servoing,

A. M. Farahmand, A. Shademan, and M. Jagersand, “Global visual- motor estimation for uncalibrated visual servoing,” in 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems . IEEE, Oct. 2007, pp. 1969–1974

work page 2007

[5] [5]

Online estimation of image jacobian matrix by Kalman-Bucy filter for uncalibrated stereo vision feedback,

J. Qian and J. Su, “Online estimation of image jacobian matrix by Kalman-Bucy filter for uncalibrated stereo vision feedback,” in Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292) , vol. 1, May 2002, pp. 562–567 vol.1

work page 2002

[6] [6]

Robot-Supervised learning for object segmentation,

V . Florence, J. J. Corso, and B. Griffin, “Robot-Supervised learning for object segmentation,” in 2020 IEEE International Conference on Robotics and Automation (ICRA) , May 2020, pp. 1343–1349

work page 2020

[7] [7]

Robust Few-Shot pose estimation of articulated robots using monocular cameras and Deep-Learning-based keypoint detec- tion,

J. Lambrecht, “Robust Few-Shot pose estimation of articulated robots using monocular cameras and Deep-Learning-based keypoint detec- tion,” in 2019 7th International Conference on Robot Intelligence Technology and Applications (RiTA) , Nov. 2019, pp. 136–141

work page 2019

[8] [8]

Visual articulated tracking in the presence of occlusions,

C. Rauch, T. Hospedales, J. Shotton, and M. Fallon, “Visual articulated tracking in the presence of occlusions,” in 2018 IEEE International Conference on Robotics and Automation (ICRA) , May 2018, pp. 643– 650

work page 2018