{"paper":{"title":"Balance Between Efficient and Effective Learning: Dense2Sparse Reward Shaping for Robot Manipulation with Environment Uncertainty","arxiv_id":"2003.02740","primary_cat":"cs.LG","submitted_at":"2020-03-05T16:10:15+00:00","version_compiled":"v1"},"notice":"Every quoted sentence is the authors' text from the arXiv listing abstract. Labels and probabilities are the outputs of classifier-1.13.0 on the question bank abstract-p1-20260923, exactly as returned. No sentence in this record was written by a language model.","schema":"pith.compiled-record/v0","status":"compiled","abstract":{"source":"arXiv listing abstract v1","sentences":[{"i":0,"p":0.95,"id":"s0","own":false,"role":"background","text":"Efficient and effective learning is one of the ultimate goals of the deep reinforcement learning (DRL), although the compromise has been made in most of the time, especially for the application of robot manipulations.","hedge":{"p":1.0,"label":"asserted"},"own_p":0.05,"main_claim_p":0.04,"quantitative":false,"quantitative_p":0.12,"role_probabilities":{"gap":0.05,"method":0.0,"result":0.0,"background":0.95,"limitation":0.0,"future_work":0.0,"contribution":0.0,"interpretation":0.0}},{"i":1,"p":0.98,"id":"s1","own":false,"role":"background","text":"Learning is always expensive for robot manipulation tasks and the learning effectiveness could be affected by the system uncertainty.","hedge":{"p":0.6,"label":"asserted"},"own_p":0.07,"main_claim_p":0.02,"quantitative":false,"quantitative_p":0.05,"role_probabilities":{"gap":0.02,"method":0.0,"result":0.0,"background":0.98,"limitation":0.0,"future_work":0.0,"contribution":0.0,"interpretation":0.0}},{"i":2,"p":0.92,"id":"s2","own":true,"role":"contribution","text":"In order to solve above challenges, in this study, we proposed a simple but powerful reward shaping method, namely Dense2Sparse.","hedge":{"p":0.99,"label":"asserted"},"own_p":0.89,"main_claim_p":0.06,"quantitative":false,"quantitative_p":0.03,"role_probabilities":{"gap":0.0,"method":0.08,"result":0.0,"background":0.0,"limitation":0.0,"future_work":0.0,"contribution":0.92,"interpretation":0.0}},{"i":3,"p":0.81,"id":"s3","own":false,"role":"method","text":"It combines the advantage of fast convergence of dense reward and the noise isolation of the sparse reward, to achieve a balance between learning efficiency and effectiveness, which makes it suitable for robot manipulation tasks.","hedge":{"p":1.0,"label":"asserted"},"own_p":0.46,"main_claim_p":0.28,"quantitative":false,"quantitative_p":0.13,"role_probabilities":{"gap":0.0,"method":0.81,"result":0.0,"background":0.0,"limitation":0.0,"future_work":0.0,"contribution":0.17,"interpretation":0.02}},{"i":4,"p":0.97,"id":"s4","own":true,"role":"method","text":"We evaluated our Dense2Sparse method with a series of ablation experiments using the state representation model with system uncertainty.","hedge":{"p":0.93,"label":"asserted"},"own_p":0.96,"main_claim_p":0.04,"quantitative":false,"quantitative_p":0.06,"role_probabilities":{"gap":0.0,"method":0.97,"result":0.0,"background":0.0,"limitation":0.0,"future_work":0.0,"contribution":0.03,"interpretation":0.0}},{"i":5,"p":1.0,"id":"s5","own":true,"role":"result","text":"The experiment results show that the Dense2Sparse method obtained higher expected reward compared with the ones using standalone dense reward or sparse reward, and it also has a superior tolerance of system uncertainty.","hedge":{"p":1.0,"label":"asserted"},"own_p":0.97,"main_claim_p":0.86,"quantitative":true,"quantitative_p":0.95,"role_probabilities":{"gap":0.0,"method":0.0,"result":1.0,"background":0.0,"limitation":0.0,"future_work":0.0,"contribution":0.0,"interpretation":0.0}}]},"compiled":{"main_claim":{"p":1.0,"text":"The experiment results show that the Dense2Sparse method obtained higher expected reward compared with the ones using standalone dense reward or sparse reward, and it also has a superior tolerance of system uncertainty.","location":"abstract s5","hedge_strength":{"p":1.0,"label":"asserted"}},"provenance":{"route":{"via":"TypeSafe API","model":"classifier-1.13.0","endpoint":"https://api.typesafe.ai/v1/systemone","provider":"TypeSafe"},"packing":"one request per paper","requests":1,"input_tokens":4948,"cost_usd_reported":0.0},"compiled_at":"2026-09-23","bank_version":"abstract-p1-20260923","model_version":"classifier-1.13.0","abstract_states":{"claims_first":0.04,"states_limitation":0.13,"human_participants":0.02,"controlled_comparison":0.91,"randomized_assignment":0.02,"states_quantitative_result":0.08,"compares_with_prior_results":0.91,"mentions_code_or_data_availability":0.02},"evidential_basis":{"p":0.84,"value":"observation or experiment","probabilities":{"argument":0.0,"literature":0.0,"proof_or_derivation":0.0,"analysis_of_existing_data":0.0,"observation_or_experiment":0.84,"simulation_or_computation":0.16}},"contribution_type":{"p":1.0,"value":"method or tool","probabilities":{"review":0.0,"method_or_tool":1.0,"empirical_study":0.0,"simulation_study":0.0,"theoretical_result":0.0,"dataset_or_benchmark":0.0,"position_or_commentary":0.0}},"contribution_statement":{"p":1.0,"text":"In order to solve above challenges, in this study, we proposed a simple but powerful reward shaping method, namely Dense2Sparse.","location":"abstract s2"}},"coverage":{"tier":"abstract","levels_run":["P abstract"],"not_examined":["full text","figures and tables","references and citing sentences","relations to other papers"],"sources_read":["arXiv listing abstract v1"],"levels_not_run":["S sections","T body sentences","C citations","R cross-paper relations"],"sentences_examined":6,"sentences_in_abstract":6},"measured_accuracy":{"url":"https://pith.science/accuracy","measured_on":"2026-10-02","method":"two independent model families labelled a fresh random sample blind; the figure is how often the published label matches their consensus","sentence_role_agreement":0.92,"main_claim_agreement":0.908,"typed_citation_agreement":0.933,"typed_citation_agreement_95_interval":[0.917,0.945],"review_comments_accurate":0.758,"review_comments_accurate_95_interval":[0.684,0.82],"review_caught_admitted_error_found_or_related":0.448,"review_comments_judged":{"judged_by":["gpt-5.6-luna","grok-4.7"],"judged_against":"Pith's own text copy of each paper: text extracted from the PDF, the first 90,000 characters","measured_on":"2026-10-04","accurate":113,"decided":149,"sampled_reviews":200,"split_by_lane":false,"by_lane":"https://pith.science/accuracy#by-lane"}}}