REVIEW 6 cited by
A Survey on Multi-Task Learning
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Multi-Task Learning (MTL) is a learning paradigm in machine learning and its aim is to leverage useful information contained in multiple related tasks to help improve the generalization performance of all the tasks. In this paper, we give a survey for MTL from the perspective of algorithmic modeling, applications and theoretical analyses. For algorithmic modeling, we give a definition of MTL and then classify different MTL algorithms into five categories, including feature learning approach, low-rank approach, task clustering approach, task relation learning approach and decomposition approach as well as discussing the characteristics of each approach. In order to improve the performance of learning tasks further, MTL can be combined with other learning paradigms including semi-supervised learning, active learning, unsupervised learning, reinforcement learning, multi-view learning and graphical models. When the number of tasks is large or the data dimensionality is high, we review online, parallel and distributed MTL models as well as dimensionality reduction and feature hashing to reveal their computational and storage advantages. Many real-world applications use MTL to boost their performance and we review representative works in this paper. Finally, we present theoretical analyses and discuss several future directions for MTL.
Forward citations
Cited by 6 Pith papers
-
Learning Adaptive Multi-Task Guidance, Navigation, and Control via Hypernetworks
A hypernetwork maps continuous physics-informed task embeddings to shared actor-critic weights, mastering four orbital GNC tasks and composing novel ones without retraining, with sim-to-real on a floating platform.
-
PEML: Parameter-efficient Multi-Task Learning with Optimized Continuous Prompts
PEML co-optimizes continuous prompts and low-rank adaptations to deliver up to 6.67% average accuracy gains over existing multi-task PEFT methods on GLUE, SuperGLUE, and other benchmarks.
-
Improving Vessel Segmentation with Multi-Task Learning and Auxiliary Data Available Only During Model Training
Using contrast-enhanced MRI only during training, a multi-task Y-Net improves non-contrast liver vessel segmentation, with the largest gains when annotations are scarce.
-
One Joke to Rule them All? On the (Im)possibility of Generalizing Humor
LLMs fine-tuned on one to three humor datasets transfer partially to unseen humor types (up to 75% accuracy); diverse training helps modestly, and dad jokes enable transfer best but resist it as a target.
-
Efficient Multi-Domain Network Learning by Covariance Normalization
CovNorm reduces parameters in domain-adaptive layers via two PCAs and a mini-adaptation layer, enabling efficient multi-domain learning with performance close to full fine-tuning.
-
Multitask Learning for Blackmarket Tweet Detection
A multitask learning framework with soft parameter sharing between classification and regression tasks detects blackmarket tweets at F1-score 0.89.
Discussion (0). Sign in to comment.