pith. sign in

Janossy pooling: Learning deep permutation-invariant functions for variable-size inputs.arXiv:1811.01900

3 Pith papers cite this work. Polarity classification is still indexing.

3 Pith papers citing it
abstract

We consider a simple and overarching representation for permutation-invariant functions of sequences (or multiset functions). Our approach, which we call Janossy pooling, expresses a permutation-invariant function as the average of a permutation-sensitive function applied to all reorderings of the input sequence. This allows us to leverage the rich and mature literature on permutation-sensitive functions to construct novel and flexible permutation-invariant functions. If carried out naively, Janossy pooling can be computationally prohibitive. To allow computational tractability, we consider three kinds of approximations: canonical orderings of sequences, functions with $k$-order interactions, and stochastic optimization algorithms with random permutations. Our framework unifies a variety of existing work in the literature, and suggests possible modeling and algorithmic extensions. We explore a few in our experiments, which demonstrate improved performance over current state-of-the-art methods.

fields

cs.LG 3

representative citing papers

How Powerful are Graph Neural Networks?

cs.LG · 2018-10-01 · accept · novelty 9.0

GIN is provably as expressive as the Weisfeiler-Lehman graph isomorphism test, while GCN and GraphSAGE have strictly weaker discriminative power on some graphs.

citing papers explorer

Showing 3 of 3 citing papers.