The reviewed record of science sign in
Pith

arxiv: 2307.11224 · v3 · pith:OTY2S4VZ · submitted 2023-07-20 · cs.CL · cs.AI· cs.IR· cs.LG

Jina Embeddings: A Novel Set of High-Performance Sentence Embedding Models

Reviewed by Pith T0 review T1 audit T2 compute T3 formal T4 kernel pith:OTY2S4VZrecord.jsonopen to challenge →

classification cs.CL cs.AIcs.IRcs.LG
keywords embeddingembeddingsjinamodelsdatasetevaluationhigh-performancemodel
0
0 comments X
read the original abstract

Jina Embeddings constitutes a set of high-performance sentence embedding models adept at translating textual inputs into numerical representations, capturing the semantics of the text. These models excel in applications like dense retrieval and semantic textual similarity. This paper details the development of Jina Embeddings, starting with the creation of high-quality pairwise and triplet datasets. It underlines the crucial role of data cleaning in dataset preparation, offers in-depth insights into the model training process, and concludes with a comprehensive performance evaluation using the Massive Text Embedding Benchmark (MTEB). Furthermore, to increase the model's awareness of grammatical negation, we construct a novel training and evaluation dataset of negated and non-negated statements, which we make publicly available to the community.

This paper has not been read by Pith yet.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. Data-CUBE: Data Curriculum for Instruction-based Sentence Representation Learning

    cs.CL 2024-01 unverdicted novelty 5.0

    Data-CUBE applies a two-level curriculum (TSP-based task ordering via simulated annealing plus difficulty-sorted mini-batches) to multi-task instruction tuning and reports gains on MTEB sentence representation tasks.