---
title: opensearch-project/opensearch-neural-sparse-encoding-doc-v2-distill
description: "The model should be selected considering search relevance, model inference and retrieval efficiency(FLOPS). We benchmark models' zero-shot p. DistilBERT, 67M parameters."
canonical_url: https://superlinked.com/models/opensearch-project-opensearch-neural-sparse-encoding-doc-v2-distill
last_updated: 2026-05-25
---

# opensearch-project/opensearch-neural-sparse-encoding-doc-v2-distill

The model should be selected considering search relevance, model inference and retrieval efficiency(FLOPS). We benchmark models' zero-shot performance on a subset of BEIR benchmark: TrecCovid,NFCorpus,NQ,HotpotQA,FiQA,ArguAna,Touche,DBPedia,SCIDOCS,FEVER,Climate FEVER,SciFact,Quora.

Source: [opensearch-project/opensearch-neural-sparse-encoding-doc-v2-distill on HuggingFace](https://huggingface.co/opensearch-project/opensearch-neural-sparse-encoding-doc-v2-distill)

## Overview

| Field | Value |
|-------|-------|
| Architecture | DistilBERT |
| Parameters | 67M |
| Tasks | Encode |
| Outputs | Sparse |
| Dimensions | Sparse: 30,522 |
| Max sequence length | 512 tokens |
| License | apache-2.0 |
| Inputs | text |
| Languages | en |

## Benchmarks

### CQADupstackPhysicsRetrieval

Domain: scientific · Task: retrieval · Language: en

Duplicate question retrieval from StackExchange Physics

Corpus: 38,314 · Queries: 1,039

**Performance (L4 b1 c16):** Corpus 31.0K tok/s · Corpus p50 60.2ms · Query 4.1K tok/s · Query p50 41.5ms

[Reference](http://nlp.cis.unimelb.edu.au/resources/cqadupstack/)

### CosQA

Domain: technology · Task: retrieval · Language: en

Code search with natural language queries

Corpus: 6,267 · Queries: 500

**Performance (L4 b1 c16):** Corpus 17.8K tok/s · Corpus p50 46.4ms · Query 2.6K tok/s · Query p50 37.3ms

[Reference](https://arxiv.org/abs/2105.13239)

### FiQA2018

Domain: finance · Task: retrieval · Language: en

Financial opinion mining and question answering

Corpus: 57,599 · Queries: 648

**Performance (L4 b1 c16):** Corpus 43.5K tok/s · Corpus p50 56.2ms · Query 4.2K tok/s · Query p50 42.8ms

[Reference](https://sites.google.com/view/fiqa/)

### LegalBenchConsumerContractsQA

Domain: legal · Task: retrieval · Language: en

Question answering on consumer contracts

Corpus: 153 · Queries: 396

**Performance (L4 b1 c16):** Corpus 104.9K tok/s · Corpus p50 72.6ms · Query 6.9K tok/s · Query p50 37.3ms

[Reference](https://huggingface.co/datasets/nguha/legalbench)

### NFCorpus

Domain: medical · Task: retrieval · Language: en

Biomedical literature search from NutritionFacts.org

Corpus: 3,593 · Queries: 323

**Quality:** ndcg at 10: 0.3398 · map at 10: 0.1303 · mrr at 10: 0.5489

**Performance (L4 b1 c16):** Corpus 56.8K tok/s · Corpus p50 70.8ms · Query 1.8K tok/s · Query p50 41.7ms

[Reference](https://www.cl.uni-heidelberg.de/statnlpgroup/nfcorpus/)

### SCIDOCS

Domain: scientific · Task: retrieval · Language: en

Citation prediction, document classification, and recommendation for scientific papers

Corpus: 25,656 · Queries: 1,000

**Performance (L4 b1 c16):** Corpus 48.7K tok/s · Corpus p50 58.5ms · Query 4.7K tok/s · Query p50 37.7ms

[Reference](https://allenai.org/data/scidocs)

### SciFact

Domain: scientific · Task: retrieval · Language: en

Scientific claim verification using research literature

Corpus: 5,183 · Queries: 300

**Performance (L4 b1 c16):** Corpus 60.2K tok/s · Corpus p50 66.4ms · Query 5.8K tok/s · Query p50 44.1ms

[Reference](https://github.com/allenai/scifact)

### StackOverflowQA

Domain: technology · Task: retrieval · Language: en

Programming question answering from Stack Overflow

Corpus: 19,931 · Queries: 1,994

**Performance (L4 b1 c16):** Corpus 49.6K tok/s · Corpus p50 70.8ms · Query 77.6K tok/s · Query p50 52.3ms

[Reference](https://arxiv.org/abs/2407.02883)