dorsal/arxiv
View SchemaMining Mass Spectra: Metric Embeddings and Fast Near Neighbor Search
| Authors | Debojyoti Dutta, Ting Chen |
|---|---|
| Categories | |
| ArXiv ID | q-bio/0603002 |
| URL | https://arxiv.org/abs/q-bio/0603002 |
Abstract
Mining large-scale high-throughput tandem mass spectrometry data sets is a very important problem in mass spectrometry based protein identification. One of the fundamental problems in large scale mining of spectra is to design appropriate metrics and algorithms to avoid all-pair-wise comparisons of spectra. In this paper, we present a general framework based on vector spaces to avoid pair-wise comparisons. We first robustly embed spectra in a high dimensional space in a novel fashion and then apply fast approximate near neighbor algorithms for tasks such as constructing filters for database search, indexing and similarity searching. We formally prove that our embedding has low distortion compared to the cosine similarity, and, along with locality sensitive hashing (LSH), we design filters for database search that can filter out more than 989% of peptides (118 times less) while missing at most 0.29% of the correct sequences. We then show how our framework can be used in similarity searching, which can then be used to detect tight clusters or replicates. On an average, for a cluster size of 16 spectra, LSH only misses 1 spectrum and admits only 1 false spectrum. In addition, our framework in conjunction with dimension reduction techniques allow us to visualize large datasets in 2D space. Our framework also has the potential to embed and compare datasets with post translation modifications (PTM).
{
"annotation_id": "fadc125b-001b-4b40-a406-24f0f02f1ccb",
"date_created": "2026-03-02T18:01:35.618000Z",
"date_modified": "2026-03-02T18:01:35.618000Z",
"file_hash": "27a239eb642551ff3d9be261290288f199db903dfd93d31dbbf33e3fe4b2b024",
"private": false,
"record": {
"abstract": "Mining large-scale high-throughput tandem mass spectrometry data sets is a\nvery important problem in mass spectrometry based protein identification. One\nof the fundamental problems in large scale mining of spectra is to design\nappropriate metrics and algorithms to avoid all-pair-wise comparisons of\nspectra. In this paper, we present a general framework based on vector spaces\nto avoid pair-wise comparisons. We first robustly embed spectra in a high\ndimensional space in a novel fashion and then apply fast approximate near\nneighbor algorithms for tasks such as constructing filters for database search,\nindexing and similarity searching. We formally prove that our embedding has low\ndistortion compared to the cosine similarity, and, along with locality\nsensitive hashing (LSH), we design filters for database search that can filter\nout more than 989% of peptides (118 times less) while missing at most 0.29% of\nthe correct sequences. We then show how our framework can be used in similarity\nsearching, which can then be used to detect tight clusters or replicates. On an\naverage, for a cluster size of 16 spectra, LSH only misses 1 spectrum and\nadmits only 1 false spectrum. In addition, our framework in conjunction with\ndimension reduction techniques allow us to visualize large datasets in 2D\nspace. Our framework also has the potential to embed and compare datasets with\npost translation modifications (PTM).",
"arxiv_id": "q-bio/0603002",
"authors": [
"Debojyoti Dutta",
"Ting Chen"
],
"categories": [
"q-bio.QM",
"q-bio.OT"
],
"title": "Mining Mass Spectra: Metric Embeddings and Fast Near Neighbor Search",
"url": "https://arxiv.org/abs/q-bio/0603002"
},
"schema_id": "dorsal/arxiv",
"source": {
"execution_id": "955ca1b5-6fd5-422d-a024-8c96f8d76eb6",
"id": "arXiv Dataset IDs",
"type": "Model",
"variant": "snapshot-2026-03-01",
"version": "0.1.0"
},
"user_id": 1000002
}