dorsal/arxiv
View SchemaMagda - Manager for grid-based data
| Authors | Wensheng Deng, Torre Wenaus |
|---|---|
| Categories | |
| ArXiv ID | physics/0306105 |
| URL | https://arxiv.org/abs/physics/0306105 |
Abstract
Magda is a distributed data manager prototype for grid-resident data. It makes use of the MySQL open source relational database, Perl, Java and C++ to provide file cataloging, retrieval and replication services. For data movement, gridFTP, bbftp and scp can be chosen depending on available protocols. Third party transfers are supported. Magda currently catalogs 321K files with total size of 85.8 TB. It was successfully used in the Data Challenge 1 production for the Atlas experiment. It has been used to replicate more than 7 TB of data between BNL and CERN mass stores. We present here the design and implementation of Magda, and how it has been used as a file catalog and replication tool.
{
"annotation_id": "b6c48058-ca96-4457-b035-b5a4dce303cc",
"date_created": "2026-03-02T18:00:43.306000Z",
"date_modified": "2026-03-02T18:00:43.306000Z",
"file_hash": "936d2eb635bf155dd2e201f93de455d4271b1907bf2822a83b4239390d9988a1",
"private": false,
"record": {
"abstract": "Magda is a distributed data manager prototype for grid-resident data. It\nmakes use of the MySQL open source relational database, Perl, Java and C++ to\nprovide file cataloging, retrieval and replication services. For data movement,\ngridFTP, bbftp and scp can be chosen depending on available protocols. Third\nparty transfers are supported. Magda currently catalogs 321K files with total\nsize of 85.8 TB. It was successfully used in the Data Challenge 1 production\nfor the Atlas experiment. It has been used to replicate more than 7 TB of data\nbetween BNL and CERN mass stores. We present here the design and implementation\nof Magda, and how it has been used as a file catalog and replication tool.",
"arxiv_id": "physics/0306105",
"authors": [
"Wensheng Deng",
"Torre Wenaus"
],
"categories": [
"physics.comp-ph"
],
"title": "Magda - Manager for grid-based data",
"url": "https://arxiv.org/abs/physics/0306105"
},
"schema_id": "dorsal/arxiv",
"source": {
"execution_id": "a3cb4865-29c6-4de8-83c4-bed6c367b858",
"id": "arXiv Dataset IDs",
"type": "Model",
"variant": "snapshot-2026-03-01",
"version": "0.1.0"
},
"user_id": 1000002
}