/datasets
directory. You have read-only access to this directory so you can initiate outbound transfers to your own destination endpoint./perftest
directory; use a descriptive name for your subdirectory so that it's easily identifiable by all, e.g. esnet-team
.Name | Total Size | Description |
---|---|---|
ds01 | 100MB | 10,000 x 10KB files in single directory |
ds04 | 10GB | 10,000 x 1MB files in 100 non-nested directories, 100 files/directory |
ds06 | 100GB | 100,000 x 1MB files in single directory |
ds08 | 1TB | 50 x 10GB; 350 x 1GB; 1,000 x 100MB; 5,500 x 10MB; 23,176 x 1MB files in single directory |
ds10 | 1TB | 100 x 10GB files in single directory |
ds12 | 100GB | 1 x 100GB file in single directory |
ds14 | 5TB | 50 x 100GB files in single directory |
ds16 | 1TB | 4 x 250GB files in single directory |
Display Name | Description |
---|---|
cac_dtn_test (606579ae-5b03-11e9-bf32-0edbf3a4e7ee) |
Cornell Center for Advanced Computing in Ithaca, NY |
DME Datasets - Boston (e6992bda-c0b4-11e9-98dc-0a63aa6b37da) |
Lustre filesystem located in Harvard's Boston datacenter |
DME Datasets - MGHPCC (6e8e1a56-beb6-11e9-9ceb-0edb67dd7a14) |
Lustre filesystem located at the MGHPCC |
DME Datasets - Argonne (e261ffb8-6d04-11e5-ba46-22000b92c6ec) |
IBM Spectrum Scale filesystem on the Petrel system at Argonne National Lab |
Pamela Hill Data Share (924a32b0-6a2a-11e6-83a8-22000b97daec) |
NCAR GLADE (IBM Spectrum Scale) filesystem in Boulder, CO |
Display Name | Description | Quota |
---|---|---|
cac_dtn_test (606579ae-5b03-11e9-bf32-0edbf3a4e7ee) |
Cornell Center for Advanced Computing in Ithaca, NY | Unknown |
DME PerfTest - Boston (38b0ee04-c0b4-11e9-939a-02ff96a5aa76) |
Lustre filesystem located in Harvard's Boston datacenter | 10TB |
DME PerfTest - MGHPCC (8c799234-be52-11e9-9ceb-0edb67dd7a14) |
Lustre filesystem located at the MGHPCC in Holyoke, MA | Unknown |
DME PerfTest - Argonne (e261ffb8-6d04-11e5-ba46-22000b92c6ec) |
IBM Spectrum Scale filesystem on the Petrel system at Argonne National Lab (Petrel detailed description) | 10TB |
DME PerfTest - Michigan (0ddccd16-c04a-11e9-9cec-0edb67dd7a14) |
Turbo system on the Flux cluster at the University of Michigan | 100GB |
Pamela Hill Data Share (924a32b0-6a2a-11e6-83a8-22000b97daec) |
NCAR GLADE (IBM Spectrum Scale) filesystem in Boulder, CO
This endpoint has multiple 40Gbps links to the Internet2 100Gbps backbone so you should see great performance (assuming the destination endpoint is well-provisioned).
|
Unknown |
DME PerfTest - Google Drive (fc185009-345f-4a62-9ae3-21e8e79960c6) |
Google Drive cloud storage accessed via an EC2 DTN in the us-east-1 region
Note: Google Drive imposes rate limits on their API so expect throttling when transferring datasets with many files.
|
None |
DME PerfTest - Box (401f8d2d-8797-4611-8521-196870dbf9fd) |
Box cloud accessed via an EC2 DTN in the us-east-1 region
Note: In addition to API rate limits, Box imposes a filesize limit of 15GB; do not attempt to transfer ds12, ds14, or ds16.
|
None |