Tutorial Materials

Test Endpoints

  • Globus endpoints: Every Globus user has access to two endpoints, Globus Tutorial Endpoint 1 and Globus Tutorial Endpoint 2. These have a 10MB quota and are used mostly to validate that a new Globus account is working.
  • ESnet endpoints: ESnet operates a set of read-only test endpoints on DTNs in various locations around the world. These endpoints host multiple datasets varying in size and number of files; they are a great resource for testing network performance. Type "esnet read-only" in the Globus endpoint search field to find these endpoints.

    Note: The ESnet endpoints are only accessible if you are connected to a research and education network endpoint (including almost all US universities, national laboratories and supercomputing facilties).

Globus Connect Server v5.4 Installation Cheatsheet

Access your instance using the IP address from the Google spreadsheet, e.g. ssh admin1@ Your 'adminN' user has passwordless sudo privileges.

The Globus Connect Server packages are already installed on your instance. For reference, the commands we used to install them on Ubuntu are as follows:

sudo su
curl -LOs http://downloads.globus.org/toolkit/gt6/stable/installers/repo/deb/globus-toolkit-repo_latest_all.deb
dpkg -i globus-connect-server-repo_latest_all.deb
sed -i /etc/apt/sources.list.d/globus-toolkit-6-stable*.list > -e 's/\^# deb /deb /'
sed -i /etc/apt/sources.list.d/globus-connect-server-stable*.list > -e 's/^# deb /deb /'
apt-key add /usr/share/globus-toolkit-repo/RPM-GPG-KEY-Globus
apt-get update
apt-get --assume-yes install globus-connect-server54
Commands for creating the endpoint and adding a data transfer node:

globus-connect-server endpoint setup 'Your Endpoint Name' --organization 'Your Organization Name' \
--client-id <your_GCS_client_ID> --owner <your_Globus_identity>
globus-connect-server node setup --client-id <your_GCS_client_ID>
systemctl restart apache2
globus-connect-server login localhost
globus-connect-server endpoint show
At this point you should have a functioning endpoint and can run the following commands to create a POSIX storage gateway and a mapped collection:

globus-connect-server storage-gateway create posix 'Your Storage Gateway Name' \
--domain oidc.globusdemo.org --authentication-timeout-mins 1440
globus-connect-server collection create <your_storage_gateway_ID> / 'Your Mapped Collection Name'

Globus Connect Server Documentation

  1. Installation Guide  
  2. GCS Command Line Reference  
  3. Video Walkthrough of GCS v5.4 Installation  

Developer Resources

Running Exercises on the Amazon EC2 Instance

Access your instance using the IP address from the Google spreadsheet, e.g. ssh developer1@ The 'developerN' user has passwordless sudo privileges.

To run the Jupyter notebook:
cd ~/globus-jupyter-notebooks
source venv/bin/activate
jupyter notebook --ip="*" --no-browser
When Jupyter starts you will see a message similar to the following:
  Copy/paste this URL into your browser when you connect for the first time,
  to login with a token:
To access the notebook, copy and paste this URL into your browser and then change "localhost" to the IP address of your EC2 instance, e.g. Once the server page loads, click on SDK.ipynb to access the notebook for this tutorial.

Note: If the above command does not work, try running sudo jupyter notebook --ip="*" --no-browser --port 443 instead. If starting the Jupyter notebook this way, point your browser at http://<YOUR_EC2_INSTANCE_IP>:443. Once the server page loads, click on SDK.ipynb to access the notebook for this tutorial.

To run the sample data portal:
cd ~/globus-sample-data-portal
source venv/bin/activate
Then you may access the portal by pointing your browser at https://<YOUR_EC2_INSTANCE_IP>:5000. Note that you must first register your portal with Globus (go to developers.globus.org), otherwise login will fail. After logging in, you must enter a value for "Institution/Department" and save your profile, before attempting to access the transfer or graph functions.

To run the graph service, access your instance via a new shell (seperate from the one that's running the sample data portal) and then do the following:
cd ~/globus-sample-data-portal
source venv/bin/activate
The graph service is now ready to process reqeusts from the sample data portal. Click on the "GRAPH" menu to select the data sets you wish to graph.

To run the native app examples:
cd ~/native-app-examples
source venv/bin/activate
Then you may run either ./example_copy_paste.py or example_copy_paste_refresh_token.py to experiment with different Globus Auth flows. In each case you will need to copy-paste the URL provided into your browser and then copy-paste the auth code from the browser back into your SSH session. Note that example_local_server.py will not run on EC2 instances.

Useful Links