Tutorial Materials


Test Endpoints

  • Globus endpoints: Every Globus user has access to two endpoints, Globus Tutorial Endpoint 1 and Globus Tutorial Endpoint 2. These have a 10MB quota and are used mostly to validate that a new Globus account is working.
  • ESnet endpoints: ESnet operates a set of read-only test endpoints on DTNs in various locations around the world. These endpoints host multiple datasets varying in size and number of files; they are a great resource for testing network performance. Type "esnet read-only" in the Globus endpoint search field to find these endpoints.

    Note: The ESnet endpoints are only accessible if you are connected to a research and education network endpoint (including almost all US universities, national laboratories and supercomputing facilties).

Globus Connect Server Installation on the EC2 Tutorial Server

Access your instance using the IP address from the Google spreadsheet, e.g. ssh globus@50.51.52.53. The 'campusadmin' user has passwordless sudo privileges.

Commands for installing Globus Connect Server v4 (use this list unless the instructor directs you otherwise):

$ ssh campusadmin@<YOUR_EC2_MACHINE_ADDRESS>
sudo su
curl -LOs https://downloads.globus.org/toolkit/globus-connect-server/globus-connect-server-repo_latest_all.deb
dpkg -i globus-connect-server-repo_latest_all.deb
apt-get update
apt-get -y install globus-connect-server
globus-connect-server-setup
Commands for installing Globus Connect Server v5.3 (for comparative purposes only):

sudo curl -LOs http://downloads.globus.org/toolkit/gt6/stable/installers/repo/deb/globus-toolkit-repo_latest_all.deb
sudo dpkg -i globus-toolkit-repo_latest_all.deb
sudo sed -i /etc/apt/sources.list.d/globus-toolkit-6-stable*.list -e 's/^# deb /deb /'
sudo sed -i /etc/apt/sources.list.d/globus-connect-server-stable*.list -e 's/^# deb /deb /'
sudo apt-get install software-properties-common
sudo add-apt-repository ppa:certbot/certbot
sudo apt-get update
sudo apt-get install globus-connect-server53

Globus Connect Server Configuration

  1. Edit the configuration file: /etc/globus-connect-server.conf
  2. Enable the configuration changes: # globus-connect-server-setup

Developer Documentation

Running Exercises on the Amazon EC2 Instance

Access your instance using the IP address from the Google spreadsheet, e.g. ssh globus@50.51.52.53. The 'globus' user has passwordless sudo privileges.

To run the Jupyter notebook:
cd ~/globus-jupyter-notebooks
source venv/bin/activate
jupyter notebook --ip="*" --no-browser
When Jupyter starts you will see a message similar to the following:
  Copy/paste this URL into your browser when you connect for the first time,
  to login with a token:
      http://localhost:8888/?token=8c325c7db3898b3af29fc9cbfaa6cbab076e3103c7aea015
To access the notebook, copy and paste this URL into your browser and then change "localhost" to the IP address of your EC2 instance, e.g. http://32.35.136.137:8888/?token=8c325c7db3898b3af29fc9cbfaa6cbab076e3103c7aea015. Once the server page loads, click on SDK.ipynb to access the notebook for this tutorial.

Note: If the above command does not work, try running sudo jupyter notebook --ip="*" --no-browser --port 443 instead. If starting the Jupyter notebook this way, point your browser at http://<YOUR_EC2_INSTANCE_IP>:443. Once the server page loads, click on SDK.ipynb to access the notebook for this tutorial.

To run the sample data portal:
cd ~/globus-sample-data-portal
source venv/bin/activate
./run_portal.py
Then you may access the portal by pointing your browser at https://<YOUR_EC2_INSTANCE_IP>:5000. Note that you must first register your portal with Globus (go to developers.globus.org), otherwise login will fail. After logging in, you must enter a value for "Institution/Department" and save your profile, before attempting to access the transfer or graph functions.

To run the graph service, access your instance via a new shell (seperate from the one that's running the sample data portal) and then do the following:
cd ~/globus-sample-data-portal
source venv/bin/activate
./run_service.py
The graph service is now ready to process reqeusts from the sample data portal. Click on the "GRAPH" menu to select the data sets you wish to graph.

To run the native app examples:
cd ~/native-app-examples
source venv/bin/activate
Then you may run either ./example_copy_paste.py or example_copy_paste_refresh_token.py to experiment with different Globus Auth flows. In each case you will need to copy-paste the URL provided into your browser and then copy-paste the auth code from the browser back into your SSH session. Note that example_local_server.py will not run on EC2 instances.

Useful Links