Tutorial Materials

Test Endpoints

Globus endpoints: Every Globus user has access to two endpoints, Globus Tutorial Endpoint 1 and Globus Tutorial Endpoint 2. These have a 10MB quota and are used mostly to validate that a new Globus account is working.
ESnet endpoints: ESnet operates a set of read-only test endpoints on DTNs in various locations around the world. These endpoints host multiple datasets varying in size and number of files; they are a great resource for testing network performance. Type "esnet read-only" in the Globus endpoint search field to find these endpoints.

Note: The ESnet endpoints are only accessible if you are connected to a research and education network endpoint (including almost all US universities, national laboratories and supercomputing facilties).

Globus Connect Server Installation on the EC2 Tutorial Server

Access your instance using the IP address from the Google spreadsheet, e.g. ssh globus@50.51.52.53. The 'campusadmin' user has passwordless sudo privileges.

Commands for installing Globus Connect Server v4 (use this list unless the instructor directs you otherwise):

$ ssh campusadmin@<YOUR_EC2_MACHINE_ADDRESS>
sudo su
curl -LOs https://downloads.globus.org/toolkit/globus-connect-server/globus-connect-server-repo_latest_all.deb
dpkg -i globus-connect-server-repo_latest_all.deb
apt-get update
apt-get -y install globus-connect-server
globus-connect-server-setup

Commands for installing Globus Connect Server v5.3 (for comparative purposes only):

sudo curl -LOs http://downloads.globus.org/toolkit/gt6/stable/installers/repo/deb/globus-toolkit-repo_latest_all.deb
sudo dpkg -i globus-toolkit-repo_latest_all.deb
sudo sed -i /etc/apt/sources.list.d/globus-toolkit-6-stable*.list -e 's/^# deb /deb /'
sudo sed -i /etc/apt/sources.list.d/globus-connect-server-stable*.list -e 's/^# deb /deb /'
sudo apt-get install software-properties-common
sudo add-apt-repository ppa:certbot/certbot
sudo apt-get update
sudo apt-get install globus-connect-server53

Globus Connect Server Configuration

Edit the configuration file: /etc/globus-connect-server.conf
Enable the configuration changes: # globus-connect-server-setup

Developer Documentation

Transfer API Reference: docs.globus.org/api/transfer
Auth API Reference: docs.globus.org/api/auth
Client App Registration: developers.globus.org
Globus Python SDK: globus-sdk-python.readthedocs.io
Web App Helper Pages: docs.globus.org/api/helper-pages
The Science DMZ (presentation by Eli Dart, ESNet) (1.5MB)

Running Exercises on the Amazon EC2 Instance

Access your instance using the IP address from the Google spreadsheet, e.g. ssh globus@50.51.52.53. The 'globus' user has passwordless sudo privileges.

To run the Jupyter notebook:

cd ~/globus-jupyter-notebooks
source venv/bin/activate
jupyter notebook --ip="*" --no-browser

When Jupyter starts you will see a message similar to the following:

  Copy/paste this URL into your browser when you connect for the first time,
  to login with a token:
      http://localhost:8888/?token=8c325c7db3898b3af29fc9cbfaa6cbab076e3103c7aea015

To access the notebook, copy and paste this URL into your browser and then change "localhost" to the IP address of your EC2 instance, e.g. http://32.35.136.137:8888/?token=8c325c7db3898b3af29fc9cbfaa6cbab076e3103c7aea015. Once the server page loads, click on SDK.ipynb to access the notebook for this tutorial.

Note: If the above command does not work, try running sudo jupyter notebook --ip="*" --no-browser --port 443 instead. If starting the Jupyter notebook this way, point your browser at http://<YOUR_EC2_INSTANCE_IP>:443. Once the server page loads, click on SDK.ipynb to access the notebook for this tutorial.

To run the sample data portal:

cd ~/globus-sample-data-portal
source venv/bin/activate
./run_portal.py

Then you may access the portal by pointing your browser at https://<YOUR_EC2_INSTANCE_IP>:5000. Note that you must first register your portal with Globus (go to developers.globus.org), otherwise login will fail. After logging in, you must enter a value for "Institution/Department" and save your profile, before attempting to access the transfer or graph functions.

To run the graph service, access your instance via a new shell (seperate from the one that's running the sample data portal) and then do the following:

cd ~/globus-sample-data-portal
source venv/bin/activate
./run_service.py

The graph service is now ready to process reqeusts from the sample data portal. Click on the "GRAPH" menu to select the data sets you wish to graph.

To run the native app examples:

cd ~/native-app-examples
source venv/bin/activate

Then you may run either ./example_copy_paste.py or example_copy_paste_refresh_token.py to experiment with different Globus Auth flows. In each case you will need to copy-paste the URL provided into your browser and then copy-paste the auth code from the browser back into your SSH session. Note that example_local_server.py will not run on EC2 instances.

Useful Links

Globus Login: app.globus.org/login
Connect your laptop to Globus: Mac OS · Windows · Linux
Create a Globus endpoint on your server: Globus Connect Server Installation Guide
FAQs: docs.globus.org/faq
Mailing Lists: globus.org/mailing-lists
Help Desk: support@globus.org
Science DMZ info: ESnet Fasterdata Knowledge Base , perfSONAR home
Follow Globus: @globus