Jetstream2 FAQ Home¶
For specific FAQs, see the following pages:
I was added to an allocation but can’t access Jetstream2?¶
It can take up to four hours for ACCESS to sync up everything to Jetstream2. If you were added recently, we recommend trying later. If you still cannot access your Jetstream2 account and your PI or resource manager has confirmed that you are on a valid allocation, contact Jetstream2 help.
Use ACCESS CI credentials if you’re having trouble authenticating
We know ACCESS-CI credentials work correctly and recommend using those unless you are 100% sure you have linked credentials PREVIOUSLY in CILogon.
Please note that other CILogon credentials (i.e. for your home institution or Google) must be set up outside of this process. Follow these Linking instructions to link your home institution or other organization (e.g. Google, ORCID, etc) credentials.
How do I cite Jetstream2 ?¶
The Jetstream2 team requests that all researchers using Jetstream2 cite us in any publications that utilize results that were computed or created on Jetstream2. We keep the most up to date citation information here - Jetstream2 Citation Information
I need a root disk larger than the maximum size for Jetstream2 instances. Can you create a custom flavor for me?¶
In OpenStack, flavors define the compute, memory, and storage capacity of instances. We may also refer to it in support tickets or documentation as the VM’s size.
We won’t create custom flavors, but there are ways to get larger root disks. You can review the flavors and see if moving up from one of the smaller VMs to a slightly larger one would yield a larger root disk. The other option is to use a custom sized root disk using what Openstack calls “boot from volume”, or a “volume-backed” instance. What this means is that instead of an ephemeral boot disk for the instance, a volume is used to be the root disk.
There are several upsides to this:
- You can have a root disk large enough to fit your needs
- The disk becomes reusable as a volume if necessary
- Shelving the instance is extremely fast compared to shelving a typical instance
The downside is that using boot from volume will count against your Jetstream2-Storage allocation whereas root disks do not.
Instructions for using boot from volume are here:
How do I get access to one of the Jetstream2 regional clouds?¶
The regional clouds of Jetstream2 (Arizona State University, Cornell University, University of Hawai’i, and Texas Advanced Computing Center) are available via invitation only. They have limited resources and the local PIs have discretion as to which projects may run there.
All allocations gain access to the primary Jetstream2 cloud at Indiana University. If you have an allocation and wish to have it added to a regional cloud, you can request access using this form
As the regional clouds have autonomy over their access and because resources are limited, it’s important to note that not all requests may be accommodated.
Will there be Microsoft Windows support on Jetstream2 ?¶
Microsoft Windows is not officially supported on Jetstream2. We will be making a limited number of images available for experimental use.
It is not known at this time whether GPUs will work on Microsoft-based instances. We will test this as time permits.
More information may be found on the Microsoft Windows on Jetstream2 page.
How do I share a volume between virtual machines?¶
You can’t easily share volumes in OpenStack without deploying a Shared File System service. However, the native Openstack Manila filesystems-as-a-service option is available.
Instructions for using manila on Jetstream2 are here - Manila - Filesystems-as-a-service - on Jetstream2
Please note, there are different quotas for block storage (volumes) and shares. There will be a self-service tool for managing those quotas soon, but for now, if you need to have your Jetstream2 Storage quota adjusted between block and share storage, please contact us via the Jetstream2 contact form with the amount you wish to move between the storage types.
Can I set the password for a user on my virtual machine?¶
We generally don’t recommend using password authentication on Jetstream2, recommending that you use SSH keys for access. That said, if you need to set a password for console access or for some other reason, you can do it like this:
sudo passwd *username*
How can I get my public IP number from my VM ?¶
If your VM has a public IP address and you need to find that IP (and don’t have ready access to the Jetstream2 interfaces), use wget or curl from the command line to get your public IP:
wget http://169.254.169.254/latest/meta-data/public-ipv4 -qO - wget http://ipinfo.io/ip -qO - curl http://169.254.169.254/latest/meta-data/public-ipv4 curl http://ipinfo.io/ip
*Note: http://169.254.169.254/latest/meta-data/public-ipv4 works even in conditions in which external DNS servers are not accessible.
How do I get a jetstream-cloud.org DNS name for my instance?¶
Jetstream2 is using OpenStack Designate to set dns names for instances. We were proactive and set the auto_allocated network that most Jetstream2 users will use, but if you’ve created a new network and want an auto-created DNS A record, you’ll need to do this from the command line:
openstack network set --dns-domain xxxxxxxxx.projects.jetstream-cloud.org. network-name-or-UUID
where the xxxxxxxxx is your XSEDE allocation number and network-name-or-UUID is the custom network you’ve created in that allocation.
This FAQ topic may move to its own page in the future.
Are there backups of Jetstream2 storage resources ?¶
Jetstream2 provides multiple forms of storage, including block (volumes), shares (Manila), and an object store. All of these storage formats are on erasure coded partitions that should provide protection against data loss in the case of hardware issues or outages.
Jetstream2, however, does not provide any backup service for data. Since the storage is not a shared filesystem as on traditional HPC, there are issues with providing consistent backup for all of the user-defined instance root disks, volumes, shares, and object store buckets. As such, we recommend that you keep a copy of any crucial data offsite. This is a good practice no matter what computing system you may be on.
Additionally, there are NSF-funded resources like the Open Storage Network (OSN) available for research storage for work in active use. This is also an ACCESS allocated resource. More information may be found on the Open Storage Network website
What are the IP ranges / CIDR blocks for Jetstream2 ?¶
The current CIDR blocks for Jetstream2 are:
184.108.40.206/22 220.127.116.11/24 18.104.22.168/21
How do I keep a program running on a VM even if I log out or get disconnected?¶
If you want to start a workflow and have it run, that’s a unix capability.
Tutorials like How to Run Linux Commands in Background
show a number of methods shown here on how to start a program and leave it running, even if your connection disconnects.
We would suggest looking at the nohup command. As that page says:
“Another way to keep a process running after the shell exit is to use nohup.
The nohup command executes another program specified as its argument and ignores all SIGHUP (hangup) signals. SIGHUP is a signal that is sent to a process when its controlling terminal is closed.”
To run a command in the background using the nohup command, type:
nohup command &
If you want to log any terminal output to a file, you can use one of these commands below.
To redirect standard output and standard error to different files:
nohup myprogram > myprogram.out 2> myprogram.err
or to the same file:
nohup myprogram > myprogram.out 2>&1