Cloud and High Performance Computing resources

How Cloud and High Performance Computing transform science at NOAA Fisheries

Cloud and High Performance Computing is transforming science at NOAA Fisheries by allowing scientists to access additional computing power. Some recent successes using cloud or high performance computing at NOAA Fisheries include:

We expect more success stories to come in the future, as NOAA Fisheries is moving to the cloud (link accessible to NOAA staff). Cloud and High Performance Computing Resources are already available at NOAA Fisheries for staff.

What is cloud computing?

From Wikipedia: “Cloud computing is the on-demand availability of computer system resources, especially data storage and computing power, without direct active management by the user. The term is generally used to describe data centers available to many users over the Internet.”

Cloud computing is scalable for the user, an advantage over on-premise computing resources.

Cloud security

Cloud services used at federal agencies need to be secure. FedRAMP authorized services help lower the barrier to adoption by federal agencies, though individual agencies ultimately determine security approval of cloud services. Not all cloud services are in scope for FedRAMP.

Google Workstations at NOAA Fisheries: A cloud computing option

On-premise resources are being migrated to the cloud. As part of the migration, Google workstations are available for NOAA Fisheries staff for cloud computing.

Google Cloud Workstations is a managed service that provides a flexible, self-serve platform. Because Google handles the underlying infrastructure, the Fisheries Cloud Program team can focus on creating tailored environments, managing access, and ensuring security, reducing setup costs and promoting a faster “time to science” for users.

Request access or learn more in the Cloud Compute Accelerator Documentation (must be logged into NOAA email to access document).

For self-guided training, see materials from the NOAA Fisheries Google Cloud Workstations Workshop. Thanks to NOAA Fisheries early adopters who have documented additional tips and tricks for using Google Workstations.

What is High Performance Computing at NOAA Fisheries?

At NOAA, High Performance Computing (HPC) refers to resources available through the High Performance Computing and Communications (HPCC program). NOAA HPC includes both cloud computing and on-prem resource options. This option is worth exploring for workflows with high computational needs.

For NOAA Fisheries staff interested in using NOAA HPC resources, contact the FIT to learn more or submit a request to use NOAA HPC resources. Individual line office within NOAA must put in requests for project resources and HPC allocation must be approved through the allocation committee.

Cloud data management

Archiving

NOAA’s NCEI provides archive services for much of the data from NOAA Observing Systems. Other options include NOAA approved data repositories.

Cloud Hosting

Generally keeping data “close to computation” will increase the speed and reduce cost of cloud resources. For example, keeping a data bucket in the same project as the virtual machine used for computation is suggested if computation is a big part of the workflow.

NOAA Fisheries staff increasingly have access to Google Cloud Platform (GCP) data buckets, which have flexible permissions. Put in a ticket with your office’s IT support to learn more about what is available at your office.

For public data sets the NOAA Open Data Dissemination Program also provides a pathway for cloud hosting of public data.

Request cloud services via the Fisheries Digital Solutions Portal

Are you struggling to find the right tools for migrating data and analyses to the cloud? Introducing the Fisheries Digital Solutions Portal (link accessible to NOAA staff)! Use this central hub for all cloud resource requests. For example, NOAA staff can request access to the Gemini Code Assist pilot through the portal.

You May Also Enjoy