NSF CC* Data Storage
High Volume Data Storage Infrastructure for Scientific Research and Education at Kennesaw State University Shared as Open Science Data Federation Data Origin
The NSF Campus Cyberinfrastructure (CC*) program invests in coordinated campus-level cyberinfrastructure improvements, innovation, integration, and engineering for science applications and distributed research projects.
The KSU proposal intends to develop a high-capacity storage system with around 4.3PB overall usable storage as an Open Science Data Federation (OSDF) data origin to support scientific research and education activities on both campuses of Kennesaw State University (KSU). 30% of the storage is to be allocated for hosting datasets of external researchers and sharing KSU spawned datasets to empower national research projects. You can learn more in the KSU's Proposal Abstract and in the NSF Award posting.
-
Progress
- June 17: SOX will switch to jumbo frames for Internet2 pipeline. (tentative date)
- June: Transceivers for 25Gbps connectivity are expected to be received and tested.
- Mid-May: SDSC has been given access for Kubernetes node configuration.
- Mid-May: CC* K8 node connected to 100 Gbps connection for setup and configuration (to be downgraded to 25 Gbps for production).
- Week of 05/01/24: Inter-campus link upgraded to 100Gbps
- Week of 04/18/24: Campus link to Internet2 upgraded to 100Gbps
- Week of 04/17/24: Seminar - ACCESSing Advanced National Supercomputing and Storage Resources for Computational Research: description, slides and video available.
- March: Investigating network switch issues with a variety of transceivers.
- Early March: Open Data Committee Meeting: Planning for upcoming seminars.
- Late February: Resolving issues, cluster is reporting as healthy
- Mid February: Issue with proxy and a disk reporting as bad.
- Week of 02/05/24: Configurations for CRUSH maps and erasure encoding.
- Early February: Proxies created for internal and external networks
- Week of 01/29/24: cephadm Orchestration tool configured for OSD daemons
- Week of 01/22/24: Disk discussion with UCSD and OSDs manually configured to use NVME disks
- Week of 01/15/24: Ceph installation started
- Week of 01/08/24: Benchmarking: network and I/O
- Week of 01/08/24: Docker installation/configuration
- Week of 12/11/23: System configuration for private network
- Week of 12/04/23: OS installations
- Mid-November: Private networking created for system
- Week of 10/02/23: Hardware installed in server room
- Week of 09/29/23: Hardware in KSU Warehouse
- Late September 2023: NSF CC* Workshop
- September 2023: OpenData Committee formed
- Early September 2023: Introductions to UCSD contacts
- August 2023: KSU hardware purchase completed
- Summer 2023: Internet2 connection to campus made