Project Hosting 3.0

Project Hosting 3.0

Lance Albertson

Session Summary

  • Brief history of FOSS hosting
  • Advances made
  • OSL Vision 2.0
  • Discuss future of FOSS hosting

Types of FOSS Hosting

File Hosting

Hosted Platform Hosting

Co-Location Hosting

Continuous Integration Hosting

Evolution of FOSS hosting

File hosting

Typically FTP and/or HTTP web servers hosted by:

  • Universities (IU, MIT, OSU)
  • ISP’s
  • Other orgs (Kernel.org, ISC)

Hosted Platform hosting

  • SourceForge (1999)
  • GNU Savannah (2001)
  • LaunchPad (2004)
  • Google Code (2006)
  • Github (2008)
  • GitLab (2011)

Co-Location Hosting

  • ISC (1994)
  • OSU Open Source Lab (2003)
  • Anyone else?

Continuous Integration Hosting

  • CircleCI (2011)
  • Travis CI (2012)
  • Drone.io (2014)

Major Advances

Github

Public cloud computing

More CDN choices (some offer free services to FOSS)

CI testing platforms

Co-Location vs. Public Cloud

Co-Location Public Cloud
More expensive Cheaper initial costs
Less flexible More flexible
Better Performance Performance varies
More control Less control
Hardware ownership Pay for the service

OSL Advances

New tools and technologies

Virtual computing / Private Cloud

  • OpenStack
  • Ganeti
  • Containers*

Storage Technologies

  • GlusterFS
  • Ceph*
  • Swift (S3)*

Configuration Management

Chef

Integration testing on infrastructure

Scale up infrastructure easier

Standardize deployments of services

Delegate infrastructure code with projects

What do FOSS Projects Need?

Testing Resources

Flexible testing compute resources

Customizable test integration tools

Unique testing challenges

Managed Service Hosting

Hosting complex platforms:

Gerrit, Gitlab, Jenkins, etc

Mailman, Jira, etc

They need the service, but don’t want to manage it

Neutral CDN Mirroring

Projects get popular and need to scale fast

Current FTP mirroring infrastructure not flexible enough

API-driven, geographically diverse

Hosted by a trusted entity

Access to specialized hardware

New and upcoming hardware (ARM64, POWER8, Open Compute, etc)

Porting and fixing bugs

IoT

How do we get there?

OSL Vision 2.0

Technical Upgrade

Build and expand Cloud infrastructure (Ganeti & OpenStack)

Automated Build Services

Test Services and Support

Project Dashboards

OSL CDN (ftp mirroring 2.0)

Security Audits

OSL University Network

Collaborate with global universities

Host half rack of gear

OpenStack / Ganeti

Mentor students at those universities

Re-engineer backend services

Convert everything to Chef + CentOS

Catch up with technology trends

Fully testable infrastructure

Make it more robust to failure

OSL - SuperCell

Currently

Created in 2010 in conjunction with Facebook

Utilized Ganeti to offer VM compute resources to projects

Dozen or so projects are currently using it

Plans

Rebuild with OpenStack and expand resources

Ease on-boarding for projects

Offer pre-built managed CI solutions

Access to upcoming testing suites from Academia

Education and Diversity

Open Source track in EECS at OSU

Online classes targeted at DevOps topics

Diversify the OSL workforce

Summary

Testing resources are important to projects

Need a place to host unique hardware

Managed service hosting

Increase our academic mission around DevOps and FOSS

We need your help!

Discussion future of FOSS hosting

What do YOU need?

What is missing?

What’s important to you?

What should the OSL be doing?

Questions?

Lance Albertson

lance@osuosl.org

@ramereth

http://osuosl.org

http://lancealbertson.com

https://github.com/ramereth/presentation-project-hosting

Attribution-ShareAlike CC BY-SA ©2015