Posted 2025-07

About Skyway

We are developing a SaaS product that simplifies financial planning and analysis of cloud billing data for large enterprises with complex cloud spending requirements. We're looking for a data engineer to wrangle complex cloud billing data by designing the pipelines that power our product.

We have fascinating technical challenges around data modeling and continuous quality control. We're analyzing massive amounts of semistructured data at scale: processing cloud bills with constantly evolving schemas—complexity that only increases as we expand functionality and provider support. On the frontend, customers use the data to drive large financial decisions, so full data product ownership and quality is key.

What You'll Do

• Build and maintain ETL pipelines processing hundreds of millions of rows of cloud billing data
• Work with ClickHouse, Parquet files, and S3 to design efficient data storage and retrieval systems
• Develop data validation and quality control systems using Python and SQL
• Design data models for complex, evolving cloud billing schemas (AWS CUR and beyond)
• Build and optimize Airflow workflows for reliable data processing
• Collaborate with the entire engineering team to investigate and resolve data quality issues
• Scale data infrastructure as we expand to new cloud providers and use cases

Our Tech Stack

• AWS
• Python + Flask
• React + TypeScript
• PostgreSQL
• ClickHouse
• Airflow

About You