When implementing a data product methodology, you may find that it can become unscalable when the number of data products in your organisation grows to hundreds if not more. Using Jinja template on your Terraform plus the help of our friendly neighbourhood Python, we can make provisioning data products more scalable. If you find the same challenge with provisioning data products at scale, you may find some ideas from this express talk.

This talk will cover some of the features, benefits and potential "gotchas" that your organisation should consider before fully adopting Streamlit in Snowflake. There'll be a live demo as well to spice things up!

Data Platforms are composite and complex ecosystems requiring cloud infrastructure, software, tooling, security, governance and heaps of data.They need to be provided in a timely fashion without compromising the aspects of reliability, scale and usability.

This talk is about our journey at Xero - the approach we have taken to architect, decentralise design and the pragmatic automation strategy adopted to build our environment.