Snowflake expands Python support to advance programmability

Author: Beatrice

Snowflake has announced at its annual user conference, Snowflake Summit 2022, new enhancements that improve programmability for data scientists, data engineers, and application developers. Snowflake’s latest innovations bring Python to the forefront, with the launch of Snowpark for Python and a native integration with Streamlit for rapid application development and iteration. Additionally, Snowflake is streamlining access to more data with new enhancements for working with streaming data, alongside making data stored in open formats and on-premises available in the Data Cloud. These enhancements make it easier for data professionals and developers to build and collaborate with data quickly, while leveraging the speed, simplicity, and consistent governance and security of Snowflake’s platform.

Snowflake doubles down on Python for machine learning and application development

The introduction of Snowpark, Snowflake’s developer framework, opened up a rich programming environment for data scientists, data engineers, and application developers to build scalable pipelines, applications, and machine learning (ML) workflows directly in Snowflake using their preferred languages and libraries. Snowflake is further extending what users can build with Snowpark for Python, making Python’s rich ecosystem of open-source packages and libraries seamlessly accessible in the Data Cloud.

With a highly secure Python sandbox, Snowpark for Python runs on the same Snowflake infrastructure as Snowflake pipelines and applications written in other languages. This provides Snowpark for Python with the same scalability, elasticity, security, and compliance benefits developers have come to expect when building with Snowflake. Developers now have the unique opportunity to streamline and modernise their data processing architecture by consolidating their Python-based data processing in Snowflake using Snowpark.

Additional updates complementing Snowpark for Python include:

• Snowflake Worksheets for Python enable users to develop pipelines, ML models, and applications directly in Snowsight, Snowflake’s user interface, using Python and Snowpark’s DataFrame APIs for Python, streamlining development with code auto-complete.

• Snowflake’s Streamlit Integration, currently in development, brings Python-based application development directly into Snowflake, enabling users to build interactive applications, and securely share, iterate, and collaborate with business teams to increase the impact of development.

• Large Memory Warehouses, currently in development, empower users to securely execute memory-intensive operations such as feature engineering and model training on large datasets using popular Python open-source libraries available through the Anaconda integration.

• SQL Machine Learning, starting with time-series forecasting now in private preview, empowers SQL users to embed ML-powered predictions into their everyday business intelligence and analytics to improve decision quality and speed.

Python’s robust syntax and rich ecosystem of open-source packages make it a popular choice for developers, and Snowflake’s continued partnership with Anaconda extends access to more Python packages seamlessly in Snowflake, with all code running in a highly secure sandboxed environment. The Snowpark Accelerated program has also seen continued growth in large part due to Snowflake’s Python advancements, with more partners building with Python to extend the power of the Data Cloud in their language of choice.

Snowflake increases data access for faster, more valuable insights

Getting access to the right data quickly and efficiently is critical for improving developer productivity, building ML models with increased accuracy, and delivering more powerful applications. Snowflake’s enhancements enable teams to experiment faster, with more data at their fingertips, driving increased programming capabilities and deeper insights for users.

“We are heavily investing in Python to make it easier for data scientists, data engineers, and application developers to build even more in the Data Cloud, without governance trade-offs,” says Christian Kleinerman, Senior Vice President of Product, Snowflake. “Our latest innovations extend the value of our customers’ data-driven ecosystems, enabling them with more access to data and new ways to develop with it directly in Snowflake. These capabilities, paired with Snowflake’s best of class data security and privacy, are changing the way teams experiment, iterate, and collaborate with data to drive value.”