Track Awesome Polars Updates Daily

A curated list of Polars talks, tools, examples & articles. Contributions welcome !

🏠 Home · 🔍 Search · 🔥 Feed · 📮 Subscribe · ❤️ Sponsor · 😺 ddotta/awesome-polars · ⭐ 420 · 🏷️ Programming Languages

[ Daily / Weekly / Overview ]

Nov 24, 2023

Resources / Blog posts

• Revolutionize Your Data Analysis: Polars Outperforms Pandas by Up to 5x in Numerical Filter Operations! - A blog post that compares Polars with Pandas by examining their performance in the real world by Daniel Builescu.

Nov 21, 2023

Resources / Blog posts

• Working with DateTime data in Polars - A blog post to helps you with the main operations that can be done with datetime data by Rielly Griffiths.

Nov 17, 2023

Libraries/Packages/Scripts / R

• polarssql (⭐8) - polarssql experimental package which is a DBI-compliant interface to Polars.

Resources / Talks and videos

• Library of the week 13 : Polars with Python ⏳ 15 min - A video that presents Polars with Python by @enarroied. Article supplied with the video in this page.

Nov 10, 2023

Resources / Blog posts

• Spark vs Polars. Real-life Test Case. - A blog post in which the author tests whether Polars is able to handle "real amounts of data" and "really replace some production Spark workloads." by @danielbeach. Code used is available on Github here (⭐1).

• Using Polars Plugins for a 14x Speed Boost with Rust - A blog post thats shows the use of Polars plugin system for Rust from some concrete examples by @ngriffiths13.

Nov 08, 2023

Resources / Blog posts

• Pandas2 and Polars for Feature Engineering - A blog post that A blog post that compares Pandas2 and Polars for Feature Engineering tasks with Python by @hopswork (⭐1k).

Oct 31, 2023

Libraries/Packages/Scripts / Python

• polars-business (⭐53) - Polars extension that offers utilities for business day operations with Polars and Python by @MarcoGorelli.

Oct 26, 2023

Resources / Blog posts

• Date and DateTime Manipulation in Polars - A blog post that shows examples of doing a number of date and datetime manipulations in Polars (Python) by @danielbeach. Code used is available on Github here (⭐1).

Oct 17, 2023

Resources / Blog posts

• Partitioning Polars DataFrame on S3 with Apache Arrow - A blog post that explains how to partition large Polars DataFrames in AWS S3 by Matteo Arellano.

• Goodbye Spark. Hello Polars + Delta Lake - An article that presents how to use Polars in addition to Delta Lake by @danielbeach.

• How to learn Polars with ChatGPT? - An article that explains how to learn fundamental Polars concepts with ChatGPT by Suhith Illesinghe.

Resources / Talks and videos

• Polars DataFrame ⏳ 41 min - A video that shows some basic manipulations with Polars and Python by @vedica1011. Notebook used for the video in this github repo (⭐0).

• Why I switched grom Pandas to Polars ⏳ 53 min - A workshop that breaks down the 3 reasons why you could switched from Pandas to Polars by @bfeif. Notebook used for the video in this github repo (⭐0).

• Delimiters in Python Polars ⏳ 15 min - A video that explains how to use delimiters in Python Polars by @CodeKlaudia.

• Intro to Polars ⏳ 7 videos - A playlist of 7 videos that introduces the basic concepts of Polars (DataFrames, filtering, splitting...) by Joram Mutenge.

• Machine Learning with Polars ⏳ 6 videos - A playlist of 6 videos that analyzing and cleaning data using Polars to train machine learning models by Joram Mutenge.

• Pandas and Polars with Marco Gorelli ⏳ 55 min - A podcast by The Developers' Bakery that compares the performance of Polars to Pandas by @MarcoGorelli.

Sep 22, 2023

Resources / Blog posts

• Using Polars with Snowflake - A blog post that shows how to use Polars with Snowflake by @IndexSeek.

Sep 20, 2023

Official documentation

• Talk about Polars at EuroPython Conference 2023 ⏳ 28 min - Talk by @ritchie46 that introduces Polars and some of its design decisions.

Sep 19, 2023

Resources / Blog posts

• Enhancing Data Analytics with Polars and MinIO - A blog post that explains how to use Polars with Minio’s open-source object storage by @IndexSeek.

Sep 14, 2023

Resources / Blog posts

• Polars vs DuckDB for Delta Lake ops - A blog post that compares Polars to DuckDB using Delta Lake by @wolliq.

Sep 13, 2023

Resources / Blog posts

• Understanding the Polars nested column types - A blog post that helps to understand how nested column types works in Polars by @braaannigan.

Sep 09, 2023

Resources / Blog posts

• Polars and Pandas : What's the difference ? - A blog post that explains how Polars works under the hood and th best use cases for Polars and Pandas by @t-redactyl.

Aug 31, 2023

Official documentation

• Keynote on Polars at EuroSciPy 2023 ⏳ 57 min - Talk by @ritchie46 that dives into Polars and sees what makes it so efficient. It will touch on technologies like Arrow, Rust, parallelism, data structures, query optimization and more.

Libraries/Packages/Scripts / Rust

• Polars CLI (⭐59) Polars CLI is a command line interface for running SQL queries with Polars as backend.

Resources / Tutorials & workshops

• Python Polars: A Lightning-Fast DataFrame Library - A tutorial that shows how to use Polars with Python ecosystem by @hfhoffman1144. Code used is available on Github here (⭐4.5k).

Resources / Talks and videos

• Using the Rust Polars DataFrame library in a CLI ⏳ 4 min - A video that shows how to integrate Polars in a commande line interface by @paiml.

• The Ultimate Guide to Data Wrangling with Python | Rust Polars Data Frame ⏳ 10 videos - A playlist of 10 videos (WIP) that equips you with all the necessary knowledge required to utilize Python Polars Data Frame by @AmitXShukla.

Aug 02, 2023

Resources / Blog posts

• Pandas vs Polars: A database speed test. Who wins? - A blog post that compares the run-time of reading a database into a dataframe using Pandas versus using Polars by Thomas Reid.

Jul 26, 2023

Follow : Official / Talks and videos

• Marco Edward Gorelli (@MarcoGorelli) - Contributor to Polars projects

• Eitsupi (@eitsupi) - Contributor to R Polars project

• Etienne Bacher (@etiennebacher) - Contributor to R Polars project

Jul 25, 2023

Resources / Tutorials & workshops

• Data Pipelines with Polars: Step-by-Step Guide - A tutorial that explains how to build data pipelines with Polars by @AntonsRuberts. Code used is available on Github here (⭐28).

Jul 24, 2023

Resources / Blog posts

• All that Polars that Make You Forget Pandas - A blog post that explores some deeper reasons behind the performance gains of Polars over Pandas.

• Polars vs Pandas. Inside an AWS Lambda - A blog post that covers the topic of using Polars vs Pandas inside an AWS Lambda to do data processing by @danielbeach. Code used is available on Github here (⭐7).

• DuckDB vs Polars for Data Engineering - A blog post that compares Polars and DuckDB with pipelines for Data Engineering by @danielbeach.

Jul 19, 2023

Libraries/Packages/Scripts / Python

• Python package functime - Machine learning Python package built on Polars for time-series predictions by @neocortexdb. According to the developpers, it's the world's fastest and most feature-full machine learning forecasting library !

Libraries/Packages/Scripts / R

• tidypolars for R (⭐84) tidypolars package to use polars with tidyverse syntax.

Resources / Blog posts

• Getting Started with the Polars Data Manipulation Library - A blog post that presents some simple features of Polars using Python by Juveriya Mahreen.

• 8 ways pandas really losing to Polars for quick market data analysis - A newsletter that compares the performance of Polars to Pandas for many common data manipulation techniques by PyQuant News.

Jul 12, 2023

Resources / Blog posts

• Pyspark or Polars — What should you use? - A blog post that explores and breaks down some of the similarities between PySpark and Polars. It provides insights on when to choose one over the other by Vivek Kovvuru.

Jul 11, 2023

Resources / Blog posts

• EDA with Polars: Step-by-Step Guide to Aggregate and Analytic Functions (Part 2) - A blog post that shows how to perform with Polars and Python some fairly complex aggregates, rolling statistics and more by @AntonsRuberts. Code used is available in this notebook (⭐28).

Jul 08, 2023

Resources / Talks and videos

• How to update mass data using Polars DataFrame ⏳ 9 min - A video that presents the process of writing code to update mass columns across CSV or data files by @AmitXShukla. Notebook used for the video in this github repo (⭐15).

Jul 06, 2023

Resources / Blog posts

• EDA with Polars: Step-by-Step Guide for Pandas Users (Part 1) - A blog post that describes the main data processing operations with Polars in Python by @AntonsRuberts. Code used is available in this notebook (⭐28).

Jun 29, 2023

Resources / Tutorials & workshops

• Polars cookbook in Python (⭐197) - This cookbook is a fork of the popular pandas-cookbook and has been modified to use the polars library. By @escobar-west, it uses real-world examples with "all the bugs and weirdness that entails."

Jun 22, 2023

Resources / Talks and videos

• Polars: A highly optimized dataframe library ⏳ 20 min - A video that presents some mains features of Polars by @mattharrison.

Jun 21, 2023

Resources / Talks and videos

• Polars - make the switch to lightning-fast dataframes ⏳ 30 min - A talk that reports an experience switching from Pandas to Polars in a real-world ML project by @datenzauberai. Slides are available here (⭐2).

Jun 16, 2023

Resources / Blog posts

• Polars vs Pandas: A Brief Tale of Two DataFrame Libraries - A blog post that compares Polars and Pandas focusing in particular on optional dependencies by @ranggakd.

Jun 13, 2023

Resources / Tutorials & workshops

• Cookbook Polars for R - A side-by-side comparison of Polars, R base, dplyr and data.table packages by @ddotta.

• Polars Workshop on AWS (⭐11) - A comprehensive workshop comparing Polars to Pandas, exploring a wide range of functions and features by @debnsuma.

Jun 12, 2023

Resources / Blog posts

• Querying Polars DataFrames using SQL - A blog post that shows how to use the SQLContext object in Python to query a Polars DataFrame directly using SQL by @weimenglee.

Jun 10, 2023

Resources / Blog posts

• Pandas vs Polars – Speed Comparison - A blog post that compares the performance of Polars, Pandas and Pandas 2.0 by @StuffbyYuki. Code used is available on Github here (⭐9).

Jun 09, 2023

Resources / Blog posts

• LazyFrame vs DataFrame in Polars – Performance Comparison - A blog post that introduces what LazyFrame is in Polars and its performance gain compared to DataFrame by @StuffbyYuki. Code used is available on Github here (⭐9).

May 30, 2023

Resources / Tutorials & workshops

• Fast String Processing with Polars — Scam Emails Dataset - A tutorial using Polars to implement a text processing pipeline process by @AntonsRuberts. Code used is available on Github here (⭐28).

Resources / Blog posts

• Lightning-fast queries with Polars - Another blog post that is a good introduction to Polars by @astrojuanlu.

• Polars – Laziness and SQL Context. - A blog post that presents two good reasons to adopt Polars : Lazy and SQL Context by @danielbeach.

• Exploring Polars - The Lightning-Fast DataFrame Library in Python - A blog post on the basics of Polars by @mddas.

May 26, 2023

Libraries/Packages/Scripts / Python

• Python package seaborn_polars (⭐17) - Python package to plot Polars DataFrames and LazyFrames with seaborn by @pavelcherepan.

Libraries/Packages/Scripts / Ruby

• polars for Ruby (⭐645) - Ruby polars-df gems to use Polars with Ruby.

Resources / Tutorials & workshops

• Rust Polars: Unlocking High-Performance Data Analysis — Part 1 - First part of an article that explores the world of Rust’s Polars and explain some basic concepts of Polars such as Series by @wiseaidev. Code used is available on Github here (⭐162).

Resources / Blog posts

• Pandas vs Polars vs Pandas 2.0 …. FIGHT - A blog post that does an ETL process for checking big data speed processing between Pandas, Pandas 2.0 and Polars by @guoliveira.

• Pandas vs Polars vs Pandas 2.0 … ROUND 2) - A blog post that makes a new comparison between Pandas, Pandas 2.0 and Polars by @guoliveira.

• Polars VS PySpark: Lazy Evaluation and Big Data - A blog post that compares lazy evaluation between Polars and Spark by @guoliveira.

• Polars in the aRtic! - An another blog post that compares the performance between Pandas and Polars across a range of common data manipulation tasks by @MCodrescu. Code used is available on Github.

• A Polars exploration into Kedro - A blog post that explains how Polars can be used instead of pandas in Kedro for your data catalog and data manipulation by @astrojuanlu.

• High Performance Data Manipulation in Python: pandas 2.0 vs. polars - A blog post that compares differences between Python pandas 2.0 and Polars libraries by @jcanalesluna.

Resources / Talks and videos

• Polars vs Pandas | detailed test with explained results ⏳ 22 min - A video that presents 8 distinct tests which demonstrates differences between Pandas and Polars by @vb100. Associated github repo is here (⭐0).

Apr 21, 2023

Resources / Blog posts

• The fastest way to read a CSV file in Python - A blog post that compares different ways (including Polars, pyarrow and C) to read a CSV file with Python by Finn Andersen.

Apr 20, 2023

Resources / Tutorials & workshops

• How to display Polars dataframes with itables - A tutorial that explains how to display Polars dataframes with itables by @mwouts.

Resources / Blog posts

• Polars - modern data frame library - A blog post that describes why Polars could be a better alternative to pandas, dplyr or data.table by @DSkrzypiec.

Resources / Talks and videos

• An opinionated introduction to Polars - Great Polars introduction slides from @krlng at PyCon 2023.

Apr 12, 2023

Resources / Blog posts

• Pandas 2.0 vs Polars: The Ultimate Battle - A blog post that analyzes in terms of Syntax, Speed, and Usability between Pandas 2.0 and Polars 0.17.0 by @priyanshu7401.

Apr 11, 2023

Resources / Blog posts

• DuckDB vs Polars vs Spark! - An article that performs a benchmark against duckdb/Polars/spark, with varying row count, with swap usage as another metric, in addition to runtime in seconds. Code used is available on Github here (⭐4).

• Benchmarking PySpark Pandas, Pandas UDFs, and Fugue Polars - A blog post that compares the execution time of fugue (⭐1.8k) + Polars, Pandas UDFs and PySpark Pandas by @kvnkho.

• Pandas vs. Polars: The Battle of Performance - An another blog post that compares the performance between Pandas and Polars across a range of common data manipulation tasks by @makeuseofcode. Code used is available on Github (⭐0).

Apr 07, 2023

Resources / Tutorials & workshops

• Converting SQL Queries to Polars DataFrames with JupySQL - A tutorial that explains how to convert SQL queries to Polars DataFrames using JupySQL by @ploomber.

Resources / Blog posts

• 7 Easy Steps To Switch From Pandas to Lightning Fast Polars And Never Return - A cheat sheet blog post of the most common Pandas operations translated into Polars by @BexTuychiev.

• Polars for initial data analysis, Polars for production - A blog post that shows how to use Polars for initial data analysis and then effectively in production by @itamarst.

Apr 03, 2023

Resources / Tutorials & workshops

• Running Polars code distributedly - A page that explains how to rung Polars code distributedly with Fugue by @fugue-project.

Mar 31, 2023

Libraries/Packages/Scripts / Python

• Working with Polars and XlsxWriter - Guide to using the Python XlsxWriter library with Polars to create Excel reports.

Mar 29, 2023

Resources / Blog posts

• Replacing Pandas with Polars. A Practical Guide - A blog post comparing some common functions between Pandas and Polars by @danielbeach. Code used is available on Github here (⭐2).

• Dataframe Showdown – Polars vs Spark vs Pandas vs DataFusion. Guess who wins? - A short article that presents a performance test between Polars, Pandas, Datafusion and Spark on a csv dataset by @danielbeach. Code used is available on Github here (⭐6).

Mar 23, 2023

Resources / Tutorials & workshops

• Prise en main de Polars - A notebook tutorial in French that illustrates the main features of Polars by @romaintailhurat and @linogaliana. There is also an accompanying blog post .

Mar 22, 2023

Resources / Tutorials & workshops

• A Practical Comparison of Polars and Pandas - A tutorial that showcases several common operations in Pandas and Polars side by side to demonstrate how much easier Polars is by @FlorianWilhelm. There is also an accompanying Jupyter notebook (⭐43) available.

Mar 20, 2023

Libraries/Packages/Scripts / Scala/Java

• scala-polars for Scala and Java (⭐21) - Scala - Java scala-polars is a library for using Polars in Scala and Java projects by @chitralverma.

Mar 15, 2023

Resources / Tutorials & workshops

• Polars: um simples mas prático tutorial - Tutorial in the format of an ipynb notebook that illustrates several features of Polars in Portuguese by @barbosarafael. Associated github repository is here (⭐36).

Mar 13, 2023

Resources / Blog posts

• Polars vs Pandas — 4 key concept differences - An article that helps to understand key differences between Pandas and Polars Data Science libraries by @DataScienceDisciple.

Mar 08, 2023

Resources / Blog posts

• Why is Polars All The Rage? - An article that explains why Polars will become very popular by SeattleDataGuy and Daniel Beach.

Resources / Talks and videos

• Manipulación de Datos con Polars en python ⏳ 51 min - A detailed tutorial video in Spanish that shows 20 Polars functions to perform 80% of the tasks of a data scientist by Naren Castellon.

Mar 06, 2023

Resources / Blog posts

• Discover the Power of Polars Library for Fast and Efficient Data Manipulation in Python - An article that quickly compares Polars to other data manipulation libraries by Morpheus.

Resources / Talks and videos

• Polars: The main alternative to pandas in Python!? ⏳ 57 min - A Polars tutorial series on Youtube by @martinbel. Notebooks and datasets used for the videos available in this github repo (⭐19).

• Polars: The Super Fast Dataframe Library for Python — Goodbye Pandas? - An article and a video ⏳ 19 min that explores some basic features of Polars by @ifrankandrade

Feb 27, 2023

Resources / Talks and videos

• Polars Introduction for Python with a 128GB Ryzen 24-core Benchmark vs Pandas ⏳ 12 min - A video that provides an introduction to Polars for Python by @jeffheaton. Notebook used for the video in this github repo (⭐171).

• Polars vs Pandas ⏳ 37 min - A detailed video on Youtube that compares Polars and Pandas by @hu-po.

Feb 25, 2023

Resources / Cheat Sheets

• Polars Cheat Sheet - A Polars Cheat Sheet by @FranzDiebold.

Resources / Talks and videos

• Expressive & fast dataframes in Python with polars ⏳ 28 min - A video that reviews some alternatives to Pandas for Python and then demonstrates some Polars features by Juan Luis Cano Rodríguez.

Feb 22, 2023

Resources / Blog posts

• Pandas vs Polars - A comparison on File I/O - A blog post that evaluates Polars and Pandas in terms of I/O performance and speed when handling large datasets by Wes Poulsen.

Feb 20, 2023

Resources / Blog posts

• Alternatives to Pandas: Python Polars - An article that explores the Python Polars module as an alternative to Pandas, comparing their similarities and differences and providing some examples by @JohnLockwood

Contributing / Talks and videos

• Damien Dotta (@ddotta) - Maintainer of Awesome Polars list

Feb 17, 2023

Official documentation

• Documentation - Official user guide for Python, Rust and R.

• Documentation for Python API - Official API Reference for Python.

• Documentation for Rust API - Official API Reference for Rust.

• Documentation for Node.js API - Official API Reference for Node.js.

• Documentation for R API - Official API Reference for R (WIP).

• Github: Polars Github Organization - Official Polars Github repository.

• Blog posts from Polars - Official blogs posts from Polars.

Libraries/Packages/Scripts / Python

• polars for Python (⭐22k) - Python polars package to use polars DataFrame from Python.

• tidypolars tidypolars python library built on top of polars library that gives access to methods and functions familiar to R tidyverse users.

Libraries/Packages/Scripts / Rust

• polars for Rust (⭐22k) - Rust polars crate to use polars DataFrame with Rust.

• GeoPolars Geopolars Rust crate that extends the Polars DataFrame library for use with geospatial data.

Libraries/Packages/Scripts / R

• rpolars for R (⭐329) - R rpolars package to use polars DataFrame from R.

Libraries/Packages/Scripts / Node.js

• nodejs-polars for Node.js (⭐215) - Node.js nodejs-polars package to use polars DataFrame from Node.js.

Resources / Tutorials & workshops

• Modern Polars - A side by side comparison between Polars and Pandas containing code in both frameworks by @kevinheavey.

Resources / Blog posts

• Using the Polars DataFrame Library - A blog post by Wei-Meng Lee to discover the basics of Polars and how it can be used in place of Pandas.

• Why Polars uses less memory than Pandas - A blog post by Itamar Turner-Trauring detailing some techniques to opptimize Pandas memory usage and see how Polars can provide an answer in some cases.

• Plodding with Polars in Python - A blog post by @amitrathore that introduces some basic features of Polars.

• Polars-lazy - A blog post by @ritchie46 and @jorgecarleitao that introduces Polars' lazy API in Rust.

• Series of posts on Polars - A series of blogpost on Polars usage with a lot of useful tricks and information by @braaannigan. Moreover, Liam also has a Data Analysis with Polars course on Udemy.

• Youtube videos about Polars - A series of short youtube videos about Polars by @braaannigan

Resources / Talks and videos

• Polars: Blazingly Fast DataFrames in Rust and Python ⏳ 37 min - Introduction to Polars by databricks.

• Polars: The Next Big Python Data Science Library... written in Rust? ⏳ 14 min - A short video tutorial to get started coding with Polars by @RobMulla.

• The Last Polars Dataframe vs. Pandas Dataframe Video You Should Ever See ⏳ 19 min - A video that compares Polars and Pandas data frames.

• The Best library for building Data Pipelines... ⏳ 12 min - A video that compares Pandas, Spark and Polars for working with data in Python by @RobMulla.

Follow : Official / Talks and videos

• pola-rs (@pola-rs) - Github organisation for Polars (Twitter: @DataPolars).

• Ritchie Vink (@ritchie46) - Author of Polars

• Stijn de Gooijer (@stinodego) - Member of Polars organisation

• Danny van Kooten (@dannyvankooten) - Member of Polars organisation

• Søren Havelund Welling (@sorhawell) - Member of Polars organisation

• Alexander Beedie (@alexander-beedie) - Contributor to Polars projects