Official account of the pandas project

We are open source, make it better. ;)
The pandas api is bad
278
1,792
24,810
2,592,778
Pandas 1.0 is here! * Read the release notes: pandas.pydata.org/pandas-doc… * Read the blogpost reflecting on what 1.0 means to our project: dev.pandas.io/pandas-blog/pa… * Install with conda / PyPI: pandas.pydata.org/pandas-doc… Thanks to our 300+ contributors to this release.
15
778
1,990
We are better than SQL. Except when SQL is better.
am i the only one who likes both pandas and SQL
18
93
1,325
179,686
We've got a new logo! Thanks @indeed for sponsoring the creation of the new logo. And thanks @matplotlib for generating our old logo for more than 10 years (yes, the old logo was generated with a simple Matplotlib script).
21
239
1,145
We are happy to announce the release candidate of pandas 2.0.0. It can be installed from our conda-forge and PyPI packages via mamba, conda or pip, for example: mamba install -c conda-forge/label/pandas_rc pandas==2.0.0rc0 python -m pip install --upgrade --pre pandas==2.0.0rc0
7
144
987
141,474
Artificial intelligence may not be so intelligent if it uses pandas .apply() when not strictly necessary. Our operations are usually vectorized (very fast), .apply() is usually not, so it may be very slow. Avoid loops and apply if a pandas operation exists for what you need.
I love GPT-4 code assistant but it uses .apply() for every bit of pandas code and I ain't about it
14
64
876
168,296
We're happy to announce the release of #pandas 2.0.0. You can install it with `pip install pandas` or `mamba install -c conda-forge pandas`. You can find what's new in this version in the release notes. Thanks to all contributors and sponsors who made this release possible!
10
180
804
121,380
We'd like to apologize to @teej_m. This tweet was never meant as a personal attack, or a "fix it yourself" as many users understood. We welcome all criticism and work with the community every day to make the API better, constrained by being as backward compatible as possible.
28
16
671
69,824
Pandas 1.1.0 is now available! mail.python.org/pipermail/pa… Thanks to the 360+ code contributors who made this release possible: pandas.pydata.org/docs/whats…
3
136
498
#pandas 2 uses less memory if you enable copy-on-write with: pd.options.mode.copy_on_write = True Learn more about CoW from our core developer Patrick in this blog post: phofl.github.io/cow-deep-div… And in the official docs: pandas.pydata.org/docs/user_…
5
57
453
82,657
We're happy to announce the release of #pandas 2.1.0. You can install it with `pip install pandas` or `mamba install -c conda-forge pandas`. You can find what's new in this version in the release notes. Thanks to all contributors and sponsors who made this release possible!
7
76
423
62,563
Lots of deprecations will be enforced in version 2.0.0, please pay attention to your FutureWarnings
6
50
424
#pandas has two internal ways to store strings: NumPy and PyArrow (faster). pandas 3.0 will change the default and strings will use PyArrow when for example calling read_csv. You can get this change now in pandas 2.1 with: pandas.options.future.infer_string = True
2
33
339
29,419
Pandas 1.0.0rc0 is now available for testing! Please try it out and report any issues. mail.python.org/pipermail/pa…
139
348
pandas 1.5.0 is now available! For more info: groups.google.com/g/pydata/c…
49
271
In addition to a new logo, there is also a new main website and documentation theme coming!
We are working on a new theme for the @pandas_dev documentation! Still some work, but preview at: dev.pandas.io/docs/user_guid… (the old to compare: pandas.pydata.org/pandas-doc…) Feedback? -> github.com/pandas-dev/pandas… Know a bit of html/css and want to contribute? -> github.com/pandas-dev/pandas…
3
34
201
Pandas 0.24.0 is now out! pandas.pydata.org/pandas-doc… Read the blog post introducing the pandas extension array interface: pandas-dev.github.io/pandas-… Thanks to all the contributors! pandas.pydata.org/pandas-doc…
3
98
194
We're happy to announce the release of #pandas 2.1.1. You can install it with `pip install pandas` or `mamba install -c conda-forge pandas`. You can find what's new in this version in the release notes. Thanks to all contributors and sponsors who made this release possible!
2
22
138
15,269
We're happy to announce the release of #pandas 2.2.0. You can install it with `pip install pandas` or `mamba install -c conda-forge pandas`. Thanks to all contributors and sponsors who made this release possible! The release notes can be found at: pandas.pydata.org/docs/whats…
2
23
139
15,802
We are excited to announce a release candidate for #pandas 2.1.0 has just been released. If all goes well, we'll release #pandas 2.1.0 in about 1 week. Full list of changes and contributors: pandas.pydata.org/docs/dev/w…
4
18
126
18,540
We're pleased to share that pandas received funding from @cziscience! This will fund more maintenance and more work on pandas' nullable dtypes. Read more at dev.pandas.io/pandas-blog/pa…
16
119
Thank you to the ~20,000 people who have installed the pandas 1.5 release candidate! You too can install it: python -m pip install --pre pandas==1.5.0rc0 OR mamba install -c conda-forge/label/pandas_rc pandas==1.5.0rc0 Please report any issues to github.com/pandas-dev/pandas
2
21
116
Pandas 0.25.0 is now available! (link: pandas.pydata.org/pandas-doc…) pandas.pydata.org/pandas-doc…… Install with conda install pandas Or python3 -m pip install --upgrade pandas
1
45
109
We're happy to announce the release of #pandas 2.1.4. You can install it with `pip install pandas` or `mamba install -c conda-forge pandas`. Thanks to all contributors and sponsors who made this release possible! The release notes can be found at: pandas.pydata.org/docs/whats…
3
10
114
15,028
Can #pandas be lazy? There has been some discussion and a proof of concept about it recently.
breakfast
2
10
115
17,755
This is the (much more efficient) workaround which you're encouraged to use instead - nice one @CaioLCastro ! Use `concat` a single time outside the loop, rather than multiple times inside it
Replying to @quant_arb
we use a hybrid approach. Append to a list, and then concat. res = [] for x in itersomething: res.append(calculations) pd.concat(res) df.append is gruesomely inefficient so maybe it is best to remove
2
8
102
21,624
Message in the pandas mailing list: "I really dont know who u folks are, but pandas changed my life forever." Thank you for the kind words! 👐
2
4
100
We are excited to share that #pandas 2.0.1 has just been released. Users already in the 2.0 series are recommended to upgrade to this version, as it contains bug fixes to the 2.0.0 release. You can upgrade via pip and mamba/conda.
1
18
103
10,544
Pandas 0.25.2 is released! This is the first pandas release to support Python 3.8 (wheels are up, conda packages coming soon). pandas.pydata.org/pandas-doc… Thanks to all the contributors!
37
93
We're happy to announce the release of #pandas 2.1.2. You can install it with `pip install pandas` or `mamba install -c conda-forge pandas`. Thanks to all contributors and sponsors who made this release possible! The release notes can be found at: pandas.pydata.org/docs/whats…
2
14
90
12,630
Pandas 0.24.0rc1 is now out! Docs: pandas.pydata.org/pandas-doc… $ conda install -c conda-forge/label/rc pandas $ pip install --pre pandas Please try it out and report back with any issues.
2
35
97
Pandas 0.25.0rc0 is now available! pandas.pydata.org/pandas-doc… Install with conda install -c conda-forge/label/rc pandas=0.25.0rc0 Or python3 -m pip install --upgrade --pre pandas
1
27
91
We are excited to announce a release candidate for #pandas 2.2.0 has just been released. If all goes well, we'll release #pandas 2.2.0 in about 2 weeks. Full list of changes and contributors: pandas.pydata.org/docs/dev/w…
1
16
84
13,912
We're happy to announce the release of #pandas 2.2.2. You can install it with `pip install pandas` or `mamba install -c conda-forge pandas`. Thanks to all contributors and sponsors who made this release possible! The release notes can be found at: pandas.pydata.org/docs/whats…
3
15
94
13,736
For the last 3 days most of our core development team has been sprinting in Basel. Lots of discussions on how to make #pandas better. This weekend, we'll participate in the #DataFrameSummit23 with developers of @DataPolars, @IbisData, @dask_dev, @numpy_team, @ApacheSpark...
3
7
84
15,412
The 2019 Pandas user survey is now live! forms.gle/NnfEdj5JK77TotYY9 We'd appreciate 5-10 minutes of your time to help improve Pandas.
2
60
74
Release candidate for pandas 1.2.0 is now available for testing! Please try it out and report any issues. See the announcement for how to install it: mail.python.org/pipermail/pa… What's new: pandas.pydata.org/pandas-doc…
1
22
80
We're happy to announce the release of #pandas 2.2.1. You can install it with `pip install pandas` or `mamba install -c conda-forge pandas`. Thanks to all contributors and sponsors who made this release possible! The release notes can be found at: pandas.pydata.org/docs/whats…
8
77
9,885
New feature alert! ✨ In version 1.5.0 we've added `from_dummies`, which allows you to do decode one-hot-encoded DataFrames It's the reverse of `get_dummies` Check the docs for more info pandas.pydata.org/pandas-doc…
2
16
74
Have you ever had pandas silently switch format whilst parsing a column of date strings? With PDEP0004, that'll no longer happen! This'll likely land in pandas 2.0.0 pandas.pydata.org/pdeps/0004…
4
13
72
We've published a blogpost on the pandas user survey results. Thanks to all of you who took the survey (about 1,250 people). dev.pandas.io/pandas-blog/20… You can run the analysis yourself on binder mybinder.org/v2/gh/pandas-de… (thanks to @mybinderteam!)
2
27
67
⚠️ Important note for pandas users reading excel files! ⚠️ Please ensure you have the "openpyxl" package installed. Previously, pandas used the "xlrd" package by default. But "xlrd" is only meant to read old xls files, not for .xlsx files. See warning at pandas.pydata.org/pandas-doc…
xlrd 2.0.1, a #python library for reading .xls files, released. Full details here: groups.google.com/g/python-e…
3
17
65
We're happy to be one of the projects supported in this program. We'll use the grant to fund additional project maintenance and to cross off some of the items on our project roadmap: dev.pandas.io/about/roadmap.…
#Opensource software is essential to science—that’s why we’re supporting 42 open source tools that accelerate biomedical research and serve the larger community. Learn about the grantees bit.ly/34YhzX1
9
59
pandas added some new sponsors in the last few months. Thanks Voltron Data, Quansight Labs, NVIDIA and Bodo for supporting pandas development. You can see the full list of sponsors in our home page: pandas.pydata.org/
1
11
66
It's already 2 weeks out, but the end of last year saw a new pandas release! Pandas 1.2.0 is out: mail.python.org/pipermail/pa… Check the release notes: pandas.pydata.org/pandas-doc… Thanks to our community and the 250+ code contributors who made this release possible!
23
63
Python 3.9 wheels are now available on PyPI for pandas 1.1.3. Thanks to Matthew Brett and the other multibuild maintainers for help with the builds!
13
54
We are pleased to announce the release of pandas v1.5.3. This is a patch release in the 1.5.x series and includes some regression fixes and bug fixes. We recommend that all users in the 1.5.x series upgrade to this version. pandas.pydata.org/docs/whats…
10
60
7,374
Haven't tried this yet, but it looks pretty neat!
14
57
I use it to read csvs
I passed 100K followers! 🤯🎉 I will randomly give away three copies of Effective Pandas to retweeters who reply with how they use Pandas. 🙏🐼
2
4
54
Or, even better, `format="%d-%m-%Y"`
1
1
54
Bodo has just become a pandas and NumFOCUS financial supporter. Bodo is a just in time compiler that allows executing pandas code in a parallel way without running the pandas underlying code based on NumPy. This should help run pandas code faster and at scale. 1/2
2
5
52
Today #pandas core developers @jorisvdbossche, Thomas and Richard are sprinting at @EuroSciPy, together with other contributors and many other open source projects such as @SciPy_team or @scikit_learn. Thanks to everybody for making open source projects better! #EuroSciPy2023
5
54
29,210
PDEP-1 has been accepted, being the first pandas enhancement proposal, and setting the guidelines fo discussions about the pandas future. This will make discussions easier and bring clarity and transparency to the project plans. pandas.pydata.org/pdeps/0001…
6
47
Release candidate for pandas 1.3.0 is now available for testing! Please try it out and report any issues. See the announcement for how to install it: mail.python.org/pipermail/pa… What's new: pandas.pydata.org/pandas-doc…
1
18
46
#pandas sprint at @PyConLT, thanks to everybody who joined, and to the organizers for making such an amazing conference possible!
1
4
52
6,249
The second release candidate of pandas 2.0 has just been published. We recommend all users planning to upgrade to pandas 2.0 to try it with their code bases, and report any possible issue before the final release.
2
13
45
8,116
We are happy to announce the release candidate of pandas 1.5.0. Users having pandas code in production and maintainers of libraries with pandas as a dependency are strongly recommended to run the tests suites with the release candidate. More info: t.me/pandas_dev
13
47
We are excited to share that #pandas 2.0.2 has just been released. Users in the 2.0.x series are recommended to upgrade to this version. Full list of changes and contributors: pandas.pydata.org/docs/whats…
7
45
5,910
Developing a great open source project is not only about the code - it's also about our community. 💓
2
3
39
5,826
We are pleased to announce the release of pandas v1.5.2. We recommend that all users in the 1.5.x series upgrade to this version. The release can be installed from PyPI and conda-forge. See the release notes for the list of changes: pandas.pydata.org/docs/whats…
10
41
If you've: - ever wondered how to contribute to pandas - are you trying to contribute but are stuck on something - want a friendly chat with maintainers then you might want to join our new contributors meeting! To prepare, here's the contributing guide: pandas.pydata.org/docs/dev/d…
2
16
41
You can now support pandas development on @tidelift. tidelift.com/funding/github/… Thanks to all our supporters!
16
38
Exciting news!
Pandas DataFrame output is now available for all sklearn transformers (in dev)! scikit-learn.org/dev/auto_ex… This will make running pipelines on dataframes soo much easier, and provides better ways to track feature names! thanks to @thomasjpfan @glemaitre58 and Christian Lorentzen!
3
38
Pandas 0.24.1 is now out! See the whatsnew for the changes: pandas.pydata.org/pandas-doc…
20
41
How has been your #pandas2 experience so far?
7
2
37
19,540
We are excited to share that #pandas 2.0.3 has just been released. Users in the 2.0.x series are recommended to upgrade to this version. Full list of changes and contributors: pandas.pydata.org/pandas-doc…
2
11
36
7,971
This is an exciting opportunity to work full time on pandas @quansightai !
I don't often tweet about roles at labs.quansight.org/, but this one feels a little special🙂. We're hiring for a Pandas maintainer! 🐼🐼🐼🐼 boards.greenhouse.io/quansig…
7
38
You can find the documentation of pandas 2.0.0 here, and the list of changes in 2.0.0, in the release notes page. We expect to release the final version of pandas 2.0.0 in around two, but the final date will depend on the issues reported to the release candidate.
2
1
39
10,934
One week left, the final 1.5 release is now scheduled for the 19th of September 🚀 Thank you to the almost 90,000 people who have downloaded the release candidate! The more of you install it and report bugs, the fewer unexpected surprises there'll be in the final release
Thank you to the ~20,000 people who have installed the pandas 1.5 release candidate! You too can install it: python -m pip install --pre pandas==1.5.0rc0 OR mamba install -c conda-forge/label/pandas_rc pandas==1.5.0rc0 Please report any issues to github.com/pandas-dev/pandas
7
34
pandas-stubs 1.4.2.220622 has been released. This is the first official version of pandas-stubs by the pandas team, after merging the two third-party projects Microsoft python-type-stubs and VirtusLabs pandas_stubs. github.com/pandas-dev/pandas…
1
10
37
There's a new place you can follow us for updates We're not allowed to name it on this site, but it rhymes with "Leontodon" and "octodon" Hope you can find it 🤞
5
5
32
We just updated our Team page to show more clearly the active maintainers who are currently working on pandas (in a broad sense, 22 maintainers). 1/2
2
1
30
🙏
How awesome are those visuals in @pandas_dev Getting Started pandas.pydata.org/pandas-doc… Who did this? Seriously, kudos!
2
31
Users having pandas code in production and maintainers of libraries with pandas as a dependency are strongly recommended to run their test suites with the release candidate, and report any breaking change to our issue tracker before the official 2.0.0 release.
1
4
35
11,887
Are you at #pydatanyc this week? Do you want to learn pandas? Maintainers @jreback, @TomAugspurger and @datapythonista will be giving a hands-on introduction to pandas on Wednesday at 9am. pydata.org/nyc2019/schedule/…
1
2
33
Scan me
7
6
32
13,397
The release notes are available here: pandas.pydata.org/pandas-doc…
4
35
7,210
For pip users, you can use `pip install --upgrade pandas` or simply `pip install pandas==2`
Replying to @pandas_dev
How to update please
1
1
27
7,189
Replying to @PicoPaco17
Not easily. If you for example tell pandas "sum this Series", we do that very fast. If you tell us "run this Python function for each element of the this Series" (what .apply() does), we do that, and that's slow.
4
30
2,634
Este jueves vamos a organizar un sprint para contribuir a pandas, o a nuestro hermano @IbisData. El sprint va a ser online por videollamada, para todos los niveles, y será en español. Únete al grupo de @telegram del sprint para participar: t.me/intro_software_libre
1
13
21
read_json now raises FileNotFoundError if the input can't be found, just like read_csv does 😇 This is one of the many improvements from the 1.5.0 release 🚀 Got any suggestions for how to summarise the other changes with memes? Let us know below ⬇️ pandas.pydata.org/pandas-doc…
5
25
Oh, I also had a release yesterday! Pandas 0.25.1 is now out with a handful of bug fixes: pandas.pydata.org/pandas-doc…
1
8
23
This will be very useful if your using my read_parquet / to_parquet functions!
We have some big C++ Parquet optimizations coming in version 0.15.0 to improve string performance and memory use, especially on dictionary-encoded data (e.g. pandas Categorical, R factor). Read more: arrow.apache.org/blog/2019/0…
7
24
Many of our maintainers will be joining the #PythonDataFrameSummit2023. If your company wants to attend and discuss the future of dataframes with them and others, consider making a financial contribution to #pandas or any of the participating projects. df-summit-23.pydata.org
4
23
4,099
Maybe you can just use `dataframe.shape[0]` to extract the number of rows.
1
19
4,655
New contributors' meeting, 2 days from now! All welcome to attend / present / watch
7
22
11,283
Hello everybody, You can now find us Mastodon: fosstodon.org/@pandas_dev There's a chance we may migrate to a purpose-built Scientific Python instance later, but for now we're there in Fosstodon
1
4
16
Next pandas development live stream is on the 26th of November, 18:00 UTC, by core dev Will Ayd! Tune in at piped.video/watch?v=RY5-WR13…
5
19
We are pleased to announce the release of pandas v1.4.3. This is a patch release in the 1.4.x series and includes some regression fixes and bug fixes. We recommend that all users in the 1.4.x series upgrade to this version. pandas.pydata.org/pandas-doc…
5
21
We're doing an "ask me anything" session on Thursday Come along and ask us anything! teddit.net/r/Python/comments…
3
17
10,681
We are pleased to announce the release of pandas v1.5.1. We recommend that all users in the 1.5.x series upgrade to this version. The release can be installed from PyPI and conda-forge. See the release notes for the list of changes: pandas.pydata.org/docs/whats…
9
18
Pandas 0.24.2 was released last week! Small bugfix release fixing some regressions, see the whatsnew for the changes: pandas.pydata.org/pandas-doc…
9
16