Chapter 4 of our book (covering the foundations of deep learning) is, for most people, the most challenging. It covers a lot of math and coding concepts very quickly.
This series from @strickvl is an amazing resource to help you understand how a neural net really works:
This week I wanted to really make sure I grasped what was going on in ch 4 of the @fastdotai book, so I put my study hat on. 🤓 Writing helps me understand so I split the things I learned into separate blog posts. I reimplemented the methods with the Fashion MNIST dataset.
We just released a new version of fastai that's now compatible with the latest @PyTorch 2.2.
h/t @benjamin_warner
Either: "pip install -U fastai" or "conda install -c fastai fastai" to upgrade.
The new `fastcore.basics` provides a lot of great functionality, but is *really* lightweight (only 0.02 secs to import, and the entire `fastcore` has no deps other than python itself)
New #fastai release: v2.7.0. github.com/fastai/fastai/rel…
Breaking changes
- Distributed training now uses Hugging Face Accelerate, rather than fastai's launcher.
Distributed training is now supported in a notebook -- see [this tutorial](https://docs.f…
New #fastai release: v2.0.18. github.com/fastai/fastai/rel…
2.0.18
### Forthcoming breaking changes
The next version of fastai will be 2.1. It will require PyTorch 1.7, which has significant foundational changes. It should not require any code chang…
We've just released fastai 2.2. This contains some fairly minor breaking changes, which should only impact you if you write your own callbacks, or use custom RNN code.
The main feature is improved FP16 training. 1/
github.com/fastai/fastai/rel…
Anyone got a bit of code that would make it easy to use the Youtube Data API to upload whisper-generated captions directly to Youtube?
Feels like this whole process could probably be automated pretty easily! :D
We should be very careful of assuming that analyzing this kind of data will help to "fight crime". It can easily lead to a feedback loop in which existing biases in policing methods get amplified.
github.com/fastai/fastbook/b…
We'll be experimenting with the Twitter API a bit today, so apologies if you see some test tweets appearing in disappearing in our stream over the next couple of hours...
New #fastai release: v2.7.10. github.com/fastai/fastai/rel…
New Features
- Add torch save and load kwargs, thanks to JonathanGrant
- This lets us do nice things like set pickle_module to cloudpickle
- PyTorch 1.13 Compatibility, thanks to @warner_benja…
New #nbdev release: v2.0.7. github.com/fastai/nbdev/rele…
New Features
- git merge hooks: automatically resolve conflicts and render markers as separate cells, thanks to @wasimlorgat
- Allow clean to keep some metadata keys, thanks to dleen
- enable mac te…
New #fastai release: v2.7.8. github.com/fastai/fastai/rel…
New Features
- add split value argument to ColSplitter, thanks to @DanteOzML
- deterministic repr for PIL images
- option to skip default callbacks in `Learner`
- update for nbdev2
Bugs Squashed
…
New #nbdev release: v2.0.6. github.com/fastai/nbdev/rele…
New Features
- new jupyter save hook to clean NBs, thanks to @wasimlorgat
- new directive `exec_doc` to auto-exec cell when building docs
- automatically escape YAML strings for title and descriptio…
New #fastai release: v2.0.14. zpr.io/Hm4BM
2.0.14
### New Features
- new callback event: `after_create` ([#2842](github.com/fastai/fastai/iss…))
- This event runs after a `Learner` is constructed. It's useful for initial setup which isn't needed for
New policy: fast.ai libraries that have reached v1.0.0 will have a bump to the MAJOR or MINOR # in the case of breaking changes.
E.g. 1.0.0->1.0.1: no breaking; 1.0.0->1.1.0: breaking. (Changes to MAJOR # indicate major API overhaul, and are very rare.)
1/
We've just enabled tweeting an announcement of each new release to the #fastai, #nbdev, and #fastcore libraries, to this account. Just about to test it out, so watch this space!
(We're using @zapier for this.)
New #nbdev release: v2.3.7. github.com/fastai/nbdev/rele…
New Features
- Set recursive `True` by default, thanks to @wasimlorgat
- `exec_doc` supports re-rendering widgets, thanks to @wasimlorgat
- If users update widgets with the `exec_doc` directive, t…
New #nbdev release: v2.3.11. github.com/fastai/nbdev/rele…
New Features
- add agplv3 license to project options, thanks to joel-lbth
- add 0 - Pre-planning status to project options, thanks to ddobrinskiy
- add conda installation docs to end-to-end tutori…
New #nbdev release: v1.2.9. github.com/fastai/nbdev/rele…
New Features
- Implement `show_doc` for dataclass, thanks to MarkB2
Bugs Squashed
- Fix show doc for object, class methods., thanks to v-ahuja
- Fix show doc for keywords., thanks to v-ahuja
- Inc…
New #fastai release: v2.0.13. zpr.io/HxnNK
2.0.13
### Bugs Squashed
- Undo breaking num_workers fix ([#2804](github.com/fastai/fastai/pul…))
- Some users found the recent addition of `num_workers` to inference
functions was causing problems, partic
New #fastcore release: v1.5.28. github.com/fastai/fastcore/r…
Bugs Squashed
- fix: `console_help` excludes entrypoints from the root module, thanks to @wasimlorgat
- Improvements to test messages, thanks to ddobrinskiy
(You might also want to consider whether at-mentioning someone with >100k followers that's provided you with free educational material is a thoughtful thing to do, and what would happen if all students did that.)
New #nbdev release: v2.1.1. github.com/fastai/nbdev/rele…
New Features
- add tools from fastrelease to nbdev
Bugs Squashed
- fix `nbdev_test` with no `--fname` in non-nbdev repos, thanks to @wasimlorgat
- Auto-generated showdoc headers not in ToC
New fastcore release v1.0.14. zpr.io/HMpb6
1.0.14
### Bugs Squashed
- Reapply fix for #86 which was unintentionally reverted by the next commit ([#91](github.com/fastai/fastcore/i…))
New #fastcore release: v1.5.15. github.com/fastai/fastcore/r…
New Features
- layered `Config` with `extra_files`; `Config` `repr`, thanks to @wasimlorgat
- in-memory `Config` by passing `save=False`, thanks to @wasimlorgat
- use `==` for non iterable a…
New fastcore release v1.0.12. zpr.io/HX4mu
1.0.12
### New Features
- add function support to `store_attr` ([#85](github.com/fastai/fastcore/i…))
### Bugs Squashed
- 'mp_context' keyword for initialising concurrent.futures.ProcessPoolExecutor only sup
New #fastcore release: v1.5.17. github.com/fastai/fastcore/r…
New Features
- Add `fastcore.style`: fast styling for friendly CLIs, thanks to @wasimlorgat
- add `skip_folder` to `xtras.walk`
Bugs Squashed
- Fix scripts not executing, thanks to @renato…
New #fastcore release: v1.5.29. github.com/fastai/fastcore/r…
New Features
- extend test_eq_type, thanks to ddobrinskiy
- PyTorch 2.0 compile compatibility, thanks to ggosline
New #fastprogress release: v1.0.3. github.com/fastai/fastprogre…
New Features
- support unknown `total` by passing `total='noinfer'`, thanks to @wasimlorgat
- support PyCharm console as TTY
New #nbdev release: v2.3.8. github.com/fastai/nbdev/rele…
New Features
- better error messages for `nbdev_migrate`
- experimental: Users can provide extra processors via the `procs` key in `settings.ini`, thanks to @wasimlorgat
- enable Documentation Only …
New #nbdev release: v2.2.6. github.com/fastai/nbdev/rele…
New Features
- Build `_modidx.py` on demand in order to git conflicts
- Add source link to index
- Order left navigation sections using numeric prefix
- Automatic rendering of python files with fron…
New #nbdev release: v2.2.0. github.com/fastai/nbdev/rele…
Breaking Changes
- Combine preprocs and postprocs into new `Processor` class
- Rename `nbdev.read` to `nbdev.config`
- Use H3 for functions and properties, instead of H4
- Remove `nbflags` directive…
New #nbdev release: v2.3.2. github.com/fastai/nbdev/rele…
New Features
- Support GitHub Enterprise
Bugs Squashed
- `nbdev_new` fails with `AttributeError: path_`
New #fastcore release: v1.5.5. github.com/fastai/fastcore/r…
New Features
- use ujson if available
- new `func` param for `globtastic`
- add nested parser support to `fastcore.script`, thanks to @wasimlorgat
New #nbdev release: v2.1.4. github.com/fastai/nbdev/rele…
New Features
- Add `custom_quarto_yml` setting, thanks to benoit-cty
- Display multiline docstrings
- Include filename in `nbdev_export` warning when nbdev1 syntax is used
- Streamline `nbdev_new`: …
FYI you'll see a few "new release" notifications today for releases that were actually a few weeks ago. Turns out we had a firewall rule that was blocking a webhook, so those new release tweets weren't getting sent.
Fixed now!
New #fastcore release: v1.5.26. github.com/fastai/fastcore/r…
Bugs Squashed
- Delegatee docments not appearing
- UnicodeDecodeError occurs when reading `settings.ini` file containing CJK characters on Windows
If you don't get an answer to a question, it's a good opportunity to reflect on how you could have asked in a way that would make it easier for people to answer. There's a lot of info on the forum to help you with this.
New #fastcore release: v1.5.0. github.com/fastai/fastcore/r…
Breaking Changes
- Importing `fastcore.utils` now longer imports `fastcore.net`
New Features
- Move imports into functions to make import faster
- use py310 style union annotations, thanks t…