Introducing Pulpie, models for cleaning the web.
70% of a typical HTML page is ads, navigation, and sidebars. Pulpie removes this noise and returns a clean document you can use in pre-training or as context.
Previously, cleaning 1 billion pages with the best extractors cost $159,000. Pulpie brings that down to $7,900. A 20x decrease.