Ferret is a web scraping system. It aims to simplify data extraction from the web for UI testing, machine learning, analytics and more.
Ferret allows users to focus on the data. It abstracts away the technical details and complexity of underlying technologies using its own declarative language.
It is extremely flexible, powerful, easy to learn and use.
You can start by reading the introduction post on our website and get your hands dirty with the getting started guide.
Ferret system contains multiple tools and components.
- Ferret runtime is the core of the system that contains the language parser and execution runtime engine. It's designed to be portable and can be embedded to any application.
- CLI is a command-line tool that allows you to run Ferret scripts from the terminal. Good for quick testing and debugging.
- Worker is a HTTP server that allows you to run Ferret scripts as a service. Good for building scalable and distributed systems.
- Lab is a test runner that allows you to write and run UI tests using Ferret scripts. Good for building test suites and running them in CI/CD pipelines.
- Chromium is a Dockerized headless Chromium that is used by Ferret to execute scripts. It's based on the latest version of the Chromium browser and is optimized for running in headless environments.
- VS Code Syntax Highlighting is a Visual Studio Code extension that provides syntax highlighting for Ferret Query Language.
- Ferret Playground is an online playground that allows you to write and run Ferret scripts in the browser. Good for quick prototyping and sharing.
Thanks to everyone who contributed.
Support this project by becoming a sponsor. Your logo will show up here with a link to your website.
