Optimus Desktop (Legacy)
The legacy version of Optimus Desktop has been deprecated and removed. We will be releasing a new and updated Optimus Desktop version in Q3 2023.
Optimus Mine is a data pipeline & web-scraping application. It can extract structured data from a multitude of different sources such as websites, APIs or databases and store it in either a local file, a cloud storage provider such as Amazon S3 or Google Cloud Storage or a database.
It can be used for a wide array of applications such as scraping websites or simply transforming & warehousing data from multiple sources.
Getting Started
Parsing Data
Learn how to configure Optimus Mine to parse & transform data into a structured format using a schema.
| Topic | Description |
|---|---|
| Parsing Basics | Start here to learn about Optimus Mine’s schema format. |
| CSV | Parse CSV data. |
| JavaScript | Create your own custom parsers using JavaScript. |
| JSON | Parse JSON data. |
| RegEx | Parse data using regular expressions. |
| XPath | Parse HTML & XML documents using XPath. |
Manipulating Data
Learn how to configure Optimus Mine to manipulate, format & sanitise data using filters.
| Topic | Description |
|---|---|
| Filters Basics | Start here to learn about Optimus Mine’s filters. |
| Arrays | Manipulate arrays. |
| Strings | Manipulate & format strings of data. |
| URLs | Manipulate URLs. |