HTTP Request

Make an HTTP request.

Properties

Name		Type
engine		String=http
method		String
url_template		String
body_template		String
header		Object
decoder		String
schema		Object
workers		Integer
requests_per_minute		Integer
retry		Integer
timeout		String

---

engine

Must be http.

Required

Yes

---

method

HTTP method to make requests.

Required

No

Default

GET

Enum

GET POST PUT PATCH DELETE

---

url_template

Template to build the request URL from the incoming data.

Required

Yes

Examples

https://example.com/products/{{data.id}}

---

body_template

Template to build the request body from the incoming data.

Required

No

Examples

{ "id": "{{data.id}}", "name": "{{data.firstname}} {{data.lastname}}" }

---

header

Add headers to http requests.

Required

No

---

decoder

The format of the data. See Parsing Data for details.

Required

Yes

Enum

csv json ndjson msgpack protobuf parquet html xml regex

---

schema

Define a schema for the data.

Required

No

---

workers

Specify how many concurrent requests you’d like to make.

Required

No

Default

5

Minimum

1

Maximum

100

---

requests_per_minute

Limit how many requests to make per minute. Requests will be spaced out e.g. 6 requests per minute will result in one request every 10s.

Required

No

---

retry

How often to retry failed requests.

Required

No

Default

3

---

timeout

Set a timeout for the HTTP requests. Durations are formatted as integers with a unit e.g. 1m30s. Valid time units are ns, us (or µs), ms, s, m, h.

Required

No

Default

30s

Format

duration