Chapter 13. Ingest

In this chapter, we will cover the following recipes:

  • Pipeline definition
  • Put an ingest pipeline
  • Get an ingest pipeline
  • Delete an ingest pipeline
  • Simulate a pipeline
  • Built-in processors
  • The grok processor
  • Using the ingest attachment plugin
  • Using the ingest GeoIP plugin

Introduction

Elasticsearch 5.x introduces a set of powerful functionalities, targeting the problems that arise during ingestion of documents via the ingest node.

An Elasticsearch node can be master, data, or ingest.

The idea to split the ingest component from the others, is to create a more stable cluster due to problems that can arise during pre-processing documents.

To create a more stable cluster, the ingest nodes should be isolated by the master or data nodes, in the event that some problems may occur, such as a crash due to an attachment plugin and high loads due to complex type manipulation.

Note

The ingestion node can replace a Logstash installation in simple scenarios.

..................Content has been hidden....................

You can't read the all page of ebook, please click here login for view all page.
Reset
3.144.222.239