The most simple crawlerΒΆ

You can define the most simple crawler job by writing a ~/.fscrawler/test/_settings.json file as follow:

  "name" : "test"

This will scan every 15 minutes all documents available in /tmp/es dir and will index them into test_doc index. It will connect to an elasticsearch cluster running on, port 9200.

Note: name is a mandatory field.