Configuring Logstash & ElasticSearch for a Custom Log Structure

Question

Configuring Logstash & ElasticSearch for a Custom Log Structure

I am trying to configure log redirection in redis / logstash / elasticsearch using https://github.com/jlecren/logserver (note this is my first attempt to use this, so I may have some things wrong).

However, the logs I want to send to the elastic search are not the standard log format (this is a special application). They are already in JSON format, so I'm just trying to forward them to redis.

I am forwarding JSON to redis using logstash and this configuration:

input {
   file {
      path => "/tmp/*.json"
      tags => "restserver"
      codec => "json"
   }
}

output {
  stdout { codec => rubydebug }
  redis { host => "192.168.33.101" data_type => "list" key => "logstash" }
}

, JSON, kibana , ES. , , , ES, .

, JSON ( - , ):

{
  "@timestamp": "2014-02-06T15:23:10-0000",
  "tags": {
    "serial": "XX2013111111",
    "command": "Thumbnail"
  },
  "ip": "10.6.1.21",
  "source": "XX2013111111",
  "fields": {
    "type": "Thumbnail",
    "controller": "Image",
    "thumbnail": {
      "datetaken": [
        "2014-02-06T13:22:35"
      ],
      "name": [
        "DCIM\\IMG_008736.JPG"
      ]
    }
  },
  "message": "....."
}