The Untergeek
  • About
The Untergeek

A rant about education, success and the 3 Ds

By Aaron On April 5, 2013 · 4 Comments

Update: Contrary to online job posting, you don’t need a college degree to work at Mass. McDonald’s

Looks like the story was bogus. Short version: Some other job posting service put the erroneous requirement in its listing.

However, [...]

Continue Reading →

The Logstash Book

By Aaron On February 4, 2013 · Leave a Comment

Get “The Logstash Book”

No, I am not the author. I am, however, in the credits on page 1, with links and examples drawn from some of the content on this site. The author, James Turnbull, approached me and asked if it would be okay to do so and [...]

Continue Reading →

Introducing zoop

By Aaron On January 30, 2013 · Leave a Comment

Drumroll please…

Introducing… zoooooooop!

I got sick of hard-coding calls to the python Zabbix API module (https://github.com/gescheit/scripts), so I wrote zoop: Zabbix Object-Oriented Python.

With zoop, I have made (and will continue to add) classes, or objects if you will, of Zabbix API calls. Need to create a new item?

[...]

Continue Reading →

The Zabbix Grab-Bag

By Aaron On December 21, 2012 · 2 Comments

I finally created a repository on GitHub for all of my Zabbix scripts (or, if you want to go directly to the repository: https://github.com/untergeek/zabbix-grab-bag)

This is the culmination of a dream that started a few years ago. I wanted a way to share [...]

Continue Reading →

ls-zbxstatsd – Part 1: Wrangling a zabbix key from a statsd key string.

By Aaron On December 8, 2012 · Leave a Comment

I have just forked zbx-statsd from github into ls-zbxstatsd.

The reason for this is that zbx-statsd was not compatible with the format coming from logstash’s statsd output plugin.

Statsd format is simply “key:value|[type]“.
In logstash, “key” is different, and the format becomes “namespace.sender.’whatever you [...]

Continue Reading →

My current template/mapping

By Aaron On November 5, 2012 · 6 Comments

Expect this post to get updated from time to time. You can come back here to check out what I’m using and why.

2012-11-05: I now map IP addresses (clientip field) as type IP to allow for range searches. I also map the fields in the geoip filter output to allow for non-analyzed terms facet [...]

Continue Reading →

Using elasticsearch mappings appropriately to map as type IP, int, float, etc.

By Aaron On October 12, 2012 · 2 Comments

Update 2012-11-05: My most recent template/mapping can be found here.

I am updating previous templates in blogs accordingly, just FYI.

Logstash allows you to tag certain fields as types within elasticsearch. This is useful for performing statistical analysis on numbers, such as the byte fields or the duration [...]

Continue Reading →

Using rsyslog to send pre-formatted JSON to logstash

By Aaron On October 11, 2012 · 13 Comments

My last post was about sending pre-formatted JSON to logstash to avoid unnecessary grok parsing. In this post I will show how to do the same thing from rsyslog.

And again, this comes with a disclaimer. My exact model here depends on a version of logstash recent enough to have the udp input. You could [...]

Continue Reading →

Getting Apache to output JSON (for logstash)

By Aaron On October 11, 2012 · 5 Comments

Last time we looked at ways to improve logstash/elasticsearch with elasticsearch templates. Today we’ll save ourselves a lot of grok parsing pain with apache’s custom log feature.

Disclaimer: This only works with versions of logstash supporting the UDP input. You can adapt this to send or log in another way, if you like, e.g. send [...]

Continue Reading →

Using templates to improve elasticsearch caching (with logstash)

By Aaron On September 20, 2012 · 5 Comments

Update 2012-11-05: My most recent template/mapping can be found here.

I find that logstash does a great job with the default index mapping behavior in elasticsearch if you are not sending a ton of log events.  Once that amount begins to grow, however, there is a need to manage [...]

Continue Reading →
← Previous Entries
  • Recent Posts

    • A rant about education, success and the 3 Ds
    • The Logstash Book
    • Introducing zoop
    • The Zabbix Grab-Bag
    • ls-zbxstatsd – Part 1: Wrangling a zabbix key from a statsd key string.
  • Recent Comments

    • Howie on Using rsyslog to send pre-formatted JSON to logstash
    • Aaron on Using rsyslog to send pre-formatted JSON to logstash
    • Howie on Using rsyslog to send pre-formatted JSON to logstash
    • Aaron on A rant about education, success and the 3 Ds
    • Peter McCombs on A rant about education, success and the 3 Ds
  • Tags

    Education Elasticsearch github linkedin Logstash Python Zabbix
  • Categories

    Blog Geek
  • June 2013
    S M T W T F S
    « Apr    
     1
    2345678
    9101112131415
    16171819202122
    23242526272829
    30  
  • Meta

    • Log in
    • Entries RSS
    • Comments RSS
    • WordPress.org
"Unknown Twitter error." — theuntergeek

The Untergeek

Pages

  • About

The Latest

  • A rant about education, success and the 3 Ds
    Update: Contrary to online job posting, you don’t need a college degree to […]

More

Thanks for dropping by! Feel free to join the discussion by leaving comments, and stay updated by subscribing to the RSS feed.
© 2012 The Untergeek
Platform by PageLines