1,987 reputation
2 11 21


Building data pipelines and analytical systems at massive scale. My experience lies in distributed systems, focusing on data driven large-scale systems (10.000+ nodes).

For the highly concurrent world my choice of development environment is Erlang(BEAM) and Clojure (JVM). Using functional languages that supports thousands of lightweight threads communicating with message passing and having inverted concurrency control enables low latency and high throughput with thread safe software.

Storing data at scale has been an interesting subject to me, I am familiar with the RCFile whitepaper and the more recent publication about ORC and Parquet. I have been using columnar stores beside the classical row oriented stores (SQL servers) and key-value stores (Riak, Couchbase).

Analysis of large datasets is sometimes challenging. Using caching and sampling and few other techniques makes it possible to query these sets. I am familiar with few query engines (Hive, PrestoDB, Tez).

Stack Overflow Careers profile

Top Tags (183)

Score 34
Posts 24
Posts % 20
Score 23
Posts 6
Score 13
Posts 9
Score 11
Posts 10
Score 8
Posts 6
Score 5
Posts 7

Top Posts (120) All Questions Answers | Votes Newest

View all questions and answers

Badges (34)

Gold 2


Silver 11


Bronze 21