programming

linux

Parallel UNIX utilities

This post covers some usefull Unix utilities to run parallel processes on the command line.

Read
programming

MapReduce avec parallel, cat et une redirection

Cet article traite d'un problème auquel nous avons fait face était de rendre possible l’exécution de notre modèle sur des centaines de milliers d’utilisateurs dans un temps très court. Il y avait un gain très grand à réaliser en changeant simplement la manière dont nous traitions chaque utilisateur.

Read
linux

Efficient log processing

I've recently learned a couple of neat tricks to process large amounts of text files more efficiently. Our use-case is efficiently going through tens of gigabytes of logs to extract specific lines and do some operation on them. Here are a couple of things we've done to speed things up.

Read
programming

64-bit Scientific Python on Windows

Getting a 64-bit installation of Python with scientific packages on our dear Windows isn't as simple as running an apt-get or port command...

Read
mir

Boston Music Hackday

I was thrilled to attend the Boston Music Hackday this week-end. A lot of people hacked up some pretty cool projects, many of us coding until the very early morning Sunday (aka 4am), only to get back up a few hours later (aka 8am) to keep at it until the dreaded 15h45 deadline, when we all had to submit our demos. The organisers did a wonderful job and the event was a success at every level.

Read
programming

Using filemerge for mercurial diffs

This post talks about a script that brings up OSX's FileMerge program instead of the text-based file comparisons you get with mercurial with doing an "hg diff".

Read