Technical Blog

Apache Spark in Resource Constrained States

Posted on Tuesday, July 29th, 2014 by

This is a two part series, read part one Evaluating Apache Spark and Twitter Scalding. Extending the work done here, we sought to evaluate Spark* in resource-constrained clusters. We used the same benchmarks found in the previous blog post while manipulating cluster configurations to validate claims of graceful degradation of RDD’s. The cluster set-up is similar to the previous post, with one master...

Read more ›

Tags: Apache Spark benchmarks Hadoop

Evaluating Apache Spark and Twitter Scalding

Posted on Thursday, July 24th, 2014 by

In general, there are two classes of frameworks to consider when building a machine learning system, in-memory and disk-based frameworks. Disk-based frameworks such as Hadoop MapReduce persist intermediate values to disk, allowing for the computation of massive data with less risk of running out of working memory. In-memory frameworks, on the other hand, attempt to circumvent the heavy cost of I/O...

Read more ›

Tags: Apache Spark benchmarks Hadoop MapReduce

Node.js Testing at Box

Posted on Wednesday, July 9th, 2014 by

Image courtesy of INTVGene When we first started experimenting with Node.js, we spent a good amount of time evaluating our stack. We debated web frameworks and took on dependency management, but one task continued to allude us: testing. As front-end developers we had plenty of experience with JavaScript, but testing it on the server was relatively new to us. Determined to tackle this last unknown,...

Read more ›

Tags: javascript node.js Testing tools

Video: “Minimum Viable Bureaucracy” by Laura Thomson

Posted on Wednesday, July 2nd, 2014 by

Mozilla Web and Release Engineering Manager Laura Thomson spoke at Box last week about how to add enough engineering management to be effective without driving engineers crazy. For more details on the event, see the event description here. Part One: Part Two: See the slides here. Questions? Email Molly MacKenzie at

Read more ›

Hackathon Spotlight: Box Watch

Posted on Friday, June 27th, 2014 by

We’re all winding down from another successful Box Hackathon. With 85 submissions in all, there were a ton of cool hacks from the team, including some we hope you’ll be able to play with soon. You can check out one of those below: Box for your new Google Watch.

Read more ›

Tags: Box for Google Watch hackathon