Category archives for Architecture

Python design patterns #5: observer (aka: pub-sub)

The observer is probably the GOF pattern with the most impact on networking. It is a massaging pattern by itself. It’s quite simple, though. The subscribers, interested with a certain topic, subscribe with a publisher for updates regarding that topic. The publisher, triggered by our topic-aware system, then publishes the topic updates to the right subscribers. Use case Every […]

Linear regression example, using simdfied

Let’s test drive simdfied library with a linear regression example. We’ll use, that uses simdfied for Machine Learning and can read csv or mat files. For example, a csv file representing house prices according to its square-foot and number of bedrooms: square foot, #bedrooms, price 2461.68 , 4 , 467883 1872, 4 , 385983 And […]

Announcing simdfied, an open-source Machine Learning library, utilizing SIMD

Lately I’ve been working on simdfied – a Machine Learning javascript library, utilizing SIMD! Earlier this year, Intel announced their collaboration with Google and Mozilla, enabling a preview native SIMD support for firefox-nightly and chromium browsers;  they provided some really nice stats for gaming implementations. For me it was time for an idea I’ve had for a while; implementing a javascript […]

SIMD.JS – another step towards pure ML in javascript

With a cross-giants collaboration between Intel and the leading modern browsers Mozilla and Google-Chrome, a native javascript SIMD performance is now available! In his article, Bringing SIMD to JavaScript, Mohammad Reza Haghighat presents interesting benchmarks running complicated visualizations. I’m much more interested with the ML implications of using SIMD over javascript. I believe this joint effort should […]

NoSQL Distributed Algorithms

NoSQL Distributed Algorithms A very thorough article by Ilya Katsov, covering every aspect of read and write tradeoffs for every CAP variation. The best in its class.

Scaling *up* Hadoop for under-100-GB jobs

Scaling *up* Hadoop for under-100 GB jobs “Nobody ever got fired for buying a cluster” – A very interesting Microsoft research paper implying: Most common huge jobs are still under 100GB (yes, including the elephant friendly Facebook) Addressing the “problematic” issue of “when and how to distribute with Hadoop”, if any? Addressing the cost efficiency […]

Design Driven Development (DDD) vs SOA, for JAVA

To SOA or to DDD? Again, today, I had to select between the two, for a new project I’m designing. In short: SOA is inherently built on a stateless model object concept, allowing it to be super loosely coupled. Objects traveling between layers as serialized data, regenerating themselves on each de-serialization. This is loosely 🙂 […]