… Ok, the speaker said far more than that. But one of his central theses is that in this “second” machine revolution, we are enabling data driven decision making, distributed decision and consensus, as well as expanding beyond the confines of specific expertise in a field. The latter I’ve heard described as cross fertilization … gather a bunch of smart people “together” and give them a problem spec. Let them run with it.

I read this announcement this morning. Our friends at Facebook releasing their reduced precision server side convolution and GEMM operations. Many years ago, I tried to convince people that HPC moves both down market, into lower cost hardware, as well as more widely into more software toolchains. Basically, the decades of experience building very high performance applications and systems will have value downstream for many users over time. GEMM is a generalized approach to a matrix multiply, which has been well optimized for HPC applications in various scientific libraries over time.

I’m attending SC18 next week. It’s been 3 years since I last attended (2015). Then we (@scalableinfo) had a large booth, lots of traffic, and showed off some of the first commercial NVMe high performance storage systems running BeeGFS over 100GbE. I am looking forward to talking with as many people as I can, to get their perspectives on things. To see what they are thinking, hear what they are doing, and in which direction they are going.

So … I’ve had this blog since 2005. I installed it from original sources. And WP made upgrades in the 2.x time frame, quite painless. Or so it seemed. Slowly, over time, some configuration/settings/whatever got out of whack. And with the last update, from a system originally installed in final form in 2013 or so, something broke. I am not sure what. But the symptoms were simple … new posts would replace the most recent posts.

Neither one is a computer related. Both are based upon what I see as unmet needs for various groups. One is a definitely “gotta have” for one group. The other group, there is one “solution” on the market that I looked at, and it’s pretty pathetic. The other uses technology where it should be using chemistry, as the tech is simply way too expensive for mass use, and quite inflexible. Both are B2C.

This was making the rounds last week. Oracle seems to have a leak in its process, creating labels that trigger event notifications for people, for their packages. Solaris was decimated. More details at the links and at The Layoff. Honestly I had expected them to reach this point. I am guessing that they were contractually obligated for at least 7 years to provide Solaris/SPARC support to US government purchasers. SGI went through a similar thing with IRIX.

First up, Tegile was acquired by Western Digital (WDC). This is in part due to WDC’s desire to be a one stop shop vertically integrated supplier for storage parts, systems, etc. This is how all of the storage parts OEMs needed to move, though Seagate failed to execute this correctly, selling off their array business in part to Cray. Toshiba … well … they have some existential challenges right now, and are about to sell off their profitable flash and memory systems business, if they can just get everyone to agree … This comes from the fact that spinning disk, while a venerable technology, has been effectively completely commoditized.

Information at this link. It is being called a “strategic transaction”, though it likely came about vis-a-vis Seagate doing some profound and deep thinking over what business it was in. Seagate has been weathering a storm, and has been working on re-orgs to deal with a declining disk market. They acquired ClusterStor as part of a preceding transaction of Xyratex. Xyratex was the basis for the Cray storage platforms (post Enginio).

I’ve written about approved vendors and “one throat to choke” concept in the past. The short take from my vantage point as a small, not well known, but highly differentiated builder of high performance storage and computing systems … was that this brand specific focus was going to remove real differentiated solutions from market, while simultaneously lowering the quality and support of products in market. The concept of brand and marketing of a brand is about erecting barriers to market entry against the smaller folk whom might have something of interest, and the larger folk who might come in with a different ecosystem.

Given that the (now former) day job has ended, I am selling some of the old day job’s assets on ebay. We’ve sold some siFlash, Unison, and have current listings for Arista and Mellanox switches. More stuff will be listed in short order, check it out here. Feel free to reach out to me at joe.landman at the google mail thingy if you want to talk about any of these things, or buy before I list them.

Though, when I look at the “great speed”, it is often on par with or less than Scalable Informatics sustained years before. From 2013 SC13 show, on the show floor, after blasting through a POC at unheard of speed, and setting long standing records in the STAC-M3 benchmarks … Article in question is in the Register. Some of the speeds and feeds: * 200 microsecs latency * 45GBps read bandwidth * 15GBps write bandwidth * 7 million IOPS But then … a fibre connection.

Way way back in the early aughts (2000’s), we had built a set of designs for an accelerator system to speed up things like BLAST, HMMer, and other codes. We were told that no one would buy such things, as the software layer was good enough and people didn’t want black boxes. This was part of an overall accelerator strategy that we had put together at the time, and were seeking to raise capital to build.

I’ve been trying to help Scalable Informatics customers understand these market realities for a while. Unfortunately, to my discredit, I’ve not been very successful at doing so … and many groups seem to assume supply is plentiful and cheap across all storage modalities. Not true. And not likely true for at least the rest of the year, if not longer. This article goes into some depth that I’ve tried to explain to others in phone conversations, private email threads.

See the article here. They mention Axellio, and on The Reg article on their ISE product, they say “X-IO partners using Axellio will be able to compete with DSSD, Mangstor and Zstor and offer what EMC has characterised as face-melting performance.” Hey, we were the first to come up with “face melting performance”. More than a year ago. And it really wasn’t us, but my buddy Dr. James Cuff of Harvard.

There has been a huge demand of SSD/Flash/memory components from a number of end users. Sadly not the day jobs customers … but enough to deplete the market of supply. Watching basic economics at work is fascinating. Supply is highly constrained, while demand is rising. Couple that with a (mis)expectation of continuous falling prices across the board leads to interesting conversations with customers. We’ve tried to set expectations appropriately, but we’ve been bitten in the past by doing just this.

ClusterHQ is now dead. They were an early container play, building a number of tools around Docker/etc. for the space. Containers are a step between bare metal and VMs. FLocker (ClusterHQ’s product) is open source, and they were looking to monetize it in a different way (not on acquisition, but on support). In this space though, Kubernetes reigns supreme. So competing products/projects need to adapt or outcompete. And its very hard to outcompete something like k8s.

Two items of note here. First, Cavium acquires qlogic. This is interesting at some levels, as qlogic has been a long time player in storage (and networking). There are many qlogic FC switches out there, as well as some older Infiniband gear (pre-Intel sale). Cavium is more of a processor shop, having built a number of interesting SoC and general purpose CPUs. I am not sure the combo is going to be a serious contender to Intel or others in the data center space, but I think they will be working on carving out a specific niche.

We strive to do right by our customers. Sometimes this involves telling them unpleasant truths about choices they are going to make in the future, or have made in the past. I try not to overly sugar coat things … I won’t be judgemental … but I will be frank, and sometimes, this doesn’t go over well. During these discussions, I often see people insisting that their goal is X, but the steps Y to get there, will lead them to Z, which is not coincident with X.

Thus ended the plaintive cry of a management consulting hawking their wares, promising us high level meetings with “customers” with “budgets” in our space. This isn’t to say we don’t want more customers, we do. We always need more (and repeat) customers … this is the nature of our business. What we don’t need is pay-for-play. There is no shared risk, no incentive for the management consultant to deliver a set of business, as they are being paid, and that … the pay for play, is their business.

Saw this in a post on VentureBeat. Intel Capital has been an important player in the space for a while. What happens next to them is worth paying attention to. They’ve been in the thick of many interesting companies, though usually outside of Intel’s core foci. Somewhat beyond the normal corporate strategic VC roles. This could change a number of things for startups … new and existing. VCs have been sitting on the sidelines, or being less active over the recent past, and this is likely not to help the situation.

An article appeared on HN this morning. In it, the author noted that all was not well with the universe, as their backup, using Amazon’s Glacier product, wound up being quite expensive for a small backup/restore. The OP discovered some of the issues with Glacier when they began the restore (not commenting on performance, merely the costing). Basically, to lure you in, they provide very low up front costs. That is, until you try to pull the data back for some reason.

This one has been in the rumor mill for a while. NetApp has been needing something to play well in the all flash array space, and it now has something. This said, the array space is very much on the decline certainly with respect to dumb JBODs and smart “filer heads”. That design is being retired in favor of smarter and hyperconverged systems. Such as Unison with Ceph, Forte, and related HCI (hyper converged infrastructure) systems.

In Feb 2013, I opined (with some measure of disgust) that people were looking at various software packages as silver bullets, these magical bits of a stack which could suddenly transform massive steaming piles of bits (big … uh … “data” ?) into golden nuggets of actionable data. Many of the “solutions” marketed these days are exactly like that … “add our magic bean software to your pipeline and you will gain insight faster.

Violin has had a rather tumultuous time in market. Post IPO, they’ve not had a great time selling. They have an interesting product, but with SanDisk coming out with their kit, and many others in the competitive flash array space, this can’t be a fun time for them. They don’t have a large installed base to protect, and their competitors are numerous and fairly well funded. Add to the mix that, as a post-IPO public company, they no longer have the luxury of not hitting targets … they will get slaughtered in the market.

We started the company on 1-August-2002. I remember arguing with a senior VP at SGI over his decision to abandon linux clusters in Feb 2001. That was the catalyst for me leaving SGI, but I was too chicken to start Scalable then. I thought I could do better than them. I went to another place for 15 months or so. Tried jumpstarting an HPC group there … hired lots of folks, pursued lots of business.

I just saw this about doing a divide and conquer approach to massive scale genomics calculation. While not specific to the code in question, it looked familiar. Yeah, I think I’ve seen something like this before … and wrote the code to do it. It was called SGI GenomeCluster. It was original and innovative at the time, hiding the massively parallel nature of the computation behind a comfortable interface that end users already knew.

Article is here, take it as a rumor until we hear from them. My comments: First, M&A; is hard. You need a good fit product wise (little overlap and great complementary functions/capabilities), and a culture/people fit matter. Second, sales teams need to be on-board selling complete solutions involving the acquired tech. Sometimes this doesn’t happen, for any number of reasons, some fixable, some not. Third, Cisco is out of the storage game if this is true.

Terascala appears to have been disassembled, with much of the team going to Cray. Terascala started out selling internally developed storage appliances for Lustre. They developed deployment, monitoring, and management tools. Their UI was reasonably good. Then they struck up a deal with Dell and a few others. In doing so, they largely stopped their appliance sales. Put their code upon their partners hardware. This did generate more force multipliers for them in sales, but it cost them some of their differentiation … unless their boxes were entirely undifferentiated, where it would reduce their overall costs to avoid selling undifferentiated hardware.

I was heads down all day yesterday working on a few things. Apparently this is widely known now, but I saw it late last night. Micron is being pursued by a group affiliated with Tsinghua University. There is a political angle to this group, as they are connected to the government through their management. Why is this interesting (the acquisition potential that is). Well, there are 4 basic Flash fabs out there these days.

[update] TL;DR this appears to be rumor/speculation. One would think that such an acquisition would be prominent on Nutanix’s web site. Its April fools, in May. /sigh Huge in the hyperconverged space (which, not so curiously, is where the day job is), and its setting up the battle lines between the major software/hardware players. Cisco was already number 5 hardware vendor, and was bragging about “beating the white boxes”. The last may be more wishful thinking than reality.

So the day job did a small capital raise. Not a huge amount, but helpful for some day to day stuff. We did this in part because a larger effort we were working on stalled for reasons I won’t go into here. Looking at where we are and where we need to be, I am amazed at the profound need for performance throughout the hyperconverged space, and blown away that we appear to be the only one focused upon it.

This is a very exciting hyper-converged system, representing our next generation of time series, and big data analytical systems. Tremendous internal bandwidths coupled with massive internal parallelism, and minimal latency design on networks. This unit has been designed to focus upon delivering the maximal performance possible in an as minimal footprint … both rack based and cost wise … as possible. You can use these as independent stand alone units, integrate them into a larger FastPath Unison system We have our software stack (SIOS) integrated onto each unit, and include our builds of Python + Pandas/SciPy/NumPy, R, and Perl.

Our Q1 is usually quiet, fairly low key. Not this one. Looks like lots of pent up demand. We are deep into record territory, running 200+% of normal, with possibility of more. Another new wrinkle is that our small investment round is mostly complete. This is new territory for us, and you may have noticed I’d backed off posting intensity over the last half year or so while this was going on.

[full disclosure: day job has a relationship with Diablo] Russell just pointed this out to me. The short (pedestrian) version (I’ve got no information that is not public, so I can’t disclose something I don’t know anyway): Netlist filed a patent infringement suit against Diablo, and then included SanDisk as they bought Smart Storage, whom worked with Diablo prior to Smart being acquired by SanDisk. Netlist appears to have won an, at least temporary, injunction against Diablo.

The day job’s products have never been stronger, fit together as well, or had as great a story arc as they do today. We can deliver denser, faster, easier to setup and manage systems quite easily. Our application stacks run atop this system on our ample computing power, and we provide massive network pipes in/out, as data motion is hard. Many more cool things are coming, but for now, we are working very hard on building something awesome.

A “gut feeling” is, at a deep level, a fundamental sense of something that you can’t necessarily ascribe metrics to, you can’t quantify exactly. Its not always right. Its a subconscious set of facts, ideas, concepts that seem to suggest something below the analytical portion of your mind, and it could bias you into a particular set of directions. Or you could take it as an aberration and go with “facts”.

Ok, didn’t see this acquirer coming, but PLX being bought … yeah, this makes sense. Avago looks like they are trying to become the glue between systems, whether the glue is a data storage fabric, or communications fabric, etc. PLX makes PCIe switches and other kit. PCIe switch and interconnection is the direction that many are converging to. Best end to end latencies, best per-lane performance, no protocol stack silliness to deal with.

I am lucky. I fully admit this. There are people out there whom will tell you that its pure skill that they have been in business and been successful for a long time. Others will admit luck is part of it, but will again, pat themselves on the back for their intestinal fortitude. Few will say “I am lucky”. Which is a shame, as luck, timing (which you can never really, truly, control), and any number of other factors really are critical to one being able to have the luxury of doing what we are doing.

For those who don’t get the reference, “going Galt” points back to the masterpiece novel “Atlas Shrugged” by Ayn Rand. In it, one of the characters is named John Galt, and part of what he does, early in the novel, is convince those whom create jobs, and wealth in the country, to abandon their efforts, as the government lurches harder and farther to the redistributionist world view. Indeed, the country eventually goes full on socialist in the story, where people are not allowed to quit work, take a better job, and so forth.

The day job had been talking to and working with Calxeda for a while. They’ve been undergoing some changes over the last few months as they worked to transition from an evangelist to a systems builder. The day job just got a note that they are restructuring. What this specifically means to an outsider, I am not sure, though I could speculate. HP has a vested interest in them. I wouldn’t be surprised to see a rapid asset acquisition.

Story at The Register. Usually you give a CEO some time to right a listing ship. I pointed out in a recent post that there are some significant grumblings about Violin and in fact about most of the flash-as-rack-appliance space. I had noted We’ve run into them a few times in competitive situations, so take what I write about them with an appropriate mass of NaCl. All the pure-play flash array vendors have to answer a basic question about their existence.

Lets see if this actually materializes. Its pretty obvious as to how hard the media folks tried to spin this with the title. A good rubric for how the US media treats the president and his opposition could be found in this cartoon. With that in mind, read the title of that article, and then note this little tidbit on the inside: Notice the scare quotes around the word treason. Treason has a very straighforward definition in the US Constitution.

This is sad. Here’s the really sad parts of this Not only did they close the parks, but they turned off the web sites The park employees are being ordered to make life as hard as possible for the patrons. None of this had to happen. Had the democrats decided that, ya know, in a political environment where negotiation is the key to advancing agendas, and not a burnt ground strategy, chances are they would be able to get some of what they wanted.

What many of us worried about years ago was whether or not we weer electing an empty suit to the highest political office in the land. Someone with no experience running anything. With no great accomplishments upon which to build. Simply a moderate orator with a teleprompter. 5 years in, our worst fears don’t even appear to scratch the surface of the failure that we have brought upon ourselves. This piece at the Wall Street Journal is so completely spot on.

Link here. Don’t want to tax ALL businesses … out of business? Just some of them? Are you mad? Are you freaking kidding me? Pulling my leg? Very sad. Very very sad. The government should be seeking to reduce taxes to make sure businesses grow, and hire, and spend. Mr. President, the entire role of government in business should be to get out of the way, lest you slow down growth, employment, and spending.

Take a gander. Some things are missing, and our marketing folks are developing the content where needed, and revising it where we have existing content. Its quite refreshing to see this. It will get better over time. Its running in our facility now, and likely we’ll have a few clones in the cloud as well. But thats for later.

Yes, actually we do. Too many. Turns out that little law of supply and demand does in fact hold true. The higher the demand for something in limited supply, the higher the price (wages) you will pay for it. By applying forces to this law, you impact a number of outcomes. That is, if you start monkeying around with the supply, sure, you can adjust the price you pay for the STEM.

Watching the slow motion train wreck in Cyprus made me wonder exactly whom the target of the money grab was. And more importatly, whether or not the people making demands had any clue that their victory was, at best, Pyrrhic, and at worst, a serious contagion. Any financial system in operation is built upon various levels of trust, implicitly in the case of the least risky capital storage system. You know that you can trust, within reasonable expectations and parameters, that capital that you deposit there can be retrieved later.

Suffice it to say that much hot air was blown over the sequester in the media. Really, there was much tearing of clothes over this. Much righteous indignation that someone in government, somewhere, would have to make (not so very hard) decisions about where to trim budgets. We needed this, as the US government is so completely broken as to no be able to propose a reasonable budget, pass a reasonable budget, nor listen to and work with ideas from other portions of the legislative branch which want to work on reasonable budgets.

See the Systems Engineering position here, and the System Build Technician position here. I’ll get these up on the InsideHPC.com site and a few others soon (tomorrow). But they are open now. For the Systems Engineering position, we really need someone in NYC area with a strong financial services background … Doug made me take out the “able to leap tall buildings in a single bound” line, as well as the “must be able to talk customers through complex vi sessions on system configuration files while driving 70 mph on a highway.

[update] There’sa good piece on the impact upon the potential negotiations and its impact upon one party. As I noted below, any deal done between 1-Jan and now will be a bad deal. The only way to get real spending cuts is to go over the cliff, so lets do this. I don’t care about the political fortunes impact. I care about the long term impact upon the country of out of control spending.

is drinking your own koolaid, consuming your own product, believing the wishful thinking that underlies your most serious predictions. Like this. Just like in catastrophic AGW, there’s one single chart that belies all the claims as to how “well” the “stimulus” package did. Its a damning chart. Here it is. [ ](http://www.aei-ideas.org/2012/11/is-this-as-good-as-it-gets-novembers-dismal-new-normal-jobs-report/) And worse, if you look at how the recovery compares to others … its not going very well at all.

A few prefaces … First, I disagree with the premise throughout this article that our governor is timid. He is, IMO, and in many people’s opinion, doing a great job. Governor Romney is very similar to Governor Snyder in many ways. Timidity really isn’t apparent. I guess that people see someone making a cost-benefit analysis for engaging in a particular debate, or pushing for a particular outcome, and deciding to forgo a particular fight, as being timid.

This is epic. As originally seen on @mndoci ’s twitter stream. Short version: Those who don’t have a clue, really … REALLY … shouldn’t write lengthy journal articles about what they don’t have a clue about. Lest they get smacked down. Like this. For some reason, its an article of faith for many people, who largely do not understand why, that the big drug companies are EEEEVVIIIILLL (hope I used enough I’s there).

[warning: longer post] I mentioned this on twitter (@sijoe). The day job has been in business for 10 years. We’ve not taken outside investment to date, and we’ve not sold the company yet. We’ve been profitable and growing continuously during our lifetime. The preceding 3 years have seen growth, accelerating hard. The company was built starting with a conviction that practitioners and users of HPC systems needed better designs, better systems than were being pushed out by traditional vendors in the early 2000’s.

[update] below the fold and video. I can only conclude at this point that the “don’t get it” disease runs deep and wide in this administration. [update 2] This at the WSJ encapsulates what we are observing. This has gone beyond painful to watch to embarrassing. The president now claims that his statements were sliced and diced. He now is saying that he believes that businesses built themselves, while claiming that his earlier statement was taken out of context.

And do it again, … sooooo …. a public works project (bridge, dam, …) is equivalent in his eyes to …. a risk an entrepreneur takes? Seriously? Erp …. its glaringly obvious whom does not have an understanding. The worker in the private sector, punches the clock BECAUSE somewhere, somewhen, the entrepreneur had the idea, took the risk, entirely upon themselves, and built something. The “public sector” is a cost, something to be kept as small as possible so as not to drive those paying the public sectors bills, into the poor house.

Wonderful post by Jim Pethokoukis, covering a talk made by Ronald Reagan years ago. and I will freely admit that I was (almost) completely wrong in my original impressions of Reagan. I had a different political outlook in those days, and I had trouble viewing the guy as getting it. But get it, he did. This change in perception comes mostly from a maturing and a rethinking of my own world view.