Under the sea, Microsoft tests a datacenter that’s quick to deploy, could provide internet connectivity for years
John Roach 5 June, 2018
Microsoft is leveraging technology from submarines and working with pioneers in marine energy for the second phase of its moonshot to develop self-sufficient underwater datacenters that can deliver lightning-quick cloud services to coastal cities. An experimental, shipping-container-size prototype is processing workloads on the seafloor near Scotland’s Orkney Islands, Microsoft announced today.
The deployment of the Northern Isles datacenter at the European Marine Energy Centre marks a milestone in Microsoft’s Project Natick, a years-long research effort to investigate manufacturing and operating environmentally sustainable, prepackaged datacenter units that can be ordered to size, rapidly deployed and left to operate lights out on the seafloor for years.
“That is kind of a crazy set of demands to make,” said Peter Lee, corporate vice president of Microsoft AI and Research, who leads the New Experiences and Technologies, or NExT, group. “Natick is trying to get there.”
Lee’s group pursues what Microsoft CEO Satya Nadella has called “relevant moonshots” with the potential to transform the core of Microsoft’s business and the computer technology industry. Project Natick is an out-of-the-box idea to accommodate exponential growth in demand for cloud computing infrastructure near population centers.
More than half of the world’s population lives within about 120 miles of the coast. By putting datacenters in bodies of water near coastal cities, data would have a short distance to travel to reach coastal communities, leading to fast and smooth web surfing, video streaming and game playing as well as authentic experiences for AI-driven technologies.
“For true delivery of AI, we are really cloud dependent today,” said Lee. “If we can be within one internet hop of everyone, then it not only benefits our products, but also the products our customers serve.”
Spencer Fowers, senior member of technical staff for Microsoft’s special projects research group, prepares Project Natick’s Northern Isles datacenter for deployment off the coast of the Orkney Islands in Scotland. The datacenter is secured to a ballast-filled triangular base that rests on the seafloor. Photo by Scott Eklund/Red Box Pictures.
From France to Scotland
Project Natick’s 40-foot long Northern Isles datacenter is loaded with 12 racks containing a total of 864 servers and associated cooling system infrastructure. The datacenter was assembled and tested in France and shipped on a flatbed truck to Scotland where it was attached to a ballast-filled triangular base for deployment on the seabed.
On deployment day, the winds were calm and seas flat under a thick coat of fog. “For us, it was perfect weather,” said Ben Cutler, a project manager in the special projects group within Microsoft’s research organization who leads the Project Natick team.
The datacenter was towed out to sea partially submerged and cradled by winches and cranes between the pontoons of an industrial catamaran-like gantry barge. At the deployment site, a remotely operated vehicle retrieved a cable containing the fiber optic and power wiring from the seafloor and brought it to the surface where it was checked and attached to the datacenter, and the datacenter powered on.
Cutler said there were sighs of relief as these risks were eliminated. As if on cue, the last wisps of fog lifted.
The most complex task of the day was the foot-by-foot lowering of the datacenter and cable 117 feet to the rock slab seafloor. The marine crew used 10 winches, a crane, a gantry barge and a remotely operated vehicle that accompanied the datacenter on its journey.
“The most joyful moment of the day was when the datacenter finally slipped beneath the surface on its slow, carefully scripted journey,” said Cutler. Once the datacenter made it to the seafloor, the shackles were released, winch cables hauled to the surface and operational control of the Northern Isles passed to the shore station.
Everything learned from the deployment – and operations over the next year and eventual recovery – will allow the researchers to measure their expectations against the reality of operating underwater datacenters in the real world.
Microsoft’s Project Natick team gathers on a barge tied up to a dock in Scotland’s Orkney Islands in preparation to deploy the Northern Isles datacenter on the seafloor. Pictured from left to right are Mike Shepperd, senior R&D engineer, Sam Ogden, senior software engineer, Spencer Fowers, senior member of technical staff, Eric Peterson, researcher, and Ben Cutler, project manager. Photo by Scott Eklund/Red Box Pictures.
Powered by renewable energy
The Northern Isles is a chapter in the continuing story of Project Natick, one that tells a tale about researching whether it’s possible to use the existing logistics supply chain to ship and rapidly deploy modular datacenters anywhere in the world, even in the roughest patches of sea.
“We know if we can put something in here and it survives, we are good for just about any place we want to go,” said Cutler.
The European Marine Energy Centre is a test site for experimental tidal turbines and wave energy converters that generate electricity from the movement of seawater. Tidal currents there travel up to nine miles per hour at peak intensity and the sea surface regularly roils with 10-foot waves that whip up to more than 60 feet in stormy conditions.
Onshore, wind turbines sprout from farmers’ rolling fields and solar panels adorn roofs of centuries-old homes, generating more than enough electricity to supply the islands’ 10,000 residents with 100 percent renewable energy. A cable from the Orkney Island grid sends electricity to the datacenter, which requires just under a quarter of a megawatt of power when operating at full capacity.
Windmills are part of the landscape in the Orkney Islands, where renewable energy technologies generate 100 percent of the electricity supplied to the islands’ 10,000 residents. A cable from the Orkney Island grid also supplies electricity to Microsoft’s Northern Isles datacenter deployed off the coast, where experimental tidal turbines and wave energy converters generate electricity from the movement of seawater. Photo by Scott Eklund/Red Box Pictures.
Colocation with marine renewable energy is a step toward realizing Microsoft’s vision of datacenters with their own sustainable power supply, explained Christian Belady, general manager of cloud infrastructure strategy and architecture in Microsoft’s cloud and enterprise division.
Energy self-sufficient datacenters, he noted, could be deployed anywhere within reach of a data pipe, bringing Azure cloud services, for example, to regions of the world with unreliable electricity, and eliminate the need for costly backup generators in case of power grid failures.
“Our vision is to be able to deploy compute rapidly anywhere on the planet as needed by our customers,” said Belady, who has long advocated research that explores the marriage of datacenters and energy generation to simplify and accelerate the build out of cloud computing infrastructure.
Backbone of the internet
Datacenters are the backbone of the internet, the physical clouds of cloud computing where customers leverage economies of scale to securely store and process data, train machine learning models and run AI algorithms.
Demand for datacenter resources across the computing industry is growing exponentially as corporations increasingly shift their networks and computing needs to the cloud, and internet-connected intelligent devices ranging from smartphones to robots proliferate.
“When you are in this kind of exponential growth curve, it tells you that most of the datacenters that we’ll ever build we haven’t built yet,” said Cutler, underscoring the need for innovation in the race to build out what is fast becoming a critical piece of 21stcentury infrastructure.
The underwater datacenter concept was originally presented in a white paper prepared for a Microsoft event called ThinkWeek that encourages employees to share out-of-the-box ideas. Lee’s group was intrigued. Just 12 months after launching Project Natick in July 2014, the team had deployed a lab-built proof-of-concept prototype in calm, shallow waters off California.
The proof-of-concept vessel operated for 105 days. Encouraged by the results and potential industry impact, the Project Natick team pushed ahead to design, manufacture and test the full-scale module deployed in Scotland. Cutler said the latest version is designed to remain in operation without maintenance for up to five years.
Project Natick’s Northern Isles datacenter is partially submerged and cradled by winches and cranes between the pontoons of an industrial catamaran-like gantry barge. At the deployment site, a cable containing fiber optic and power wiring was attached to the Microsoft datacenter, and then the datacenter and cable lowered foot-by-foot 117 feet to the seafloor. Photo by Scott Eklund/Red Box Pictures.
Datacenter and submarine synergy
Phase 1 of Project Natick showed the underwater datacenter concept is feasible; Phase 2 is focused on researching whether the concept is logistically, environmentally and economically practical.
At the outset of Phase 2, the Microsoft team knew that scalable manufacture of submarine-like datacenters would require outside expertise. That’s why Microsoft chose to work with Naval Group, a 400-year old France-based company with global expertise in engineering, manufacturing and maintaining military-grade ships and submarines as well as marine energy technologies.
The Microsoft team presented Naval Group with general specifications for the underwater datacenter and let the company take the lead on the design and manufacture of the vessel deployed in Scotland.
“At the first look, we thought there is a big gap between datacenters and submarines, but in fact they have a lot of synergies,” said Eric Papin, senior vice president, chief technical officer and director of innovation for Naval Group.
Submarines, he noted, are essentially big pressure vessels that house complex data management and processing infrastructure for ship management and other systems integrated according to stringent requirements on electricity, volume, weight, thermal balance and cooling.
Engineers slide racks of Microsoft servers and associated cooling system infrastructure into Project Natick’s Northern Isles datacenter at a Naval Group facility in Brest, France. The datacenter has about the same dimensions as a 40-foot long ISO shipping container seen on ships, trains and trucks. Photo by Frank
Betermin.
Submarine technology
In fact, Naval Group adapted a heat-exchange process commonly used for cooling submarines to the underwater datacenter. The system pipes seawater directly through the radiators on the back of each of the 12 server racks and back out into the ocean. Findings from phase 1 of Project Natick indicate water from the datacenter rapidly mixes and dissipates in the surrounding currents.
Spencer Fowers, a senior member of technical staff for Microsoft’s special projects research group, said one key design specification was for the vessel itself to have roughly the dimensions of a standard cargo container used to move supplies on ships, trains and trucks to optimize the existing logistics supply chain.
Once the datacenter was bolted shut and all systems checked out in France, the team loaded the datacenter onto the back of an 18-wheel truck and drove it to the Orkney Islands, ferry crossings included. In Scotland, the vessel was secured to the ballast-filled triangular base and towed out to sea for deployment from the gantry barge
“Like any new car, we will kick the tires and run the engine in different speeds to make sure everything works well,” Fowers said. “Then, once we are completely ready to go, we will grab one or two of our clients and hand them over the keys and let them start deploying jobs onto our system.”
Spencer Fowers, senior member of technical staff for Microsoft’s special projects research group, prepares Project Natick’s Northern Isles datacenter for deployment off the coast of the Orkney Islands in Scotland. The datacenter is secured to a ballast-filled triangular base that rests on the seafloor. Photo by Scott Eklund/Red Box Pictures
Applied research
The Project Natick team will spend the next 12 months monitoring and recording the performance of the datacenter, keeping tabs on everything from power consumption and internal humidity levels to sound and temperature levels.
The world’s oceans at depth are consistently cold, offering ready and free access to cooling, which is one of the biggest costs for land-based datacenters. Underwater datacenters could also serve as anchor tenants for marine renewable energy such as offshore wind farms or banks of tidal turbines, allowing the two industries to evolve in lockstep.
For now, Project Natick is an applied research project, focused on determining the economic viability of operating containerized datacenters offshore near major population centers to provide cloud computing for a world increasingly dependent on internet connectivity.
“When you go for a moonshot, you might not ever get to the moon,” Lee said. “It is great if you do, but, regardless, you learn a lot and there are unexpected spinoffs along the way. You get Velcro at some point. That is happening in this case. We are learning about disk failures, about rack design, about the mechanical engineering of cooling systems and those things will feedback into our normal datacenters.”
Top Image: Project Natick’s Northern Isles datacenter reaches full submersion as it is lowered foot-by-foot 117 feet to the rock slab seafloor off the coast of the Orkney Islands in Scotland. Microsoft’s Project Natick is a years-long research effort to investigate manufacturing and operating environmentally sustainable, prepackaged datacenter units that can be ordered to size, rapidly deployed and left to operate lights out on the seafloor for years.
Photo courtesy of Microsoft
TO READ THE FULL ARTICLE: https://smitanairjain.blog/
ABOUT THE AUTHOR
John Roach
John Roach is a Seattle-based journalist, writer, and storyteller with two decades of experience in content creation. Over the years, he has taught and informed millions of readers about people, science, and technologies that change lives and solve global challenges in health, climate, food, water, and energy.
He is detail oriented, a stickler for accuracy, and relishes narratives that provide big picture context. Across disciplines and clients, the core feature of his work is language that bridges the communications gap between complex research and the executives, policymakers, and generally curious who want to understand it.
John’s bylined work has populated the digital news feeds of Yale Environment 360, NBC Universal, Microsoft, and National Geographic; been syndicated in newspapers around the world via the New York Times News Service/Syndicate and Knight Ridder/Tribune News Service; and filled pages in trade journals, newsletters, and magazines including BigLife, Powder, and HHMI Bulletin, among others.
In addition, clients in the financial, beverage, travel, media, and electric power industries have hired him to research, write, and edit project proposals, marketing materials, newsletters, and special reports. Going forward, John is available to help companies and organizations develop and implement content strategy as well as report on social responsibility and sustainability initiatives. Please get in touch.
Disclosure: Smita Nair Jain has nothing to disclose. She doesn’t own stock in any publicly traded companies and does not hold investments in the technology companies. She has equivalent of the American 401(k) plan in India that is automatically managed. (Updated: June 07, 2018)
Disclaimer: The opinions, beliefs and viewpoints expressed by the various author(s), publisher(s) and forum participant(s) on this web site do not necessarily reflect the opinions, beliefs and viewpoints of the @SmitaNairJain or official policies of the #SmitaNairJain
Hashtags: #amreading #copypaste #diversity #equality #feminism #genderequality #heforshe #leadership #sharingwisdom #smitanairjain #tedxspeakers #tedxtalks #womenboss #womencreate #womendigital #womenempowerment #womeninbiz #womeninbusiness #womenindatascience #womeninengineering #womeninfinance #womeninleadership #womeninpower #womeninstem #womenintech #womenintheword #womenonboard #womenpower #womenstyle #womenwhocode
Categories & Tags: #smitanairjain, @smitanairjain, smita nair jain, smitanairjain, smitha nair jain</smitha nair jain
Take A Minute To Follow Me On Social Media
Facebook: @SmitaNairJainPage Twitter: @SmitaNairJain Instagram: @smita.nair.jain LinkedIn: @smitanairjain Google+: @smitanairjain
