opensource.google.com

Menu
Showing posts with label Linux. Show all posts
Showing posts with label Linux. Show all posts

Bounds Checking Flexible Array Members

Tuesday, July 9, 2024

Buffer overflows are the cause of many security issues, and are a persistent thorn in programmers' sides. C is particularly susceptible to them. The advent of sanitizers mitigates some security issues by automatically inserting bounds checking, but they're not able to do so in all situations—in particular for flexible array members, because their size is known only at runtime.

The size of a flexible array member is typically opaque to the compiler. The alloc_size attribute on malloc() may be used for bounds checking flexible array members within the same function as the allocation. But the attribute's information isn't carried with the allocated object, making it impossible to perform bounds checking elsewhere.

To mitigate this drawback, Clang and GCC are introducing1 the counted_by attribute for flexible array members.


Specifying a flexible array member's element count

The number of elements allocated for a flexible array member is frequently stored in another field within the same structure. When applied to the flexible array member, the counted_by attribute is used by the sanitizer—enabled by -fsanitize=array-bounds—by explicitly referencing the field that stores the number of elements. The attribute creates an implicit relationship between the flexible array member and the count field enabling the array bounds sanitizer to verify flexible array operations.

There are some rules to follow when using this feature. For this structure:

struct foo {
	/* ... */
	size_t count; /* Number of elements in array */
	int array[] __attribute__((counted_by(count)));
};
  • The count field must be within the same non-anonymous, enclosing struct as the flexible array member.
  • The count field must be set before any array access.
  • The array field must have at least count number of elements available at all times.
  • The count field may change, but must never be larger than the number of elements originally allocated.

An example allocation of the above structure:

struct foo *foo_alloc(size_t count) {
  struct foo *ptr = NULL;
  size_t size = MAX(sizeof(struct foo),
                    offsetof(struct foo, array[0]) +
                        count * sizeof(p->array[0]));

  ptr = calloc(1, size);
  ptr->count = count;
  return ptr;
}

Uses for fortification

Fortification (enabled by the _FORTIFY_SOURCE macro) is an ongoing project to make the Linux kernel more secure. Its main focus is preventing buffer overflows on memory and string operations.

Fortification uses the __builtin_object_size() and __builtin_dynamic_object_size() builtins to try to determine if input passed into a function is valid (i.e. "safe"). A call to __builtin_dynamic_object_size() generally isn't able to take the size of a flexible array member into account. But with the counted_by attribute, we're able to calculate the size and improve safety.


Uses in the Linux kernel

The counted_by attribute is already in use in the Linux kernel, and will be instrumental in catching issues like integer overflows, which led to a heap buffer overflow. We want to expand its use to more flexible array members, and enforce its use in the future.


Conclusion

The counted_by attribute helps address a long-standing fortification road block where the memory bounds of a flexible array member couldn't be determined by the compiler, thus making Linux, and other hardened applications, less exploitable.

1In Clang v18.0.0 and GCC v15.0.0.

By Bill Wendling, Staff Software Engineer

Why Diversity is Important in Open Source: Google's Sponsorship of OSSEU

Monday, October 28, 2019

The Open Source Summit + Embedded Linux Conference is taking place in Lyon, France, which the Google Open Source Programs Office is sponsoring. The Linux Foundation supports shared technology through open source, while the conference provides a space for developers and technologists in open source to meet, network, and share knowledge with one another in order to advance the community. Why is this of utmost importance to Google OSS? Google has been rooted in the open source community for many years, supporting programs, projects, and organizations to help advance open source software and technology—we understand the necessity of sustaining open source and the developer community in order to advance technology as a whole.

Sponsoring OSSEU is more than just providing funds, but really pushing the diversity initiative in open source. We need diversity across all levels in open source whether it’s contributors, maintainers, doc writers, or anyone supporting the project. As said recently by the Open Source Initiative, “Many perspectives makes better software.” Having previously funded diversity initiatives such as scholarships or lunches at OSS conferences, Google continues to support this cause by sponsoring the diversity lunch at OSSEU.
In particular, sessions and events that Google will be hosting while at OSSEU include a keynote on Documentation by Megan Byrd-Sanicki and the Women in Open Source Lunch, both on Tuesday, October 29, 2019. The keynote on Docs highlights the importance of doc stars and why their contributions are essential to the growth of the open source community. Our support of the women in open source lunch is especially important as we look to increase the diversity of the open source community, through supporting women and non-binary persons to get more involved and have the opportunity to connect with each other at an event of this scale.

If you’re attending OSSEU, stop by the keynote, and we hope to see you at the lunch as well. If you aren’t attending this year, and are interested in getting more involved in the open source community, the summits hosted by the Linux Foundation are one of the best ways to learn more about OSS and meet passionate people involved in different OSS projects and organizations.

By Radha Jhatakia, Google OSPO

Google fosters the open source hardware community

Thursday, May 16, 2019

Open source silicon promises new challenges and opportunities for both industry and the open source community. To take full advantage of open silicon we will need new design methodologies, new governance models, and increased collaborations between industry, academia, and not for profits. A vibrant free and open source software community has been vital to both Google and our customer’s success. We look forward to supporting the new domain of open source silicon to similarly benefit all participants.

Working through its Open Source Programs Office (OSPO), Google is actively engaged in helping seed the open silicon space. Specifically by providing funding, strategic, and legal support to key open hardware efforts including lowRISC and CHIPS alliance.

lowRISC

lowRISC is a leader in open silicon community outreach, technical documentation, and advancing the goal of a truly open source system on a chip. We have long supported lowRISC’s mission of transparently implemented silicon and robust engagement of the open source silicon community, providing funding, advice, and recognizing their open source community leadership by selecting them as a Google Summer of Code mentoring organization.

Similar to the benefits of open source software, we believe our users will derive great outcomes from open source silicon. Besides enabling and encouraging innovation, chip designs derived from a common, open baseline will provide the benefit of implementation choice while still guaranteeing software compatibility and a set of common interfaces. With regards to security, the transparency of an open source approach is critical to both bugfinding and establishing implementation trustworthiness.

"Google has encouraged and supported lowRISC since the very start. They clearly share our optimism for what open source hardware can offer and our community-driven vision of the future. We are excited by the expanding open source RISC-V ecosystem and look forward to lowRISC community IP being deployed in the real world,” said Alex Bradbury, Co-founder and Director. “We believe lowRISC can act as an important catalyst for open source silicon, providing a shared engineering resource to ensure quality, provide support and help to maintain IP from a range of partners.”
lowRISC board members (L to R): Dominic Rizzo (Google), Alex Bradbury (lowRISC), Gavin Ferris (lowRISC), Dr Robert Mullins (University of Cambridge), Prof. Luca Benini (ETH Zürich), and Ron Minnich (Google, not pictured).
A first example of Google’s ongoing collaboration with ETH Zürich and lowRISC is the recently released “Ibex” RISC-V core. ETH Zürich donated their Zero-riscy core as a starting point and technical work to extend the core was done across all three organizations. You can learn more about Google’s collaboration with lowRISC on the RISC-V core here.

Furthermore, Google is excited to announce that it is joining the board of lowRISC, with the appointment of Dominic Rizzo and Ronald Minnich as corporate directors.

CHIPS Alliance 

Along with our increased funding, support and collaboration with lowRISC, we are also happy to announce our status as a founding member of the Linux Foundation’s CHIPS Alliance project. CHIPS Alliance features an industry-driven, collaborative model to release high-quality silicon IP and supporting technical collateral. Most recently, in collaboration with CHIPS Alliance, we released a Universal Verification Methodology (UVM) instruction stream generator to aid in the verification of RISC-V cores. We believe such open sourcing of verification tools will prove critical to the long-term success of the open source silicon community.

Google has been an early, strong supporter of the open silicon community. We believe deeply in a future where transparent, trustworthy open source chip designs are commonplace. To get there, we are committed to establishing a collaborative, community-focused, open source basis for free and open silicon design.

By Parthasarathy Ranganathan, Distinguished Engineer, Google and Dominic Rizzo, Open Silicon Tech Lead, Google 

Google Summer of Code 2016 wrap-up: Linux XIA

Friday, November 18, 2016

We're sharing guest posts from students, mentors and organization administrators who participated in Google Summer of Code 2016. This is the fifth post in that series and there are more on the way.


Linux XIA is the native implementation of XIA, a meta network architecture that supports evolution of all of its components, which we call “principals,” and promotes interoperability between these principals. It is the second year that our organization, Boston University / XIA, has participated in Google Summer of Code (GSoC), and this year we received 31 proposals from 8 countries.

Our ideas list this year focused on upgrading key forwarding data structures to their best known versions. Our group chose the most deserving students for each of the following projects:

Accelerating the forwarding speed of the LPM principal with poptrie

Student André Ferreira Eleuterio and mentor Cody Doucette implemented the first version of the LPM principal in Linux XIA for GSoC 2015. The LPM principal enables Linux XIA to leverage routing tables derived from BGP, OSPF, IS-IS and any other IP routing protocol to forward XIA packets natively, that is, without encapsulation in IP. For GSoC 2016, student Vaibhav Raj Gupta from India partnered with mentor Cody Doucette to speed up the LPM principal by employing a state-of-the-art data structure to find the longest prefix matching using general purpose processors: poptrie.

Upgrading the FIB hash table of principals to the relativistic hash table

Principals that rely on routing flat names have used a resizable hash table that supports lockless readers since 2011. While this data structure was unique in 2011, in the same year, relativistic hash tables were published. The appeal to upgrade to relativistic hash tables was twofold: reduced memory footprint per hashed element, and the fact they were implemented in the Linux kernel in 2014. Student Sachin Paryani, also from India, worked with mentor Qiaobin Fu to replace our resizable hash table with the relativistic hash table.

Google Summer of Code nurtures a brighter future. Thanks to GSoC, our project has received important code contributions, and our community has been enlarged. It was rewarding to learn that two of our GSoC students have decided to pursue graduate school after their GSoC experience with us: Pranav Goswami (2015) and Sachin Paryani (2016). We hope these examples will motivate other students to do their best because the world is what we make of it.

By Michel Machado, Boston University / XIA organization administrator

Google Summer of Code wrap-up: Linux XIA

Friday, September 25, 2015

It’s Friday! Time for another Google Summer of Code wrap-up post. Boston University / XIA is one of the 37 new organizations to the program this year. Read below about three student projects and their work to discover the future architecture of the internet.
lx-motto.png
Linux XIA is the native implementation of eXpressive Internet Architecture (XIA), a meta network architecture that supports evolution of all of its components, which we call “principals,” and promotes interoperability between these principals. We are developing Linux XIA because we believe that the most effective way to find the future Internet architecture that will eventually replace TCP/IP is to crowdsource the search. This crowdsourced search is possible in Linux XIA.

Our organization, Boston University / XIA, received 34 proposals from 12 countries. As a first-year organization in Google Summer of Code (GSoC), we were surprised by the number of proposals, and we did our best to choose great students for each of the following projects:

XLXC is a set of scripts written in Ruby that creates network topologies using virtual interfaces and Linux containers. While testing a new network stack, a good amount of work goes into creating testing environments. XLXC saves developers and tinkerers a lot of time while experimenting with Linux XIA. Our student Aryaman Gupta from India worked with mentor Rahul Kumar to enable XLXC to emulate any topology using a language to describe the topologies.

Linux XIA needs to call forwarding functions that correspond to each XID type in order to forward a packet. XID types are 32-bit identifiers associated with principals which, in turn, define the forwarding functions. Being able to hash each XID type to a unique entry in an array increases the number of packets Linux XIA can forward per second because it reduces the number of memory accesses per lookup. Our student Pranav Goswami, also from India, worked with mentor Qiaobin Fu to find the best perfect hashing algorithm for Linux XIA to use in this case, and implemented it in Linux XIA.

We do not know how the future Internet will route packets between autonomous systems (ASes), but we are certain that Linux XIA can leverage IP's routing tables to have large deployments of Linux XIA. This is the goal of the LPM principal: leveraging routing tables derived from BGP, OSPF, IS-IS and any other IP routing protocol to forward XIA packets natively, that is, without encapsulation in IP. Thanks to the evolution mechanism built into Linux XIA, when a better way to route between ASes becomes available, we will be able to incrementally phase LPM out. Student André Ferreira Eleuterio from Brazil implemented the LPM principal in Linux XIA with the help of mentor Cody Doucette.

We are going to work with our students during the fall to have their contributions merged into our repositories and to add new projects to our ideas list that build upon their contributions. We expect that this will motivate new contributors by showing how much impact they can have on Linux XIA. Finally, new collaborators do not need to wait for the next GSoC to get involved! Join our community today, and "do what you can, with what you have, where you are" to make a difference like our three students successfully did.

By Michel Machado, Organization Administrator for Boston University / XIA

Open Source Release: LiquidFun 1.0

Tuesday, March 18, 2014

Last December we announced the initial release of LiquidFun, a C++ library that adds particle physics, including realistic fluid dynamics, to the open-source Box2D. Today, we’re excited to be releasing LiquidFun 1.0!

New features in this release include:
  • Multiple particle systems
  • New particle behaviors: barrier, static-pressure, and repulsive
  • Particle lifetimes
  • Detection of stuck particles
  • The ability to apply forces and impulses to particles
  • Java support via SWIG
  • A host of new demos: inside the existing Testbed application; and, a gorgeous new “EyeCandy” demo for Android
Download the latest release from our github page and join our discussion list!

Several Googlers made LiquidFun possible: Howard Berkey, Alice Ching, Wolff Dobson, Dave Friedman, Stewart Miles, Jason Sanmiya, Kentaro Suto, and Ali Tahiri.

By Dave Friedman, Fun Propulsion Labs*

*Fun Propulsion Labs is a team within Google that's dedicated to advancing gaming on Android and other platforms.

A new role in Open Invention Network

Wednesday, December 18, 2013

As readers of this blog will know, open-source software like Linux has spurred huge innovation in cloud computing, the mobile web, and the Internet in general. Linux now powers nearly all the world’s supercomputers, runs the International Space Station, and forms the core of Android. But as open source has proliferated, so have the threats against it, particularly using patents. That's why we're expanding our participation in Open Invention Network (OIN), becoming the organization’s first new full board member since 2007.

OIN protects the open-source community through a patent cross-license for Linux and related open-source technologies. The license is free and available to companies, organizations, and individual developers if they agree not to assert their own patents against Linux. OIN also defends against anti-open-source patent aggression through education, reform efforts, and its own defensive patent portfolio.

Over nearly three decades, what is now known as open-source software has benefited consumers all over the world by delivering innovative products and services. We’re committed to helping protect that innovation and are happy to expand our role in OIN.

Posted by Chris DiBona, Director of Open Source

LiquidFun: a rigid-body physics library with fluid simulation

Wednesday, December 11, 2013

We are excited to announce the open-source release of LiquidFun, a C++ 2D physics library based upon Box2D that includes particle-based fluid simulation.

LiquidFun makes it easier for developers to write games that include realistic fluid physics.  For example, this clip shows a circular body falling into a viscous fluid.
The LiquidFun library is written in platform independent C++ which makes it possible to use on any platform that has a C++ compiler.  We have provided a method to build the LiquidFun library, example applications, and unit tests for Android, Linux, OSX and Windows.

Game developers can use physics to drive new game mechanics and add realistic physics.  Designers can use this library to build beautiful fluid interactive experiences.  We’re excited about the possibilities, and want to hear from you about how we can make this even better!

Download the latest release from our github page and join our discussion list!

Several Googlers made LiquidFun possible: Alice Ching, Wolff Dobson, Dave Friedman, Vince Harron, Stewart Miles, Jason Sanmiya, Kentaro Suto, and Ali Tahiri.

By Stewart Miles, Google engineer

GSoC Meetup at LinuxCon Europe: There are many more than “10 Things” to like about Edinburgh

Wednesday, November 20, 2013

LinuxCon Europe drew a great crowd of 1000+ free and open source developers to majestic Edinburgh, Scotland during the last week of October. Attendees were there to meet and learn about a wide variety of open source technologies, including Yocto, Gluster, GStreamer, Xen, embedded Linux, Linux in cars, the Linux Kernel - are you sensing a theme?

This week of crunchy codey goodness started our Google Summer of Code “10 Things” campaign visits with a “Birds of a Feather” (BoF)  session on the evening of Monday, October 21. Roughly 50 GSoC mentors, past students and interested “yet-to-participate-in-GSoC” attendees came to enjoy brownies, beverages and lots of conversation.

Attendees of the BoF represented a wide range of open source projects, including but not limited to: LibreOffice, Debian, PulseAudio, Apache, Gentoo, Battle for Wesnoth, OpenMRS, Code For America, and Gnome.

My hearty thanks to all of you who came, especially for not making me present a slide deck; it was great how you all pitched in and talked, asking questions and sharing your experiences with the program.

By Cat Allman, Open Source Programs


LinuxDay 2011 Italy celebrates 20 years of Linux

Tuesday, November 8, 2011

Every October in Italy we hold an event dedicated to GNU/Linux and open source software development called LinuxDay 2011 Italy. The event is organized by the Italian Linux Society (ILS) and local Linux User Groups (LUG's). LUG’s hold conferences in many cities spreading the philosophy of "Freedom, as in free speech,” with the goal of popularizing the use and development of open source software.

This year the event was held on October 22nd, and was special because 20 years ago a man named Linus Torvalds made the very first announcement in a mailing list about a new "(free) operating system (just a hobby, won't be big and professional like gnu) for 386(486) AT clones" that was the Linux OS.

My LUG and I have been involved in the organization of LinuxDay in Matera, a beautiful city that is a UNESCO World Heritage site. This year I decided to talk about my experience as a Google Summer of Code student because it has been an awesome experience that has allowed me to both improve my programming skills and to increase my involvement in the open source community. The concept of community is very important for open source development and this is the message I tried to spread through my talk. Many students were present during my speech and asked me for more information about the Google Summer of Code program. I hope my talk will encourage more Italian students to participate in the program in the coming years.

I would like to thank Google for offering us this opportunity and my colleagues who helped organize this wonderful event. Time spent together is always worthy of some sacrifice, we are maybe the last dreamers in the world, believing that changing the world is possible starting from changing ourselves. "Dreaming together a world of Freedom, and working to build it".

By Margherita Di Leo, Google Summer of Code Student

Linux File Systems in the Cloud @ Linux Collaboration Summit 2011

Thursday, May 5, 2011

As tech lead of the Google Linux Storage Team I get to see how Linux runs on tens of thousands machines in Google's cloud. Over the last year our team migrated this super system from ext2 to ext4, an educational and exciting experience to say the least. We learned a lot about the impact of the Linux file system on Google.

Our team is often bombarded with questions from both within and outside of Google about why we chose ext4, and if the local file system even matters. The Linux Collaboration Summit with its audience of both kernel hackers and business folks interested in Linux deployments seemed like a good forum at which to present on this topic.

So with a lot of help from my team I put together a talk that covers a range of topics. The talk includes how cloud storage is different than both local and enterprise, our reasons behind choosing ext4 and the impact, and where the file systems need to improve to meet the demands of the cloud.



If you are interested in Linux, storage, clouds and some internal tales you might want to check it out.

By Michael Rubin, Google Engineering

Linux Foundation Collaboration Summit 2011

Tuesday, April 5, 2011

This week marks the fifth annual Linux Foundation Collaboration Summit, which will be held from April 6th to 8th in San Francisco, CA. Many Googlers will be attending, and several Googlers are presenting at the Summit as well.
Andrew Morton will be in a panel discussion on The Linux Kernel: What's Next at 11 AM on Wednesday April 6th.

Michael Rubin, Technical Lead for Google's Kernel Storage team will be presenting a keynote on File systems in the Cloud at 3:30 on Wednesday.

Ian Lance Taylor will be discussing the Go Programming Language at 2:15 on Thursday the 7th as part of the Tools track.

Later on Thursday, Jeremy Allison of the Open Source Programs Office will explain Why Samba Switched to GPLv3 at 4 PM.
Although the event is invitation only, live video streaming is available for free, so everyone can watch the keynotes and panel discussions. Tune in to the video stream, or if you’ll be attending, introduce yourself after any of the talks!

By Ellen Ko, Open Source Team

Geek Time with Jim Zemlin

Friday, February 25, 2011


Jim Zemlin is the Executive Director of the Linux Foundation, and earlier this month he sat down with the Open Source Programs Office’s Jeremy Allison for a chat about the future of Linux. In addition to talking about the future, Jim shares insights on the history and significance of Linux. Some highlights:
  • Jim explains the role of the Linux Foundation in Linux kernel development, including the work of Linus Torvalds. (0:18)
  • Jeremy and Jim talk about the organizations that support the Linux Foundation, and their reasons for doing so. (2:21)
  • Jeremy poses one of his favorite questions: “Is this the year of the Linux desktop?” Jim responds with less concern about desktop computers and focuses his interest on mobile devices, which are becoming predominately Linux. (9:33)
  • The discussion turns toward tablet devices and their impact on Linux. (13:25)
  • Linux’s GPLv2 license allows DRM, and Jeremy wonders if this contradicts the ideals of freedom that Linux was built upon. Jim compares the controversy to the “Consume vs. Contribute” issue that Linux faced years ago. In that case, the collaborative nature of open source software development made it advantageous for everyone to contribute, so most commercial users eventually ended up contributing. In regards to DRM, Jim believes that consumers dictate the future of DRM products. (15:23)
  • Jim recounts a conversation he had with a major electronics company about the importance and complexity of software on consumer electronic devices. Jim explains how these considerations direct manufacturers towards open source software. (20:32)
  • Jeremy asks Jim about the feasibility of creating an operating system from scratch, or if Linux is the only viable option. The value of Linux was recently estimated at $10.8 billion, so the barrier to entry is extremely high. In addition, there are several incentives for using the existing Linux ecosystem. (23:07)
  • Jim talks about how advances in one field of Linux has benefited other fields. For example, developers working on mobile devices helped reduce power consumption for those working on high-performance computing. (26:58)
  • Jim shares how his career path led him to his current role at the Linux Foundation. (31:05)
By Ellen Ko, Open Source Team

Geek Time with Peter Brown

Friday, December 17, 2010



When the Free Software Foundation’s executive director, Peter Brown, visited the Google offices last week, he graciously offered his time for an interview with Samba co-founder and Open Source Programs Office team member Jeremy Allison. Peter and Jeremy spoke for quite a while about several of the hot topics facing free software today. Some highlights of their conversation include:

• A brief history of the free software movement (0:14)
• The difference between open source and free software (4:12),
• The importance of specifying “GNU/Linux” when referring to the first fully free operating system (7:42),
Linux Libre, a fully free kernel distribution, including the drivers (12:29)
• The Free Software Foundation’s hardware endorsement program, Respects Your Freedom (13:54)
• Unexpected places that free software is appearing around the world (18:42)
• Peter’s career with the Free Software Foundation (20:50).
• Ways that non-programmers can get involved and support the free software movement (26:23)

Throughout the conversation, both Jeremy and Peter provide fascinating anecdotes about ways that free software is shaping society. The video is an effective introduction to software freedom for those who have just discovered the concept, but it's also a great way for everyone to learn more about free software.

UPDATE: The video is now also available in the open video format WebM.

By Ellen Ko, Open Source Team

Objects in mirror...

Wednesday, November 24, 2010

Nearly a year in the making, kernel.org has announced four new machines coming online in November of 2010. This is quite the change in infrastructure, covering two new "heavy lifting machines" and two new backend machines to round out kernel.org's infrastructure of 12 boxes running worldwide.

As many people know, particularly if you are reading this blog, kernel.org runs the infrastructure that the Linux Kernel community uses to develop and maintain a core piece of the operating system. That said, kernel.org provides a lot more services than just a couple of git repositories and a place to download kernel releases. It hosts the Android source, provides Internet bootable utilities and installers, one of the fastest and most comprehensive mirrors of Linux distros, a plethora of wikis, and the Linux Kernel bugzilla. It also hosts and maintains a variety of other websites that are central to the development of the Linux Kernel or to the greater Linux ecosystem.

The four new machines that have fully come online in November were donated by Google with a generous discount from HP, and they are some impressive pieces of hardware to say the least!

Mirrors1 and Mirrors2, the two machines in the United States that service mirrors.kernel.org, fully replace machines that had been in service for 5 years. The new machines live up to their names of the “heavy lifting machines” (both because they move the most data for kernel.org, but lifting 6-10u worth of equipment is actually quite heavy)! Specs for those are:

Mirrors1:
DL380 G7
2 x E5640 Intel Xeon Processors
144GB DDR3 ECC RAM
2 x MSA70 external drive chassis
2 x P812 Array controllers
66 x 300GB 10K RPM SAS drives

Mirrors2:
DL380 G6
2 x X5550 Intel Xeon Processors
144GB DDR3 ECC RAM
2 x MSA70 external drive chassis
2 x P812 Array controllers
66 x 300GB 10K RPM SAS drives

Each setup uses up 6u of space now, saving us about 4u per-setup over our old equipment, and they give us a lot more storage space and a lot more RAM to be able to handle mirroring for so many people.

We also upgraded the master backend machine for kernel.org, and took our still-awesome previous master backend and turned it into a live spare should anything ever happen to the primary machine. We added a second dynamic web infrastructure box as well, to help host the wikis and things like bugzilla, giving us an active fail over as well as a load balanced system.

With these two additional boxes coming online, kernel.org reached a milestone as we now have a redundant machine for everything currently in our inventory. We've been quite successful with the redundancy we have with our frontend facing machines, and now we have that same level of redundancy available to us on our backend machines.

master:
DL380 G6
2 x X5550 Intel Xeon Processors
32G DDR3 ECC RAM
1 x MSA60 external drive chassis
2 x P812 Array controllers
8 x 300G 10K RPM SAS drives
12 x 300G 15K RPM SAS drives

dynamic web box 2:
DL380 G6
2 x X5550 Intel Xeon Processors
32G DDR3 ECC RAM
1 x MSA60 external drive chassis
1 x P812 Array controller
8 x 300G 10K RPM SAS drives

Needless to say we can talk a lot about specs and numbers. But really, a photo is worth a thousand words:


Those are the new backend boxes hosted at OSUOSL.

Our thanks go out to Google and HP for helping make this happen, with special thanks going to
Chris DiBona of Google for making this happen, Shawn Pearce of Google for putting up with with me through all of this, and Bdale Garbee of HP for helping us get the equipment we need and being such a great friend of kernel.org for so many years!

To quote our saying on mirrors.kernel.org, “Objects in mirrors may be closer than they appear!”

By John “Warthog9” Hawley, Chief Kernel.org Administrator

Geek Time with Rusty Russell

Monday, October 18, 2010



Free software advocate and Linux developer Rusty Russell sat down for an interview with Google’s Jeremy Allison when they were both in Japan for LinuxCon. They discuss Rusty’s role maintaining the Linux kernel (0:15), why Australia has produced so many top notch open source developers (3:13), and suggestions for people starting out in their careers and looking to get into open source (9:13). Enjoy!

Thanks to Simon Horman for operating the camera.

By Ellen Ko, Open Source Team

Geek Time with James Bottomley

Monday, October 11, 2010



When people first meet Linux Kernel SCSI subsystem maintainer James Bottomley, one question that often comes up is, “Why the bow tie?” Jeremy Allison, Samba co-founder and Google Open Source Programs Office team member, spent time with James at LinuxCon last month and uncovered the answer. After that, Jeremy gets the backstory on the inspiration behind James’ LinuxCon talk about how to convince management to embrace open source (4:58). James also talked about how he became the SCSI subsystem maintainer (1:54) and how he started working on open source (6:47).

Thanks to Sergio Victorino for operating the camera.

By Ellen Ko, Open Source Team

Geek Time with Ric Wheeler

Monday, October 4, 2010



Ric Wheeler is the File System Group Manager at Red Hat, and Jeremy Allison caught up with him at LinuxCon in Sao Paulo, Brazil earlier this month. Ric tells Jeremy how he got into file system development as a grad student, then how he progressed into building storage arrays, eventually becoming a Linux advocate. From there, Jeremy and Ric talk about the direction that Linux is headed and the future of desktop computing. At the very end of the video, you can even hear about Ric’s brush with Hollywood!

Thanks to Sergio Victorino for operating the camera.

By Ellen Ko, Open Source Team

Geek Time with Linus Torvalds

Monday, September 27, 2010



Linus Torvalds and Jeremy Allision were both in Sao Paulo, Brazil a few weeks ago for LinuxCon, where they were both presenters. Later in the week when they were waiting to go on a safari at the Sao Paulo Zoo, Jeremy seized the opportunity to go on a trip down memory lane when he asked Linus about the Sinclair QL they each owned while growing up. Because it was so hard to get software for it in Finland, Linus wrote his own assembler and editor (in addition to Pac-Man graphics libraries). They continue to reminisce about more archaic hardware like floppy drives, microdrives, 512 K RAM expansion packs and the Acorn Archimedes.

It’s a geek fest for fans of British computers from the ‘80s! Who knew that the Sinclair QL would play a role in the development of the modern free operating system?

By Ellen Ko, Open Source Team

Ohio LinuxFest Wrap-up

Monday, September 20, 2010


I just got back from Ohio LinuxFest, a three-day all-volunteer conference on free and open source software held in Columbus, Ohio. A wonderful group of about 800 people, some from the Midwest, some of whom were from other parts of the country, some of whom were experienced with open source software, and some of whom were new to it, attended. I enjoyed seeing the wide variety of talk topics - from starting your own business in open source to an entire workshop devoted to diversity in open source software development. Some of the topics were even a little unexpected - there was a great talk on reaching out to new people through video games.

I spoke on the 7 Habits of Highly Ineffective Project Managers late in the day on Saturday. Much of the content for the talk was gleaned from experience at Google and managing the Google Summer of Code project. The audience had some great questions about how to effectively manage upward (to your boss), what sorts of tactics to take when you feel your managers are meddling too much in your project, and how to manage your workflow in an environment where too many tasks are high priority. I’ll be giving this talk again at linux.conf.au, which is being held in Brisbane January 24th to 29th next year.

.