I’ll be talking about DevOps at Netflix next week at JavaOne. In the meantime, I wanted to highlight some amazing talks that are already out there that go deep in some areas that I won’t.
In particular, check out these talks from AWS:Reinvent.
I hope to see some of you next Tuesday (11 am) or Wednesday (10 am) in San Francisco.
In CodeMash-speak, we call the tutorials “precompilers”. If you’re planning to join the Netflix precompilers on Wednesday, here are the prerequisites (downloads, mostly) so that you’ll be ready to get started immediately. We only have 4 hours and lots to do!
Architecting for the Cloud: Hands on With NetflixOSS
Sudhir Tonse
Wednesday, January 8, 8:30-12:30
Browser (preferably Chrome or Safari as Netflix Asgard will not work with Firefox)
JDK 1.6 or later (Oracle SDK peferred)
gradle (See http://www.gradle.org/installation)
(*) git (see http://git-scm.com/book/en/Getting-Started-Installing-Git)
(*) Your favorite IDE. Instructions will be in Eclipse (Juno or later)
Gradle plugin recommended
(*) Apache Tomcat 7.X
The items marked in (*) are optional.
Git is used to clone the existing NetflixOSS repositories. If you dont have git installed, please download https://github.com/Netflix/karyon/archive/master.zip
IDE: Although useful you may also follow along with vi/emacs/<your favorite text editor> as well. We will use gradle to build and run the apps
Setting up your Environment for the AWS Cloud using Netflix OSS
Joe Sondow and Peter Sankauskas
Wednesday, January 8, 1:30-5:30
Your own AWS account (you can convert a shopping account), with Billing and Payments enabled.
Access to AWS console
git installed
Your favorite text editor.
We’ll walk you through the rest!
Looking forward to seeing you on Wednesday!
If you’re interested in the cloud and how you might leverage Netflix OSS to migrate your company without starting from scratch, you won’t want to miss the Netflix sessions at CodeMash (January 7-10 in Sandusky, OH). We’ll talk about technology, culture, open source, and how they all fit together to make a great product and an amazing work environment.
Yes, I joined Netflix this year, and I’m thrilled that Sudhir Tonse, Roy Rapoport, Jeremy Edberg, and Joe Sondow will be experiencing their first CodeMash. And it’s gonna be a doozy — starting with snow-delayed travel. And, I’m also ecstatic that veteran CodeMash speaker and entrepreneur Andy Glover has joined Netflix (about a month ago!), and will be speaking as well.
Sudhir and Joe are doing a One/Two punch on precompilers. Sudhir will whet your appetite for NetflixOSS in a morning session on Wednesday. Through a test account, you will be able to quickly experience several NetflixOSS projects in “Architecting for the Cloud: Hands on with NetflixOSS”. If you’re sold on the concept, you can join Joe Sondow for an afternoon session, “Setting up your Environment for the AWS Cloud using Netflix OSS”, which will focus on bootstrapping NetflixOSS. We’ll use Peter Sankauskas’ Netflix CloudPrize winning contribution for usability: bootstrapping NetflixOSS with Ansible Playbooks and Cloud Formation templates. And, Peter will join us as a special guest!
We’ll help kick off the conference by joining a panel on “Open Source in Business” on Wednesday night at 7 pm.
You’ll also meet Jeremy Edberg, who will talk about architecting resiliency through failure in “How Netflix Architects for Survival” and how we created a system that allows us to reduce the bureaucracy around system changes while improving how we resolve problems in “Following the Changing Weather of the Clouds”.
Roy Rapoport leads our Insight Engineering team, a team that collects a lot of data and collates it into information then translates that into insights. He will talk about how Python showed up at Netflix and how our focus on Freedom and Responsibility made that possible. His talk is entitled, “Python in the Back Door: How We Brought Python into Netflix”.
And I’ll be sharing Roy’s theme about how programming languages evolve at Netflix, doing a variation of the talk I did at OSCON, “Sneaking Scala Through the Back Door”. Coincidentally, Roy’s team is almost exclusively Scala!
And — we’ll have a vendor session on Thursday, where we will talk about NetflixOSS in an open discussion format. Ask questions about getting started, why we do it, how the culture works. We’ll be there.
Here’s a PDF of the scheduled Netflix talks.
Looking forward to seeing you. Safe travels to Ohio!
My team is still looking for some great developers who feel passionate about working with other teams, improving resiliency in the cloud, and building out a continuous delivery platform. You may have heard of the Chaos Monkey — we have many more ideas where that one came from!
If you have a solid Java background, we definitely want to talk to you. Lots of JVM language excitement on the team: Groovy, Scala and yes, some Java too. Our jobs site is at jobs.netflix.com.
This is an amazing time to be at Netflix. I hope you’ll consider reaching out and talking to me about our team. I’ll be at SpringOne2GX in a few weeks (9/9-9/12), in Santa Clara. We’re also hosting a Scala meetup at Netflix on 9/9.
You can find me on twitter at @dmarsh or on Linked In. Hope to talk to you soon!
Netflix has decided to open source many projects, contributing to the mindshare for cloud development. Follow the Netflix Tech Blog for the latest news, but I’ll also highlight things that I think might be interested as I have time.
The Simian Army is Netflix’s solution to keeping your cloud working well. From the Chaos Monkey (which improves your overall, long-term resiliency by shutting down your instances) to the Janitor Monkey (which detects and cleans up instances you no longer need), the Simian Army is worth investigating if you use the Amazon cloud. It’s available as open source, so you can use it and even choose to contribute.
Today, another team at Netflix open sourced Garbage Collection Visualization (gcviz). Being able to look at garbage collection as events is essential to understanding its impact on outages.
Oh, and if you REALLY like the Simian Army, maybe you will come join my team. We’re hiring for work on the Simian Army and Edda.
Interested in what Netflix is doing with Gradle for Build Tools? Check out this slideshare by Justin Ryan, Senior Software Engineer in Engineering Tools, from the San Francisco Gradle Meetup this week.
http://www.slideshare.net/quidryan/sf-gradle-may
FYI: The Gradle Summit is in Santa Clara, CA, June 13-14, 2013, and early bird pricing ends May 20.
Sometimes, I just want to know what the underlying technology is … when things touch me in my everyday life. Today, I’m thinking about NetFlix. Do they REALLY have huge warehouses all over the country with copies of obscure titles to send to people the same day? Really? Or do they have some agreement with the movie/DVD industry to burn CDs on the fly? Sheesh, only the latter seems reasonable to me.
I mean, come on. I put “The Thin Man” on my queue and it was shipped to me when my previous movie was returned. Now, I don’t really REMEMBER if I only had it there for a day … or a few hours … or whether it had been sitting in my queue for several days. If it had been sitting in my queue for a while, then I can understand … they could look ahead at queues and ship movies to “closer” locations to get them to us faster. But … but … but … it would make SO much more sense to have an agreement to burn the DVDs as needed and toss the movie when it’s returned (if no one else is demanding it).
Hmm, so I went on an internet search to see if there was anything describing how NetFlix is doing what they’re doing. I couldn’t find anything. I would GREATLY appreciate a heads-up if someone sees something somewhere … or if a NetFlix insider wants to blab. Newsweek had an article on NetFlix a week or so ago, and the article really did seem to imply that they warehoused the DVDs.
Why do I care so much? No idea. I’m just curious, and I hate it when I can’t get the answer to a question!