Scaling on Justin Carmony

Talk: Scaling & Managing Asynchronous Workers (and staying sane!) - PHPNW15

Sun, 04 Oct 2015 20:00:18 +0000

I had the absolute privilege of flying out to Manchester, England to give this presentation. It was a total blast.

Video

https://www.youtube.com/watch?v=bTcyuzJkxIg

Slides

https://speakerdeck.com/justincarmony/scaling-and-managing-asynchronous-workers-and-staying-sane

Abstract

There comes a point in time with a website when eventually need to do something in the background. There are always cron jobs, but eventually those either don’t scale well, or are not responsive enough. Learn about how to help your website efficiently scale by using workers. We’ll touch briefly the fundamental theory behind workers and how to easily implement them. We’ll learn about several different technologies to help manage workers such as Beanstalkd, Supervisord, Redis, and others. We’ll show a live demo of PHP workers performing tasks and you’ll leave with sound understanding of how to implement workers in your own application.

Talk: Scaling & Managing Asynchronous Workers (and staying sane!) - Lone Star PHP 2014

Fri, 25 Apr 2014 20:00:48 +0000

Slides

https://speakerdeck.com/justincarmony/managing-and-scaling-asynchronous-workers-and-staying-sane

Talk: Blazing Data with Redis - True North PHP 2013

Sat, 09 Nov 2013 20:00:32 +0000

Slides

https://speakerdeck.com/justincarmony/blazing-data-with-redis-truenorthphp

Talk: Blazing Data with Redis - Utah Open Source Conference 2012

Tue, 01 May 2012 12:00:00 +0000

I gave this talk at the Utah Open Source Conference in May 2012, the same year I presented it at PHP Tek.

Blazing Data With Redis (and LEGOS!) from Justin Carmony

Working with Middle-Scale Websites

Tue, 19 Jul 2011 00:02:40 +0000

I’ve been thinking about this idea for awhile, and I thought I would put a name to the thought. I brought up this idea while I was giving my “Real Life Scaling” presentation at the Utah Open Source Conference in 2009. Here is the problem I think most individuals in the web development face:

Hopefully at some point, your website gets a lot of traffic. Yay, you’ve reached your goal of getting good traffic, but it is soon followed by issues with performance and load. I like to call these the growing pains of a website. So as a web developer, I suddenly have the epiphany of “Hey, I need to scale my website!” What follows next is the biggest mistake a web developer can make:

MySQL, Redis, and a Billion Rows - A Love Story

Mon, 23 May 2011 15:20:35 +0000

This last week we pushed live a very large architecture change for Dating DNA. For those who know me, and have heard me talk about the Dating DNA Scoring System, they know how big of a problem we faced. For those who don’t know, let me give some background:

The Problem

With Dating DNA, our goal was to display a compatibility score with every other user. This score is generated by taking two sets of answers to our 20 page survey, and running it through our algorithm. While it is super convenient for our users, this poses a problem. We wanted not only for people to be able to visit a profile and see a score, which is easy to generate a score on demand. We wanted our users to be able to browse other profiles sorted by their score with them. This requires us to pre-generate and store these scores, and then later query them.

How I Became a Web Developer & CTO

Wed, 23 Feb 2011 11:57:56 +0000

Note: many of the screenshots of websites I had done in the past are from the Internet Archive and many of the images are missing. But it can give an idea on the projects I had worked on. One day I’ll try and track down the original files and update the screenshots.

Today some memories came from when I first started with web development. So before I forget anymore of the details, I thought I would share my unique way I became a web developer. I never went to school to learn Computer Science or Information Systems. I’ve had a total of 2 programming classes, which were my in sophomore and junior years of High School, one of which we lovingly nicknamed Warcraft 101, because we would spend the entire time getting out butts kicked in Warcraft 2 by my classmate Daren (We all got A’s, we had just finished the entire coursework in 2 and a half weeks).

MySQL Sleeping Connections & PHP

Sat, 08 Jan 2011 20:51:48 +0000

If you want to skip to the explanation, just read below. But before then, here is a little background.

A Little Background

On January 2nd, we started to run into some serious performance problems with Dating DNA, so we began the process of going and deciding what were our problems, and how to optimize them. At the beginning, the Database was the bottleneck. It would get flooded with requests, and unable to handle them all, each query would slow down. We were using a tool called Jet Profiler (which I will post about more in detail later), but here is a graph it would output before we started out optimizations:

Creating Chatroom / Walls with Redis & PHP

Sat, 08 Jan 2011 00:15:16 +0000

Preface: This is not a step-by-step tutorial, but more of an outline on what I did. Also, I wrote this really quickly before heading off to dinner, so if there are parts that are unclear, or you have questions about, please leave a comment!

This last week has been a roller coaster for us at Dating DNA. We had an excellent holiday season, but with mass volume of new sign ups our servers started to slow down. Severely. Something you never want to have happen. So over this last week I’ve worked about 80 hours (though I’m a salary employee, woohoo… :P) and implemented a lot of new performance boots, and I have about four or five blog posts worth of discoveries I need to write. So before I forget them, I’m going to write them.

Large MySQL Conversion & InnoDB

Sat, 16 Oct 2010 03:01:32 +0000

Over the last week at Dating DNA, we’ve re-engineered our internal mail system that users use to send messages to each other. It took a few days longer to convert and re-engineer everything, but we finally made the change. With the exception of two small bugs, it all went off without a hitch. But before all the different things I learned doing it fade, I wanted to document them here.

First off, converting from one large set of InnoDB tables to a new structure. I’ve done something similar in the past, and I think I’ve honed in a little bit more the technique. So here are some thoughts regarding doing this process.

PHP HipHop – What It Means

Wed, 03 Feb 2010 16:32:04 +0000

There has been a lot of speculation about PHP, Facebook, and a big announcement. Over the last few weeks, several predominate PHP community members were invited to the Facebook offices to check something out. Facebook asked the PHP members, as Ben Ramsey put it, to “make a gentleman’s agreement that I wouldn’t talk until FB is ready.”

Well, Facebook has made their announcement, and it is called HipHop. Here is an excerpt:

My 2009 Technology Recap

Wed, 23 Dec 2009 18:55:31 +0000

Its been two years now that I’ve been a more or less “serious blogger.” I had using the term blogger, since when people hear about blogs, they think of people either detailing their entire lives, or pumping some angel. For me, blogging has just been a way to share information with people I know locally, and those I don’t even know who find my blog via searching. I’ve had a few spurts where I blogged quite frequently, but for the most part it was just here and there.

Presentation: Real Life Scaling

Sun, 11 Oct 2009 18:39:44 +0000

Here are my slides for the presentation that I gave at the Utah Open Source Conference on Friday. It was an awesome conference, and I am glad that I was able to be involved.

Real Life Scaling: A Tale of Two Websites http://static.slidesharecdn.com/swf/ssplayer2.swf?doc=reallifescaling-ataleoftwowebsites-small-091010143045-phpapp02&stripped_title=real-life-scaling-a-tale-of-two-websites

View more presentations from Justin Carmony.

If you have any questions or comments, please feel free to leave them below.

Talk: Real Life Scaling - A Tale of Two Websites - Utah Open Source Conference 2009

Fri, 09 Oct 2009 21:01:04 +0000

This was my first talk at any conference. Utah Open Source Conference, now known as OpenWest, was and still is a great place to get your start as a technology speaker.

Slides

https://www.slideshare.net/JustinCarmony/real-life-scaling-a-tale-of-two-websites

Speaking: Utah Open Source Conference 2009

Wed, 16 Sep 2009 18:00:13 +0000

I will be speaking this year at the Utah Open Source Conference this year. My presentation is “Real Life Scaling: A Tale of Two Websites.” Here is the abstract:

Scaling is a real issue for many websites. However, many developers try to implement solutions used by the giants of the internet: Google, Facebook, Twitter, WordPress, etc. However, many of these techniques are designed for very unique and high demand situations. Implementing these techniques prematurely to smaller websites can lead to overly-complex solutions that can be difficult to manage, and even hinder progress.