Tips and Tricks on Justin Carmony

Debugging Nginx Configuration Trick

Sat, 14 Jan 2012 02:24:49 +0000

Today I had an issue where I was trying to debug a problem with an nginx configuration, I came up with a simple trick. One of the hardest parts of nginx configurations, especially with rewrites, is you might not know which “location” directive is not working as expected.

In PHP, sometimes you would just add something like this:

echo "I'm here!";
exit();

However, in Nginx configuration files, it isn’t as easy…

… or is it?

PHP Workers with Redis & Solo

Tue, 10 Jan 2012 18:20:10 +0000

I’ve come across an awesome combination of tools for managing PHP Workers, and thought I’d share.

Why Workers?

Sometimes there are situations when you want to parallel process things. Other times you might have a list of tasks to accomplish, and you don’t want to make the user wait after pressing a button. This is where “Workers” can come in. They are independent scripts that run along side of your application, performing tasks, or “jobs.”

Siege with User Authentication

Thu, 03 Nov 2011 16:33:02 +0000

If you want to stress test your application, the quickest and best way to do so is with siege. From the siege website:

Siege is an http load testing and benchmarking utility. It was designed to let web developers measure their code under duress, to see how it will stand up to load on the internet. Siege supports basic authentication, cookies, HTTP and HTTPS protocols. It lets its user hit a web server with a configurable number of simulated web browsers. Those browsers place the server “under siege.”

Simple Trick: History Command

Tue, 31 May 2011 21:05:08 +0000

So today I quickly installed Redis on a server, and I wanted to keep a copy of all the commands I had used to do so. I knew there was a better way than hitting the up arrow each time to copy and paste each command in reverse order. So after some Googling, I found out about the history command. So I was able to type the command “history” and it showed me the last two thousand or so commands I had used. I was able to copy and paste that into a wiki, and was good to go. You could also search your history by piping the history command to grep. Cool stuff I don’t want to forget.

Restoring Large MySQL Dump - 900 Million Rows

Thu, 07 Apr 2011 03:05:12 +0000

This last weekend I had a fun opportunity of restoring roughly 912 Million Rows to a database. 902 Million belonged to one single table (902,966,645 rows, to be exact). To give an idea of growth, the last time I blogged about this database we had about 40 million rows. This giant table, the “Scores” table, is has a very small schema: two ints, a tiny int, and a DECIMAL(5,2).

Problem

Our current backup system uses mysqldump. It dumps a 25 GB sql dump file, which compresses to about 2.5GB using gzip. The last time we needed to restore a backup it was only about 9GB, and it took several hours.

PHP, Nginx, and Output Flushing

Tue, 25 Jan 2011 04:01:00 +0000

Alright, so one of the few hangups I’ve ran into with moving from Apache to Nginx was output buffering. Now, we have a few administrative tools we use to perform large operations on our library and data. These scripts can take normally 3-5 minutes to run, and they output their progress and what step they are on as they run. The way they do this is after ever step in PHP I issue the same two commands:

jQuery UI - Disable Title On Dialog

Thu, 16 Sep 2010 05:56:35 +0000

For some reason, this was turning out to be kind of hard to accomplish, and everyone on the internet wanted to do it with JavaScript hacks. My issue was if the JavaScript hack didn’t execute fast enough, causing the title to flash for just a second, so I’d much rather do it with CSS. Unfortunately, there are no built in ways to hide it in jQuery. However, there is an option you can pass in the .dialog() method: dialogClass. This places a custom class in the main div element, allowing you to do something like this:

VirtualBox Networking Setup

Mon, 22 Mar 2010 06:32:43 +0000

Every time I go to set up VirtualBox and several VMs I always forget how I setup the networking for them. Once again, I went through the pain of trying to figure it all out, so I might as well document it for future use.

The Problem

When creating virtual machines, especially virtual linux servers, I want them to be able to do the following things:

Connect to the Internet
Connect over SSH from my Host Machine to the Guest Machine
Have the servers connect to each other on a private internal network

Out of the box, a VM is configured for #1, however it cannot do #2 and #3. There are some solutions that do some archaic port forwarding by issuing special commands from the Terminal. This is just painful, and if you just want one port to work, that’s manageable, but what if you want ssh, ftp, myql, http, https, etc? Any on multiple VMs? What a nightmare! What is painful is when googling for a solution, almost every “answer” is this crazy port forwarding method. There is a much cleaner, better way!

Presentation: Real Life Scaling

Sun, 11 Oct 2009 18:39:44 +0000

Here are my slides for the presentation that I gave at the Utah Open Source Conference on Friday. It was an awesome conference, and I am glad that I was able to be involved.

Real Life Scaling: A Tale of Two Websites http://static.slidesharecdn.com/swf/ssplayer2.swf?doc=reallifescaling-ataleoftwowebsites-small-091010143045-phpapp02&stripped_title=real-life-scaling-a-tale-of-two-websites

View more presentations from Justin Carmony.

If you have any questions or comments, please feel free to leave them below.

My New External Hard Drive: Blacx + 1TB Drive

Sat, 26 Sep 2009 18:03:10 +0000

These last few weeks I’ve been dealing with larger and larger sets of data that I would need to download to my PC to work on. When working with multiple copies of data that are 10-20 GBs each, it started to fill up my two HDDs very quickly. I decided I need to go buy a new hard drive to give me plenty of room. The question was “internal” or “external” and how big.

"Nerfing" a PHP Object

Sun, 20 Sep 2009 18:26:35 +0000

I was trying to think of something with PHP I could blog about that would be short and sweet. Then I thought of something that a good friend of my taught me: nerfing objects.

The Problem

Many times while working with PHP and bigger frameworks, you’ll have classes that extend classes that extand classes. We have an ORM system that interfaces our Database with PHP classes. This makes accessing and updating information easy for us. So lets say we have a class called “Post” that stores a blog post. Our ORM class just takes a few lines of code to hook up our “Post” class to the “posts” database tables. We just extend our base DataObject, which contains all sorts of references to other class isntances. Long story short, this PHP code is awesome, but there is one issue.

jQuery Tip: Better Toggle

Tue, 15 Sep 2009 18:28:05 +0000

For many web developers, jQuery is the most awesome JavaScript library out there. For me, it has turned JavaScript from being a nightmare into a power tool. I love JavaScript now, where as before I truely hated it. Takes all the hassel out of most compatibility issues across browsers. I spend less time debuging it and more time writing it. While I’m on my goal to write more blog posts, I’m going to share a few jQuery tricks.

Memcached: Simple, Effective, and Powerful

Wed, 20 May 2009 16:12:01 +0000

Realizing once again I haven’t written a blog post for quite some time, I thought I would just write a few smaller posts on things I’ve learned these last few months. Hopefully I can get back into the habit of blogging regularly again.

This last month I finally broke down and learned how to use memcached. While I have known about memcached for a very long time, I just never got around to using it. While I heard it was beyond easy to implement, I still assumed it would take a few days to get the hang of it and figure out its quirks. However, when the forces of high load on a webserver and the file-based caching system that I have previously used were found to be too I/O intensive, I had no choice but to take the plunge.

Recursively Add New Files to SVN

Fri, 20 Feb 2009 16:51:33 +0000

One great thing about running Windows is TortoiseSVN. I makes managing my SVN so easy. One of the problems I’ve ran into on other systems was I had been working for several hours. I would have dozens of new files and with TortoiseSVN it would show me a list of all the new files and I could hit “select all” and commit. However, on Mac I haven’t found an SVN client that I like, so I just use the terminal commands. There are also times, like when managing a WordPress installation, that WordPress and its plug-ins could auto update. I wanted to be able to add all the new files on the linux server back into the svn.

List of 50 PHP Tools

Wed, 21 Jan 2009 18:08:58 +0000

Found a great article listing popular tools that every PHP developer should be away of. Here is an excerpt:

PHP is one of the most widely used open-source server-side scripting languages that exist today. With over 20 million indexed domains using PHP, including major websites like Facebook, Digg and WordPress, there are good reasons why many Web developers prefer it to other server-side scripting languages, such as Python and Ruby.

PHP is faster (updated), and it is the most used scripting language in practice; it has detailed documentation, a huge community, numerous ready-to-use scripts and well-supported frameworks; and most importantly, it’s much easier to get started with PHP than with other scripting languages (Python, for example). That’s why it makes perfect sense to provide the huge community of PHP developers with an overview of useful tools and resources that can make their development process easier and more effective.

MySQL, 40 Million Rows, MyISAM to InnoDB, 45 Minutes

Tue, 13 Jan 2009 05:13:08 +0000

Warning: This blog post is NOT a walk-through or tutorial. If you don’t know what you’re doing, you could seriously screw up your database. This is just talking theory and ideas on how I solved my problem.

The other night (really, the other morning) I had the wonderful pleasure of trying to convert a table with 40 millions from MyISAM to InnoDB. The reason for the conversion was this table had a high amount of queries, and a high amount of writes. With this table growing and updating daily, the table locks were killing us. Because MyISAM needs to peform a lock on the entire table, we would have dozens of queries backlog as locks and writes were taking place. It was causing the site to screech to a halt, waiting for the locks the be released. It was a total nightmare.

CSS – I’m 100% Converted

Thu, 08 Jan 2009 06:01:35 +0000

It has been a hard, long road. But these last few days, I’ve finally have reached a realization of a great step in my life as a web design: I’m 100% converted to CSS layouts, and have forsaken tables. 5 years ago I would have believed that would be impossible, and that I would love and use tables for my layouts until the day I die. I remember hearing the lectures and heated discussions on using CSS instead, but I couldn’t bring myself to using CSS for layouts. Don’t get me wrong, using CSS was amazing for formatting and styling, such a color, size, bolding, etc. I love it every second and my conversion to CSS for those scenarios was very quick. However, the positioning of content, headers, footers, side menus and navigation was a nightmare for me at first. I just didn’t get it.

PHP Singletons, Sub-Classing, and HAS-A Relationships

Wed, 03 Dec 2008 06:37:53 +0000

I’ve been very busy these last fews weeks and have neglected making any posts. While there are a variety of subjects I’d love to post about, they’ll most likely have to wait until the next year. However, I thought I might be able to throw up a quick example of how to use PHP Singletons and extending public classes.

The Singleton Pattern “is a design pattern that is used to restrict instantiation of a class to one object.” (Wikipedia) In PHP, a singleton is created by making the constructor protected or private. “How do you create an object then?” Its done in two parts. First, you make a static class variable that is private, to hold the instance. Second, create a static function to return the instance. Here is an example:

MySQL - Does Table Exist w/o Throwing Errors

Tue, 04 Nov 2008 00:34:33 +0000

There are times where you would like to know if a table exists before executing an query. Most solutions require having MySQL throw an error saying “table does not exist,” but I prefer a cleaner way. I found on this forum post a clean way to do it:

/* example with table name: table_name */
SHOW TABLES LIKE 'table_name';

This solution will return 1 row if it exists, and 0 rows if it doesn’t. Here is a PHP example using this:

PHP Design - Biggest Database Oversights

Sat, 25 Oct 2008 07:56:44 +0000

Over the last three years I’ve had the opportunity to work on several PHP projects, some of them having grown rapidly and required to scale quickly. Three in particular have been a fantastic learning experience for me. Now I don’t consider myself a total expert, but I thought I would share my experiences. Many PHP developers are self-taught, like I was, and are learning PHP to be able to create dynamic websites. Many haven’t had studied or learned best practices for Object-Oriented Programming (OOP). They are web designers first, and programming in PHP is just a way to do things simple HTML can’t do.

PHP Video Tutorial – Getting Started – Installing XAMPP

Wed, 15 Oct 2008 01:32:30 +0000

I’ve decided to give this a try and make a video on Installing & Running XAMPP, the easy to instal web stack for developing websites on your own computer. This video is for beginners who need help walking through the installation of XAMPP.

View Video Tutorial - Installing XAMPP

If you have any questions or comments, feel free to leave them here. If you enjoyed this tutorial and are in need of a web server, check out Layered Tech, a server host that I highly recommend.

Local LAMP Developement & User Content

Fri, 10 Oct 2008 20:37:26 +0000

I’ve come up with a simple solution for handling user uploaded content when trying to work in a local development environment. I’ve installed XAMPP on my windows machine and at the beginning of every week I take a database snapshot and update my local database. I had a pretty smooth system going with one problem: user uploaded content.

When working with social networking sites, many times they allow for users to upload their own videos, pictures, etc. My current project wasn’t different, but I didn’t want to download 80GB of user content every week to store on my PC. I wanted a way to point my browser to the live server to get recent images, etc.

Two-Way Sync between Google Calendar, Windows, OS X, and iPhone

Sat, 23 Aug 2008 21:43:36 +0000

Since my wife and I got our new iPhones, I’ve been playing around with a way unify our calendars. When we first got married we started to use Google Calendar. We have three calendars: mine, hers, and ours. Its great for staying organized, especially when we’re trying to organize two lives. It worked well for several weeks, except one thing…

We had to be on-line and on the browser to view our Google Calendars. Lot of the time when we needed to see our calendar we were with family or friends without computer access. Also, when I work I have twenty or so browser windows open, and it can be difficult to find my calendar in the mix. I also am biased towards desktop client applications when I’m using them every hour of the day. So I set out on my quest to find a way to sync across all the different mediums I use. Now that I think I’ve found my solution, I thought I would share my findings with the rest of the world.

Collection of Useful Plesk Tricks

Thu, 10 Jul 2008 01:01:17 +0000

Found this blog post with a handful of Plesk tricks while searching for a different problem. Posting it here to remember it.

Mac Keyboard Quirks - Making Mac more like Windows

Thu, 03 Jul 2008 16:16:00 +0000

Alright, the sound of dying Apple fanboys are crying through out the internet at the posting of this entry, but there are two things I can’t stand about the Mac:

Command & Control are switched - this is a major pain, especially when using a KVM to switch between a Windows, Mac, and Linux machine. It is just crazy!

Home & End - They don’t work like they should on every other OS. I’ve never really figured out exactly what they do on Mac, but on Windows they go to the beginning or end of a line.

OS X and Tabs - Skipping Drop Down Controls

Tue, 17 Jun 2008 07:33:15 +0000

This was driving me crazy for this last week. Since moving to my new house I’ve been without internet for a week. Comcast is supposed to come tomorrow to hook up my house, but until then I’ve been mooching of relatives’ WI-FI on my Mac Book Pro. This has forced me to use it for all of my work, including web development and graphics design. However, while tabbing through forms on websites, the tab would skip over drop down boxes. Why this is the default is beyond me. It is not user friendly at all. Fortunately I found through a website how to change it. Of course the OS X elite call this change simple and easy, but I’d think it’d be easy to just have it work in the first place.

MS SQL 2005 (T-SQL) Row Count for Each Table

Tue, 19 Feb 2008 16:08:38 +0000

At work I needed a solution to give me a count of how many rows each table contained. I’ve always liked phpMyAdmin’s ability to list all the tables and show their size and row count. I’ve found it immensely helpful. However, I couldn’t find anything similar for SQL Server Manager Studio 2005. I found a blog post that pointed me in the right direction on how to get the row counts, but I couldn’t get their script to run on the SQL Server 2005. Since I figured this would be a useful script to have I would re-write it and comment it for others. Here it is: