I've been busy since returning from vacation on getting my new iMac up and running. Aside from the machine being a physical work of art, it's also been performing very well and runs so silent that I'm hearing all kinds of new noises in my house that I wasn't aware of before. This doesn't mean that I've completely forsaken Windows. In fact, the move to the Mac has allowed me to finally move to Vista on my home machine and install Visual Studio 2008, which is killing my work laptop. For those of you remotely familiar with the Mac, running Windows side-by-side with OS X has been possible since the release of the Intel-based Macs. This started with Boot Camp and gained serious traction with the release of Parallels. Most recently, VMware jumped into this space with their Fusion product for the Mac. I went with Fusion due to reviews on both Apple's site and Amazon.com that seemed to indicate that Fusion was more stable and that there were far more converts from Parallels to Fusion than in the opposite direction.

I'm running 3 operating systems now on this machine, 2 of them under Fusion 1.1. Mac OS X Leopard came pre-installed with the machine and Vista and Ubuntu Linux are running under Fusion. Despite the 64-bit Intel architecture on the new Macs, both the Vista and Ubuntu installs are 32-bit. I didn't hear enough good news about the 64 bit releases to convince me that they were worth pursuing. All of this is running on 4GB of memory. Only 1 GB was stock and you'd be crazy to pay Apple's prices for memory. Other World Computing (OWC) will get you to the 4GB maximum for less than $100. The memory install took all of about 10 minutes and OWC's service and delivery were nothing short of outstanding.

As far as the individual operating systems, they are all running fine. That said, everyone puts different kinds of stresses on their machines. Mine is software development and I require each of my operating systems to run at least oneIDE. That's actually the reason for the existence of these VMs in the first place. Although my initial research prepared me for the worst, I've had no issues with running IDEs concurrently on all 3 operating systems. I've encountered some small quirks, which I've documented below for anyone who might find this sort of thing useful:

• Mac OS X Leopard - I'm running NetBeans 6.0 with the Ruby-only configuration. Much to the chagrin of many Mac developers, Leopard did not ship with Java 6 even though it was included in some of thepre-releases. This proved to be a non-issue for the installation of the latest version of NetBeans. Obviously, running NetBeans in Ruby-only mode means that I'm not exercising the JDK and thus avoiding what could potentially be a lot of issues.
• Windows Vista - Although I've had issues getting used to the Vista operating system from the Windows 2003 Server / Windows XP I've become so familiar with, I've had few issues actually running Vista. I'm running Vista with the 1 GB RAM that Fusion recommended and have had no issues thus far. The only issue I encountered was trying to install Vista in Fusion Easy Install mode with multipleCDs , as opposed to a DVD. This is a documented issue with Fusion that I didn't become aware of until I ran into it head-on. Simply switching to a normal install solved all of my issues. On top of Vista, I'm running Visual Studio 2008. This runs pretty quick - even on 1 GB and builds of moderately sized solutions are pretty fast. TheIDE is really responsive and you really only notice that your running in a virtualized environment if you try to resize the entire Vista window to get more real estate for the IDE.
• Ubuntu 7.10 - Despite the size of the operating system, this installation took longer than Vista. I chose not to use one of VMware's canned virtual appliances and go with a fresh install.  I would probably re-examine this decision if I had the chance to do it all over again. Ubuntu is running NetBeans 6.0 with the full Java EE stack. The install of NetBeans downloaded directly from netbeans.com went really well once the proper Sun JDKs were installed. Both the Java 5 and Java 6 JDKs were available directly from Ubuntu's installation utility. I installed Java 5 first and, after realizing that it was a vanilla 1.5.0 release that didn't meet the requirements for NetBeans 6.0, I installed Java 6. Things have been just dandy since then.

After a long hiatus, I just got done working my way through a 6 month photo backlog, arranging and backing up photos and picking the best ones out for uploading to Flickr. You can find the new photos in the photo section of my blog. I was working my way through videos as well and preparing to convert some of these to Flash for uploading. If you look at the videos section of my blog, you'll notice that there are no new videos. So what happened?

Although I'm really happy with On2 Technologies Flash encoding software, the process of importing and transcoding video is time consuming and CPU intensive. Then there's the entire upload and markup creation process, which is a royal pain that I should have long since automated away - but I haven't. What I'd really like is a process similar to the one that I have with Flickr: I upload photos using a OS-specific program (uploadr) and they just appear on my blog. I've known that this process needs to be replaced for a while, I've just been hesitant to pull the trigger. Enter Smugmug...

Smugmug, the family owned photo service that leans heavily on Amazon's S3 service for file storage, announced last week a significant upgrade to their video hosting capabilities by supporting the H.264 video format. Right now, Apple's QuickTime plugin provides the best support for H.264 but Adobe's newest version of Flash will also be supporting H.264. If Microsoft wants to remain competitive with Silverlight, they'll be following suit as well. So what does this mean? This means that Smugmug will automatically transcode your uploaded video. Depending upon your membership level, video can be encoded at DVD resolution (960x540, for power users) or HD (1280x720, for pro users). You upload it and Smugmug transcodes and hosts it, providing unlimited bandwidth and storage space. Since seeing is believing, click on the image below to see a sample SmugMug Thanksgiving video and tell me you wouldn't like to have online video of this quality.



If you're going video, you've got to go big and at $150/year, Smugmug carries with it a fairly large price tag. However, when I factor in that I can cancel my Flickr subscription, stop upgrading my Flash encoder, decrease my bandwidth utilization on my hosting service, and have a hassle free upload and transcode experience... in HD, I'm sold. As an added bonus, Smugmug has just added an adaptive imaging sizing capability they call "SmugMungous" that automatically selects the right size picture for your screen. To get the full effect, this needs to be tried on a fairly large monitor. And by the way, you can point to your smugmug gallery using a custom domain or sub-domain and you can share video updates as an iTunes Podcast that friends and family can subscribe to.

SmugMug is just one more piece in my grand attempt to upgrade my life to HD. We went with HD TV almost 3 years ago now and it's hard looking at a normal signal now, especially on a large 16:9 screen. I'm strongly considering Smugmug for its HD capabilities but this is going to cause me to reexamine two other areas of my life that need HD upgrading: my HD recording capability and HD playback capability. I'm waiting for Santa Claus to drop an HD TiVo down the chimney. The $1000 dollar price tag for the original Series3 TiVo was a pill I couldn't bring myself to swallow, no matter how much I love TiVo. AT $300 and almost all of the features of the Series3, the HD TiVo got my attention. I'm also looking at an HD camcorder, an essential item if I'm serious about the Smugmug thing.

That's a lot of upgrading to do. Still, there are several areas that I'm not upgrading. I'm waiting for the Blu-ray / HD DVD war to show some signs of abating but this is definitely a medium worth revisiting in 2008. HD Radio - now I just don't get this one!

Another in the installment of Rails on Windows “gotchas”, there are some things to be wary of when working with the Simple_Captcha plugin in the Windows environment. In terms of basic background, the Simple_Captcha plugin facilitates the integration of CAPTCHA (Computer Automated Public Turing test to tell Computers and Humans Apart) image recognition tests, like the example below, into a Rails application. Facilitates is perhaps not a strong enough term. The plugin makes CAPTCHA integration dirt simple.

The Simple_Captcha plugin uses RMagick for generation of the CAPTCHA recognition images, allowing for various image styles and distortion levels. The CAPTCHA can be integrated via the controller (this one is dirt simple) or via the model (this one is just silly simple). You can find out more about these and various other integration options on the plugin’s page.  

If you’re doing Rails development on the Windows platform and are not feeling especially masochistic, the rmagick-win32 gem, which is bundled with a copy of the ImageMagick Windows installer, is really the only way to use RMagick. For a long while, the 1.13.0 rmagick-win32 gem was the standard. However, this gem is likely to cause you issues and you should really upgrade your gem to the 1.14.1 gem or greater. These gems are fixed to work with RubyGems 0.9.4, which is the most recent version of this gem as of this blog post. If you don’t perform this update, you’re likely to see ImageMagick issues bubble up at runtime.

On Windows, these runtime errors frequently manifest themselves as ‘cur_image’ issues. Several of these issues have been reported on the plugin’s page. My post on 10/6 covered fixing these issues by upgrading your RMagick gem. Please don’t downgrade other gems, as suggested in some other posts; this will only make your life more miserable in the future.

All-in-all, the RMagick Windows gem is an excellent way to make powerful image processing capabilities available to all, including those unfortunate enough to be stuck on a Rails on Windows development platform. The plugins built on top of RMagick such as Simple_Captcha and Attachment_Fu are incredibly powerful and remain very simple by leveraging RMagick’s capabilities. Just beware if you’re developing on Windows, a little bit of tweaking and debugging may be necessary to get these plugins to work as advertised.

I’ve posted about how impressed I was with NetBeans as a Java IDE and the incredible progress this product has made in the last couple of years. I knew for a while that Ruby on Rails and JRuby support was coming for the next major Netbeans release (v 6.0), but I hesitated moving from RadRails to NetBeans until the feature set had stabilized. Last week, the Netbeans 6.0 beta was released and, with RadRails stagnating somewhat under the Aptana brand, I caved in and made the switch.

 

George Cook does an excellent Job of running through the new features with lots of nice pretty screenshots. If you’re looking at moving to Netbeans as a Rails IDE, it’s the first place I suggest that you go. Some of my favorite features of Netbeans (with screens shamelessly stolen from George’s site) include code completion

 

 

 

…and debugging

 

 

There are several features from RadRails that I miss and that I hope the NetBeans team will consider integrating over time. These include the ability to import a project directly from Subversion and the test window that allows you to visually check the status of your tests and select particular tests to run. Those features aside, I don’t plan on going back to RadRails. NetBeans has made so much progress so quickly, I can only imagine that it’s going to put significant distance between itself and RadRails in the near future.

 

You can get Netbeans 6.0 here, available as a skinnied-down Ruby only version if you want. Finally, since Netbeans uses JRuby as the default interpreter and expects the Derby Java database, this article on wiring NetBeans for InstantRails should get you up and moving with the standard Ruby interpreter and MySQL database configuration, regardless of whether you’re using InstantRails or not.

 

Final note if you're brand new to Ruby on Rails and reading this post. Skip right to Rails 2.0, which is now in preview mode, to avoid dealing with Rails 1.2.x deprecations and to benefit from some of the new defaults. Enjoy!

During a discussion the other day, I found myself repeatedly asking the question of how many organizations could make the leap from an organization dabbling in services (SOA believers) to an organization living SOA and benefiting from services (SOA achievers). I kept referring to the SOA chasm, this nearly insurmountable gap that needs to be crossed to move from an SOA believer to an SOA achiever. The image below is my visualization of this gap.

 

 

Why is it so hard to make it from one side to the other? It’s because this leap requires an organization to rethink everything; fundamentally changing the way they fund, govern, build, and host their applications. If you’re wondering what an SOA achiever looks like, check out this article on the Amazon.com architecture. Note the stat near the top of the page – between 100 and 150 services are accessed to build a page. These guys have made the leap.

 

I’ve heard a lot of contentions that the move to an SOA represents an evolution, not a revolution. I think this is true for only so long. An organization can incrementally improve their capabilities as an SOA believer but once they reach the end of the SOA believer cliff, it’s an all-or-nothing proposition. When an organization has completed the construction of their utility services and the time comes to tackle the core business entities, functions, and processes, it’s the SOA moment of truth. That quote from the Matrix before Neo tries to jump the chasm between two buildings rings in my head, “You have to let it all go, Neo; fear, doubt, disbelief. Free your mind!"

Tad Anderson posted about the release of an SOA-related e-book from Microsoft concerning Service Oriented Architecture (SOA). This is one area in which Microsoft has remained notably quiet compared with competing enterprise software vendors such as IBM and Sun. As Tad points out in his post, Microsoft has made some forays into SOA publications and they have been pretty readable.

Their most recent publication, SOA in the Real World (mirrored here), is one of the better pieces of SOA writing that I’ve encountered, vendor-specific or otherwise. It uses Microsoft technologies to illustrate certain principles but it manages to maintain a largely implementation-agnostic viewpoint. The e-book has multiple authors but it was edited together in a very seamless way, which is not always the easiest thing to pull off.

The e-book appears to have been pulled together by Microsoft’s Architectural Resource Center (ARC). No authors are listed specifically and the ARC branding is new, somewhat resembling the branding used for Microsoft’s Architecture Journal. The publication includes a pretty sound enterprise SOA approach, detailed explanations of how some of the major pieces of a SOA come together and a description of how Microsoft’s technologies fit in the mix. Whether one architect’s opinion or the Microsoft party line, there are some insightful and succinct explanations provided, such as the differences between Workflow Foundation and BizTalk when it comes to implementing workflow.

This book is a great read for anyone looking for a solid introduction to SOA and could well be the definitive read for anyone dealing with SOA and Microsoft technologies.

I was performing functional tests on my models that employed Attachment_Fu this morning and thought it would be worthwhile to share the code since it was a bit of a hassle pulling it together. Kudos to Mike Subelsky for his introduction to functional testing Attachment_Fu. It got me going in the right direction. What proved difficult once again was the multi-model controller. Once I got over that hump, I was on my way. As you can see from all the detail in the HTTP POST below, that was not an entirely easy task.

class ProductsControllerTest < Test::Unit::TestCase
...
def test_create_with_user
    num_products = Product.count
    imgdata = fixture_file_upload('/files/image.png', 'image/png')
    audiodata = fixture_file_upload('/files/sound.mp3', 'audio/mpeg')
    post :create, {:product => {
            :name => "Widget",
            :description => "A small tool-like item",
            :weight => "3",
            :price => "19.99",
            :language_id => "1"
                   },
            :image => {:uploaded_data => imgdata},
            :audio => {:uploaded_data => audiodata} ,
            :html => { :multipart => true }
          },
          {:user_id => users(:valid_active_user).id}
    assert_response :redirect
    assert_redirected_to :action => 'show'
    assert_equal num_products + 1, Product.count
  end
  ...
  end

Continuing my Rails on Windows thread, I’m going to spend a bit of time on something that’s brought me both some substantial gains and some minor woes lately, running the Attachment_Fu plugin on Windows. I’ll start off with some general Attachment_Fu information and then get into some of the quirks, which are, as expected, mostly specific to the Windows environment.

First, for those not in the know, Attachment_Fu is a Rails plugin that allows you to store binary data (e.g. images, video, documents) and associate it with other models in your Rails application. Metadata (content type, size, height, width) about the attachment is stored in a separate model. Attachment_Fu’s sweet spot is handling images. It can handle automatic image conversion and thumbnailing using a number of popular image processors such as ImageScience, RMagick, or minmagick. Although not provided, you can imagine that Attachment_Fu might be extended to handle other types of binary processing utilities such as PDF converters or audio/video transcoding software. The other very cool thing about Attachment_Fu is that it provides support for pluggable persistence mechanisms. Out of the box, it allows for storage on the file system, as binary information in a database or on Amazon’s S3 storage service.

There is an abundance of information already written about Attachment_Fu so to avoid re-inventing the wheel, I’ll provide what I found to be the best sources of information to start.

• Mike Clark’s tutorial is the gold standard introduction to using Attachment_Fu. The code is simplistic but rock solid. It covers using both the file system and S3 for storage and will get you up and running on Attachment_Fu in no time.
  

• This post on the Attachment_Fu message board provides a solution to associating the attachment model with another model (i.e. making it an attachment to something). The post provides both the controller and the view code for uploading the initial attachment and rendering it. Handling the attachment relationship in your MVC is going to be a fairly common requirement and most Attachment_Fu users will benefit from this post.
  

For my part, I’m going to provide some controller source code for updating the attachment when you have a relationship with another model (an extension of the second item above) since this is one area that wasn’t covered well anywhere else and might save you some time in your travels. In the code below, my main model is the product and the image is the model where a photo and thumbnail are stored using Attachment_Fu.

class ProductController < ApplicationController

  def update
    @product = Product.find(params[:id])
    # Load up product categories for the view
    @all_categories = Category.find(:all, :order=>"name_en")
    if @product.update_attributes(params[:product])
      if !params[:image][:uploaded_data].blank?
        # My product only has one image / thumbnail, I'll destroy 'each'
        # wait 3 # See quirk no.1 below
        @product.images.each {|img| img.destroy}
        @image = @product.images ||= Image.new
        @image = @product.images.build(params[:image])
        @image.save
      end
      flash[:notice] = 'Product was successfully updated.'
      redirect_to :action => 'show', :id => @product
    else
      render :action => 'edit'
    end
  end
 
end

The links above, in combination with my snippet, should get you through creating an attachment and handling CRUD for an attachment and its parent model from a single view. Now comes the Windows quirkiness. Not knowing to expect these Attachment_Fu quirks and then having to root out the cause of the behavior took up a lot of time. It turns out that most of I found that most of the quirks are documented in some way, shape, or form. I’ve pulled together a list of the quirks as well as some best practice workarounds.

• When running Attachment_Fu on Windows, the most commonly accounted problem is the “Size Is Not Included In List” validation error. This post goes into some details and speculation around the cause of the issue. It appears that no amount of fixing in the Ruby code is going to help here since it appears to be a Windows file system issue. The workaround is really simple, just add a wait x statement before your attachment processing and things will be golden. The x (which denotes seconds) time will vary based upon the size of the attachments you are processing. Bigger attachments require more of a wait. Also, be sure to comment this code out in production since this is a Windows only issue.

7/19/2007 Update - Rick suggested using RUBY_PLATFORM to determine if the wait should be invoked. I tested this and it worked as suggested

• When you invoke the destroy method on your attachment using Attachment_Fu on Windows, your models reference to the attachment will be deleted but the physical attachments themselves will not be deleted if you have persisted them to the file system. If you look at the Attachment_Fu source code or your log files, you’ll see that Attachment_Fu assumes that you are using a UNIX-based system and executes UNIX commands like rm to remove these files. These commands will obviously not work in a Windows environment, leaving you with a bunch of zombie files. This should not be a problem if you use a database or S3 persistence mechanism since these mechanisms are independent of the operating system.

7/19/2007 Update - Rick corrected me. He is indeed calling the OS safe FileUtils.rm in the file system backend. It still isn't working though - at least on my machine.

• My last Windows specific quirk is actually an Internet Explorer issue. If your attachments are images, you may have problems with uploading JPEG’s using the default Attachment_Fu plugin. From what I’ve been able to determine, if you upload a JPEG from IE with a file extension of .JPEG, IE will set the MIME type to image/pjpeg for a progressive JPEG. However, if the image extension is simply .jpg, IE will set the MIME type to image/jpg. This MIME type, however, is not included in the default list of content types accepted by Attachment_Fu. My suggestion is to add this type to the list in the source code until Rick can get around to modifying the source.

7/19/2007 Update - The MIME type was added to source. For reference, Rick suggested that this could have been done without changing the source simply by adding
    Technoweenie::AttachmentFu.content_types << 'image/jpg

The last quirk for my post should be meaningful to all of those using Capistrano, the Rails migration utility. Capistrano manages versions of the application for rollforward / rollback by creating symlinks to previous versions of an application and deploying the most recent version of your entire application tree from your version control system (e.g. Subversion). However, since it’s very unlikely that you are storing all of the attachments for your application under version control, the attachments will be unlinked and no longer available when you migrate a new version of your application to production. To get around this issue, the solution proposed here creates a separate physical directory for the attachments outside of your application’s directory and then updates a symlink from your application’s attachment directory to the separate physical directory every time you migrate.