Ivan Sutherland’s Sketchpad MIT thesis was covered by Create Digital Motion after I posted the video clip from MIT’s New Media Reader featuring Dr. Alay Kay from Xerox PARC give a lecture on Sketchpad. The video clip has since garnered over 10,000 YouTube views and other “instances” of the film on video sharing sites — so appropriate given Sutherland’s contribution of the idea of a “master” and “instances.” His contributions to computer aided design history extend well into its origins and beyond its final outcome.

Peter Kirn says it best — what I think, he was able to say about this…

Additional Demonstration Footage Also Emerged

This Sketchpad film on YouTube: Part 1

The computer has been, in a sense, nothing but a very elaborate calculating machine. But, now we’re making the computer be more like, almost like a “human assistant” and the computer will seem to have some intelligence.

It doesn’t really. Only the intelligence that we put in it.

{Emphasis added.}

Professor Steven Coons
Associate Professor of Mechanical Engineering at MIT
Co-Director of The Computer Aided Design Project

On Teaching Mobile Application Design at Parsons

Dr. Dobb’s Journal, legendary software design publication, published our phone interview on its web portal yesterday on the subject of teaching mobile media design at Parsons Communication Design & Technology. John Dorsey, the editor of Dr. Dobb’s, offered probing questions that got at the nature of the program, the challenges of teaching Flash for application design, and how various tools and platforms can fit together in a technology curriculum at the service of the arts. This is all very interesting when you consider Dr. Dobb’s target audience, clearly hard-core coders and application developers. It’s a good sign when engineer-types are starting to take what’s going on in art and design schools more seriously. These distinctions are very much starting to blur.

» Interview

Web Ink for Mobile Media Curriculum

Adobe published a case study on my work with students at Parsons Communication Design & Technology in the area of mobile media design.

Mobile Touch Screen WordPress Theme In The Works

In response to the proliferating importance of portable touch-screen interfaces, we have started the design and development of a WordPress theme for iPhone and iPod Touch devices. The theme will make your WordPress site look and behave like a native application, taking advantage of the special requirements of a touch-screen, flick-and-slide scroll interface minimizing zoom-pinching, all using Joe Hewitt’s iUI JavaScript and CSS library.

The project is currently in a pre-alpha release state. We have released an early alpha, with a distant dream publish it to the official WordPress theme site. Anyone who is interested in helping to test and develop the concept should contact us by email. Let it be known that we are not the first to attempt a WordPress iUI theme, although we are working a more comprehensive implementation than what Justin Barkhuff has already achieved while on his year-long honeymoon!

» Try WordPress Touch pre-alpha on your iPhone or iPod Touch.

If the Touch theme does not appear right away, keep trying, by refreshing or revisiting this link. For some reason, the cookie that tells WordPress to use this theme isn’t registering correctly.

Release Notes

• You can simulate the experience by viewing the Touch theme without an iPhone or iPod Touch by using Safari 3.1 or the Webkit nightly build, the iPhoney simulator, or the official iPhone simulator as part of the SDK.
• Viewing this theme in other browsers will probably yield unpredictable and undesirable results.
• Your browser will remember your theme choice in a cookie. To reset back to the standard theme, choose Preferences > Theme > Desktop within the Touch theme main menu.
• As stated above, if you don’t succeed in triggering the WordPress Touch theme to appear, be persistent. This is an known issue to be resolved. It has something to do with the theme switcher plugin I’m using.

Design Goals

• Optimize WordPress consumption for the WebKit touchscreen user-interface model — in progress
• Focus on mobile use-cases, to allow a quick consume, easy lookups — in progress
• Employ best practices for iPhone and iPod Touch interface design conventions — in progress
• Allow options for auto-detection, user-selection and return to standard desktop views — in progess
• Introduce glossy icons for menus, with preference to disable — to do
• Introduce auto-resizing thumbnail management and disabling LightBox photo gallery features — to do

Specula-palooza

Risking iPhone coverage overexposure, today we ponder one of the most interesting questions about the future of Flash, iPhone and web standards. Despite assurances by Uncle Walt that Apple and Adobe are hard at work on a Flash Player for iPhone, plenty of naysayers, skeptics, and player-haters have voiced strong speculations that Flash will never appear on the iPhone for strategic, practical and technical reasons. A quick scan of comments on various iPhone related entries across the web reveals an almost universal plea amongst everyday users indicating that a dearly missed feature from Mobile Safari is the presence of a mainstream multimedia plugin. In fact, the world’s most popular piece of software in history, is well known to be absent from iPhone.¹

Mobilizing the Means of Production

Those who have written about why iPhone should not have a Flash Player don’t mask their agendas. These voices are usually programmers and developers who have always been hostile to Flash, mostly because it threatens their grip on the means of production, by bringing software and interface design to the masses. Indeed, we’ve seen the worst and the best of the web, as a result. Furthermore, because Flash has always been a mainstream, populist, albeit proprietary media format, it has been deployed for reach and ease of creation, rather than robust performance. When imagining a Flash Player for iPhone, its high-octane thirst for processor cycles does not bode well for battery life.

Monopolizing Web Standards

The second significant argument against iPhone Flash is Apple’s strategy to deploy its WebKit “web standards” platform for all third-party application development. Indeed, the recently redesigned Apple.com site has reduced its use of Flash significantly, in favor of JavaScript and browser based features, so-called AJAX. The argument goes that Apple doesn’t want to forsake its influence on the consumer-level interface design market by inserting Adobe’s trojan horse into the battlefield.² This perspective does make a lot of sense, but leaves out a tremendous amount of nuance, that we’ll investigate here.

A Muted Voice

The assumption that web standards based technology, such as JavaScript, can wholly replace Flash functionality is only somewhat true, especially on iPhone.³ Certainly, the support of JavaScript and its embrace by the web developer community over the past three to five years has changed the face of the web, earning the popular title of version 2.0. However, Flash offers some essential multimedia capabilities that JavaScript alone cannot yet offer. This includes audio support. It’s no coincidence that Bejeweled for iPhone is mute. Especially considering that many iPhone users may have stereo headsets plugged in during use, there are unimaginable uses for audio based applications, especially when combined with locative media technologies. Imagine a sort of audiopedia. The differences don’t start and end with audio support, however. Even Apple’s newly touted Web Gallery feature, part of a .Mac subscription with the iLife personal media suite needs to use Flash for its carousel photo browsing interface.⁴ Indeed, only the Flash Player offers the multimedia engine to manipulate the images as a responsive interface with the reach required on this consumer grade product.

I Want My MTV

Certainly, the most common deployment of Flash Player on the web recently is for web video. It was almost shocking to watch the FLV video format surpass RealPlayer, Windows Media and QuickTime as the most important, influential web video format, in what seemed like a matter of months, with much thanks to YouTube and others. A recent Adobe Flash Player 9 public beta featured H.264 video support, which seems part of its strategy to preserve the dominance of Flash video, especially as Apple and Google migrate towards this non-Flash based video standard. However, until the myriad of embedded SWF FLV players on perhaps billions of web pages get updated to auto-detect the client and deliver the appropriate video by codec, the web will still appear to be littered with missing plugins on Mobile Safari.

Assumptions and Speculations

Let’s proceed with the assumption that Walt Mossberg was correct, and indeed, Apple and Adobe have reached an agreement to release Flash Player iPhone in some manifestation, at some time. Of course, he could be blindly speculating like the rest of us, just running on the fact that it feels crazy for Flash not to be there. But, let’s hope he’s as well-connected and respected as they say he is.⁵ There are several scenarios for the future of Flash iPhone, which should only contribute to the over-saturated discourse by further complicating the biased opinions with an understanding of Adobe’s perspective, previously, and conveniently left out of the discussion.

A Straight Port of Flash Player 9

In this scenario, Adobe compiles the current version of the desktop Flash Player 9 for the ARM processor of iPhone. This scenario would allow all of the existing web-based Flash content to function within Mobile Safari. Authors who create content in ActionScript 3 would enjoy a noticeable improvement of performance and energy efficiency on the iPhone, since this type of content would play in the more recent Flash Virtual Machine, a marked improvement over previous runtime environments, across Windows, Mac OS X and Linux. However, the vast majority of Flash content on the web right now was created in ActionScript 1.0 and 2.0, and so does not take advantage of the improvements to the runtime. Indeed, the skeptics are correct when they assume that running web pages with Flash content, even animated banners, would put an unfortunate drain on the battery.However, what’s crucially missing from a simple straight-on port of Flash Player 9 for iPhone is a substantial confrontation with the multi-touch interface. This is likely the deal-breaker for this scenario. Although, ActionScript and Flash button symbols might offer some means of developing and designing for the iPhone’s multi-touch interface, it’s more than likely that despite the best efforts of Flash coders, the existing means to respond to mouse-based interactions will fall short of the requirements needed to respond to multi-touch. Gestures like pinch, tap-zoom, and flick are difficult to imagine as ActionScript events. Indeed, Adobe probably needs to reckon with the reality that ActionScript needs a true multi-touch API. This could be one of the many reasons why we can only assume that iPhone Flash is in development now, and may be for quite some time, especially based on Apple’s delay in releasing an official iPhone SDK.

Probability: Very Low

Flash Player 10

Looking into 2008, perhaps third or fourth quarter, we have to assume that Adobe will continue to release improved versions of the Flash Player. Version 10 is likely to provide Adobe with the required release cycle needed to fully contend with Apple’s native iPhone application API and SDK release schedule. It’s much more likely that ActionScript libraries will be written that allow true response to the multi-touch gestures, such as pinching, flicking and zoom-tapping. It’s really difficult to imagine a Flash Player on iPhone without this crucial ActionScript API.Furthermore, this allows Adobe to potentially release new versions of the Flash and Flex authoring tools that will compile in Flash Player 10, and subsequently, support a runtime environment that is tuned to the needs of the ARM architecture and precious battery life. It’s been frustrating to read the Flash iPhone haters and their blatant neglect for Adobe’s expertise in the area of building a Flash Player for mobile devices. There has simply been no mention of the possibility of Flash Lite for iPhone.

Probability: Medium

Flash Lite 2.1

Flash Lite is a very special version of the Flash Player for mobile devices, such as Symbian Series 60, Windows Mobile and others. It is not the Flash Player that typically sits in an embedded browser, like the vast majority of Flash content out there. Instead, Flash Lite content exists as standalone, full-screen, mobile applications, or more appropriate mobile media implementations such as a standby screens, wallpapers, screen-savers, and even the device’s native UI.Not only is Flash Lite compiled to the particular device, and so is limited by its processing and memory capabilities, but it also has proven to be very energy efficient, accordingly. Indeed, authors must specifically design and code for Flash Lite. It is in no way, a conversion from desktop Flash content. In this manner, designers and developers alike, are rightly forced to contend with the requirements of mobile media, in terms of interface, content and use-case considerations.It’s possible that Adobe could port Flash Lite to iPhone instead of the expected desktop Flash Player. In this regard, Flash Player would exists as a widget on the SpringBoard home-screen of iPhone, and not as a Mobile Safari plugin. Although it would not fix countless broken plugins in pages that use Flash Player, it would offer mobile media design opportunities for Flash on iPhone. Specifically, Flash Lite already offers APIs to interact with mobile phone specific features, such as triggering the vibrate, detecting battery life, and cell network signal strength. These capabilities are not offered on the desktop version of Flash Player, and may or may not be available in Apple’s official native iPhone application API or SDK. Only time will tell.In this scenario, Flash Lite becomes an avenue for designers and developers familiar with Adobe’s toolsets to create applications that exist as standalone native experiences, rather than embedded modules of Mobile Safari. In many ways, this supports the special needs of mobile media more appropriately than simply making the familiar Flash just work. Imagining a port of Flash Lite for iPhone could mean the opening of a vast market for native iPhone widget applications, designed by designers, and not restricted to hard-core Objective C programmers. Indeed, this is a threatening prospect for those that are eager to carve out a niche in iPhone application development. However, Flash Lite 2.1 probably does not offer the means to react to multi-touch gestures like pinch, flick and tap-zoom, and so it’s probably not the version we will eventually see.

Probability: Low

Flash Lite 3

Just as the desktop Flash Player is constantly updated, the mobile Flash Lite player is also expected to be evolving. It is said, that a forthcoming version of the Flash Lite player, perhaps 3, will bridge the gap between the embedded browser Flash content and the standalone mobile specific Flash Lite content.⁶ In other words, Flash Lite 3 could play not just in the mobile device’s web browser, but could also run within its native operating system environment. This jives with Adobe’s efforts to seed the use of Flash outside of the browser and distribute a desktop based native runtime, called AIR, the Adobe Integrated Runtime. In addition, a Flash Lite 3 would address the concerns of a multi-touch API, and the required energy efficiencies for battery life, memory usage and processor cycling, as well as provide ActionScript to trigger mobile device specific features intrinsic to Flash Lite.In this case, Flash would exist in two manifestations on iPhone: as standalone native applications on the SpringBoard home screen, and as a Mobile Safari plugin, playing the usual desktop based content. This gives developers, designers and end-users the best of all worlds. Flash content can be created with mobile use in mind, considering the unique user interface and energy efficiency required. Everyday users will enjoy not only the full multimedia web they’ve grown accustomed to on the desktop, but also will enjoy a market of native mobile applications that arguably, the Objective C programmers of the world, simply cannot singlehandedly service.

Probability: Medium-High

Conclusions

Flash will appear on iPhone eventually. There is no doubt that Adobe will roadmap this device into its strategy for Flash Player, Flash Lite, or both.Yes, there are significant performance, interface and user considerations that must be addressed as Flash appears on iPhone. Adobe has already demonstrated an accomplished ability to service the mobile media market. It’s only a matter of when, and what form iPhone Flash takes as it appears beneath our beloved glass multi-touch screens.One can only imagine the pressure Adobe’s product planners are putting on its Flash Player team to fit iPhone into the needs of the short-term and long-term strategy. In the short term, Adobe needs to get Flash on iPhone within the next three to six months to capture the required developer and designer audience, and compete with the ascendancy of Mobile Safari and native iPhone applications. In the long term, Adobe needs to get it right, and release a iPhone Flash Player that addresses the specific needs of both mobile media and the vast legacy of desktop Flash content out there. A premature release could spell long term disaster for Flash, as it needs to compete with the rapidly expanding Open Source and Web Standards movement. We haven’t mentioned Microsoft’s entry into the web media space with its recently launched Silverlight platform, but until we stumble upon a site that actually uses it, it’s irrelevant.Although there are many who would like Flash to just go away, because it’s not open source, not free, and tends to be used to bombard us with annoying banner ads and horrible interface design models, Flash is not going away anytime soon. However, how Apple and Adobe navigate the uncharted territory of merging mobile and desktop user experiences along with multi-touch interfaces, will certainly determine the relevance of Flash in the years to come.

Footnotes

1. See Adobe statistics on Flash Player downloads.
2. See Roughly Drafted’s analysis.
3. See A List Apart’s analysis.
4. See Cabel Sasser’s Twitter which claims dibs on this observation.
5. See the profile of Walt Mossberg in the New Yorker.
6. Speculative, but based on reliable, but undisclosed interactions with Adobe. Also, see Bill Perry’s entry on the subject.

• Introduction↓
• Getting Started↓
• How to install NES Game ROMs↓
• How to get sound working in NES↓
• How to get PICO working in iPhone Remote Terminal↓
• How to change the SSH root password↓
• How to Remove (Uninstall) applications↓
• How to Find your iPhone’s IP Address↓

Introduction

This guide is written for Mac users who are not familiar with using UNIX, but are very interested in getting third-party applications installed into the Springboard home screen of their iPhone (not Safari web apps). There are several guides and wiki sites out there at the moment that detail this process. This guide has not yet been updated for firmware 1.1.1 and only applies to 1.0.2 and under until it is updated. In the meantime, iPhoneAlley offers one of the first step-by-step guides for the recently announced 1.1.1  third-party application installation technique. It is not meant for novices, but could  be what you’re looking for.

Since the original posting, installing native iPhone applications has become easier than ever, thanks to the amazing Nullriver software Installer. → It gives you a beautiful iPhone style multi-touch interface to install emerging 3rd party applications handling all the tricky stuff for you. Furthermore, it automatically checks for updates and makes sure you can keep up with the rapid pace of development. It is already clear that the Nullriver Installer is going to fuel the growth of this exploding scene.Nullriver has created AppTapp, a Mac and Windows graphical wizard← to get you started automated script that allows you to bypass all the instructions on this guide! You will need to issue a single command in Terminal, and so the gentle primer to using that below may no longer be required since this installer installer (I know, unfortunately, redundant, but true) handles everything and gets you started. An open source alternative to Nullriver Installer has emerged called Breezy that I’ll be testing a reviewing. Clearly, Nullriver is bound to be one of the first commercial (shareware) programs available for the native iPhone application market, eventually. Apparently, Nullriver and the PXL package development group are joining forces to bring aspects of open source to AppTapp.

This guide also addresses some of the most frequently asked questions that I’ve been seeing in the comments and threads. Most of them, I’ve also had myself at some point during this process. This guide is the result of working through these challenges, doing the research, trial-and-error. It may try your patience, but be reassured that it’s all very possible, and the hardest part is just getting set up. This guide relies on some of the excellent guides that have emerged at ModMyiPhone.com, but attempts to update, augment and clean up things.

Contributions

It is my hope that this helps out the iPhoneDevTeam by fulfilling the overwhelming need to teach so many new users basic UNIX and other tricks to get these mods working. Instead of wasting time teaching newbies the basics, these amazing folks can stay focused on delivering us amazing new tools to make the most of our beloved devices. Consider this my donation to the cause.

Disclaimer and Warning

If you run into problems during modding, such as losing sync capabilities with iTunes, you will need to go through the Restore process through iTunes, which should make your phone factory fresh, but you will lose your customizations. Hopefully, this guide will help you quickly rebuild your mods, in case that happens.Set aside several hours to go through everything in this guide. However, when you’re done, you will have a nice setup for enjoying third-party iPhone applications.

Of course, this guide is provided AS IS, and use it at your own risk. I do not condone, endorse or warrant any of the actions suggested here. You are advised that altering the software on your iPhone is consideration a violation of the legal agreement you enact with Apple, and hence, they will no longer be obligated to support you. This means that you will likely void your warranty.

Modding from iPhone 1.0.1 to 1.0.2

If you have made modifications prior to the iPhone 1.0.2 software update, it is strongly recommended that you:

1. Sync to iTunes to backup your settings
2. Choose “Download” instead of “Download and Install” when prompted to update your iPhone to 1.0.2
3. Run a restore process, which will reset your phone to factory settings. Then only things you should lose are your voicemail password and WiFi access point passwords. Everything else, including SMS and Notes should be restored and you’ll have iPhone 1.0.2
4. Re-sync to iTunes. Quit iTunes and then run the Nullriver Installer script (the included README file gets you going)
5. Install Launcher, through Installer on the iPhone
6. Proceed to install items such as BSD Subsystem and OpenSSH, and then you’ll be in good shape to get NES, Lights Off and many of the other great tools and programs emerging.

Getting Started

Refer to this handy Glossary by Erica Sadun to have some of the common terms of iPhone modding translated into plain language.

1. Get comfortable with Terminal

Open what’s called a UNIX shell by finding /Applications/Utilites/Terminal on your hard drive and practice using some basic commands. If you’ve used Terminal before, you can skip this step.You’ll need to issue lots of these commands during the process, so it’s worth understanding the relationship between the command-line actions and the equivalent familiar actions that is second nature when clicking around in the Finder.Try out these commands, hitting enter after each line. See if you can figure out what’s going on.

lscd /lscd /var/root/lscd ../../cd /usr/ls -lacd ~

cd means change directory. ls means list the files in the directory, with -la you get all the file information and show hidden files also. This is what’s happening behind the scenes when you click on icons and folders in the Finder. Note that ~ means your user’s home directory.Tip: If you’re ever lost in the Terminal file paths, you can always drag-and-drop a file from the Finder into the Terminal and it will convert the path for you.

2. Get started with iActivator

http://www.modmyiphone.com/wiki/index.php/Getting_Started_iPhone_ModdingFollow the detailed guide on this page, which includes download links. In this step, you’ll create a local “phonedmg” directory on your Mac’s user account, download the restore files from Apple, and go through the “jailbreak” process, which makes your iPhone writable. You’ll always need to go back to jail to make it work with iTunes. If you have any trouble with iActivator, or it suddenly becomes unavailable for download, you can perform a jailbreak in Terminal on the command-line.

3. Install iPHUC

http://www.modmyiphone.com/wiki/index.php/Installing_iPHUC_iPhoneThis process is complicated, requiring several programmer’s tools and libraries including XCode from Apple, the MacPorts open source kit and others. All of it is free and open source, and this tutorial does take you through each step very carefully. iPHUC is required to install SSH, which will allow you to copy and manage files on your iPhone much more elegantly. Luckily, you only have to go through this and the next step once. Seriously, this is the most elaborate step, but you’ll only have to go through it once.

4. Install SSH

http://www.modmyiphone.com/wiki/index.php/Installing_ssh_on_iPhone_using_iPHUC_in_OS_XFortunately, after completing this next step, you’ll be able to easily install a more robust version of SSH, with a better security setup, as you’ll create unique security keys for your device. In addition, it is strongly recommended that you change your root password after you’ve gotten things in order. This may help prevent an attack on your phone by a malicious program that looks for iPhones with SSH enabled on public WiFi networks. Be aware that by enabling SSH, you are making your device prone to malicious attacks by downloading software that may contain malware or worse. In other words, by enabling SSH, you open the possibility of allowing software to connect to servers behind the scenes. This could involve allowing your private data being sent to servers without your explicit knowledge, or worse. There were many reasons why Apple removed SSH from the iPhone’s UNIX system in the first place. But keep things in perspective — you probably have SSH enabled on your Mac right now and so you’ve been living with these risks all along. When you realize you can wirelessly connect to your iPhone from anywhere and transfer files and do other powerful things, you’ll appreciate the potential that you’ve unlocked.

5. Install Installer.app (aka AppTapp)

http://iphone.nullriver.com/beta/Note: Nullriver’s AppTapp no longer requires the manual command-line installation detailed below, instead offering a GUI wizard style installer for Mac and Windows. This installation occurs over the USB dock cable, so if would like to install over wireless.Once you install this, adding and updating software becomes very elegant and easy. However, the documentation for this is very poor, assuming you are already familiar installing programs manually. Unfortunately, this is probably the best app to install first if you’re a newbie! Here are detailed steps, assuming you have already completed the installation of iPHUC and SSH, above.

1. Download Installer.app ZIP file from Nullriver, unzip, and move into your local “phonedmg” folder with your usual drag-and-drop Finder interactions. Make this folder, if necessary: ~/phonedmg/Applications/
2. Shut down iTunes, and use Activity Monitor to quit iTunesHelper. (see iActivator guide for details, it should be familiar from step #2 above)
3. Open iActivator, and do a Jailbreak
4. Open Terminal on your Mac
5. Find your iPhone’s IP address↓: iPhone > Settings > WiFi > blue-arrow on current network > 10.0.1.4 (sample address)We’ll use the IP address 10.0.1.4 in this guide. Your IP will probably vary, so remember to replace it with yours each time you see in the code examples.
6. Type (replacing with your iPhone’s IP address)

ssh -l root 10.0.1.4

7. When prompted, enter default password (unless you’ve already changed it)

dottie

8. Type (hitting return after each line):

       cd /Applications    mkdir Installer.app    cd Installer.app    exit

9. Type:

       cd ~/phonedmg/Applications/Installer.app

10. Type: (replacing your IP address)

    scp * root@10.0.1.4:/Applications/Installer.app[password "dottie"]

11. Type: (replacing with your IP address)

        ssh -l root 10.0.1.4    [password "dottie"]    cd /Applications/Installer.app    chmod +x Installer    chmod +x ditto    exit

12. Hold down Sleep button and slide power off. Restart iPhone
13. The Installer widget icon should appear in the Springboard. Use it to install the available packages, especially, Launcher, BSD Subsystem and Open SSH. You’ll probably find dozens of interesting native applications to try, all of them constantly being updated and easily maintained with Installer.
14. You’ll always need to be jailbroken to allow Installer to write to the iPhone file system. Keep this in mind if you get any installation errors when using Installer.

How to install NES Game ROMs

Game ROMs are .nes files. Note: No one is going to tell you how to obtain these files. Learn about what ROMs are on NerveGas’s NES project page.

1. Make sure iPhone is jailbroken
2. Copy ROMs to ~/phonedmg/var/root/Media/ROMs/NES on your local drive. (Create directories if necessary)
3. Open Terminal and type (as always, replacing with your IP address):

        ssh -l root 10.0.1.4        [password "dottie"]        cd /var/root/Media        mkdir ROMs        cd ROMS        mkdir NES        exit        cd ~/phonedmg/var/root/Media/ROMs/NES        scp * root@10.0.1.4:/var/root/Media/ROMs/NES        [password "dottie"]

1. Restart iPhone, games should appear in NES

How to get sound working on NES

UPDATE September 1, 2007

Nervegas’ NES app no longer requires further hacking to get the sound to work as of its version 1.0 release, so you can disregard the tutorial below, as it is now obsolete.

Erica Utility Method — UPDATE August 26, 2007

If you install the Erica Utilities package with apptapp Installer from Nullriver, you already should have the command to disable and en-enabled the system sound, which allows the NES sound to work. You can also manually install the Erica command-line utilities if you don’t use apptapp. Use Mobile Terminal and type:

sound no

When you’re done playing NES, return to Mobile Terminal and re-enable the system sounds, so important things like calls will work:

sound yes

The program gives you textual confirmation of sound status. This new method is much easier than the old method

Manual Method

At the time of this writing, sound support was very glitchy, but may be improving with the rapid updates of NES.app thanks to the hard work of NerveGas. Although having sound is very appealing, if you have difficulties with this step, realize that it may not be worth the trouble.

1. Make sure iPhone is jailbroken
2. Create a text file in your local drive here: ~/phonedmg/var/root/.profileDon’t use TextEdit. Download TextWrangler or TextMate if you don’t have a true plain text editor.
3. Contents of .profile text file should be:

    # Aliases    alias pico='pico -w'    alias rm='rm -i'    alias ssh='ssh2'    alias nosound="launchctl unload /System/Library/LaunchDaemons/coreaudiod.plist"    alias sound="launchctl load /System/Library/LaunchDaemons/coreaudiod.plist"    # User specific environment    PATH=$PATH:/sbin:/usr/sbin

4. In Terminal:

       cd ~/phonedmg/var/root    scp .profile root@10.0.1.4:/var/root/.profile

5. Make sure ‘login’ is present in ‘/bin’

   cd /bincurl http://iphone.natetrue.com/login

6. Make sure you installed MobileTerminal with Installer by Nullriver
7. Restart iPhone, as needed. Unplug earbuds.
8. Open Terminal on iPhone and type:

   nosound

9. Go Home, and Launch NES. Sound should work.
10. When you’re done playing, dont’ forget to return to Terminal on iPhone and type:

sound

11. Regular sound functions should be restored

How to get pico (text editor) working on iPhone Remote Terminal:

pico is a very basic text editor that works in the Unix command line. Although it would be cool to be able to edit files in Mobile Terminal, this is actually more useful for the occasions when you have connected into your iPhone via SSH on your Mac Terminal and want to make an edit to a configuration file directly.I haven’t been able to get pico working on the Mobile Terminal, on the iPhone itself, but through an SSH session on your Mac it works well. It appears that it’s a problem with the Mobile Terminal application, rather than with the UNIX configurations. Recent updates to the Mobile Terminal native application suggest that we are very close to being able to enable pico on the iPhone directly. However, there will be tricky interface issues to contend with because the iPhone keyboard lacks essential things like arrow keys. Running on your Mac Terminal, however, is useful to cut out the step of editing the text file on your computer and then needing to copy it to the phone.

1. Make sure you’ve installed the BSD Subsystem, either with Installer.app, or manually. Using Nullriver’s Installer is by far the easiest way to get the BSD Subsystem, which in turn, help makes your iPhone work like a full-on computer.
2. Open Terminal, and type (replace with your iPhone’s IP address):

       ssh -l root 10.0.1.4    [password "dottie"]    mkdir /usr/share/terminfo    mkdir /usr/share/terminfo/76    exit    cd /usr/share/terminfo/76    scp vt100 root@10.0.1.4:/usr/share/terminfo/76/vt100    [password "dottie"]    ssh -l root 10.0.1.4    [password "dottie"]    csh    set term=vt100

How to change the SSH root password:

Since the root password “dottie” is now very public knowledge, it’s a security hazard to be walking around with SSH enabled on your iPhone, roaming around on public WiFi networks. You should change your root password once you’ve got the basics installed.

1. Visit this site to get your new root password encryptedhttp://iphone.simbunch.com/crypt.php
2. Make a backup of your original master password. In Mac Terminal, type:

   ssh -l root 10.0.1.4[password "dottie"]cp /etc/master.passwd /etc/master.passwd.bakexit

3. Optional: While you’re in there, consider changing your default shell to ‘bash’ from ’sh’ which will do a better job of honoring the changes to your .profile and other nice things. See this tutorial on the iPhoneDevWiki to change your default shell.
4. Copy the contents of the result of the password form on the above page into a new blank text file. Save it to your local drive at ~/phonedmg/etc/master.passwd
5. Upload it your iPhone. In Mac Terminal type:

       cd ~/phonedmg/etc    scp master.passwd root@10.0.1.4:/etc/master.passwd    [password "dottie"]

6. Restart your iPhone
7. In Mac Terminal, test the new password:

   ssh -l root 10.0.1.4

8. Enter your new password at prompt

How to Remove, (Uninstall) applications:

If you’ve installed a 3rd party application with Nullriver’s Installer, just use its Uninstall feature.If you need to uninstall by the command-line, follow this example where we’ll delete an installed application called Tetris.appThe trick is to go into the .app directory, and delete the files first, then go up, and delete the enclosing .app directory.

1. In Mac Terminal, SSH into your iPhone

       ssh -l root 10.0.1.4    [password]    cd /Applications/Tetris.app    rm *.*    cd ../    rmdir Tetris.app    exit

2. Restart iPhone. Application widget should be gone, no longer appearing on the Springboard.

How to Find your iPhone’s IP Address:

You need to be connected to a WiFi network.

1. At the Home screen…
2. Click Settings
3. Click WiFi
4. Click the blue arrow of the network you’re connected to
5. IP address is displayed

As companies embed full-fledged computers into consumer entertainment products, such as Sony PSP, Apple TV, and iPhone, and then proceed to lock them down to restrict their functionality in the name of stability and security, legions of enthusiasts heed the call to open them up again, to enjoy the computer hidden within.

At the time of this posting, iPhone Modding is very difficult for the inexperienced — not for the faint-of-heart or command-line averse. After a lot of trial-and-error and hours of research, we have installed some third-party standalone applications into the Spring Board (iPhone Home Screen). We can only assume that as modders enjoy more success, and more true third-party programs are written, more user-friendly applications will be released to streamline and simplify the process. That said, crude, but essential tools are starting to appear that allow a patient, persistent and somewhat fearless enthusiast to get started modding.

As you can see from the screenshot, the highlight of the modding is the installation of a Nintendo NES emulator which can put hundreds of games at your fingertips. Although, obtaining the game ROMs is of dubious legality, and the games lack sound and many have buggy graphics. The real lesson learned in this exercise is that there’s probably a very good reason why iPhone didn’t launch with any games — the multi-touch interface truly requires a comprehensive rethinking of game design and controls.

A Do-It-Yourself Work Ethic Required

Only recently, a step-by-step iPhone modification guide suitable for beginners→ emerged for getting started. Since, then, we’ve written our own guide← that consolidates and adds detail, especially for beginners. By far, most articles out there at the moment, assume you are familiar with UNIX and know about toolchains.→

At posting, the modding possibilities are nascent, including adding the following new applications and features into an iPhone:

• Custom ring tones
• Custom graphics and skins
• Screenshot tool →
• Sound recording application →
  
• Tetris →
• TicTacToe →
• Nintendo NES Emulator →

Where To Begin

The iFuntastic↓tool, while crude, is a good place to get started and become familiar with the Jailbreak process. → It’s helpful to install this first, as it does get you started with the ardous process of setting up the toolchain. Use iFuntastic to do simple, but high-impact modifications, such as alter the Spring Board (home screen), customize iPhone UI graphic files, and easily add custom ringtones. iFuntastic only supports Mac Intel machines at this time.

An essential alternative to iFuntastic is iActivator↓, which also peforms the Jailbreak process and manipulates the activation process, and works on Mac Intel and older PowerPC systems.

In addition, we figured out iphonedisk→, which mounts some parts of the iPhone file system as a network drive for easy drag-and-drop file installation.

But first, there are so many dependent programmer tools that must first be installed, including subversion and specialized iPhone modding tools like the unfortunately named iPHUC→. A decent guide for installing iPHUC→ is available.

The main key to gaining access to your iPhone is enabling SSH→, which allows secure command line access to the iPhone’s UNIX file system. However, this should be carefully considered, as enabling this feature certainly opens your iPhone up to future hackers who will now have a way into your handheld computer as you wander through open WiFi networks.

At the moment, the various executives at AT&T and Apple have nothing to worry about. This mod movement is restricted to the realm of enthusiasts. But it’s only a matter of time before refined GUI interfaces for iPhone customization and third-party application development and management emerge. Remember that modders got Windows to boot on the Mac Intel machines very quickly. Apple responded with Boot Camp offering native, official support to be offered in Mac OS X Leopard (10.5). It’s not a matter of if but when a truly open iPhone platform appears.

Doesn’t the iPhone look even better with a full set of buttons?

For the uninitiated, Processing→ is an open interactive media platform published on free software license via MIT by Casey Reas→ and Ben Fry→. Originally created as a learning tool, it is maturing through a Beta phase currently while winning tremendous support within the academic and design community. It appears to be emerging as the [tag]Sketchpad[/tag]↔ of the future. Sutherland→ would be so proud of his fellow alumni.

• Download Sample Chapters→ in PDF
• MIT Press→

For those in-the-know, this MIT Press release, Processing: A Programming Handbook for Visual Designers and Artists will be noticed on August 24, 2007. A substantial amount of the book is available in PDF format now. The free preview certainly suggests how tremendous and definitive this text is going to be. Take a peak at this inspiring passage from the introduction. It begins by describing the world view of Processing and the philosophy about software it epitomizes:

Software is a unique medium with unique qualities
Concepts and emotions that are not possible to express in other media may be expressed in this medium. Software requires its own terminology and discourse and should not be evaluated in relation to prior media such as film, photography, and painting. History shows that technologies such as oil paint, cameras, and film have changed artistic practice and discourse, and while we do not claim that new technologies improve art, we do feel they enable different forms of communication and expression. Software holds a unique position among artistic media because of its ability to produce dynamic forms, process gestures, define behavior, simulate natural systems, and integrate other media including sound, image, and text. (p. 1)

The introduction continues on to beautifully frame the pursuit of aesthetics through software. The free preview includes not only complete Table of Contents and Index, but also a very solid introduction to Processing and some of fundamental concepts. It’s enough material to function as an ideal free resource for getting started, while also leaves you thirsting for more.

Indeed, a more comprehensive review is forthcoming.

Adobe Integrated Runtime demonstrated by Big Spaceship.

This afternoon, Joshua Hirsch and Jamie Kosoy from Big Spaceship, here in Brooklyn, presented Building Adobe AIR Applications with Flash CS3 on the Adobe Connect presentation service. They did an excellent job of introducing the new capabilities of Adobe’s new desktop application delivery platform. In particular, they focused on how Flash CS3 can be used to compile AIR programs. Although still in Beta, AIR remains un-implemented in Flash CS3. The online seminar walked us through the tricky process of configuring for AIR development and introduce us to the command-line tools required to build and test AIR projects. However, Grant Skinner apparently has an extension set for Flash CS3 that assists with this process as we await Adobe’s full integration into the Publish Settings of Flash CS3. The links and notes of the presentation are posted here for reference. This post is likely to be updated and fleshed out as I process and try things out myself.

What is AIR?

AIR brings Flash and other web formats to desktop standalone applications. We should start to see more ‘downloadables’ once this catches on. Probably the best way to figure out AIR is to look at some examples on Adobe Labs→I’ve been a fan of kuler→ ever since I started following the Adobe Labs, and discovered Apollo, the codename for AIR. This is a great example of how being able to break out of the browser will encourage creative technology to engage with us more deeply.

Presentation Links

How to get started with AIR and Flash CS3

• Presentation Event Details
• About Adobe AIR
• AIR Developer FAQ
• Download AIR SDK
• Download FLEX Builder
• ActionScript 3.0 Language Reference
• Get the Flash Debug Player
• Get FlashTracer extension for Firefox
• Get Grant Skinner’s AIR Panel for CS3
• Big Spaceship’s Lab

Raw Notes from the Presentation

Here are the raw notes from the presentation. I’ll try to decipher them into more sense once I get my head around it all myself.

 airglobal.swc locations: MAC:    /Applications/Adobe Flex Builder 3/sdks/moxie/frameworks/libs/air/airglobal.swc PC:      Program Files/Adobe Flex Builder 3/sdks/moxie/frameworks/libs/air/airglobal.swc move and rename to MAC:    /Applications/Adobe Flash CS3/Configuration/ActionScript 3.0/Classes/playerglobal.swc PC:      Program Files/Adobe Flash CS3/Configuration/ActionScript 3.0/Classes/playerglobal.swc (you should make a backup of your old playerglobal.swc) AIR SDK: MAC:    Place all files in /Users/[you]/ PC:      Place files whereever you want. (I use c:AIR_SDK) Set environment variables: Right click "My Computer" Hit Properties. Go to the "Advanced" tab Click "Environment Variables" In "System Variables", under Path add path you put the sdk. If there is no Path var, you can add it. ADL syntax: adl myApp.xml Flash Tracer: After installing extension, Tools --> FlashTracer Click "Options" in the bottom right of the AddOn. PC Path MUST be: C:Documents and Settings[YOU]Application DataMacromediaFlash PlayerLogsflashlog.txt Mac Path MUST be: Hard Drive:Users:[YOU]:Library:Preferences:Macromedia:Flash Player:Logs:flashlog.txt If no Logs directory or flashlog.txt file is missing, you need to add them. ADT syntax: adt -package myAirFile.air myApp.xml foo.swf bar.swf icons videos etc