I had been using the following elisp to set my font in Emacs 23. However, it did not work when creating new frames with C-x 5 2.
(if (>= emacs-major-version 23)
(set-default-font "Monospace-11"))
Here is how I set the font for all frames:
(if (>= emacs-major-version 23)
(modify-all-frames-parameters
'((font . "Monospace-11"))))
See the documentation for modify-all-frames-parameters for more information.
I've been using Twisted's Perspective Broker to manage networking for my Python program. Perspective Broker allows me to run a Python program on a remote machine and perform remote method calls on an object in the Python program. It also allows me to serialize objects and transfer them over TCP.
Once I got a Perspective Broker server and client running, I wanted to create a "Twisted Application" and run it using twistd, the Twisted Daemon. Two major options are: creating a .tac file and creating a twistd plugin. Below, I show the steps I took to create a .tac application script and a twistd plugin using a simple Perspective Broker example.
Here is a simple Perspective Broker server and client example which I adapted from Twisted's examples page. The PB server code lives in pbsimpleserver.py:
from twisted.spread import pb
from twisted.internet import reactor
class Echoer(pb.Root):
def remote_echo(self, st):
print 'echoing:', st
return st
if __name__ == '__main__':
serverfactory = pb.PBServerFactory(Echoer())
reactor.listenTCP(8789, serverfactory)
reactor.run()
Here is a simple PB client, pbsimpleclient.py:
from twisted.spread import pb
from twisted.internet import reactor
class EchoClient(object):
def connect(self):
clientfactory = pb.PBClientFactory()
reactor.connectTCP("localhost", 8789, clientfactory)
d = clientfactory.getRootObject()
d.addCallback(self.send_msg)
def send_msg(self, result):
d = result.callRemote("echo", "hello network")
d.addCallback(self.get_msg)
def get_msg(self, result):
print "server echoed: ", result
if __name__ == '__main__':
EchoClient().connect()
reactor.run()
This code connects the client to the server using port 8789. It sends a message by calling the server's remote_echo method with an argument of "hello network". The server prints the message and returns the same message to the client. The client then prints the message.
To test the code, I ran both client and server on my local machine. I ran python pbsimpleserver.py in one terminal shell, then ran python pbsimpleclient.py in another shell. In the server shell, I got:
echoing: hello network
and in the client shell I got:
server echoed: hello network
To stop the client and server, I hit CTRL-C in both shells
To create a Twisted application, I used the twisted.application.service.Application object. When converting the example code above to an Application, I replaced twisted.internet.reactor.listenTCP with twisted.application.internet.TCPServer and twisted.internet.reactor.connectTCP with twisted.application.internet.TCPClient. Below is my server application, pbsimpleserver_app.py. (Note: the two files below are considered .tac files even though the filename doesn't end in .tac. From the documentation, .tac files are Python files which configure an Application object and assign this object to the top-level variable "application".)
from twisted.spread import pb
from twisted.application.internet import TCPServer
from twisted.application.service import Application
class Echoer(pb.Root):
def remote_echo(self, st):
print 'echoing:', st
return st
serverfactory = pb.PBServerFactory(Echoer())
application = Application("echo")
echoServerService = TCPServer(8789, serverfactory)
echoServerService.setServiceParent(application)
Here is my client application, pbsimpleclient_app.py:
from twisted.spread import pb
from twisted.application.internet import TCPClient
from twisted.application.service import Application
class EchoClient(object):
def send_msg(self, result):
d = result.callRemote("echo", "hello network")
d.addCallback(self.get_msg)
def get_msg(self, result):
print "server echoed: ", result
e = EchoClient()
clientfactory = pb.PBClientFactory()
d = clientfactory.getRootObject()
d.addCallback(e.send_msg)
application = Application("echo")
echoClientService = TCPClient("localhost", 8789, clientfactory)
echoClientService.setServiceParent(application)
To run these as daemons with twistd, I executed:
twistd -l server.log --pidfile server.pid -y pbsimpleserver_app.py
then:
twistd -l client.log --pidfile client.pid -y pbsimpleclient_app.py
This created the log file, server.log:
2008-10-27 00:08:35-0700 [-] Log opened. 2008-10-27 00:08:35-0700 [-] twistd 8.1.0 (/usr/bin/python 2.5.2) starting up 2008-10-27 00:08:35-0700 [-] reactor class:2008-10-27 00:08:35-0700 [-] twisted.spread.pb.PBServerFactory starting on 8789 2008-10-27 00:08:35-0700 [-] Starting factory 2008-10-27 00:08:53-0700 [Broker,0,127.0.0.1] echoing: hello network
and client.log:
2008-10-27 00:08:53-0700 [-] Log opened. 2008-10-27 00:08:53-0700 [-] twistd 8.1.0 (/usr/bin/python 2.5.2) starting up 2008-10-27 00:08:53-0700 [-] reactor class:2008-10-27 00:08:53-0700 [-] Starting factory 2008-10-27 00:08:53-0700 [Broker,client] server echoed: hello network
In order to pass command line arguments to my Twisted application daemon, I need to create a twistd plugin. The following is how I implemented my plugin after reading the Writing a twistd plugin documentation. Here is my directory structure. EchoProj is located in ~/Projects.
EchoProj
|-- echoproj
| |-- __init__.py
| |-- pbsimpleclient.py
| `-- pbsimpleserver.py
`-- twisted
`-- plugins
|-- echoclient_plugin.py
`-- echoserver_plugin.pypbsimpleserver.py:
from twisted.spread import pb
class EchoServer(pb.Root):
def remote_echo(self, st):
print 'echoing:', st
return st
pbsimpleclient.py:
class EchoClient(object):
def send_msg(self, result):
d = result.callRemote("echo", "hello network")
d.addCallback(self.get_msg)
def get_msg(self, result):
print "server echoed: ", result
echoserver_plugin.py:
from zope.interface import implements
from twisted.python import usage
from twisted.plugin import IPlugin
from twisted.application.service import IServiceMaker
from twisted.application.internet import TCPServer
from twisted.spread import pb
from echoproj.pbsimpleserver import EchoServer
class Options(usage.Options):
optParameters = [["port", "p", 8789, "The port number to listen on."]]
class MyServiceMaker(object):
implements(IServiceMaker, IPlugin)
tapname = "echoserver"
description = "Echo Server"
options = Options
def makeService(self, options):
serverfactory = pb.PBServerFactory(EchoServer())
return TCPServer(int(options["port"]), serverfactory)
serviceMaker = MyServiceMaker()
echoclient_plugin.py:
from zope.interface import implements
from twisted.python import usage
from twisted.plugin import IPlugin
from twisted.application.service import IServiceMaker
from twisted.application.internet import TCPClient
from twisted.spread import pb
from echoproj.pbsimpleclient import EchoClient
class Options(usage.Options):
optParameters = [["port", "p", 8789, "The port number to connect to."],
["host", "h", "localhost", "The host machine to connect to."]
]
class MyServiceMaker(object):
implements(IServiceMaker, IPlugin)
tapname = "echoclient"
description = "Echo Client"
options = Options
def makeService(self, options):
e = EchoClient()
clientfactory = pb.PBClientFactory()
d = clientfactory.getRootObject()
d.addCallback(e.send_msg)
return TCPClient(options["host"], int(options["port"]), clientfactory)
serviceMaker = MyServiceMaker()
I set the PYTHONPATH to include the top-level project directory:
export PYTHONPATH="$HOME/Projects/EchoProj:$PYTHONPATH"
Running twistd --help now showed "echoserver" and "echoclient" in the list of commands. To run my server and client as daemons using port 8790 on my local machine, I executed:
twistd -l server.log --pidfile server.pid echoserver -p 8790
and
twistd -l client.log --pidfile client.pid echoclient -p 8790
This produced the logfiles, server.log:
2008-10-27 11:49:12-0700 [-] Log opened. 2008-10-27 11:49:12-0700 [-] twistd 8.1.0 (/usr/bin/python 2.5.2) starting up 2008-10-27 11:49:12-0700 [-] reactor class:2008-10-27 11:49:12-0700 [-] twisted.spread.pb.PBServerFactory starting on 8790 2008-10-27 11:49:12-0700 [-] Starting factory 2008-10-27 11:49:17-0700 [Broker,0,127.0.0.1] echoing: hello network
and client.log:
2008-10-27 11:49:17-0700 [-] Log opened. 2008-10-27 11:49:17-0700 [-] twistd 8.1.0 (/usr/bin/python 2.5.2) starting up 2008-10-27 11:49:17-0700 [-] reactor class:2008-10-27 11:49:17-0700 [-] Starting factory 2008-10-27 11:49:17-0700 [Broker,client] server echoed: hello network
Despite the existence of the promising waitForDeferred/deferredGenerator and the newer inlineCallbacks, it appears there is no way to block while waiting for a Deferred. Brian Granger described the problem on the Twisted mailing list:
I have a function that returns a Deferred. I need to have the result of this Deferred returned in a (apparently) blocking/synchronous manner:glyph provided the succinct answer (as well as an interesting commentary on using Twisted the wrong way).def myfuncBlocking(): d = myfuncReturnsDeferred() ... result = return resultI need to be able to call this function like:result = myfuncBlocking()The question is how to get the result out of the Deferred() and make it *look* like myfuncBlocking() has blocked.
This issue has been discussed repeatedly - long story short, it's just a bad idea.
Hmmm, maybe learning Twisted will be harder than I thought.
Update 2008-10-20: Marcin Kasperski wrote a good example comparing raw deferreds, deferred generators, and inline callbacks.
Twisted is pretty cool-- it is very powerful, but I haven't had the easiest time learning it. Here is a simple example that runs a couple functions periodically (at different rates) using LoopingCall.
For more information, here are the Twisted docs for LoopingCall.
from datetime import datetime
from twisted.internet.task import LoopingCall
from twisted.internet import reactor
def hyper_task():
print "I like to run fast", datetime.now()
def tired_task():
print "I want to run slowly", datetime.now()
lc = LoopingCall(hyper_task)
lc.start(0.1)
lc2 = LoopingCall(tired_task)
lc2.start(0.5)
reactor.run()
Results:
I like to run fast 2008-10-14 15:51:02.449537 I want to run slowly 2008-10-14 15:51:02.449915 I like to run fast 2008-10-14 15:51:02.551972 I like to run fast 2008-10-14 15:51:02.652013 I like to run fast 2008-10-14 15:51:02.752006 I like to run fast 2008-10-14 15:51:02.852008 I like to run fast 2008-10-14 15:51:02.952487 I want to run slowly 2008-10-14 15:51:02.952681 I like to run fast 2008-10-14 15:51:03.052012 I like to run fast 2008-10-14 15:51:03.152012 I like to run fast 2008-10-14 15:51:03.252010 I like to run fast 2008-10-14 15:51:03.352009 I like to run fast 2008-10-14 15:51:03.452008 I want to run slowly 2008-10-14 15:51:03.452206 I like to run fast 2008-10-14 15:51:03.552009 I like to run fast 2008-10-14 15:51:03.652013
To create a daemon with twistd that achieves the same effect, use TimerService. TimerService runs LoopingCall under the hood. It is meant to be used with the Twisted Application infrastructure. See also the documentation on TimerService.
timerservice_ex.py
from datetime import datetime
from twisted.application import service
from twisted.application.internet import TimerService
def tired_task():
print "I want to run slowly", datetime.now()
application = service.Application("myapp")
ts = TimerService(0.5, tired_task)
ts.setServiceParent(application)
Run it:
$ twistd -y timerservice_ex.py
Console output is stored in twistd.log:
2010-09-20 18:53:50-0700 [-] Log opened. 2010-09-20 18:53:50-0700 [-] using set_wakeup_fd 2010-09-20 18:53:50-0700 [-] twistd 10.1.0 (/home/saltycrane/.virtualenvs/default/bin/python 2.6.5) starting up. 2010-09-20 18:53:50-0700 [-] reactor class: twisted.internet.selectreactor.SelectReactor. 2010-09-20 18:53:50-0700 [-] I want to run slowly 2010-09-20 18:53:50.896477 2010-09-20 18:53:51-0700 [-] I want to run slowly 2010-09-20 18:53:51.397043 2010-09-20 18:53:51-0700 [-] I want to run slowly 2010-09-20 18:53:51.897087 2010-09-20 18:53:52-0700 [-] I want to run slowly 2010-09-20 18:53:52.397047 2010-09-20 18:53:52-0700 [-] I want to run slowly 2010-09-20 18:53:52.897068 2010-09-20 18:53:53-0700 [-] I want to run slowly 2010-09-20 18:53:53.397073 2010-09-20 18:53:53-0700 [-] I want to run slowly 2010-09-20 18:53:53.897032 2010-09-20 18:53:54-0700 [-] I want to run slowly 2010-09-20 18:53:54.397083
Nikolay pointed me at beanstalkd, a lightweight, message queue service partially inspired by the popular caching system, memcached. It features a blocking "reserve" call so workers don't need to poll for new jobs. However, some might miss the data persistence since the queue is stored in memory. beanstalkd has client libraries in Erlang, Perl, PHP, Python, and Ruby. Of course, I will use the Python version, pybeanstalk. Simon Willison also found beanstalkd interesting. (Credit to him for some of the words above.)
Update 2008-10-13: For a helpful example on using beanstalkd and pybeanstalk see Parand's beanstalkd tutorial.
Here is how I installed the beanstalkd server and pybeanstalk client on Ubuntu. I found no Ubuntu package for beanstalkd, so I installed from source.
$ sudo apt-get install libevent1 libevent-dev
$ cd ~/lib $ wget http://xph.us/software/beanstalkd/rel/beanstalkd-1.0.tar.gz
$ tar zxvf beanstalkd-1.0.tar.gz
$ cd beanstalkd-1.0 $ make
$ ./beanstalkd -h
$ wget http://pyyaml.org/download/pyyaml/PyYAML-3.06.tar.gz
$ tar zxvf PyYAML-3.06.tar.gz
PyYAML-3.06/lib/yaml somewhere on your Python path or run python setup.py.$ wget http://pybeanstalk.googlecode.com/files/pybeanstalk-0.11.1.tar.gz
$ tar zxvf pybeanstalk-0.11.1.tar.gz
pybeanstalk-0.11.1/beanstalk somewhere on your Python path or run python setup.py$ ~/lib/beanstalkd-1.0/beanstalkd -d -l 127.0.0.5 -p 11300
from beanstalk import serverconn
from beanstalk import job
SERVER = '127.0.0.5'
PORT = 11300
# setup connection
connection = serverconn.ServerConn(SERVER, PORT)
connection.job = job.Job
# produce data
for i in range(5):
print 'put data: %d' % i
data = job.Job(data=str(i), conn=connection)
data.Queue()
# consume data
while True:
j = connection.reserve()
print 'got data: %s' % j.data
j.Finish()
put data: 0 put data: 1 put data: 2 put data: 3 put data: 4 got data: 0 got data: 1 got data: 2 got data: 3 got data: 4
Python 2.6 was released yesterday! This version aims to smooth the transition from Python 2.5 to Python 3.0 which is planned for release soon (currently available as a release candidate). Python 3.0 will be break backwards compatibility with the 2.x series. Python 2.6 is backwards compatible with 2.5. All the backwards compatible features of 3.0 have been backported to 2.6.
One of the new 2.6 features I'm particularly intersted in is the new multiprocessing module which has a similar interface to the threading module, but it uses processes instead of threads. This avoids the limitations imposed by the Global Interpreter Lock in a multi-threaded Python program. Yet it still has the nice communications and management features like Pipe()s, Queues, Pools, etc. I didn't plan to focus so much on the multiprocessing module in this post-- I just want to document my install notes on Ubuntu Linux. For all the new features in 2.6 see What's New in Python 2.6. (It is a long list).
$ cd incoming $ wget http://www.python.org/ftp/python/2.6/Python-2.6.tgz
$ tar zxvf Python-2.6.tgz
~/incoming/Python-2.6/README$ sudo apt-get install build-essential $ sudo apt-get install libncursesw5-dev $ sudo apt-get install libreadline5-dev $ sudo apt-get install libssl-dev $ sudo apt-get install libgdbm-dev $ sudo apt-get install libbz2-dev $ sudo apt-get install libc6-dev $ sudo apt-get install libsqlite3-dev $ sudo apt-get install tk-dev
~/lib/python2.6.$ cd Python-2.6 $ ./configure --prefix=/home/sofeng/lib/python2.6
$ makeNote I got the following message:
Failed to find the necessary bits to build these modules: bsddb185 sunaudiodev To find the necessary bits, look in setup.py in detect_modules() for the module's name.I was not able to find the Ubuntu packages for these.
$ ./python
Python 2.6 (r26:66714, Oct 2 2008, 15:32:46) [GCC 4.2.3 (Ubuntu 4.2.3-2ubuntu7)] on linux2 Type "help", "copyright", "credits" or "license" for more information. >>>
$ make testI got the following status:
327 tests OK.
33 tests skipped:
test_aepack test_al test_applesingle test_bsddb185 test_bsddb3
test_cd test_cl test_codecmaps_cn test_codecmaps_hk
test_codecmaps_jp test_codecmaps_kr test_codecmaps_tw test_curses
test_gl test_imgfile test_kqueue test_linuxaudiodev test_macos
test_macostools test_normalization test_ossaudiodev test_pep277
test_py3kwarn test_scriptpackages test_socketserver test_startfile
test_sunaudiodev test_timeout test_urllib2net test_urllibnet
test_winreg test_winsound test_zipfile64
Those skips are all expected on linux2.$ make install
~/lib/python/bin/python2.6 to my PATHThe first time I ran, I got this message:
Failed to find the necessary bits to build these modules: _hashlib _ssl bsddb185 bz2 gdbm readline sunaudiodev To find the necessary bits, look in setup.py in detect_modules() for the module's name.
I think I found Ubuntu packages for some of them:
I have been using the emacs-snapshot package in Ubuntu Hardy. However, when I tried to use Tramp, I got an error message: Variable binding depth exceeds max-specpdl-size. I couldn't find out how to fix this, and I didn't want to use Emacs 22.3 because it doesn't have Xft (anti-aliased fonts), so I decided to live on the bleeding edge and install Emacs 23 from CVS. Besides the INSTALL and INSTALL.CVS files, I also used theBlackDragon's article for reference.
Update 2008-10-09: I just found that Romain Francoise maintains an emacs-snapshot Debian package and it has been adapted for Ubuntu. This is an alternative to installing from source.
Update 2010-01-09: Since Emacs has switched from CVS to Bazaar, I've updated these instructions to use Bazaar. Also, I'm now running on Ubuntu 9.10 Karmic Koala instead of Ubuntu Hardy.
Update 2012-09-19: Here are some additional Ubuntu 12.04 packages I needed to install Emacs 24.2.
$ sudo apt-get install libgif-dev
$ sudo apt-get install libtiff4-dev
$ sudo apt-get install xaw3dg-dev
$ sudo apt-get install librsvg2-dev
$ sudo apt-get install libmagick++-dev
$ sudo apt-get install libgpm-dev
$ sudo apt-get install libgconf2-dev
$ sudo apt-get install libselinux1-dev
$ sudo apt-get install libm17n-dev
$ sudo apt-get install libotf-dev
$ sudo apt-get install bzr
$ cd ~/incoming
$ bzr branch http://bzr.savannah.gnu.org/r/emacs/trunk emacs_trunk
Read the INSTALL and INSTALL.BZR files in ~/incoming/emacs_trunk
$ sudo apt-get install build-essential
$ sudo apt-get build-dep emacs23
To see what is installed by build-dep, see the emacs23 karmic package page
--prefix=/home/saltycrane/lib/emacs-bzr-20100210 means I am installing Emacs in /home/saltycrane/lib/emacs-bzr-20100210.$ cd ~/incoming/emacs_trunk
$ ./configure --prefix=/home/saltycrane/lib/emacs-bzr-20100210
make bootstrap instead of make because some files, such as byte-compiled lisp files are not stored in Bazaar. Note, this takes a long time (over 10 min for me).$ make bootstrap
$ make
$ src/emacs -q
$ make install
PATH)$ ln -s ~/lib/emacs-bzr-20100210 ~/lib/emacs
$ cd ~/bin
$ ln -s ../lib/emacs/bin/* .
Alternatively, I could add ~/lib/emacs-bzr-20100210/bin to my PATH.
Now I have "Pretty Emacs" with working Tramp for remote file access. It also has multi-tty support which is supposed to be very cool (but I haven't tried it yet) is very cool (e.g. for displaying my running desktop emacs process on my Android phone.)
configure: error: You do not seem to have makeinfo >= 4.6, and your
source tree does not seem to have pre-built manuals in the `info' directory.
Either install a suitable version of makeinfo, or re-run configure
with the `--without-makeinfo' option to build without the manuals.
$ sudo apt-get install texinfo
configure: error: The following required libraries were not found:
libjpeg libgif/libungif libtiff
Maybe some development libraries/packages are missing?
If you don't want to link with them give
--with-jpeg=no --with-gif=no --with-tiff=no
as options to configure
$ sudo apt-get install libjpeg-dev libgif-dev libtiff4-dev
Warning: arch-dependent data dir (/home/saltycrane/lib/emacs-bzr/libexec/emacs/23.1.92/i686-pc-linux-gnu/) does not exist.
Warning: Lisp directory `/home/saltycrane/lib/emacs-bzr/share/emacs/23.1.92/site-lisp' does not exist.
Warning: Lisp directory `/home/saltycrane/lib/emacs-bzr/share/emacs/site-lisp' does not exist.
Warning: Lisp directory `/home/saltycrane/lib/emacs-bzr/share/emacs/23.1.92/lisp' does not exist.
Warning: Lisp directory `/home/saltycrane/lib/emacs-bzr/share/emacs/23.1.92/leim' does not exist.
Warning: Could not find simple.el nor simple.elc
This happened because I originally used ./configure --prefix=/home/saltycrane/lib/emacs-bzr and then renamed ~/lib/emacs-bzr to ~/lib/emacs-bzr-20100210. Solution: don't rename the directory.
I found out about Fabric via Armin Ronacher's article Deploying Python Web Applications. Fabric is a Capistrano inspired deployment tool for the Python community. It is very simple to use. There are 4 main commands: local is almost like os.system because it runs a command on the local machine, run and sudo run a command on a remote machine as either a normal user or as root, and put transfers a file to a remote machine.
Here is a sample setup which displays information about the Apache processes on my remote EC2 instance.
$ sudo easy_install Fabric
fabfile.py located at ~/myprojectdef ec2():
set(fab_hosts = ['ec2-65-234-55-183.compute-1.amazonaws.com'],
fab_user = 'sofeng',
fab_password = 'mypassword',)
def ps_apache():
run("ps -e -O rss,pcpu | grep apache")
$ cd ~/myproject $ fab ec2 ps_apacheResults:
Fabric v. 0.0.9, Copyright (C) 2008 Christian Vest Hansen.
Fabric comes with ABSOLUTELY NO WARRANTY; for details type `fab warranty'.
This is free software, and you are welcome to redistribute it
under certain conditions; type `fab license' for details.
Running ec2...
Running ps_apache...
Logging into the following hosts as sofeng:
ec2-65-234-55-183.compute-1.amazonaws.com
[ec2-65-234-55-183.compute-1.amazonaws.com] run: ps -e -O rss,pcpu | grep apache
[ec2-65-234-55-183.compute-1.amazonaws.com] out: 2163 5504 0.0 S ? 00:00:00 /usr/sbin/apache2 -k start
[ec2-65-234-55-183.compute-1.amazonaws.com] out: 2520 15812 0.0 S ? 00:00:00 /usr/sbin/apache2 -k start
[ec2-65-234-55-183.compute-1.amazonaws.com] out: 2521 3664 0.0 S ? 00:00:00 /usr/sbin/apache2 -k start
[ec2-65-234-55-183.compute-1.amazonaws.com] out: 2522 3664 0.0 S ? 00:00:00 /usr/sbin/apache2 -k start
[ec2-65-234-55-183.compute-1.amazonaws.com] out: 2523 3664 0.0 S ? 00:00:00 /usr/sbin/apache2 -k start
[ec2-65-234-55-183.compute-1.amazonaws.com] out: 2524 3664 0.0 S ? 00:00:00 /usr/sbin/apache2 -k start
[ec2-65-234-55-183.compute-1.amazonaws.com] out: 2619 3664 0.0 S ? 00:00:00 /usr/sbin/apache2 -k start
[ec2-65-234-55-183.compute-1.amazonaws.com] out: 2629 1204 0.0 R ? 00:00:00 /bin/bash -l -c ps -e -O rss,pcpu | grep apache
Done.Note: A X.509 Certificate is one type of Access Identifier. Access Identifiers are used to "identify yourself as the sender of a request to an AWS web service". There are two types of access identifiers: AWS Access Key Identifiers and X.509 Certificates. AWS Access Key Identifiers are supported by all Amazon Web Services and X.509 Certificates are supported only by Amazon's EC2 and SQS services (see here for the chart). However, for some reason, the popular Java command line tools for EC2 only support X.509 Certificates (and not AWS Access Key Identifiers).
~/.ec2. (The private key file will be named something like pk-XXXXXXXXXXXXXXXXXXXXXX.pem and the X.509 Certificate file will be named something like cert-XXXXXXXXXXXXXXXXXXXXXX.pem.)The command line tools require Java version 5 or later. Only the JRE is required.
$ sudo apt-get install sun-java6-jre
~/lib$ unzip ec2-api-tools.zip mv ec2-api-tools-1.3-24159 ~/lib
~/.bashrc (or wherever you set your environment variables).export EC2_HOME=$HOME/lib/ec2-api-tools-1.3-24159 export JAVA_HOME=/usr export EC2_PRIVATE_KEY=$HOME/.ec2/pk-XXXXXXXXXXXXXXXXXXXX.pem export EC2_CERT=$HOME/.ec2/cert-XXXXXXXXXXXXXXXXXXXX.pem export PATH=$PATH:$EC2_HOME/bin
.bashrc or whichever file you used$ source ~/.bashrc
ec2-describe-images command to verify everything is working. It should list all the Ubuntu 8.xx images from Alestic.$ ec2-describe-images -a | grep alestic/ubuntu-8Results:
IMAGE ami-3a7c9953 alestic/ubuntu-8.04-hardy-base-20080419.manifest.xml 063491364108 available public i386 machine aki-a71cf9ce ari-a51cf9cc IMAGE ami-75789d1c alestic/ubuntu-8.04-hardy-base-20080424.manifest.xml 063491364108 available public i386 machine aki-a71cf9ce ari-a51cf9cc IMAGE ami-ce44a1a7 alestic/ubuntu-8.04-hardy-base-20080430.manifest.xml 063491364108 available public i386 machine aki-a71cf9ce ari-a51cf9cc IMAGE ami-2048ad49 alestic/ubuntu-8.04-hardy-base-20080514.manifest.xml 063491364108 available public i386 machine aki-a71cf9ce ari-a51cf9cc IMAGE ami-6a57b203 alestic/ubuntu-8.04-hardy-base-20080517.manifest.xml 063491364108 available public i386 machine aki-a71cf9ce ari-a51cf9cc IMAGE ami-26bc584f alestic/ubuntu-8.04-hardy-base-20080628.manifest.xml 063491364108 available public i386 machine aki-a71cf9ce ari-a51cf9cc IMAGE ami-179e7a7e alestic/ubuntu-8.04-hardy-base-20080803.manifest.xml 063491364108 available public i386 machine aki-a71cf9ce ari-a51cf9cc IMAGE ami-c0fa1ea9 alestic/ubuntu-8.04-hardy-base-20080905.manifest.xml 063491364108 available public i386 machine aki-a71cf9ce ari-a51cf9cc IMAGE ami-38d43051 alestic/ubuntu-8.04-hardy-base-20080922.manifest.xml 063491364108 available public i386 machine aki-a71cf9ce ari-a51cf9cc IMAGE ami-1cd73375 alestic/ubuntu-8.04-hardy-base-20080924.manifest.xml 063491364108 available public i386 machine aki-a71cf9ce ari-a51cf9cc IMAGE ami-337c995a alestic/ubuntu-8.04-hardy-desktop-20080419.manifest.xml 063491364108 available public i386 machine aki-a71cf9ce ari-a51cf9cc IMAGE ami-4f789d26 alestic/ubuntu-8.04-hardy-desktop-20080424.manifest.xml 063491364108 available public i386 machine aki-a71cf9ce ari-a51cf9cc IMAGE ami-f744a19e alestic/ubuntu-8.04-hardy-desktop-20080430.manifest.xml 063491364108 available public i386 machine aki-a71cf9ce ari-a51cf9cc IMAGE ami-1f4bae76 alestic/ubuntu-8.04-hardy-desktop-20080514.manifest.xml 063491364108 available public i386 machine aki-a71cf9ce ari-a51cf9cc IMAGE ami-0e57b267 alestic/ubuntu-8.04-hardy-desktop-20080517.manifest.xml 063491364108 available public i386 machine aki-a71cf9ce ari-a51cf9cc IMAGE ami-b5bc58dc alestic/ubuntu-8.04-hardy-desktop-20080628.manifest.xml 063491364108 available public i386 machine aki-a71cf9ce ari-a51cf9cc IMAGE ami-f39e7a9a alestic/ubuntu-8.04-hardy-desktop-20080803.manifest.xml 063491364108 available public i386 machine aki-a71cf9ce ari-a51cf9cc IMAGE ami-44c4202d alestic/ubuntu-8.04-hardy-desktop-20080905.manifest.xml 063491364108 available public i386 machine aki-a71cf9ce ari-a51cf9cc IMAGE ami-f7d4309e alestic/ubuntu-8.04-hardy-desktop-20080922.manifest.xml 063491364108 available public i386 machine aki-a71cf9ce ari-a51cf9cc IMAGE ami-88d733e1 alestic/ubuntu-8.04-hardy-desktop-20080924.manifest.xml 063491364108 available public i386 machine aki-a71cf9ce ari-a51cf9cc IMAGE ami-bcbe5ad5 alestic/ubuntu-8.04-hardy-rightscale-20080701.manifest.xml 063491364108 available public i386 machine aki-a71cf9ce ari-a51cf9cc IMAGE ami-27b95d4e alestic/ubuntu-8.04-hardy-rightscale-20080703.manifest.xml 063491364108 available public i386 machine aki-a71cf9ce ari-a51cf9cc IMAGE ami-b1ea0ed8 alestic/ubuntu-8.04-hardy-rightscale-20080824.manifest.xml 063491364108 available public i386 machine aki-a71cf9ce ari-a51cf9cc IMAGE ami-47c4202e alestic/ubuntu-8.04-hardy-rightscale-20080905.manifest.xml 063491364108 available public i386 machine aki-a71cf9ce ari-a51cf9cc IMAGE ami-f4d4309d alestic/ubuntu-8.04-hardy-rightscale-20080922.manifest.xml 063491364108 available public i386 machine aki-a71cf9ce ari-a51cf9cc IMAGE ami-89d733e0 alestic/ubuntu-8.04-hardy-rightscale-20080924.manifest.xml 063491364108 available public i386 machine aki-a71cf9ce ari-a51cf9cc IMAGE ami-dcbc58b5 alestic/ubuntu-8.10-intrepid-base-20080628.manifest.xml 063491364108 available public i386 machine aki-a71cf9ce ari-a51cf9cc IMAGE ami-db9e7ab2 alestic/ubuntu-8.10-intrepid-base-20080804.manifest.xml 063491364108 available public i386 machine aki-a71cf9ce ari-a51cf9cc IMAGE ami-9de105f4 alestic/ubuntu-8.10-intrepid-base-20080814.manifest.xml 063491364108 available public i386 machine aki-a71cf9ce ari-a51cf9cc IMAGE ami-c3fa1eaa alestic/ubuntu-8.10-intrepid-base-20080905.manifest.xml 063491364108 available public i386 machine aki-a71cf9ce ari-a51cf9cc IMAGE ami-3bd43052 alestic/ubuntu-8.10-intrepid-base-20080922.manifest.xml 063491364108 available public i386 machine aki-a71cf9ce ari-a51cf9cc IMAGE ami-1ad73373 alestic/ubuntu-8.10-intrepid-base-20080924.manifest.xml 063491364108 available public i386 machine aki-a71cf9ce ari-a51cf9cc IMAGE ami-b6bc58df alestic/ubuntu-8.10-intrepid-desktop-20080628.manifest.xml 063491364108 available public i386 machine aki-a71cf9ce ari-a51cf9cc IMAGE ami-d69e7abf alestic/ubuntu-8.10-intrepid-desktop-20080804.manifest.xml 063491364108 available public i386 machine aki-a71cf9ce ari-a51cf9cc IMAGE ami-d4e206bd alestic/ubuntu-8.10-intrepid-desktop-20080815.manifest.xml 063491364108 available public i386 machine aki-a71cf9ce ari-a51cf9cc IMAGE ami-7dc22614 alestic/ubuntu-8.10-intrepid-desktop-20080908.manifest.xml 063491364108 available public i386 machine aki-a71cf9ce ari-a51cf9cc IMAGE ami-f5d4309c alestic/ubuntu-8.10-intrepid-desktop-20080922.manifest.xml 063491364108 available public i386 machine aki-a71cf9ce ari-a51cf9cc IMAGE ami-b6d733df alestic/ubuntu-8.10-intrepid-desktop-20080924.manifest.xml 063491364108 available public i386 machine aki-a71cf9ce ari-a51cf9cc
In the second step, I generated a keypair as my X.509 Certificate. That was used to identifiy myself to Amazon Web Services. Now I need to create another keypair which is used to log into a running EC2 instance. (Note, there is exactly one X.509 Certificate per user (i.e. AWS account), but a user can have many keypairs used for logging into various EC2 instances.) See also the Generating a keypair section in the Getting Started Guide.
disco-keypair because I will use this keypair with EC2 instances used to try out Disco.$ ec2-add-keypair disco-keypair > ~/.ec2/id_rsa-disco-keypair
chmod 600 ~/.ec2/id_rsa-disco-keypair
alestic/ubuntu-8.04-hardy-base-20080924 image with image ID ami-1cd73375.$ ec2-run-instances -k disco-keypair ami-1cd73375It should return something like:
RESERVATION r-568f5d3f 719606167433 default INSTANCE i-339f3c5a ami-1cd73375 pending disco-keypair 0 m1.small 2008-09-28T00:50:35+0000 us-east-1c aki-a71cf9ce ari-a51cf9cc
$ ec2-describe-instancesAfter a short period of time, it should return something like:
RESERVATION r-568f5d3f 719606167433 default INSTANCE i-339f3c5a ami-1cd73375 ec2-75-101-200-13.compute-1.amazonaws.com ip-10-251-30-10.ec2.internal running disco-keypair 0 m1.small 2008-09-28T00:50:35+0000us-east-1c aki-a71cf9ce ari-a51cf9ccNote the address
ec2-75-101-200-13.compute-1.amazonaws.com. This is the external address used to connect to the instance. Also note the instance ID i-339f3c5a. This is needed to terminate the instance.$ ec2-authorize default -p 22
GROUP default
PERMISSION default ALLOWS tcp 22 22 FROM CIDR 0.0.0.0/0$ ec2-authorize default -p 80 GROUP default PERMISSION default ALLOWS tcp 80 80 FROM CIDR 0.0.0.0/0
$ ssh -i ~/.ec2/id_rsa-disco-keypair -l root ec2-75-101-200-13.compute-1.amazonaws.com
$ ec2-terminate-instance i-339f3c5awhich returns:
INSTANCE i-339f3c5a running shutting-down
ec2-describe-instances shows that the instance is terminated.$ ec2-describe-instances RESERVATION r-568f5d3f 719606167433 default INSTANCE i-339f3c5a ami-1cd73375 terminated disco-keypair 0 m1.small 2008-09-28T00:50:35+0000 aki-a71cf9ce ari-a51cf9cc
