Search Results: "ag"

19 January 2008

David Nusinow: On Visualizing Biological Data

The following is a brain dump of some of the things I've been thinking about lately.

One of the biggest changes over the past several years in biology has been the incredible deluge of information. In response to this there's been a rise in bioinformatics to cope with all this. While this has led to some major successes, where it's failed is in its ability to impart a greater understanding of the subject at hand. Biologists still learn primarily from reading papers, the same way we always have. There are massive databases full of wonderful information but most of it is encoded with minimal or no context so you're always forced to go back to the papers to understand what the database is actually telling you. In that sense, these databases are fantastic at indexing information, but very poor at organizing it in such a way as to teach people about the topic at hand. We're still forced to slog through papers for just about everything.

What's striking about this is that the most informative bits in any biological paper I've ever read are encapsulated in the figures. The images themselves, provided you have sufficient background knowledge, show the basic data and give you the most understanding for the smallest investment of time. You can skim an article's abstract, it's figures and figure legends and gain a fair understanding of the topic before deciding whether or not to go further.

Now, there's a contradiction of sorts here. Many of these figures are generated via computers, usually an excel-made graph. The rest are actual photographs of things, such as blots, gels, or stained tissues, eventually inserted and processed via the computer. The contradiction is that the computer is used intensively to organize this data for publication, but we have a hard time extracting the essence of that visualization for indexing in "big picture" sorts of ways. That almost always has to be done by hand (and brain) by the biologist. This, of course, is suboptimal when you have thousands of individual genes.

The fundamental reason for all of this is that biological information depends wholly on context. For example, you can sequence the whole genome, but it's totally unclear what genes will be expressed at any given time unless you have much more information about the cell type, developmental stage, pathologies, and so forth. As far as I can see, all our bioinformatics tools have failed completely at providing any sort of context for their information. A common thing to see is so-called "wiring diagrams" that display molecular interactions. These diagrams are full of nodes and edges and it looks almost impossible to understand such things. While there is a great deal of complexity, contextual information provides us with a framework to understand what's actually working. Looking at these diagrams, there's no sense of this though, it looks instead like complexity overrun.

So that presents us with the challenge for the future. What's required of bioinformatics is to not only index the raw data, but also the context, and then present the data to us in a context-dependent manner. I am convinced that the key to presenting data this way is to come up with novel visualization methods because it's the visualizations in the papers that we use today to get the most out of our time. I believe that this problem is tractable and that there is a solution. More than likely we'll need several solutions, and I look forward to seeing them develop.

Neil Williams: Debian Lenny on amd64 HP Pavilion dv6000 (dv6615ea)

Working!
I've decided to replace the previous post rather than leave it in place when there is a solution available.
Fixing the problem
I've been considering a new laptop for weeks - mainly to get more RAM, more space but without adding to the actual size of the machine (or weight). I know, I should have taken more time over the selection, I should have found out more about the hardware, etc.etc.
I've ended up with an HP Pavilion dv6000 (dv6615ea) for the 2Gb RAM, 15inch screen, 250Gb hard drive to replace my ageing iBook 12inch with 128Mb RAM and 30Gb hard drive - all for barely an inch extra depth and very similar weight (and it was cheaper than the original price of the iBook). I thought I'd made a good choice. Yes, it was "NVidia Graphics" according to the sticker and yes, I could have spent more time (and money) finding a pre-installed lappy but I was hasty. (Much the same way as you should never go food shopping whilst hungry). I've managed with NVidia graphics before without using the horrid proprietary rubbish and I was prepared to put up with less-than-perfect graphics (I never use 3D anyway) because the free driver is at least stable with the graphics that I actually need.
Updated
The ethernet card is not recognised by the Debian Etch installer - after a comment placed on this blog after my original post, I tried the Lenny installer for amd64 with signficant success. Selecting the vesa driver for the graphics provided a usable X setup (1024x768). I've still spent a lot more time on this than it should really have required but I do now have a genuine amd64 Debian installation with GNOME. The only thing not working is wireless (oh and sound). The wireless appears to be a bcm43xx issue - the driver appears to let the card work (the orange light turns blue) and the device is created but scanning fails.
I'm probably still going to have to leave this new lappy behind and take my existing iBook to Fosdem in a few weeks, but I'm now happier with HP in general.
I'll try to post a longer review somewhere soon.
So, thanks for the tip, Julian!

Neil Williams: Blaming HP for a laptop problem

The problems are now fixed, thanks to a tip from Julian.
See Debian Lenny on amd64 HP Pavilion dv6000 (dv6615ea).
Julian notes that HP do make some friendly laptops. Thing is, I'm not looking for a "business laptop" - neither are many potential GNU/Linux users. I took the chance to persuade the sales assistant about Debian and all things free software - URL's, etc., then the laptop demonstrated the size of the gap that we still need to cover - that needs a change of heart at NVidia.
I had already found that Wiki page but that refers to the dv6116eu as opposed to the dv6615ea - a small difference but these things can mean big differences in how the chipsets are actually implemented.
Matthew - I tried to install an amd64 etch installer (4.0r2), i386 etch installer (4.0) and I tried upgrading to Debian sid once I did have a working implementation via Mepis. I wasn't at all surprised that the graphics were going to be a problem - my surprise is reserved for the parts of a laptop that I tend to assume are no longer proprietary, like ethernet. Guess I was wrong.
The bcm43xx driver problem is a Broadcom issue - it is hardly suprising that the free software driver has problems when there is no spec. What is more annoying is that the wireless device does not show up anywhere in the logs, even with Mepis, with or without the bcm driver + firmware.
GNOME does need more than the expected graphics problems - without the proprietary drivers the trackpad is also non-functional, the Mepis patches for X mean that the Gnome libraries don't load and updating the X packages means that X itself fails.
I may have been "frank" in my assessment of the laptop but that was simply down to the frustration. I don't have time to faff around with this kind of hassle.
I really don't mind having problems with the NVidia graphics - what annoys me is that the lack of any kind of ethernet support and the sheer number of fixes and hacks that Mepis have to use to get something out of the laptop.
Each time I tried to move to an updated Debian package of a mepis version, something else proprietary broke and I really can't use KDE long term. I also wanted to be able to use this in 64bit but the (non-graphics) proprietary stuff just doesn't allow that.
Not everyone has the option of only buying expensive business laptops or those that are known to work and not everyone has the time to spend working out how to fix these problems. (I used to but I wanted something that required less downtime.)

Jacobo Tarrío Barreiro

Many languages are spoken in more than one country, and many countries have more than one language. When you forget this you do stuff like language selection menus that use flags to represent languages. This is problematic for several reasons, starting with having to ask yourself what flag you are going to use to represent English, and how to deal with the angry letters you’ll receive when you use the national flag to represent a regional language. So, using flags to represent languages is definitely discouraged. This said, have a look at this small piece of the KDE l10n stats page: Galician language with flag of Greenland The funny thing is that the flag you see next to Galician is the flag of Greenland. And Galician is not spoken at all in Greenland! So, what happened? Why did they use so wrong a flag? The problem is that the ISO 639-1 code for the Galician language is gl , which is the same as the ISO 3166-1 code for Greenland. So, when choosing the flag for Galician they confused the language code with the country code and selected the flag for gl : that is, for Greenland. (I’m surprised that they used the Ukrainian flag ( ua ) for the Ukrainian language ( uk ), and not the Union Flag ( uk ). Perhaps that would have been too obvious an error :)) So, my takeaway message is: don’t use flags to represent languages and if you do, make sure you use a flag of a place where the language is actually spoken!

Jacobo Tarrío Barreiro: Flags and languages

Many languages are spoken in more than one country, and many countries have more than one language. When you forget this you do stuff like language selection menus that use flags to represent languages. This is problematic for several reasons, starting with having to ask yourself what flag you are going to use to represent English, and how to deal with the angry letters you’ll receive when you use the national flag to represent a regional language. So, using flags to represent languages is definitely discouraged. This said, have a look at this small piece of the KDE l10n stats page: Galician language with flag of Greenland The funny thing is that the flag you see next to Galician is the flag of Greenland. And Galician is not spoken at all in Greenland! So, what happened? Why did they use so wrong a flag? The problem is that the ISO 639-1 code for the Galician language is gl , which is the same as the ISO 3166-1 code for Greenland. So, when choosing the flag for Galician they confused the language code with the country code and selected the flag for gl : that is, for Greenland. (I’m surprised that they used the Ukrainian flag ( ua ) for the Ukrainian language ( uk ), and not the Union Flag. Perhaps that would have been too obvious an error :) – although I have been told by email that the ISO 3166-1 code for the UK is GB , not UK ) So, my takeaway message is: don’t use flags to represent languages and if you do, make sure you use a flag of a place where the language is actually spoken!

Biella Coleman: Classic in Internet Studies

One might think that it is too early to declare the existence of a “classic” work on the Internet given how the Internet as a widely accessible communications networks is barely out of its pre-teen years, But if there is one book that I would say is a classic, it’s Julian Dibbell’s My Tiny Life. There were plans underway to release it under a libre license but after I ran into Julian at the AAAs in November, I got the scoop that things had come to a screeching halt. So a few days ago I was surprised to find in my inbox, this nicely crafted announcement that My Tiny Life is more or less (more more than less) free as a free bird. This is good news and his story about the trials and tribulations of getting My Tiny Life out of the noose of copyright, is an interesting one, involving among other things, outsourced Indian Labor. Who knew. And while I am on the topic, I meant to write about who, among the many authors I assigned this last fall, took the cake among students as their favorite book/article. Somewhat, unsurprisingly, Dibbell’s more recent Play Money was the champion. Most of the comments were relayed in class but here is one of the more amusing comments indicating the love:
Reading Julian Dibbell s Real Money, Or How I quit My Day Job and Made Millions Trading Virtual Loot was exceedingly more interesting than I expected.
And then just yesterday, another student wrote me an email telling me he read and re-read the book over his holiday break and wants to get Dibbell inivited to NYU to speak (which would be great, though I admittedly have no idea how to make that happen given my recent arrival here). But clearly, there is another classic in the making. Thankfully students liked many other readings and I think there were two other clear winners: Carl Elliot’s Better than Well , Michael Warner’s The Trouble with Normal. and Michael Sandel’s The Case against Perfection. This is of course no surprise to me as I picked these books because I knew they would teach themselves.

Christian Perrier: [sports] Streif

Mausefalle, Karusellkurve, Steilhang, Br ckenschuss, Alte Schneise, Seildamsprung, L chenschuss, Oberhausberg, Hausbergkante, Zielschuss (ach mein Gott!) and the terrible Zielsprung. After last week's Lauberhorn downhill, today was Hahnenkamm's downhill race in Kitzb hel (Austria). Even though I slightly prefer the Wengen race, Die Streif is one of the scariest racest of the Ski World Cup. Great spectacle today again, however saddenned by Scott Mc Carthy's terrible accident on the Zielsprung. We don't have news yet but I cross fingers for him. Today, Didier Cuche won the race wonderfully, just before lastweek's winner, the tireless Bode Miller. Again another great ski week-end, really.

Christian Perrier: How many known human languages are there?

Tricky question, isn't it? Indeed, according to the ISO 639-3 standard which finally became an official ISO standard in 2007, there are 7696 different languages, including extinct, ancient, historic, and constructed languages. Of course, this may become a very debated discussion about what constitues a "language". Let's give the guidelines used by SIL International, who was designated by ISO as the official maintenance agency for ISo-639: There is no one definition of "language" that is agreed upon by all and appropriate for all purposes. As a result, there can be disagreement, even among speakers or linguistic experts, as to whether two varieties represent dialects of a single language or two distinct languages. For this part of ISO 639, judgments regarding when two varieties are considered to be the same or different languages are based on a number of factors, including linguistic similarity, intelligibility, a common literature, the views of speakers concerning the relationship between language and identity, and other factors. The following basic criteria are followed: So, we (iso-codes package maintainers) now have to update that part of our package and buy a big bunch of aspirin to people who will work on translating this. Moreover, contrary to all other such standards (3166 for country names, old 639-2 for languages, 15924 for language script names), there is no bloody official *French* version, so even the French translator has to work. Gues who this was until now? :-) To end this blog entry, let's ask a funny question to the readers (no, comments not allowed on my blog, I'm lazy, so answers by mail or in your blogs): what is the country in the world which as the highest number of languages listed in ISO 639-3?

18 January 2008

Ben Hutchings: Idea for a new PAM module

To guard against late-night administrative mistakes: pam_breathalyser.

Kartik Mistry: Reason to use laptop in train

* .. because its too cold, and fortunately my laptop heats so much. Sometime bad things are good for life :P

Axel Beckert: Following Bleeding Edge Software and still using Debian Stable

Many Linux fans know that Debian Stable usually already lost the “b” when it’s being released. ;-) What seems not so well known (especially not by some DesktopBSD Marketing guy at last year’s LinuxDay.at :-) is that there is really a lot of people who really like this “stale” software collection — because it’s rock solid — especially compared to the ports in FreeBSD or DesktopBSD *evilgrin* which unnecessarily follow every new feature upstream introduces. This is really annoying in a server environment where you want as less changes as possible when updates are necessary due to security issues. My personal favourites here are Samba and CUPS. *grmpf* Although I belong to those people who run Debian Stable even on brand-new hardware, I sometimes have to use the newest beta or alpha versions of some software to get it even only running. And doing so is fun but feels strange somehow, though. Currently I follow the pre-releases of three software makers quite close, due to a new laptop: At the beginning of last semester I bought a brand-new Lenovo ThinkPad T61 (2,2 GHz Intel Core2 Duo T7500, 4 GB RAM, 160 GB HD, 1440x900 14” Widescreen) without preinstalled operating system (possible thanks to the ETHZ Neptun Project) and installed — of course — 64-bit Debian Stable on it. While the Debian Installer from Etch worked fine even on such new hardware, not all features worked out of the box because some components were just too new. So the first thing I did was installing 2.6.22 from Backports.org, quickly moving farther to vanilla 2.6.23. Nearly everything I needed worked except the wireless network card. It needs the iwlwifi driver which is officially in the Linux kernel starting at the upcoming 2.6.24 (said to be released during the next few days). So I run 2.6.24 pre-releases on the laptop since the first release candidate, always eagerly waiting for either the next RC or the final release. (And 2.6.24 looks impressively stable to me — even since the early release candidates. :-) I even got the fingerprint reader working for login and sudo (but not xscreensaver) using libthinkfinger backported to Etch from Debian Experimental. I’m just not sure if this is a good idea since the back of the screen already has enough of my fingerprints on it. ;-) The next software of which I’m currently running an alpha version is 64-bit Opera 9.50 (aka Kestrel, available at snapshot.opera.com) because no earlier Opera version is available for 64-bit Linuxes. Here I had different experiences: The builds from October and November were already quite stable, but since December it crashes usually several times a day. At work I also run the 64-bit Opera on my workstation, but stalled updating it when I noticed that it became so unstable. So my Opera at work has currently an uptime of nearly four weeks — and would have probably more if I hadn’t rebooted my workstation in Mid-December. Somehow this hunting for new versions and eagerly waiting for every new (pre-)release makes me really fidgety sometimes. And my understanding for people doing this for there whole userland or even operating system has grown, but I still prefer to have stale but stable software on all my productive machines, even on my laptop — just with some few and handpicked excpetions. The third but less thrilling thing I’m following are nVidia drivers for X. Since the free nv driver of X.org doesn’t support (and not only just doesn’t know) my graphics card yet and nouveau isn’t ready yet, I run the binary only and closed source driver from nVidia, waiting for that one release which supports Xen since I really would like to run a Xen guest with Debian Unstable for testing purposes and package building on my laptop. Until then I have to content myself with the much more unwieldy QEMU respectively KVM. Anyway, I’m very happy with the T61 and Debian Stable and can easily connive at the few not (yet) perfect issues like missing Xen support by nVidia, broken ad-hoc mode in the wireless card, no internal card-reader (as announced in the Neptun specifications) and no native serial port. Some useful links regarding the subject of this post:

Now playing: Jean Michel Jarre — Rendez-vous à Paris

Lior Kaplan: Pidgin blist.xml error message


When I opened pidgin today, I got an error message regarding my buddy list file. Since the program couldn’t use the current list, it has loaded an old file with about half my buddies. Pidgin blist.xml error message The problem with this error message, is that it doesn’t give you any clue to the root cause of the error. This of course makes it harder for me to fix the problem and get on with using the program. I’ve opened the file with vi, and it generally seemed OK with the all the major starting/ending XML tags. So I opened it with Firefox, to see if it parses the XML, and only then I could see the real problem:
XML Parsing Error: reference to invalid character number
Location: file:///home/kaplan/.purple/blist.xml~
Line Number 416, Column 47:
Looks like one of my buddies has a weird Unicode character in his nickname, which wasn’t correctly escaped by pidgin when it had been written to the XML file. Removing the problematic character fixed the problem and pidgin started with my full buddy list. For me, as a technical person, seeing a problem with a XML file, usually raises the flag regarding parsing errors. I don’t expect common users to have this information. But giving a more informative error message could help such a user to get help and directions to the solution in forums or IRC. So to all the programmers reading this, I’d like to ask you to try and give a clue to the problem in your error messages. It can simplify usres’ life…

Jonathan McDowell: Thanks, but not helpful

The UK mirror service is great. They run a whole bunch of mirrors that mean I don't have to use transatlantic bandwidth to get stuff. Like, say, the latest Linux kernel. However they have a really annoying way of displaying indexes over HTTP, where they won't put everything on the same page and instead break it up. Which I find really annoying. To the point that I'm favouring www.ie.kernel.org over www.uk.kernel.org when I want to browse for the right file rather than manually typing it in. Is it just me annoyed by this?

Russell Coker: Bruce Schneier Advocates no Encryption

Bruce has written an interesting post about wireless encryption [1]. His main ideas seem to be that it’s nice to provide emergency net access for random people, that attempting to secure a wireless network only causes more problems when (not if) it is broken, and that your machines which are mobile need to be secure against a hostile LAN anyway. These all make sense. I’d probably be doing the same if it wasn’t for the problems I had getting 802.11b gear working in my house (maybe conflicts with some of the other wireless equipment I run) and for the fact that I run NFS over my home network (which needs decent performance and has no security).

Meike Reichle: My current favourite debian package

... and the reason I get nothing done. Please meet cuyo. Fun, addictive, drives you nuts!

17 January 2008

Christian Perrier: Solutions Linux 2008

The traditional gathering of the Linux and FLOSS community in France will this year again feature a Debian booth. The event will be held in Paris-La D fense (CNIT), on Jan 29-31. As the Babelbox was born in that event three years ago, we will again have one, of course (people will get bored of it...). Frans Pop improved the thing so much that it took me less than 2 hours to set one up. We will also probably have a few other demo machines and the usual bunch of developers, contributors and friends popping up at the booth. If you're around, please come up and say "hi"....(don't forget fingerprints, IDs and some aspirin to cope with the verbiage of some of us who definitely talk too much).

Michal Čihař: Toshiba ACPI keys, HAL and friends

Long time ago I used FnFX to handle events from ACPI keys on my Toshiba notebook. However when reinstalling notebook because of disk crash, I thought there must be a cleaner way to handle these and I found patch for acpid which added handling of these special events. However I really didn't like patching acpid on every update and there didn't seem to be chance to merge it upstream, so I started to look for better solution. After another amount of googling, I found that HAL already has some support for Toshiba hotkeys. Unfortunately it is now disabled in Debian because most key did not emit anything using HAL. Okay, let's fix the HAL, maybe it will get later enabled. Converting FnFX keymap to C code was quite easy and I made a patch for HAL to add support for all keys. Hopefully it get merged soon and I can then file bug on Debian package to reenable Toshiba support in HAL. Meanwhile I'd like to find some generic way of configuring what happens on these events. For now I hacked simple Python script which listens to DBUS events and invokes appropriate commands for keys, but I hope that some such tool already exists and I just missed it. If you know something, please let me know at michal@cihar.com.

Eddy Petrișor: networking in wine on amd64

Anyone managed to do that?

I tried the sid amd64 packages, the i386 packages, the lenny amd64 packages, backported etch packages (they worked for me on a i386 system at work). None of these lets me use networking.

Is wine networking working for other people using the amd64 arch?




Update: apparently I am one of the few for which wine networking on amd64 doesn't work. Th ebad thing is that I don't know why or how to fix it.

Steve Kemp: I hear it every day

It bothers me that my Tor usage is less than I'd like because it is just so fiddly. When it comes to privacy I want to keep things simple, I want to use tor, but I dont want to use it for things that aren't sane. In practise that means I want to use tor for a small amount of browsing: To do that I have to install privoxy, and use that with a configuration file like this:
# don't forward by default.
forward-socks4   /    .
# don't forward by default, even more so for HTTPS
forward-socks4   :443 .
# but we do want tor on these three sites:
forward-socks4   a.com/       127.0.0.1:9050 .
forward-socks4   b.com/       127.0.0.1:9050 .
forward-socks4   c.com/       127.0.0.1:9050 .
I'm using absolutely nothing else in my Privoxy configuration, so it seems like overkill. I'd love to hear about a simple rule-based proxy-chaining tool - if there is one out there then I'd love to know about it lazyweb. If not it shouldn't be too hard to write one with the Net::Proxy & Net::Socks module(s).
<global>
  listen 1234
  no-proxy
</global>
<sites>  
  hostname one.com
  port != 443
  proxy socks localhost 8050
</sites>
<sites>  
  hostname two.com
  port != 443
  proxy socks localhost 8050
</sites>
<sites>
  hostname foo.com
  port = 80
  proxy localhost 8000
</sites>

Lior Kaplan: Why does Oracle s applications needs xscreensaver in order to run ?


Working with some of Oracle’s products, made me wonder about their installation requirements as appears in the documentation. Let start with Oracle Database 10g Release 2. The installation guide for linux x86 says under “Checking the Software Requirements” it needs the following RPMs for RHEL 4.0:
  • binutils
  • compat-db
  • compat-libstdc++-296
  • control-center
  • gcc
  • gcc-c++
  • glibc
  • glibc-common
  • gnome-libs
  • libstdc++
  • libstdc++-devel
  • make
  • pdksh
  • sysstat
  • xscreensaver
  • setarch
Most of them are valid requirements when needing to compile C/C++ code (as it may be done inside the database). But why do I need to install gnome’s libraries, gnome’s control-center and xscreensaver? I fail to see how are these 3 are related to running a database. It is reasonable to require these packages for running a graphical installation, but that’s not a runtime requirement! I even tested that with checking the database opened files while it’s been running. I really don’t want to have these packages installed on servers unless I must, as I believe server should contain the minimal software required on top of the distribution default installation. Another funny (and weird) fact is that for SELS 9.0 there isn’t any requirement for gnome’s control-center. For RHEL 3.0 there aren’t any requirements for the 3 packages… Mentioning optional requirements are probably the best why to solve this, unless there’s some real requirement that eludes me. John Smiley’s “Installing Oracle Database 10g Release 2 on Linux x86″ has this for openmotif21 which is mentioned as needed only for Oracle demos. The same happens for Oracle Enterprise Manager in installation guide for linux x86 10g Release 2 (10.2), but this time the package requirements for RHEL 3.0 and SELS 9.0 don’t mention any of the 3 packages, whilst they are required for RHEL 4.0. Very weird. The status for Oracle Application Server 10g Release 3 is similar. I would be happy if someone could shed some light on the issue.

Next.

Previous.